Skip to content

how to decide the value of λ #60

Open

Description

@silentsaber

Since the d_loss = fake-real+gp, how to decide the value of LAMBDA to get a reasonable gradient penalty.
I mean, if fake=-10, real=10, is gp=10 appropriate?or the gp should be smaller(e.g. gp=5)?

Activity

  1. hangexuexi commented on Nov 29, 2022

    @hangexuexi

    i have the same question about it, did you solve this problem? at the start of my train, the wass loss is very small, about 0.01, so how should i set the lambda?

  2. cjblocker commented on Aug 7, 2023

    @cjblocker

    The original paper suggests sticking with 10

    Penalty coefficient All experiments in this paper use λ = 10, which we found to work well across a variety of architectures and datasets ranging from toy tasks to large ImageNet CNNs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions