Skip to content

optimzer's step counter 'cnt' incremented in multiple places #13

@yvdriess

Description

@yvdriess

Optimizer class tracks a cnt counter to decide when to apply the minibatch update. However, it appears that the counter is incremented not only in the _learn driver loop (

), but also in the concrete optimizer class update_general methods ( ), which is called once for each layer for each step.

Is this intended behavior? The minibatch update can trigger in some middle layer and reset the counter, rather than every mini-batch-size number of observables backprops.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions