Skip to content

Ignore padding index in negative log likelihood (NLL) loss #90

@karnawhat

Description

@karnawhat

Currently, the NLL loss computation doesn't take into account loss calculated as part of the padding index. These indices need to be ignored to more accurately measure the loss, so that the function optimizes properly.

For now, this doesn't matter since all the sequences are of the same length, meaning no padding is currently being used.

Metadata

Metadata

Assignees

Labels

invalidThis doesn't seem right

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions