Skip to content

How do you visualize attention weights? #53

Description

@tomename

Thanks for sharing the great work.

I would like to reproduce the paper's visualization results for the decoder self-attention weights in Figure 1 and the encoder self-attention weights in Figure 8.
Please help me.

  • How do you visualize attention weights?
  • Does "all points in the scene" mean no down sampling?
  • Which layer and which head's attention weights did you visualize?
  • Could you share the code for the attention weights visualization?

Thank you.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions