Token Visualization DDL:[2024/5/27]

[SalazarPeverelll]

In code search tasks, the representation of a piece of code is composed of the representations of many tokens. We can visualize and observe the representation of each token.