This repository was archived by the owner on Jan 1, 2026. It is now read-only.

This repository was archived by the owner on Jan 1, 2026. It is now read-only.

CLS token in pretrained model #7

Open

opened

on Jun 15, 2022

Hi, I have noticed CLS token is still existed in the provided ckpt. But in the appendix, it said that class token is not utilized for training? So I am confused about this. Did the cls token in provided ckpt be trained or just randomly initialized?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests