不同模型的推理时间 #50

Open

1556900941lizerui

opened

on Sep 22, 2025

我在尝试使用small级别的模型和base级别的模型进行推理时，发现两者的推理时间几乎没有差别，明明参数量相差了三到四倍

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests