Skip to content

The model Deepseek-Math-7B-base cannot reproduce the ratings in the paper #12

@hhhbxloveai

Description

@hhhbxloveai

First of all, I would like to express my sincere gratitude to the authors for their wonderful work.
However,I couldn't reproduce the evaluation results related to deepseek using the script you provided.When I was testing, the base model of deepseek basically had no ability to answer mathematical questions.Could the author provide more details about the evaluation related to deepseek-math-base?
I'm really looking forward to the author's reply. Thank you very much!
@Wyyyb

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions