Skip to content

nakasyou/lmarena-history

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

124 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

lmarena-history

JSONized lmarena.ai score data.

Where

JSON data is on https://github.com/nakasyou/lmarena-history/blob/main/output/scores.json.

What

// JSON Data
type Data = {
  [yyyymmdd: `${number}`]: {
    text: Columns // conversations which uses only text
    vision?: Columns // conversations using a vision model
  }
}

/**
 * Including `overall`, `japanese`, `math`, `coding`, and more...
 */
type Columns = Record<string, Score>

type Score = {
  [modelID: string]: number // elo score
}

How

lmarena manages that data in HuggingFace. The data is saved as Python Pickle file. The project uses GitHub Actions to process data.

When

The data is updated every day by GitHub Actions.

Why

As I wrote original data is saved as Python Pikcle file, so it's diffucult to use it with other languages. By converting to JSON, you can use the data using other languages such as JavaScript.

About

The history of scores on lmarena.ai saved as JSON.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages