Skip to content

[TASK] Add Client-Side Display Features for DeepSeek R1 Example #621

@zhanghb97

Description

@zhanghb97

Deliverables

  • A PR that adds separate tokens/s metrics for prefilling and decoding in the current buddy-deepseek-r1-run.
  • A PR that adds buddy-deepseek-r1-cli.

Task Description

Task 1: Compute and Display Tokens/s

  • Implement the calculation of tokens-per-second.
  • Display separate metrics for prefilling and decoding.
Image

Task 2: Add a CLI Tool

  • Add a tool that, when executed, does not print each token and its timestamp, but instead streams only the final generated text in real time.
  • Use the llama.cpp CLI tool as a reference.

Timeline

  • Coding phase: 2025.11.17 – 2025.11.18
  • Code review: Begins on 2025.11.19

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions