Historical data

[javlund]

Hi there, awesome and useful project.

It would be great to have a way to generate a report/graph with model name, historic TTFT and average TPS over one or more sessions in order to evaluate a model over time. This way one could get a more holistic view of a model's performance and also see peak usage periods in order to find the optimal time to use a model.

[Tarquinen]

I was thinking I would keep this pretty simple, but if people are interested in analytics like that I'd be open to PRs

[jpds]

I've found https://github.com/zhumengzhu/opencode-cache-hit which does this.