Skip to content
Discussion options

You must be logged in to vote

I recommend you use venv module

python3 -m venv .venv
source .venv/bin/activate
pip install llm-benchmark

All the related exes are inside .venv separated from your system-wide python3

As for LMstudio, it's a separate thing. This tool only measures ollama throughput.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by chuangtc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants