AI Runner

Runner for AI models in the local system. Allows to quickly run models available on ollama website with a single command.

Models available at: https://ollama.com/search

Supported OS

• macOS
• Linux
• WSL2 (Windows via WSL2). Install and run the Windows Ollama app; this project runs inside WSL2 and connects to http://localhost:11434.

Dependencies

Initialize or update the script helpers submodule before running scripts:

./update

If you see a "script-helpers dependency not found" message, run ./update first. See docs/INSTALL.md for the rest of the installation steps.

Core scripts live in scripts/; use the root symlinks where possible.

Run the model and install

Run the command:

./run [-i] [-m <model>] [-p]

Parameters:

• -i : install dependencies and ollama
• -m <model> : define the model to use
• -p <prompt> : run the prompt command right away

Example:

./run

If NO MODEL was selected, a selector will be displayed - so you can pick one that is available on Ollama:

Run the prompt in existing model

If you already set up the model, size and have run the steps under ./run, you can run the prompt directly, using the Curl request and see the results in the dialog:

./prompt

Only download the models

Use ./get to download a model archive (tar.gz) to a local folder for offline use or analysis. This does not install the model into Ollama — use ./run (or ollama pull) to run it.

Examples:

# Download a known model by name to ./models
./get -m llama3 -d ./models

# Or provide a direct tar URL (if available)
./get -u https://ollama.com/models/llama3.tar.gz -d ./models/llama3

Notes:

• The script creates the destination directory if it does not exist and extracts the archive there.
• If you run without flags, it opens a dialog to select a model (and size) from the indexed list and chooses a default destination like ./models/<model>-<size>.
• To run a model with Ollama, prefer ./run to select and pull a model (internally uses ollama pull), e.g.:

./run -m llama3 -p "Hello"

• Some tar URLs may not be publicly available for all models; in such cases use ./run or ollama pull <model>:<tag>.
• If a direct tar URL is unavailable (non-gzip response), the script falls back to ollama pull <model>:<tag> and, when supported, ollama export to save an .ollama file in your destination.
• Optional: you can track a local path in .env via model_path=./models/<name> for your own workflows (not required by ./run).

get.sh help

View usage and options:

./get -h

Summary:

• Usage: ./get [-m <model>] [-u <url>] [-d <dir>]
• Options:
  • -m <model>: model name (default: llama3)
  • -u <url>: direct tar URL (if available)
  • -d <dir>: destination directory (created if missing) Example: ./get -m llama3 -d ./models

Run prompts as CURL

You can run prompts against the running model via curl commands:

Example:

curl -X POST http://localhost:11434/api/generate -d "{\"model\": \"llama3\",  \"prompt\":\"Tell me about the meaning of life.\", \"stream\": false}"

Endpoints

• http://localhost:11434/api/tags
• http://localhost:11434/api/generate

Check parameters of the currently installed model:

First, check what is the installed (and running) model. It should reflect what's in the .env file.

Run:

source .env
ollama show --modelfile $MODEL