Skip to content

bbonnin/exploring-mozilla-ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Exploring Mozilla AI libs

Some examples for any-llm, any-agent, any-guardrail, ...

Exploring...

The AI specific functions are declared in ai.py file.

  • First, configure the .env file:
# Model providers (comma-separated list of providers)
PROVIDERS=ollama,anthropic

# Provider and model to use by default
DEFAULT_MODEL=ollama/ministral-3:3b

# Other LLM parameters
DEFAULT_TEMPERATURE=0.0
DEFAULT_MAX_TOKENS=1024

# Ollama configuration (if not localhost)
OLLAMA_HOST="http://example.com:11434"

# Provider keys
ANTHROPIC_API_KEY="sk-ant-..."
  • Then, launch exploring-any-llm.py: with any-llm, the same code for any LLM providers, that's great !
    • Load the models:

Load models

  • Select the model for the chat:

Select a model

  • Chat:

Chat

  • Compare models - choose the models:

Choose a model Choose another model

  • Compare models - ask something et see the result:

Compare models

TODO

  • Translate into english (désolé...)

About

Tests of Mozilla libs (any-llm, any-agent, ...)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages