Goal
Enable ultra-fast inference using Groq API endpoints (https://api.groq.com/openai/v1) for open-source models (e.g., llama-3.3-70b-versatile).
Requirements
- Create
internal/providers/groq/provider.go implementing ai.Provider.
- Adapt OpenAI-compatible endpoint payloads specifically for Groq's high-speed API.
- Register via
ai.Register("groq", New) inside init().
Goal
Enable ultra-fast inference using Groq API endpoints (
https://api.groq.com/openai/v1) for open-source models (e.g.,llama-3.3-70b-versatile).Requirements
internal/providers/groq/provider.goimplementingai.Provider.ai.Register("groq", New)insideinit().