The open-source map of the AI developer tooling ecosystem.
Window-shop coding agents, IDE assistants, MCP tooling, evals, observability, security, and self-hosted AI dev stacks.
357 tools 270 reviewed 87 draft 17 active reviewed shelves
AI developer tooling changes quickly. This directory keeps entries in structured metadata so the public view can stay polished while the data remains sortable, reviewable, and validation-backed.
No rankings. No launch hype. Just a clean storefront for discovering tools worth a closer look.
- Agent Powerups - Curated skill packs, commands, MCP configs, hooks, templates, and workflows for coding agents.
- Everything Claude Code - Agent harness performance system with skills, hooks, MCP configs, memory optimization, and cross-harness workflows.
- Claude Skills - Repository of 232+ Claude Code skills and agent plugins convertible to 12 AI coding tools including Codex, Cursor, and Windsurf.
- Anthropic Skills - Official public repository of Agent Skills for Claude demonstrating creative, technical, and enterprise workflow patterns.
- Superpowers - Core skills library for Claude Code with TDD, debugging, collaboration patterns, and systematic problem-solving techniques.
- Aider - Open-source terminal pair programmer that edits tracked files in a local Git repository.
- Cline - Open-source coding agent for editor workflows with file edits, terminal commands, browser use, and MCP-based tool extension.
- OpenCode - Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows.
- OpenHands - Open-source software agent platform with GUI, CLI, SDK, and self-hosted or cloud deployment options.
- Continue - Open-source AI code assistant and CLI for IDE agents, source-controlled checks, and customizable development workflows.
- AnythingLLM - Self-hosted RAG and agent platform with no-code agent builder and Docker Compose deployment options.
- Dify - Open-source LLMOps platform with visual studio for chatbots, workflows, agents, and RAG that supports self-hosted deployment.
- Onyx - Open-source self-hostable AI platform offering chat UI with agents, RAG, MCP tools, and multi-provider model support.
- Open WebUI Platform - Self-hosted AI platform and UI that supports Ollama and OpenAI-compatible APIs and can run entirely offline.
- Tabby - Self-hosted AI coding assistant for teams that want private code assistance and repository-aware development.
- Chrome DevTools MCP - MCP server that gives AI agents Chrome DevTools debugging capabilities for web applications.
- GitHub MCP Server - Official GitHub MCP server for repository access, issues, pull requests, code analysis, and workflow automation.
- Context7 MCP Server - MCP server for retrieving up-to-date library documentation and code examples for AI coding assistants.
- Browserbase MCP Server - MCP server that lets AI agents control cloud browsers through Browserbase and Stagehand.
- Agent Powerups - Curated skill packs, commands, MCP configs, hooks, templates, and workflows for coding agents.
- Arize Phoenix - Open-source AI observability platform with tracing, evals, datasets, and experiments for LLM, agent, and RAG systems.
- Comet Opik - Open-source LLM observability framework for tracing, evaluating, and monitoring LLM, RAG, and agent workflows.
- Helicone - Open-source LLM observability platform and gateway for logging, tracing, and evaluating LLM and agent requests.
- Langfuse - Open-source LLM engineering platform for observability, tracing, prompt management, datasets, and evaluations.
- OpenLIT - Open-source OpenTelemetry-native observability and evaluations platform for GenAI and LLM applications.
- Ollama - Local LLM runtime and model manager that runs open models on your machine with an OpenAI-compatible Chat Completions API.
- LM Studio - Cross-platform desktop app and SDKs to discover, run, and serve local LLMs with an OpenAI-compatible server mode.
- Llamafile - Single-file local LLM runtime bundling llama.cpp and web UI, with an OpenAI-compatible /v1 chat completions endpoint.
- LocalAI - Self-hosted REST server that emulates the OpenAI API to run local ggml/llama.cpp and related models on your own hardware.
- vLLM - High-throughput LLM inference engine with an OpenAI-compatible HTTP server for serving models locally or on servers.
Coding agents (26) · Terminal agents (13) · IDE assistants (17) · Browser agents (23)
MCP servers (15) · MCP clients (6) · MCP tooling (17) · Agent skill packs (30)
Agent observability (40) · Agent evals (22)
Self-hosted AI dev stacks (25) · Local LLM developer tools (31)
Repo automation tools (27) · AI code review tools (10) · Documentation agents (24) · Test generation agents (6)
| Tool | Main shelf | OSS | Local | Self-hosted | CLI | IDE | MCP | Links |
|---|---|---|---|---|---|---|---|---|
| Agent Powerups | Agent skill packs | Yes | Yes | No | Yes | No | Yes | Repo |
| Everything Claude Code | Agent skill packs | Yes | Yes | No | Yes | No | Yes | Docs / Repo |
| Claude Skills | Agent skill packs | Yes | Yes | No | Yes | No | No | Repo |
| Anthropic Skills | Agent skill packs | Yes | Yes | No | No | No | No | Repo |
| Superpowers | Agent skill packs | Yes | Yes | No | No | No | No | Repo |
| Aider | Coding agents | Yes | Yes | No | Yes | No | No | Website / Docs / Repo |
| Cline | Coding agents | Yes | No | No | Yes | Yes | Yes | Docs / Repo |
| OpenCode | Coding agents | Yes | Yes | No | Yes | Yes | Yes | Website / Docs / Repo |
| OpenHands | Coding agents | Yes | No | Yes | Yes | No | No | Website / Docs / Repo |
| Continue | IDE assistants | Yes | No | No | Yes | Yes | No | Docs / Repo |
| AnythingLLM | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Website / Docs / Repo |
| Dify | Self-hosted AI dev stacks | Yes | No | Yes | No | No | No | Website / Docs / Repo |
| Onyx | Self-hosted AI dev stacks | Yes | Yes | Yes | No | No | Yes | Website / Docs / Repo |
| Open WebUI Platform | Self-hosted AI dev stacks | Yes | Yes | Yes | No | No | No | Website / Docs / Repo |
| Tabby | Self-hosted AI dev stacks | Yes | No | Yes | No | Yes | No | Website / Docs / Repo |
| Chrome DevTools MCP | MCP servers | Yes | Yes | No | No | No | Yes | Docs / Repo |
| GitHub MCP Server | MCP servers | Yes | No | No | No | No | Yes | Repo |
| Context7 MCP Server | MCP servers | Yes | No | No | No | No | Yes | Website / Repo |
| Browserbase MCP Server | MCP servers | Yes | No | No | No | No | Yes | Website / Repo |
| Arize Phoenix | Agent observability | Yes | No | Yes | No | No | No | Website / Docs / Repo |
| Comet Opik | Agent observability | Yes | No | No | No | No | No | Website / Docs / Repo |
| Helicone | Agent observability | Yes | No | Yes | No | No | No | Website / Docs / Repo |
| Langfuse | Agent observability | Yes | No | Yes | No | No | No | Docs / Repo |
| OpenLIT | Agent observability | Yes | No | Yes | Yes | No | No | Website / Docs / Repo |
| Ollama | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Website / Docs / Repo |
| LM Studio | Local LLM developer tools | Yes | Yes | No | Yes | No | No | Website / Docs / Repo |
| Llamafile | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| LocalAI | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Website / Docs / Repo |
| vLLM | Local LLM developer tools | Yes | No | Yes | Yes | No | No | Website / Docs / Repo |
| Athenaeum | Self-hosted AI dev stacks | Yes | Yes | Yes | No | No | Yes | Docs / Repo |
| Gemini CLI | Coding agents | Yes | Yes | No | Yes | No | Yes | Docs / Repo |
| Goose | Coding agents | Yes | Yes | No | Yes | No | Yes | Website / Docs / Repo |
| Harbor CLI Stack | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| IBM MCP CLI | MCP tooling | Yes | Yes | No | Yes | No | Yes | Repo |
| Jan Server | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Website / Docs / Repo |
| KoboldCpp | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Website / Docs / Repo |
| llama-cpp-python | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| llama.cpp | Local LLM developer tools | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| MCP Bundles (MCPB) | MCP servers | Yes | Yes | No | Yes | No | Yes | Docs / Repo |
| MCP Inspector | MCP tooling | Yes | Yes | No | Yes | No | Yes | Docs / Repo |
| mcp-cli (wong2) | MCP tooling | Yes | Yes | No | Yes | No | Yes | Website / Repo |
| Redis + Ollama RAG Stack | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| Ruflo | Coding agents | Yes | No | Yes | Yes | No | Yes | Docs / Repo |
| Self-hosted AI Starter Kit (n8n) | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Docs / Repo |
| Smithery CLI | MCP tooling | Yes | Yes | No | Yes | No | Yes | Website / Docs / Repo |
| Zed | IDE assistants | Yes | Yes | No | No | Yes | Yes | Website / Docs / Repo |
| Nosia | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Website / Docs |
| Nosia Installer Stack | Self-hosted AI dev stacks | Yes | Yes | Yes | Yes | No | No | Website / Docs |
| Roo Code | Coding agents | Yes | No | No | Yes | Yes | Yes | Website / Docs / Repo |
| Agent Skills | Agent skill packs | Yes | Yes | No | No | No | Yes | Repo |
Agentic tools that can inspect, modify, and reason about source code.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Aider | Open-source terminal pair programmer that edits tracked files in a local Git repository. | CLI · Local | Website / Docs / Repo |
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Amp | Terminal-centric coding agent with deep codebase context, editor links, and automation-oriented SDK features. | API · CLI · Hybrid | Website / Docs |
| Augment Code | Repo-aware coding agent for editors and terminal that edits files, uses tools, and understands large codebases. | CLI · IDE · Hybrid | Website / Docs |
| Claude Code | Anthropic coding agent for terminal workflows that can read code, edit files, run commands, and use project context. | CLI · Hybrid | Docs |
| Cline | Open-source coding agent for editor workflows with file edits, terminal commands, browser use, and MCP-based tool extension. | Browser · CLI · IDE · Hybrid | Docs / Repo |
| Cursor | AI code editor built around chat, codebase context, agents, rules, MCP, and terminal-assisted development workflows. | CLI · Desktop · IDE · Hybrid | Website / Docs |
| Devin | Cloud software engineering agent for teams that works on repositories and can run tasks in parallel. | Web · Hosted | Website / Docs |
| Ellipsis | GitHub agent that reviews pull requests, answers repo questions, and can generate changes or release notes. | GitHub app · Web · Hosted | Website / Docs |
| Factory Droid | Coding agent platform with CLI, desktop, and headless automation for code changes, review, and CI workflows. | API · CLI · Desktop · Hybrid | Website / Docs |
| Gemini CLI | Open-source terminal coding agent that uses tool calls and MCP servers to work on repository tasks. | CLI · MCP · Local | Docs / Repo |
| Gemini Code Assist | Google's coding assistant for IDEs and GitHub with agent mode, PR summaries, and code review. | GitHub app · IDE · Hosted | Website / Docs |
| Goose | Open-source local agent with desktop, CLI, and API surfaces for editing, running, and testing code. | API · CLI · Desktop · Local | Website / Docs / Repo |
| Jules | Google asynchronous coding agent for GitHub that fixes bugs, adds features, and updates documentation. | API · Web · Hosted | Website / Docs |
| Junie | JetBrains coding agent for IDEs and terminal that plans, edits, tests, and reviews project changes. | CLI · IDE · Hybrid | Website / Docs / Repo |
| OpenAI Codex CLI | Local terminal coding agent from OpenAI that can inspect code, edit files, and run commands in a developer workspace. | CLI · Hybrid | Docs / Repo |
| OpenCode | Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows. | CLI · Desktop · GitHub app · IDE · MCP · Local | Website / Docs / Repo |
| OpenHands | Open-source software agent platform with GUI, CLI, SDK, and self-hosted or cloud deployment options. | API · CLI · Web · Hybrid | Website / Docs / Repo |
| Plandex | Open-source terminal agent for long-running tasks across large projects and real repositories. | CLI · Local | Website / Docs / Repo |
| Qwen Code | Open-source terminal coding agent optimized for Qwen models and large repository tasks. | CLI · Local | Website / Repo |
| Refact.ai | Coding agent for IDEs and enterprises that can automate coding, debugging, testing, and documentation tasks. | IDE · Web · Hybrid | Website / Docs / Repo |
| Roo Code | Open-source coding agent for VS Code and cloud agents that can code, review, and automate repository tasks. | CLI · IDE · Web · Hybrid | Website / Docs / Repo |
| Ruflo | Enterprise-grade multi-agent orchestration framework for Claude that deploys 60+ specialized AI agents with shared memory, RAG, and swarm coordination across machines and teams. | API · CLI · Web · Self-hosted | Docs / Repo |
| SWE-agent | Open-source agent for resolving real repository issues and automating software engineering tasks. | CLI · Local | Website / Docs / Repo |
| Sweep | JetBrains-focused coding assistant with agent mode, repo edits, AI code review, and MCP integration. | IDE · Hybrid | Website / Docs / Repo |
| Windsurf Editor | AI code editor with repo-aware agent workflows for multi-file edits and developer automation. | Desktop · Hybrid | Website / Docs |
AI developer tools primarily operated from a command-line interface.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| agenttrace | Local CLI/TUI that turns AI coding agent session logs into cost, token, latency, failure, and health reports. | CLI · Local | Website / Docs / Repo |
| Aider | Open-source terminal pair programmer that edits tracked files in a local Git repository. | CLI · Local | Website / Docs / Repo |
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Amp | Terminal-centric coding agent with deep codebase context, editor links, and automation-oriented SDK features. | API · CLI · Hybrid | Website / Docs |
| Augment Code | Repo-aware coding agent for editors and terminal that edits files, uses tools, and understands large codebases. | CLI · IDE · Hybrid | Website / Docs |
| Claude Code | Anthropic coding agent for terminal workflows that can read code, edit files, run commands, and use project context. | CLI · Hybrid | Docs |
| CodeRabbit | AI code review agent for pull requests, local IDE review, and terminal-based review workflows. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Factory Droid | Coding agent platform with CLI, desktop, and headless automation for code changes, review, and CI workflows. | API · CLI · Desktop · Hybrid | Website / Docs |
| Gemini CLI | Open-source terminal coding agent that uses tool calls and MCP servers to work on repository tasks. | CLI · MCP · Local | Docs / Repo |
| Junie | JetBrains coding agent for IDEs and terminal that plans, edits, tests, and reviews project changes. | CLI · IDE · Hybrid | Website / Docs / Repo |
| OpenAI Codex CLI | Local terminal coding agent from OpenAI that can inspect code, edit files, and run commands in a developer workspace. | CLI · Hybrid | Docs / Repo |
| OpenCode | Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows. | CLI · Desktop · GitHub app · IDE · MCP · Local | Website / Docs / Repo |
| Qwen Code | Open-source terminal coding agent optimized for Qwen models and large repository tasks. | CLI · Local | Website / Repo |
AI assistants embedded in editors or IDEs for coding workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Augment Code | Repo-aware coding agent for editors and terminal that edits files, uses tools, and understands large codebases. | CLI · IDE · Hybrid | Website / Docs |
| Cline | Open-source coding agent for editor workflows with file edits, terminal commands, browser use, and MCP-based tool extension. | Browser · CLI · IDE · Hybrid | Docs / Repo |
| CodeRabbit | AI code review agent for pull requests, local IDE review, and terminal-based review workflows. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Continue | Open-source AI code assistant and CLI for IDE agents, source-controlled checks, and customizable development workflows. | CLI · IDE · Hybrid | Docs / Repo |
| Cursor | AI code editor built around chat, codebase context, agents, rules, MCP, and terminal-assisted development workflows. | CLI · Desktop · IDE · Hybrid | Website / Docs |
| Gemini Code Assist | Google's coding assistant for IDEs and GitHub with agent mode, PR summaries, and code review. | GitHub app · IDE · Hosted | Website / Docs |
| GitHub Copilot | GitHub AI coding assistant for IDEs and GitHub workflows, including code suggestions, chat, and pull request support. | GitHub app · IDE · Web · Hosted | Website / Docs |
| Junie | JetBrains coding agent for IDEs and terminal that plans, edits, tests, and reviews project changes. | CLI · IDE · Hybrid | Website / Docs / Repo |
| OpenCode | Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows. | CLI · Desktop · GitHub app · IDE · MCP · Local | Website / Docs / Repo |
| Qodo | Code review and IDE assistant product focused on reviewing diffs, tests, and repository context. | GitHub app · IDE · Hosted | Website / Docs |
| Refact.ai | Coding agent for IDEs and enterprises that can automate coding, debugging, testing, and documentation tasks. | IDE · Web · Hybrid | Website / Docs / Repo |
| Roo Code | Open-source coding agent for VS Code and cloud agents that can code, review, and automate repository tasks. | CLI · IDE · Web · Hybrid | Website / Docs / Repo |
| Sweep | JetBrains-focused coding assistant with agent mode, repo edits, AI code review, and MCP integration. | IDE · Hybrid | Website / Docs / Repo |
| Tabby | Self-hosted AI coding assistant for teams that want private code assistance and repository-aware development. | API · IDE · Self-hosted | Website / Docs / Repo |
| Windsurf Editor | AI code editor with repo-aware agent workflows for multi-file edits and developer automation. | Desktop · Hybrid | Website / Docs |
| Zed | Code editor with built-in agent workflows, external agent support, and MCP-connected coding assistance. | Desktop · MCP · Local | Website / Docs / Repo |
Tools that can inspect, drive, or test browser-based developer workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Agent Browser | Rust-based headless browser automation CLI designed for AI agents, wrapping Chromium control behind a simple command-line tool. | CLI | Repo |
| Agent-E | Open-source agent system focused on browser automation, offering a natural-language web automation API and local agent runtime. | Framework · Library | Repo |
| Agent-WebVoyager | Implementation showcasing an autonomous WebVoyager-style agent that navigates and extracts data from sites via visual interactions. | Framework · Library | Repo |
| Anchor Browser | Cloud-hosted browser fleet built for AI agents, providing human-like Chromium instances and deterministic browser task execution APIs. | API · Hosted | Docs |
| Browser MCP | Local MCP server and browser extension that connect AI apps to your real browser profile for automating web tasks using AI tools. | Browser · MCP · Local | Docs |
| Browser Use | Open-source Python library that lets AI agents control browsers via Playwright using natural language to navigate, extract, and automate web tasks. | API · Framework · Library · Hybrid | Website / Repo |
| Browserbase | Cloud headless browser infrastructure built for AI agents and web automation, providing scalable browser sessions with anti-detection features. | API · Hosted | Docs / Repo |
| Browserless | Hosted headless Chrome service that exposes browser automation via APIs and MCP so AI agents can scrape, capture, and audit real web pages. | API · MCP · Hosted | Website / Docs |
| BrowserPilot | Python library that offers an intelligent web browsing agent controlled by natural language commands over a ChromeDriver-driven browser. | Library | Repo |
| Charlotte MCP Server | Open-source MCP server that renders web pages into structured, token-efficient representations using headless Chromium for agents. | MCP · Self-hosted | Docs / Repo |
| Cline | Open-source coding agent for editor workflows with file edits, terminal commands, browser use, and MCP-based tool extension. | Browser · CLI · IDE · Hybrid | Docs / Repo |
| Firecrawl | Open-source web data API for AI that lets agents search, scrape, and interact with the web at scale via HTTP, SDKs, CLI, and MCP. | API · CLI · Library · MCP · Hybrid | Docs / Repo |
| Firecrawl Web Agent | Autonomous web data agent built on Firecrawl and browser-use to execute web tasks over an HTTP API for downstream applications. | API · Framework | Repo |
| HyperAgent | TypeScript SDK and CLI that layers AI commands like page.ai and executeTask on top of Playwright for intelligent browser automation. | CLI · Library | Repo |
| LaVague | Large Action Model framework that turns natural language instructions into Selenium-based browser interactions for AI web agents. | Framework · Library | Repo |
| OpenAgents Web Agent | Web Agent inside the OpenAgents platform that performs autonomous web browsing with open-source code and UI for real-world tasks. | Framework · Web | Website / Repo |
| OpenAI Computer Use | OpenAI API capability that lets models operate software through the UI, including navigating and interacting with browser windows. | API · Hosted | Website / Docs |
| Skyvern | AI browser automation framework that uses LLMs and computer vision to automate multi-step workflows across websites via an API and SDK. | API · Library · Hybrid | Docs / Repo |
| Stagehand | AI browser automation framework that mixes natural language actions with Playwright code for reliable production browser agents. | Framework · Library | Website / Repo |
| Steel Browser | Open-source browser API that lets AI apps and agents perform programmatic browsing tasks without managing browser processes directly. | API · Library | Website / Repo |
| Tarsier | Vision utility library that gives web interaction agents structured, OCR-backed views of pages by tagging interactable elements. | Library | Repo |
| Webagent (webagent-cloud) | Simple web agent server built on Browser Use that exposes browser automation to other apps via HTTP APIs. | API · Framework | Repo |
| WebVoyager | LMM-powered web agent that completes end-to-end tasks on real websites using visual and textual signals in a Selenium environment. | Framework · Library | Repo |
Model Context Protocol servers that expose tools, resources, or prompts.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Anki MCP Server | MCP server that lets AI assistants interact with Anki flashcards and spaced-repetition workflows. | MCP · Local | Website / Repo |
| ArXiv MCP Server | MCP server for searching arXiv papers and exposing academic paper content to AI assistants. | MCP · Local | Repo |
| Browserbase MCP Server | MCP server that lets AI agents control cloud browsers through Browserbase and Stagehand. | MCP · Hybrid | Website / Repo |
| Chrome DevTools MCP | MCP server that gives AI agents Chrome DevTools debugging capabilities for web applications. | MCP · Local | Docs / Repo |
| Context7 MCP Server | MCP server for retrieving up-to-date library documentation and code examples for AI coding assistants. | MCP · Hybrid | Website / Repo |
| e2b-mcp | CLI and API for running MCP servers inside isolated E2B cloud sandboxes. | CLI · Hosted | Website / Repo |
| Exa MCP Server | MCP server for connecting AI assistants to Exa web search, crawling, and research tools. | MCP · Hosted | Repo |
| GitHub MCP Server | Official GitHub MCP server for repository access, issues, pull requests, code analysis, and workflow automation. | MCP · Hybrid | Repo |
| Google MCP Servers | Collection of Google MCP servers for Google Cloud services such as BigQuery, Maps, Cloud SQL, and Cloud Storage. | MCP · Hosted | Repo |
| MCP Bundles (MCPB) | CLI tool for packaging local MCP servers into installable .mcpb files. | CLI · Local | Docs / Repo |
| Next.js DevTools MCP | MCP server for exposing Next.js development tools and diagnostics to coding agents. | MCP · Local | Repo |
| Playwright Code Runner | MCP-related tool for running Playwright code as part of browser automation workflows. | MCP · Local | Website / Repo |
| Playwright MCP Server | MCP server that uses Playwright to let AI agents interact with web pages through accessibility snapshots. | MCP · Local | Docs / Repo |
| ServiceGraph MCP | MCP server for exposing observability data such as service metrics and logs to AI agents. | MCP · Hosted | Repo |
| Supabase MCP Server | Official Supabase MCP server for connecting AI assistants to Supabase projects and database operations. | MCP · Hosted | Repo |
Applications and agents that connect to Model Context Protocol servers.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Augment Code | Repo-aware coding agent for editors and terminal that edits files, uses tools, and understands large codebases. | CLI · IDE · Hybrid | Website / Docs |
| Gemini CLI | Open-source terminal coding agent that uses tool calls and MCP servers to work on repository tasks. | CLI · MCP · Local | Docs / Repo |
| OpenCode | Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows. | CLI · Desktop · GitHub app · IDE · MCP · Local | Website / Docs / Repo |
| Roo Code | Open-source coding agent for VS Code and cloud agents that can code, review, and automate repository tasks. | CLI · IDE · Web · Hybrid | Website / Docs / Repo |
| Sweep | JetBrains-focused coding assistant with agent mode, repo edits, AI code review, and MCP integration. | IDE · Hybrid | Website / Docs / Repo |
| Zed | Code editor with built-in agent workflows, external agent support, and MCP-connected coding assistance. | Desktop · MCP · Local | Website / Docs / Repo |
Developer tools for building, testing, debugging, or managing MCP systems.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| cheqd MCP Toolkit | Modular MCP toolkit and server framework for decentralized identity workflows on the Cheqd network. | Framework | Docs / Repo |
| IBM MCP CLI | IBM command-line interface for interacting with MCP servers from scripts and terminals. | CLI · Local | Repo |
| MCP C# SDK | Official C# SDK for MCP servers and clients, maintained with Microsoft and published to NuGet. | Library | Docs / Repo |
| MCP Clients Registry | Community-maintained registry mapping MCP client identifiers to official client names and metadata. | Library | Repo |
| MCP Framework (QuantGeekDev) | TypeScript-first framework and CLI for building MCP servers with automatic discovery and multi-transport support. | CLI · Framework | Docs / Repo |
| MCP Inspector | Official visual and command-line testing tool for developing, inspecting, and debugging Model Context Protocol servers. | CLI · MCP · Web · Local | Docs / Repo |
| MCP Registry | Community-driven registry service and REST API for publishing and discovering Model Context Protocol servers. | API · Hybrid | Website / Docs / Repo |
| MCP Registry Server (KBB99) | MCP server that exposes semantic search and retrieval over an MCP registry for discovering other servers. | MCP · Self-hosted | Website / Repo |
| MCP Rust SDK (rmcp) | Rust SDK for implementing MCP clients and servers, published as the rmcp crate. | Library | Docs / Repo |
| mcp-cli (wong2) | Interactive and non-interactive CLI inspector for running, listing, and calling MCP server tools, resources, and prompts. | CLI · Local | Website / Repo |
| mcpscan.ai | Web-based security scanner for discovering vulnerabilities in MCP server implementations and configurations. | Web | Docs |
| Model Context Protocol Specification Repo | Official repository containing the MCP specification, schemas, and documentation website sources. | Library | Website / Repo |
| Model Context Protocol TypeScript SDK | Official TypeScript SDK for building MCP servers and clients with stdio and HTTP transports. | Library | Website / Docs / Repo |
| PulseMCP Registry | MCP-focused registry and API that aggregates, enriches, and exposes metadata about public MCP servers. | API · Web · Hosted | Website / Docs |
| Smithery CLI | CLI to search, install, run, publish, and inspect MCP servers and skills across clients. | CLI · Local | Website / Docs / Repo |
| Smithery MCP Installer Server | Official MCP server for Smithery CLI that finds, configures, and installs MCP servers for local clients. | MCP · Self-hosted | Repo |
| WebMCP JavaScript Library | JavaScript library and runtime for exposing website functionality as WebMCP tools to MCP-aware agents. | Library | Website / Docs / Repo |
Reusable instruction, workflow, or capability packs for coding agents.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Agent Powerups | Curated skill packs, commands, MCP configs, hooks, templates, and workflows for coding agents. | CLI · Desktop · MCP · Skill Pack · Template · Local | Repo |
| Agent Skills | Python package to create, manage, and execute reusable code-based tool compositions for AI agents with MCP integration. | MCP · Local | Repo |
| Agent Skills Specification | Open specification and documentation for Agent Skills format maintained by Anthropic with reference SDK and examples. | Framework · Skill Pack | Repo |
| AgentSkills MCP | MCP server that brings Anthropic Agent Skills to any MCP-compatible agent with progressive disclosure architecture. | MCP · Local | Repo |
| Anthropic Knowledge Work Plugins | Official open-source plugins for Claude Cowork and Claude Code with skills, commands, and MCP connectors for knowledge workers. | MCP · Local | Repo |
| Anthropic Skills | Official public repository of Agent Skills for Claude demonstrating creative, technical, and enterprise workflow patterns. | Skill Pack · Local | Repo |
| Astronomer Agents | AI agent tooling for data engineering workflows with Airflow MCP server and skills for DAG development, lineage, and dbt integration. | MCP · Local | Repo |
| Awesome Agent Skills | Community-curated directory of agent skills, tutorials, and guides for Claude, Copilot, Codex, and other AI assistants. | Skill Pack | Repo |
| Awesome Cursorrules | Community collection of configuration files that enhance Cursor AI editor with custom rules and behaviors. | Template · Local | Repo |
| Awesome GitHub Copilot | Community collection of custom agents, instructions, skills, hooks, workflows, and plugins for GitHub Copilot. | Skill Pack · Template | Repo |
| Awesome Rules | Collection of useful markdown rules with YAML frontmatter for coding assistants including testing, DevOps, and documentation categories. | Skill Pack · Template · Local | Repo |
| Azure DevOps Skills | Example skills for GitHub Copilot integrating with Azure DevOps via MCP server for work items, iterations, and builds. | MCP · Local | Repo |
| CC DevOps Skills | Practical agent skill pack with 31 skills for DevOps work in Claude Code and Codex including generators, validators, and debuggers. | CLI · Local | Repo |
| Claude Skills | Repository of 232+ Claude Code skills and agent plugins convertible to 12 AI coding tools including Codex, Cursor, and Windsurf. | CLI · Local | Repo |
| Cursor Rules | Curated collection of .cursorrules files for Cursor IDE covering React, Next.js, Python, Node.js, and more frameworks. | Template · Local | Repo |
| Cursorrules Collection | 110+ tested .cursorrules and .mdc rule files for Cursor, Claude Code, Copilot, Windsurf, Gemini CLI, and Codex. | Template · Local | Repo |
| Custom Modes for Roo Code | Collection of 171 specialized AI agent configurations for Roo Code across 9 categories with security-first principles. | Skill Pack · Template · Local | Repo |
| dbt Agent Skills | Curated Agent Skills for working with dbt to help AI agents understand and execute analytics engineering workflows. | Skill Pack · Local | Repo |
| dotskills | Personal .skills repository for Codex, Cursor, and OpenClaw with reusable skill units bundling prompts, scripts, and validation workflows. | Skill Pack · Template · Local | Repo |
| Everything Claude Code | Agent harness performance system with skills, hooks, MCP configs, memory optimization, and cross-harness workflows. | CLI · MCP · Local | Docs / Repo |
| helderberto/skills | Reusable AI agent skills for development workflows including code review, refactoring, TDD, security audit, and git automation. | Skill Pack · Local | Repo |
| Invariant Testing | Lightweight library for writing debuggable unit tests for AI agent applications with localized assertions. | Library · Skill Pack · Local | Repo |
| Microsoft Skills | Skills, custom agents, AGENTS.md templates, and MCP configurations for AI coding agents working with Azure SDKs and Microsoft AI Foundry. | MCP · Local | Repo |
| Pulumi Agent Skills | Agent Skills for infrastructure-as-code workflows teaching AI assistants Pulumi migrations, components, and secrets management. | Skill Pack · Template · Local | Repo |
| roomode | CLI tool to create, list, export, and import custom modes for RooCode defined in markdown files. | CLI · Local | Repo |
| rules | CLI tool to create, manage, and convert rule sets for code guidance across Cursor, Continue.dev, Claude, Copilot, and Codex. | CLI · Local | Repo |
| Superpowers | Core skills library for Claude Code with TDD, debugging, collaboration patterns, and systematic problem-solving techniques. | Skill Pack · Local | Repo |
| Superpowers Lab | Experimental skills for Claude Code including semantic duplicate detection, tmux automation, and on-demand MCP server usage. | Skill Pack · Local | Repo |
| Swarms | Multi-agent orchestration skills for Claude Code and Codex with dependency-aware planning and wave-based parallel execution. | Framework · Skill Pack · Local | Repo |
| wshobson/agents | Unified repository with 185 specialized agents, 16 orchestrators, 153 skills, and 100 commands for Claude Code automation. | CLI · Local | Repo |
Tools for tracing, monitoring, and debugging agent or LLM application behavior.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| agenttrace | Local CLI/TUI that turns AI coding agent session logs into cost, token, latency, failure, and health reports. | CLI · Local | Website / Docs / Repo |
| Amazon CloudWatch GenAI Observability | CloudWatch capabilities for monitoring and tracing generative AI agents, workloads, and quality metrics on AWS. | API · Web · Hosted | Website / Docs / Repo |
| Arize AX | Commercial agent and LLM observability platform built on Phoenix for tracing, evaluation, and monitoring production AI systems. | API · Web · Hosted | Website / Docs |
| Arize Phoenix | Open-source AI observability platform with tracing, evals, datasets, and experiments for LLM, agent, and RAG systems. | API · Web · Self-hosted | Website / Docs / Repo |
| Braintrust | AI observability and evaluation platform that logs LLM and agent traces and turns production logs into test datasets. | API · Web · Hosted | Website / Docs |
| Comet Opik | Open-source LLM observability framework for tracing, evaluating, and monitoring LLM, RAG, and agent workflows. | API · Web · Hybrid | Website / Docs / Repo |
| Confident AI | Evaluation and observability platform that traces LLM apps and runs DeepEval metrics on components and end-to-end workflows. | API · Web · Hosted | Website / Docs |
| Datadog LLM Observability | Datadog product for tracing, monitoring, and evaluating LLM and agent applications with integrated APM views. | API · Library · Web · Hosted | Website / Docs / Repo |
| Dunetrace | Open-source anomaly detection layer that monitors agent traces for structural failures and alerts in real time. | API · Self-hosted | Website / Docs / Repo |
| Evidently AI | Open-source library and cloud service for evaluating, testing, and monitoring ML and LLM systems, including RAG and agents. | API · Web · Hybrid | Website / Docs / Repo |
| Fiddler AI Observability | AI observability and security platform for monitoring, alerting, and troubleshooting LLM and ML applications. | API · Web · Hosted | Website / Docs |
| Flexible GraphRAG Observability Stack | Observability setup in Flexible GraphRAG that instruments LlamaIndex RAG apps with OTEL traces, metrics, and Grafana dashboards. | CLI · Self-hosted | Docs / Repo |
| Galileo AI | Agent-centric observability and evaluation platform with tracing, guardrails, and Luna models for RAG and agents. | API · Web · Hosted | Website / Docs |
| Grafana GenAI Observability | Grafana Cloud dashboards and metrics for monitoring LLM application performance, token usage, and cost. | API · Web · Hosted | Website / Docs |
| Helicone | Open-source LLM observability platform and gateway for logging, tracing, and evaluating LLM and agent requests. | API · Web · Self-hosted | Website / Docs / Repo |
| IBM Instana GenAI Observability | Instana module that provides GenAI observability for LLM and agentic workloads with unified tracing and metrics. | API · Web · Hosted | Website / Docs |
| Keywords AI | LLM observability platform offering real-time traces, logs, metrics, and quality scores across many models. | API · Web · Hosted | Website / Docs |
| Langfuse | Open-source LLM engineering platform for observability, tracing, prompt management, datasets, and evaluations. | API · Web · Hybrid | Docs / Repo |
| LangSmith | Hosted observability and evaluation platform for tracing, debugging, and monitoring LangChain and other LLM or agent applications. | API · Web · Hosted | Website / Docs |
| Langtrace | Open-source OpenTelemetry-based observability tool and dashboard for tracing, evaluating, and debugging LLM applications. | API · Web · Self-hosted | Website / Docs / Repo |
| LangWatch | LLM observability and evaluation platform focused on tracing, debugging, and optimizing AI agents and applications. | API · Web · Hybrid | Website / Docs / Repo |
| Lunary | Open-source observability and prompt platform for LLM chatbots with analytics, logs, traces, and evaluations. | API · Library · Web · Hybrid | Website / Docs / Repo |
| Mastra Observability | Observability module in Mastra for tracing, monitoring, and evaluating LLM agents and workflows via OpenTelemetry. | API · Web · Hybrid | Website / Docs / Repo |
| Maxim AI | End-to-end AI evaluation and observability platform for testing and monitoring agents and LLM applications. | API · Web · Hosted | Website / Docs / Repo |
| MLflow AI Observability | MLflow extensions for LLM and agent observability with tracing, evaluation, and integration with TruLens scorers. | API · CLI · Web · Hybrid | Website / Docs / Repo |
| Monocle | Linux Foundation project providing a framework to trace GenAI app code and agent workflows with minimal code changes. | API · Local | Website / Docs / Repo |
| Noveum AI Agent Monitoring | Enterprise AI agent monitoring platform with real-time tracing of LLM calls, RAG steps, and tool interactions. | API · Web · Hosted | Website |
| Okahu | AI observability platform and tools for debugging, testing, and monitoring agentic and LLM-based applications. | API · Web · Hosted | Website / Docs / Repo |
| OpenAI Traces and Evals | Built-in OpenAI platform capabilities for tracing agent workflows and running evaluations on traces and datasets. | API · Web · Hosted | Website / Docs / Repo |
| OpenInference | Open-source OpenTelemetry-based specification and instrumentations for tracing AI and LLM applications. | Library · Local | Docs / Repo |
| OpenLIT | Open-source OpenTelemetry-native observability and evaluations platform for GenAI and LLM applications. | API · CLI · Web · Self-hosted | Website / Docs / Repo |
| OpenObserve LLM Observability | Open-source observability platform that unifies infrastructure and LLM observability with logs, metrics, and traces. | API · Web · Hybrid | Website / Docs / Repo |
| OpenSearch GenAI Observability SDK | OpenTelemetry-native Python SDK for one-line LLM observability using OpenSearch and Data Prepper as backend. | Library · Local | Website / Docs / Repo |
| PostHog LLM Analytics | LLM observability product in PostHog that captures traces, spans, and sessions for AI-powered applications. | API · Web · Hosted | Website / Docs / Repo |
| Respan | LLM engineering platform that unifies observability, evals, prompt optimization, and gateway for AI applications. | API · Web · Hosted | Website |
| Traceloop OpenLLMetry | Open-source OpenTelemetry extensions and SDKs for providing LLM and RAG observability across backends. | API · Local | Website / Docs / Repo |
| TruLens | Open-source library for tracing and evaluating AI agents, RAG systems, and LLM applications with feedback functions. | Web · Local | Website / Docs / Repo |
| Weights & Biases Weave | Framework and UI for debugging, tracing, and monitoring LLM applications with W&B observability. | API · Web · Hybrid | Website / Docs / Repo |
| WhyLabs OpenLLMTelemetry | Python library that instruments LLM calls and sends OpenTelemetry traces and safeguards data to WhyLabs. | API · Local | Website / Docs / Repo |
| Zenity AI Observability Platform | Security-focused AI observability platform for discovering and monitoring agents across SaaS, endpoints, and environments. | API · Web · Hosted | Website |
Evaluation frameworks and systems for agents, LLM apps, and developer workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Agent Eval Framework | Python package for production-grade evaluation and continuous improvement of AI agents across multiple quality dimensions. | Framework · Library | Repo |
| Agentic Security | Open-source vulnerability scanner and red-teaming kit for LLM agents and workflows focused on security evaluation. | CLI · Framework · Library | Repo |
| Async Labs LLM Eval (PHP) | PHP package for evaluating LLM outputs to test prompts and validate responses in PHP applications. | Framework · Library | Repo |
| AWS Agent Evaluation | Generative AI-powered framework from AWS Labs to test virtual agents via multi-turn conversations and CI-friendly workflows. | CLI · Framework · Library | Docs / Repo |
| DeepEval | Python framework for unit testing and benchmarking LLM applications, RAG systems, and agents with research-backed metrics. | CLI · Framework · Library | Website / Repo |
| DeepTeam | Open-source LLM red teaming framework for simulating attacks and evaluating safety of LLM systems using DeepEval metrics. | CLI · Framework · Library | Repo |
| Guardrails AI | Python library for enforcing structured outputs, validations, and safety constraints on LLM and agent responses. | Framework · Library · Local | Docs / Repo |
| LangChain OpenEvals | Open-source collection of ready-made evaluators for LLM applications in the LangChain ecosystem. | Framework · Library | Repo |
| LangFair | Python library for use-case level LLM bias and fairness assessment using bring-your-own-prompts workflows. | Framework · Library | Docs / Repo |
| Langfuse | Open-source LLM engineering platform for observability, tracing, prompt management, datasets, and evaluations. | API · Web · Hybrid | Docs / Repo |
| LangSmith Evaluations | Hosted evaluation and tracing platform for LLM apps and agents with dataset-based and online eval workflows. | API · Framework · Web | Website / Docs |
| LLM Evaluation Framework (Inference-Time) | Research framework implementing multiple inference-time methods to evaluate LLM reliability across reasoning strategies. | Framework · Library | Repo |
| nuclia-eval | Python library for evaluating RAG experiences with Nuclia’s REMi models using RAG triad metrics. | Framework · Library | Website / Repo |
| Open RAG Eval | Python toolkit from Vectara for evaluating and comparing RAG pipelines using TREC-RAG style metrics. | CLI · Framework · Library | Website / Docs / Repo |
| OpenAI HumanEval Harness | Evaluation harness and dataset for assessing LLM code generation via functional correctness tests. | CLI · Framework · Library | Repo |
| Promptfoo | Open-source framework and CLI for testing prompts, models, RAG pipelines, and LLM security via automated evals and red teaming. | CLI · Framework · Library · Web | Website / Docs / Repo |
| PyHDL-Eval | Domain-specific LLM evaluation framework for assessing hardware design code generation using Python-embedded DSLs and RTL tasks. | CLI · Framework · Library | Repo |
| RAG Evaluation Harnesses | Evaluation harness adapted from lm-evaluation-harness for retrieval-augmented generation tasks. | CLI · Framework · Library | Repo |
| RAGAS | Open-source toolkit for automated evaluation of RAG systems using reference-free and reference-based metrics. | CLI · Framework · Library | Website / Docs / Repo |
| Rhesis AI | Open-source collaborative testing platform for LLM and agentic applications with UI, SDK, and CI integration. | API · CLI · Framework · Web | Website / Docs / Repo |
| Unitxt | IBM-backed library and catalog for textual data preparation and evaluation of generative language models across many tasks. | CLI · Framework · Library | Website / Docs / Repo |
| Vectara Open Evaluation UI | Web UI for loading reports from Open RAG Eval and comparing RAG configurations across queries and metrics. | Framework · Web | Website / Docs |
Self-hostable platforms and infrastructure for AI developer workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| AnythingLLM | Self-hosted RAG and agent platform with no-code agent builder and Docker Compose deployment options. | API · CLI · Web · Hybrid | Website / Docs / Repo |
| Athenaeum | Self-hosted semantic library platform with embeddings, chat UI, pgvector, and MCP server support. | API · MCP · Web · Self-hosted | Docs / Repo |
| Clawix AI Platform | Open-source, self-hosted multi-agent AI orchestration platform running agents in isolated Docker containers. | CLI · Web · Self-hosted | Docs / Repo |
| DevBox AI Dev Stack | Zero-trust dev environment repository including an AI dev stack installer for Docker-based tools on a VPS. | CLI · Self-hosted | Docs / Repo |
| Dify | Open-source LLMOps platform with visual studio for chatbots, workflows, agents, and RAG that supports self-hosted deployment. | API · Web · Hybrid | Website / Docs / Repo |
| Harbor CLI Stack | CLI tool that spins up a local LLM stack (Ollama, Open WebUI, others) with a single command using container orchestration. | CLI · Template · Local | Docs / Repo |
| Jan Server | Self-hosted agentic AI platform powered by local models with Docker Compose-based infrastructure files. | API · CLI · Framework · Web · Self-hosted | Website / Docs / Repo |
| Langfuse | Open-source LLM engineering platform for observability, tracing, prompt management, datasets, and evaluations. | API · Web · Hybrid | Docs / Repo |
| Local LLM Docker (mythrantic) | Docker Compose setup for running Ollama and a web UI in containers with GPU optional. | Web · Self-hosted | Docs / Repo |
| Nosia | Self-hosted RAG platform with OpenAI-compatible API, Docker Compose deployment, and web UI for chat over private documents. | API · CLI · Web · Self-hosted | Website / Docs |
| Nosia Installer Stack | Scripted Docker Compose stack that installs Nosia plus dependencies for self-hosted RAG and chat on local infrastructure. | CLI · Web · Self-hosted | Website / Docs |
| Onyx | Open-source self-hostable AI platform offering chat UI with agents, RAG, MCP tools, and multi-provider model support. | API · MCP · Web · Self-hosted | Website / Docs / Repo |
| Open WebUI Platform | Self-hosted AI platform and UI that supports Ollama and OpenAI-compatible APIs and can run entirely offline. | API · Web · Self-hosted | Website / Docs / Repo |
| OpenRAG | Open-source RAG stack combining Langflow, Docling, and OpenSearch with single-command Docker Compose deployment. | API · Web · Self-hosted | Docs / Repo |
| Paddler | Open-source LLMOps platform for hosting and scaling AI models in your own infrastructure. | API · CLI · Web · Self-hosted | Docs / Repo |
| Pleng | Self-hosted AI platform engineer that installs a Docker-based PaaS with AI agents and automation on your own cloud. | CLI · Web · Self-hosted | Website / Docs / Repo |
| Redis + Ollama RAG Stack | Docker-based stack using RedisVL, Ollama, FastAPI, and RQ worker to build a local RAG pipeline. | API · CLI · Self-hosted | Docs / Repo |
| Refact.ai | Coding agent for IDEs and enterprises that can automate coding, debugging, testing, and documentation tasks. | IDE · Web · Hybrid | Website / Docs / Repo |
| Ruflo | Enterprise-grade multi-agent orchestration framework for Claude that deploys 60+ specialized AI agents with shared memory, RAG, and swarm coordination across machines and teams. | API · CLI · Web · Self-hosted | Docs / Repo |
| Scalable Agentic RAG Platform (FareedKhan-dev) | Production-grade agentic RAG platform with Kubernetes, Ray, LangGraph, and multi-plane architecture. | CLI · Self-hosted | Docs / Repo |
| Self-hosted AI Package | Open-source Docker Compose starter kit bundling Ollama, n8n, Supabase, Open WebUI, Flowise, Neo4j, Langfuse, and related tools. | API · Web · Self-hosted | Website / Repo |
| Self-hosted AI Starter Kit (n8n) | Docker Compose-based local AI and low-code stack bundling n8n, Ollama, Qdrant, PostgreSQL, and related services. | API · CLI · Web · Self-hosted | Docs / Repo |
| Synaplan AI Platform | Open-source, self-hosted AI platform with full stack deployment via Docker Compose and local inference via Ollama. | API · Web · Self-hosted | Website / Docs |
| Tabby | Self-hosted AI coding assistant for teams that want private code assistance and repository-aware development. | API · IDE · Self-hosted | Website / Docs / Repo |
| Winy RAG Sample Stack | Sample RAG application with Ollama, Qdrant, and Streamlit web app orchestrated via Docker Compose. | Web · Self-hosted | Docs / Repo |
Tools that help developers run or integrate local models in coding workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| AutoGPTQ | Python library for GPTQ weight-only quantization of Transformer language models for efficient local inference. | Library · Local | Docs / Repo |
| ChromaDB | Lightweight vector database and Python library for local embeddings storage and RAG-style similarity search. | API · Library · Local | Website / Docs / Repo |
| Docker Model Runner | Docker Desktop-integrated local model runtime that runs GGUF models via an OpenAI-compatible API. | API · CLI · Local | Website / Docs |
| ExLlamaV2 | Inference library for running GPTQ-quantized LLMs on modern consumer GPUs with high performance. | CLI · Library · Local | Docs / Repo |
| GPT4All | Local LLM desktop client and Python library with optional OpenAI-compatible API server on localhost. | API · Desktop · Library · Local | Website / Docs / Repo |
| Haystack | Open-source framework for building RAG pipelines, agents, and semantic search over private data. | API · Framework · Local | Docs / Repo |
| Intel Neural Compressor | Open-source compression toolkit supporting quantization and pruning for deep learning and LLM workloads. | Library · Local | Docs / Repo |
| KoboldCpp | Single-file local LLM server and web UI for GGUF models with Kobold-style API and OpenAI-like integrations. | API · CLI · Web · Local | Website / Docs / Repo |
| LiteLLM Gateway | Drop-in proxy that unifies many LLM providers behind an OpenAI-compatible API, with logging and rate limiting. | API · CLI · Self-hosted | Docs / Repo |
| llama-cpp-python | Python bindings and OpenAI-compatible web server for llama.cpp, exposing local models via HTTP and Python APIs. | API · CLI · Library · Self-hosted | Docs / Repo |
| llama.cpp | C/C++ LLM inference library and tools for running quantized models on CPUs and GPUs with optional HTTP and OpenAI-style servers. | API · CLI · Library · Self-hosted | Docs / Repo |
| Llamafile | Single-file local LLM runtime bundling llama.cpp and web UI, with an OpenAI-compatible /v1 chat completions endpoint. | API · CLI · Web · Local | Docs / Repo |
| LlamaIndex | Framework for building RAG and agent systems that can target local LLMs and embedding backends like Ollama or llamafile. | Framework · Library · Local | Website / Docs / Repo |
| LLM Compressor | Compression and quantization library for optimizing LLMs for deployment with vLLM. | Library · Local | Docs / Repo |
| llm-llamafile | Plugin for the llm CLI that lets you use a locally running llamafile server as an LLM provider. |
CLI · Library · Local | Docs / Repo |
| LM Studio | Cross-platform desktop app and SDKs to discover, run, and serve local LLMs with an OpenAI-compatible server mode. | API · CLI · Desktop · Local | Website / Docs / Repo |
| LMDeploy | OpenAI-compatible API server for deploying multimodal models with LMDeploy on GPUs, locally or via Docker. | API · CLI · Self-hosted | Website / Docs / Repo |
| LocalAI | Self-hosted REST server that emulates the OpenAI API to run local ggml/llama.cpp and related models on your own hardware. | API · CLI · Self-hosted | Website / Docs / Repo |
| Mistral Inference | Official inference library for running Mistral models via CLI and Python on local or server hardware. | CLI · Library · Self-hosted | Docs / Repo |
| mistral.rs | Rust-based engine for fast, flexible LLM inference with OpenAI-compatible APIs, web UI, and extensive quantization options. | API · CLI · Library · Web · Self-hosted | Docs / Repo |
| MLC LLM | Universal LLM deployment engine and compiler for running quantized models natively across many hardware backends. | API · CLI · Library · Self-hosted | Website / Docs / Repo |
| MLX Engine for LM Studio | Apple MLX-based inference engine used by LM Studio to run quantized text and vision models locally on macOS. | Library · Local | Docs / Repo |
| mlx-lm | Apple MLX-based Python package for running and fine-tuning LLMs on Apple silicon, with an HTTP server similar to OpenAI chat API. | API · CLI · Library · Local | Docs / Repo |
| Ollama | Local LLM runtime and model manager that runs open models on your machine with an OpenAI-compatible Chat Completions API. | API · CLI · Local | Website / Docs / Repo |
| PydanticAI | Pydantic-based framework for building typed LLM apps and agents with validation, tools, and structured outputs. | Framework · Library · Local | Docs / Repo |
| Tabby | Self-hosted AI coding assistant for teams that want private code assistance and repository-aware development. | API · IDE · Self-hosted | Website / Docs / Repo |
| TabbyAPI | FastAPI-based backend server for ExLlamaV2 that exposes local text generation over HTTP for coding and chat workloads. | API · Self-hosted | Docs / Repo |
| Text Generation Inference | High-performance Rust and Python server for deploying and serving open-source LLMs via HTTP and gRPC. | API · CLI · Self-hosted | Website / Docs / Repo |
| text-generation-webui | Self-hosted Gradio/Web UI and API for running diverse local text generation models on CPUs and GPUs. | CLI · Web · Self-hosted | Docs / Repo |
| vLLM | High-throughput LLM inference engine with an OpenAI-compatible HTTP server for serving models locally or on servers. | API · CLI · Library · Self-hosted | Website / Docs / Repo |
| WebLLM | In-browser LLM inference engine using WebGPU that exposes an OpenAI-compatible API surface for local models. | Library · Web · Local | Website / Docs / Repo |
AI tools that automate repository checks, changes, pull requests, or maintenance.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Amp | Terminal-centric coding agent with deep codebase context, editor links, and automation-oriented SDK features. | API · CLI · Hybrid | Website / Docs |
| auto-changelog (cookpete) | CLI tool that generates a changelog from git tags and commit history for use in release workflows. | CLI · Local | Repo |
| automerge-action | GitHub Action that automatically merges pull requests labeled for automerge once checks and reviews pass. | GitHub app | Docs / Repo |
| Bito AI Code Review Agent | Repository review agent for GitHub, GitLab, and Bitbucket pull or merge request workflows. | GitHub app · Hosted | Website / Docs |
| changelog-generator (jaywcjlove) | GitHub Action and CLI that computes markdown changelogs between git references and outputs them for releases. | CLI · GitHub app · Local | Repo |
| CodeRabbit | AI code review agent for pull requests, local IDE review, and terminal-based review workflows. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Continue | Open-source AI code assistant and CLI for IDE agents, source-controlled checks, and customizable development workflows. | CLI · IDE · Hybrid | Docs / Repo |
| dbt-semguard | CLI and GitHub Action that detects breaking or risky semantic changes in dbt metrics before production. | CLI · Hybrid | Docs / Repo |
| Factory Droid | Coding agent platform with CLI, desktop, and headless automation for code changes, review, and CI workflows. | API · CLI · Desktop · Hybrid | Website / Docs |
| Gemini Code Assist | Google's coding assistant for IDEs and GitHub with agent mode, PR summaries, and code review. | GitHub app · IDE · Hosted | Website / Docs |
| GitHub Dependabot | GitHub-native service that configures and runs automated security and version dependency update pull requests. | GitHub app · Hosted | Docs |
| GitHub Stacked PRs (gh stack) | Native GitHub feature and gh CLI support for creating and managing stacked pull requests for large changes. | CLI · Local | Docs |
| GitHub Stale Action | Official GitHub Action that marks inactive issues and pull requests as stale and optionally closes them. | GitHub app | Repo |
| OpenCode | Open-source AI coding agent for terminal, desktop, IDE, and GitHub repository workflows. | CLI · Desktop · GitHub app · IDE · MCP · Local | Website / Docs / Repo |
| Pull Request Labeler (actions/labeler) | GitHub Action that automatically labels pull requests based on changed file paths or branch names. | GitHub app | Docs / Repo |
| Qodo-Cover | AI-powered tool that automatically generates unit tests and improves code coverage, runnable as a CLI or in CI. | CLI · GitHub app · Hybrid | Docs / Repo |
| Release Please | Tool and GitHub Action that automates changelog updates, GitHub releases, and version bumps using Conventional Commits. | CLI · GitHub app | Docs / Repo |
| release-it | Generic CLI tool to automate versioning, tagging, changelog, and package publishing as part of release workflows. | CLI · Local | Repo |
| Renovate | Automated dependency update bot that scans repositories and opens pull requests to keep dependencies up to date. | CLI · GitHub app · Hybrid | Docs / Repo |
| Roo Code | Open-source coding agent for VS Code and cloud agents that can code, review, and automate repository tasks. | CLI · IDE · Web · Hybrid | Website / Docs / Repo |
| semantic-release | CLI tool that automates semantic versioning, changelog generation, tagging, and publishing from commit history. | CLI · Local | Docs / Repo |
| Shelfi AI GitHub Bot | AI-powered GitHub bot that analyzes pull requests and suggests documentation updates tied to code changes. | GitHub app · Web · Hosted | Docs |
| stack-attack | CLI tool that helps developers create, manipulate, and land stacks of pull requests instead of single large PRs. | CLI · Local | Repo |
| stack-pr | CLI tool that manages stacked pull requests on GitHub, creating and updating PR stacks from a series of commits. | CLI · Local | Repo |
| stale-repos Action | GitHub Action that identifies inactive repositories in an organization and reports them for archival decisions. | GitHub app | Docs / Repo |
| UpdateBot | Bot that scans git repositories and automatically updates dependencies across multiple projects via configuration. | CLI · Local | Repo |
AI-assisted tools for reviewing changes, pull requests, and code quality.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Bito AI Code Review Agent | Repository review agent for GitHub, GitLab, and Bitbucket pull or merge request workflows. | GitHub app · Hosted | Website / Docs |
| CodeRabbit | AI code review agent for pull requests, local IDE review, and terminal-based review workflows. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Continue | Open-source AI code assistant and CLI for IDE agents, source-controlled checks, and customizable development workflows. | CLI · IDE · Hybrid | Docs / Repo |
| Factory Droid | Coding agent platform with CLI, desktop, and headless automation for code changes, review, and CI workflows. | API · CLI · Desktop · Hybrid | Website / Docs |
| Gemini Code Assist | Google's coding assistant for IDEs and GitHub with agent mode, PR summaries, and code review. | GitHub app · IDE · Hosted | Website / Docs |
| GitHub Copilot | GitHub AI coding assistant for IDEs and GitHub workflows, including code suggestions, chat, and pull request support. | GitHub app · IDE · Web · Hosted | Website / Docs |
| Junie | JetBrains coding agent for IDEs and terminal that plans, edits, tests, and reviews project changes. | CLI · IDE · Hybrid | Website / Docs / Repo |
| Qodo | Code review and IDE assistant product focused on reviewing diffs, tests, and repository context. | GitHub app · IDE · Hosted | Website / Docs |
| Sweep | JetBrains-focused coding assistant with agent mode, repo edits, AI code review, and MCP integration. | IDE · Hybrid | Website / Docs / Repo |
AI coding tools focused on data, notebooks, machine learning, or analytics workflows.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| dbt-semguard | CLI and GitHub Action that detects breaking or risky semantic changes in dbt metrics before production. | CLI · Hybrid | Docs / Repo |
AI tools that generate, maintain, or reason over developer documentation.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| AI Document Creator | GitHub app that auto-generates and updates multi-level repository documentation via pull requests. | GitHub app · Web · Hosted | Website / Docs |
| ai-doc-gen | Multi-agent CLI that analyzes codebases and generates repository documentation and READMEs using LLMs. | CLI · Local | Repo |
| AIGNE DocSmith | AI-driven documentation generator that builds structured multi-language docs directly from code repositories. | CLI | Website / Repo |
| AutoCodeDocs | Hosted tool that analyzes code and generates structured Markdown documentation, READMEs, and API references. | Web · Hosted | Docs |
| AWS Documentation MCP Server | MCP server that exposes AWS documentation search and retrieval tools to AI assistants. | MCP · Hosted | Docs / Repo |
| Code2Docs | AI system and CLI that converts GitHub repositories into structured markdown documentation and exports docs. | CLI · Web | Docs / Repo |
| DeepDocs | GitHub-native AI agent that keeps READMEs, API docs, SDK guides, and tutorials in sync with code changes. | GitHub app · Web · Hosted | Website / Docs |
| DeepWiki | AI-powered service that turns GitHub repositories into interactive wiki-style documentation with Q&A. | Web · Hosted | Website / Docs |
| Docs.dev | AI-assisted docs-as-code platform that generates and audits Markdown documentation from your codebase. | GitHub app · Web · Hosted | Website / Docs |
| Docudoodle | PHP-focused AI documentation generator that creates Markdown docs from existing codebases. | CLI · Local | Repo |
| Documentation.AI | AI documentation platform for product docs, API references, and internal knowledge with assistant and automation. | Web · Hosted | Docs |
| DocuWriter.ai | AI code documentation tool that generates comprehensive docs, API references, and diagrams from repositories. | Web · Hosted | Website / Docs |
| DocWhizz | AI assistant embedded in developer docs that answers API questions and highlights documentation gaps. | Web · Hosted | Docs |
| GitBook AI (Assistant & Agent) | AI-native documentation assistant and agent for writing, updating, and searching GitBook docs. | Web · Hosted | Website / Docs |
| GitCrafts | Hosted assistant that generates professional documentation for GitHub repositories using AI. | Web · Hosted | Docs |
| Gitdocs AI | AI-powered README generator and developer documentation platform integrated with Git hosting. | Web · Hosted | Website / Docs |
| Google Developer Knowledge API & MCP Server | API and MCP server that let AI tools search and retrieve Google developer documentation as Markdown. | API · MCP · Hosted | Website / Docs |
| Mintlify | AI-native documentation platform that generates and maintains docs and API references from repositories. | GitHub app · Web · Hosted | Website / Docs |
| ReadMe Agent & Ask AI | AI documentation assistant for ReadMe that edits docs and answers user questions grounded in API docs. | Web · Hosted | Website / Docs |
| Refact.ai | Coding agent for IDEs and enterprises that can automate coding, debugging, testing, and documentation tasks. | IDE · Web · Hybrid | Website / Docs / Repo |
| RepoGPT | Open-source GitHub assistant that can generate documentation and answer questions about repositories. | Web | Repo |
| RepoMix | CLI that summarizes and compresses a repository into a single prompt-friendly file using heuristics and optional LLM support. | CLI · Local | Docs / Repo |
| Stenography | AI-powered codebase documenter with API and editor extensions for automatic code explanations and docs. | API · IDE · Hosted | Docs |
| write-the | AI-powered Python tool that auto-generates documentation and tests from code, and assists with refactoring. | CLI · Library · Local | Docs / Repo |
AI tools that create, improve, or maintain automated tests.
| Tool | Good for | Experience | Links |
|---|---|---|---|
| Amazon Q Developer | AWS coding assistant with IDE, CLI, and GitHub agents for coding, testing, review, and transformations. | CLI · GitHub app · IDE · Hybrid | Website / Docs |
| Junie | JetBrains coding agent for IDEs and terminal that plans, edits, tests, and reviews project changes. | CLI · IDE · Hybrid | Website / Docs / Repo |
| Qodo | Code review and IDE assistant product focused on reviewing diffs, tests, and repository context. | GitHub app · IDE · Hosted | Website / Docs |
| Qodo-Cover | AI-powered tool that automatically generates unit tests and improves code coverage, runnable as a CLI or in CI. | CLI · GitHub app · Hybrid | Docs / Repo |
| Refact.ai | Coding agent for IDEs and enterprises that can automate coding, debugging, testing, and documentation tasks. | IDE · Web · Hybrid | Website / Docs / Repo |
| write-the | AI-powered Python tool that auto-generates documentation and tests from code, and assists with refactoring. | CLI · Library · Local | Docs / Repo |
- 2026-05-15: Guardrails AI
- 2026-05-15: Haystack
- 2026-05-15: LiteLLM Gateway
- 2026-05-15: PydanticAI
- 2026-05-15: Qodo-Cover
- 2026-05-15: RepoMix
- 2026-05-15: Ruflo
- 2026-05-15: write-the
Draft entries stay out of the main shelves until their metadata and sources are reviewed.
| Tool | Suggested shelf | Review note | Links |
|---|---|---|---|
| Action to update GitHub Action documentation | Repo automation tools | Draft: source_model=not specified. | Docs |
| action-github-changelog-generator | Repo automation tools | Draft: source_model=not specified. | Docs |
| Agenta | Agent evals | Draft: broad platform similar to Dify/Langfuse. | Docs / Repo |
| Agentkit | Agent skill packs | Draft: specialized but relevant for devtool-style onchain skills. | Docs / Repo |
| AgentOps | Agent observability | Draft: newer but fits observability niche. | Docs / Repo |
| AI-Agent (Browser-Use WebUI) | Browser agents | Draft: needs-human-review. | Repo |
| ai-smart-doc-generator | Documentation agents | Draft: source_model=not specified. | Repo |
| AIFLow Dev | Self-hosted AI dev stacks | Draft: position vs. Dify / AnythingLLM. | Docs / Repo |
| Auto Documentation & Docstrings Action | Documentation agents | Draft: source_model=not specified. | Docs |
| auto-generate-changelog | Repo automation tools | Draft: source_model=not specified. | Docs |
| Auto-Merge Pull Request | Repo automation tools | Draft: source_model=not specified. | Docs |
| Automatic Pull Request (AutoPR) | Repo automation tools | Draft: source_model=not specified. | Docs |
| Automatic Pull Request Review | Repo automation tools | Draft: source_model=not specified. | Docs |
| Autopilot | Coding agents | Draft: confirm stability and supported providers. | Docs / Repo |
| Awesome Codex Skills | Agent skill packs | Draft: source_model=not specified. | Repo |
| Awesome MCP Servers | MCP servers | Draft: curated list rather than a runtime tool, but matches existing awesome-* style entries. | Repo |
| ChatGPT Retrieval Plugin | Local LLM developer tools | Draft: historical but still a reference retrieval implementation. | Docs / Repo |
| ci-debug-action | Repo automation tools | Draft: source_model=not specified. | Repo |
| Cline Prompts | Agent skill packs | Draft: source_model=not specified. | Repo |
| Code Summarizer Action | Repo automation tools | Draft: verify current marketplace listing and name. | Website / Docs / Repo |
Showing 20 of 87 draft entries. Full queue in data/tools.yml.
Add or update one tool by editing data/tools.yml, then run:
npm run sort
npm run generate
npm testUse official sources, keep descriptions factual, and leave uncertain metadata as not specified instead of guessing. See CONTRIBUTING.md and docs/submission-guide.md.
- Review and promote the ~47 queued draft entries, prioritising thin shelves.
- Expand thin shelves: test generation agents (4 reviewed), MCP clients (6), data and ML coding assistants (1).
- Populate empty shelves when quality entries are found: AI devtools security, DevOps/SRE agents, prompt and workflow libraries.
- Add stale-entry and broken-link checks.
- Improve generated filter views and category-level comparisons.
- Keep the schema small and strict as the catalog grows.