Agent Distillation
by nardien
Distill large LLM agents into efficient small language models with retrieval and code tools.
What it does
Agent Distillation is a specialized framework designed to transfer the agentic capabilities of large language models (teachers) into much smaller, more efficient models (students). It focuses on mimicking complex behaviors, specifically those involving retrieval-augmented generation and code execution, allowing small models to maintain high performance on factual and mathematical reasoning tasks.
Tools
- Trajectory Logger: Captures detailed agent run logs to create high-quality training datasets.
- SFT Trainer: Uses the TRL library to fine-tune small models while maintaining compatibility with the smolagents framework.
- Benchmarking Suite: Evaluates distilled agents on standard factual and mathematical reasoning benchmarks.
Installation
{
"mcpServers": {
"agent-distillation": {
"command": "python3",
"args": ["-m", "agent_distillation.server"]
}
}
}
Supported hosts
- claude
Quick install
pip install -e .[distill]Information
- Pricing
- free
- Published
- 6/14/2026
- stars
- 0
Categories
Choose your AI client and follow the steps below.
Claude Desktop
Add the server configuration to your claude_desktop_config.json using the python3 module command.Related Apps
DiffSitter MCP
MCP ServerAI-powered structural code navigation using tree-sitter ASTs for semantic understanding across 14+ languages.
OpenAI Apps SDK Examples
MCP AppOfficial example gallery of interactive MCP widgets for ChatGPT — 3D viewers, maps, carousels, shopping carts, and more.
Human MCP
MCP ServerGive AI agents human-like senses: visual analysis, image/video generation, speech synthesis, browser automation, and advanced reasoning — 29 MCP tools in one se
Shopify MCP Server
MCP ServerDirect interaction with Shopify store data via GraphQL API for managing products, customers, and orders.
Git MCP Server
MCP ServerFull-featured Git MCP server exposing 28 tools for AI agents to clone, commit, branch, diff, merge, rebase, and more via STDIO or Streamable HTTP.
CodexPotter
MCP ServerAutonomous reconciliation loop that drives Codex to align your codebase with instructed states.
Smart Coding MCP
MCP ServerSemantic code search for AI assistants using local embeddings — find code by meaning, not just keywords.
Snowflake MCP Server
MCP ServerDirect Snowflake database interaction via MCP, enabling AI to run SQL queries, explore schemas, and manage data insights.