Bodhi App
by bodhisearch
Run Open Source and Open Weight LLMs locally with OpenAI-compatible APIs and a built-in Chat UI.
What it does
Bodhi App is a comprehensive local LLM runner that enables users to deploy open-source models (like Llama, Mistral, and Gemma) on their own hardware. It leverages the HuggingFace ecosystem for model discovery and is powered by llama.cpp for efficient inference.
Tools
- OpenAI-Compatible API: Provides chat completions and models endpoints for external integrations.
- Model Manager: Direct integration with HuggingFace to download and manage GGUF files.
- SwaggerUI: Built-in interactive documentation for testing API endpoints live.
- Local Chat UI: A responsive, markdown-supported interface for non-technical users to interact with LLMs.
Installation
For Mac users, install via Homebrew:
brew install --cask BodhiSearch/apps/bodhi
Or via Docker (CPU variant):
docker run -p 8080:8080 -v ./bodhi_home:/data/bodhi_home -v ./hf_home:/data/hf_home ghcr.io/bodhisearch/bodhiapp:latest-cpu
Supported hosts
- claude
Quick install
brew install --cask BodhiSearch/apps/bodhiInformation
- Pricing
- free
- Published
- 6/10/2026
- stars
- 0
Categories
Choose your AI client and follow the steps below.
Claude Desktop
Install the app via Homebrew, then connect to the local OpenAI-compatible endpoint at http://localhost:8080Related Apps
DiffSitter MCP
MCP ServerAI-powered structural code navigation using tree-sitter ASTs for semantic understanding across 14+ languages.
OpenAI Apps SDK Examples
MCP AppOfficial example gallery of interactive MCP widgets for ChatGPT — 3D viewers, maps, carousels, shopping carts, and more.
Human MCP
MCP ServerGive AI agents human-like senses: visual analysis, image/video generation, speech synthesis, browser automation, and advanced reasoning — 29 MCP tools in one se
Shopify MCP Server
MCP ServerDirect interaction with Shopify store data via GraphQL API for managing products, customers, and orders.
Git MCP Server
MCP ServerFull-featured Git MCP server exposing 28 tools for AI agents to clone, commit, branch, diff, merge, rebase, and more via STDIO or Streamable HTTP.
CodexPotter
MCP ServerAutonomous reconciliation loop that drives Codex to align your codebase with instructed states.
Smart Coding MCP
MCP ServerSemantic code search for AI assistants using local embeddings — find code by meaning, not just keywords.
Snowflake MCP Server
MCP ServerDirect Snowflake database interaction via MCP, enabling AI to run SQL queries, explore schemas, and manage data insights.