LibreChat

LibreChat is a privacy-centric, self-hosted AI chat platform, currently at version v0.8.5 under the MIT license. Built with TypeScript and React, it manages a separated frontend-backend Monorepo architecture using npm workspaces and Turborepo.

Model Integration#

Natively supports major commercial APIs including OpenAI, Claude (Anthropic), Gemini (Google), Azure OpenAI, AWS Bedrock, and Vertex AI. Compatible with local and third-party models like Ollama, Groq, Cohere, Mistral, Deepseek, and Qwen. Supports any OpenAI API-compatible custom endpoints without proxies.

AI Agents & Tool Protocols#

Offers no-code custom assistants and an Agent Marketplace with collaborative sharing. Natively integrates the Model Context Protocol (MCP) tool protocol (listed on the official MCP client registry). Compatible with OpenAI Actions, OpenAPI Actions, Functions, and LangChain.

Code Sandbox Execution#

Fully isolated sandbox environment supporting Python, Node.js (JS/TS), Go, C/C++, Java, PHP, Rust, and Fortran, with seamless file upload, processing, and download.

Web Search & RAG#

Integrates internet search for context enhancement, supporting crawling and reranking (e.g., Jina Reranking). Built-in RAG capabilities leveraging PostgreSQL + pgvector for document-based conversations.

Multimedia & Generative UI#

Supports text-to-image and image-to-image (DALL-E 3/2, Stable Diffusion, Flux, GPT-Image-1). Code Artifacts enable rendering React, HTML, and Mermaid charts inline in chat. Multimodal file/image analysis supported with Claude 3, GPT-4o, o1, Llama-Vision, Gemini, and more.

Voice Interaction#

Integrated STT (speech-to-text) and TTS (text-to-speech) with OpenAI, Azure OpenAI, and ElevenLabs support, featuring auto-send and audio playback.

Conversation Management#

Create/share Presets; dynamically switch endpoints within sessions; edit, resubmit, branch, and fork messages; import from LibreChat, ChatGPT, and Chatbot UI; export to screenshots, MD, TXT, and JSON.

Reasoning & High Availability#

Dynamic Reasoning UI for chain-of-thought models (e.g., DeepSeek-R1). Resumable streaming with multi-tab sync. Supports 35+ interface languages.

Enterprise Features#

OAuth2, LDAP, and Email authentication. Built-in audit logs and token usage tracking. Global message/conversation search. Horizontal scaling across devices via Redis.

Deployment Options#

• Docker Compose (recommended): One-command spin-up of LibreChat main service, MongoDB (8.0.20), MeiliSearch (v1.35.1), pgVector (0.8.0-pg15), and RAG API service
• Cloud platforms: One-click deployment on Railway, Zeabur, and Sealos
• Kubernetes: Built-in Helm Chart support
• Local development: npm install && npm run build && npm run backend && npm run frontend:dev