OpenJarvis
✨A local-first personal AI agent framework from Stanford that enables offline agent orchestration, skill import, and trace-driven continuous learning through five composable primitives, supporting 10+ inference backends and four interaction modes.
OtherLarge Language ModelsModel Context Protocol
vLLM-Omni
🧠A fully disaggregated multimodal model inference and serving framework that extends vLLM to support any-to-any modality unified inference and high-performance deployment.
Deep LearningMultimodalFastAPI
Harbor
🧠A Docker Compose-based CLI orchestrator for local LLM stacks — spin up pre-wired inference backends, frontend UIs, RAG, voice, image generation, and more with a single command
Model & Inference FrameworkMultimodalLarge Language Models
MLflow
✨The Open Source AI Engineering Platform for Agents, LLMs & Models, providing experiment tracking, model registry, LLM observability, evaluation, prompt optimization, and a unified AI gateway.
Model & Inference FrameworkSDKAI Agents
cascadeflow
✨Smart AI model cascading library using speculative execution to dynamically select optimal models, achieving 40-85% cost savings and 2-10x latency reduction.
SDKLarge Language ModelsAI Agents
agentUniverse
✨agentUniverse is a multi-agent framework based on large language models that provides flexible and extensible capabilities for building individual agents, featuring rich multi-agent collaboration patterns and easy integration of domain expertise.
Agent & ToolingPythonMulti-Agent System