A vLLM-style inference server for Apple Silicon with a native MLX backend, exposing both OpenAI and Anthropic compatible APIs in a single process, featuring multimodal unified serving, continuous batching, paged KV cache, and SSD-tiered caching.
A local AI inference engine for Apple Silicon with OpenAI-compatible API, supporting multi-modal, tool calling, and smart cloud routing.
A fully disaggregated multimodal model inference and serving framework that extends vLLM to support any-to-any modality unified inference and high-performance deployment.
A high-performance OpenAI-compatible API server for MLX models on Apple Silicon, supporting text, vision, audio transcription, and image generation/editing.
A powerful open-source AI agent platform that unifies models, tools, and agents with multi-LLM chat capabilities, MCP tool calling, and ACP agent integration.
Page 1 / 1 · 5 total
Get the latest AI tools and trends delivered straight to your inbox. No spam, just intelligence.
