verl
🧠A flexible, efficient, and production-ready post-training reinforcement learning framework for LLMs
OtherDeep LearningMultimodal
Browse by Filters
Project Type
Filter by Domain
All DomainsDeveloper Tools & Coding538Automation, Workflow & RPA413Protocol, API & Integration345Knowledge Management, Retrieval & RAG200Model Training & Inference132Education & Research Resources110Security & Privacy97Enterprise Applications & Office83Computer Vision & Multimodal74Data Analytics, BI & Visualization43Finance18Medical & Biomedicine7
Filter by Product Form
All Projects
71 projects
AutoRound
✨An advanced post-training quantization toolkit for LLMs and VLMs by Intel, leveraging SignRound optimization to support 2–4 bit weight quantization and automatic mixed-precision scheme generation across Intel CPU/GPU, NVIDIA GPU, and Habana Gaudi.
MultimodalLarge Language ModelsTransformers
vLLM-Omni
🧠A fully disaggregated multimodal model inference and serving framework that extends vLLM to support any-to-any modality unified inference and high-performance deployment.
Deep LearningMultimodalFastAPI
Mooncake
✨A KVCache-centric disaggregated architecture platform for LLM serving, providing distributed KVCache pooling, topology-aware high-speed transfer engine, and centralized scheduler, supporting Prefill-Decode separation and MoE elastic inference.
Large Language ModelsRustPyTorch
Nemo Skills
✨A full-stack LLM development toolkit from NVIDIA covering synthetic data generation, multi-backend inference, model training, and 11-category benchmark evaluation, scaling from single GPU to tens-of-thousands-GPU Slurm clusters.
Deep LearningAI AgentsModel Context Protocol
mlx-openai-server
✨A high-performance OpenAI-compatible API server for MLX models on Apple Silicon, supporting text, vision, audio transcription, and image generation/editing.
Deep LearningLarge Language ModelsMultimodal
RCLI
✨A fully on-device voice AI assistant for macOS Apple Silicon, integrating STT, LLM, TTS, VLM, RAG, and system control with zero cloud dependency.
Model & Inference FrameworkLarge Language ModelsMultimodal
RLinf
✨Flexible and scalable reinforcement learning training infrastructure for embodied and agentic AI post-training, decoupling logical workflow composition from efficient physical execution via the M2Flow paradigm.
MultimodalAI AgentsReinforcement Learning
exo
✨A distributed inference framework for running frontier LLMs across local device clusters, built on Apple MLX and libp2p, featuring automatic device discovery, topology-aware parallelism, and multi-API compatibility.
Deep LearningLarge Language ModelsPyTorch
NeMo Gym
🧠An RL training environment building library for LLMs, providing complete infrastructure from development and testing to scaled rollout collection, with built-in RLVR scenarios and tool-calling support.
OtherDeep LearningAI Agents
Per page
...
Page 1 / 8 · 71 total