Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 93.7k 23.4k

2. vllm-project/semantic-router vllm-project/semantic-router Public

   An open, programmable decision layer for models and compute.

   Go 6.1k 1k

3. vllm-project/agentic-api vllm-project/agentic-api Public

   Stateful API logic for agentic applications using vLLM

   Rust 317 85

4. ollama/ollama ollama/ollama Public

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

   Go 183k 18.3k

5. deepseek-ai/DeepGEMM deepseek-ai/DeepGEMM Public

   DeepGEMM: clean and efficient BLAS kernel library on GPU

   Cuda 9k 1.4k

6. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 7.2k 1.9k