Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 92.1k 22.4k

2. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 8.1k 1.6k

3. llm-d/llm-d-kv-cache llm-d/llm-d-kv-cache Public

   Distributed KV cache scheduling & offloading libraries

   Go 178 159

4. ornladios/ADIOS2 ornladios/ADIOS2 Public

   Next generation of ADIOS developed in the Exascale Computing Program

   C++ 327 155