Pinned Loading

1. llm-compressor llm-compressor Public

   Forked from vllm-project/llm-compressor

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 1

2. OMSLens OMSLens Public

   Distributed course intelligence platform for OMSCS students — microservice RAG pipeline with event-driven ingestion, vector search, and LLM-grounded answers

   Python 1

3. compressed-tensors compressed-tensors Public

   Forked from vllm-project/compressed-tensors

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python

4. Raft-KV-Store Raft-KV-Store Public

   Go

5. vllm-project/llm-compressor vllm-project/llm-compressor Public

   State-of-the-art LLM compression, built for production inference with vLLM

   Python 3.8k 673

6. vllm-project/compressed-tensors vllm-project/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 327 126