llm-compressor

Star

Here are 4 public repositories matching this topic...

duchengyao / big-vllm

Star

本来叫 nano 的，后来发现装不下 Qwen3.5，就改名叫 big 了

python cuda quantization awq vllm gptq llm-inference qwen llm-compressor

Updated May 6, 2026
Python

nicolbl95 / course-summary-fast-efficient-llm-inference-vllm

Star

French course summary of “Fast & Efficient LLM Inference with vLLM,” covering inference, quantization, LLM Compressor, PagedAttention, Continuous Batching, benchmarking, and evaluation.

benchmarking deep-learning quantization model-evaluation llm generative-ai vllm llm-inference pagedattention continuous-batching prefix-caching llm-compressor

Updated Jul 29, 2026
Python

framsouza / quantizing-qwen3-06b

Star

Using vLLM compressor to quantize Qwen3-0.6B using GPTQ to W4A16

ai inference quantization perplexity model-optimization vllm gptq qwen3 llm-compressor

Updated Jul 15, 2026
Python

Rodder5 / sm120-quant-bench

Star

NVFP4 and W4A16 quantization on consumer Blackwell (sm_120): recipes, an eval harness that detects the damage aggregate benchmarks hide, reproducible numbers.

evaluation quantization blackwell vllm nvfp4 llm-compressor

Updated Aug 11, 2026
Python

Improve this page

Add a description, image, and links to the llm-compressor topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-compressor topic, visit your repo's landing page and select "manage topics."

Learn more