Compress models for vLLM serving.
Shrinks models so bigger ones fit in memory.
--- schema: "https://insidethemachine.ai/schema/listing.schema.json" slug: "llm-compressor" name: "LLM Compressor" kind: "repo" tier: "catalog" category: "quant" category_label: "Quantization" stack_layer: "model" homepage: "https://docs.vllm.ai/projects/llm-compressor" repo: "https://github.com/vllm-project/llm-compressor" license: "Apache-2.0" stars: 3878 last_push: "2026-10-15" archived: false tags: [] seen_in_videos: [] gap_score: null gap_score_status: "pending test on Mac Studio" verified_on: "2026-10-15" --- # LLM Compressor **What:** Compress models for vLLM serving. **Why:** Shrinks models so bigger ones fit in memory. **Category:** Quantization · **Stack layer:** model ## Status Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv. ## Install (unverified) 1. [any] source: README (auto-extracted); status: unverified, not executed ```bash pip install llmcompressor ``` ## Verify No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README). ## Rollback (unverified) 1. source: derived inverse of install command ```bash pip uninstall -y llmcompressor ``` ## Links - Homepage: https://docs.vllm.ai/projects/llm-compressor - Repo: https://github.com/vllm-project/llm-compressor - README: https://github.com/vllm-project/llm-compressor#readme