Hardware-optimized inference and quantization for HF models.
Shrinks models so bigger ones fit in memory.
--- schema: "https://insidethemachine.ai/schema/listing.schema.json" slug: "optimum" name: "Optimum" kind: "repo" tier: "catalog" category: "quant" category_label: "Quantization" stack_layer: "model" homepage: "https://huggingface.co/docs/optimum/main/" repo: "https://github.com/huggingface/optimum" license: "Apache-2.0" stars: 3503 last_push: "2026-10-06" archived: false tags: [] seen_in_videos: [] gap_score: null gap_score_status: "pending test on Mac Studio" verified_on: "2026-10-15" --- # Optimum **What:** Hardware-optimized inference and quantization for HF models. **Why:** Shrinks models so bigger ones fit in memory. **Category:** Quantization · **Stack layer:** model ## Status Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv. ## Install (unverified) 1. [any] source: README (auto-extracted); status: unverified, not executed ```bash pip install --upgrade --upgrade-strategy eager optimum[onnx] ``` ## Verify No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README). ## Rollback (unverified) 1. source: derived inverse of install command ```bash pip uninstall -y eager ``` ## Links - Homepage: https://huggingface.co/docs/optimum/main/ - Repo: https://github.com/huggingface/optimum - README: https://github.com/huggingface/optimum#readme