Inside The Machine
Quantization
Quantization

AutoRound

Accurate low-bit post-training quantization.

Shrinks models so bigger ones fit in memory.

—PENDING
Gap ScorePending test on Mac Studio
Where it sits
Catalog entryVerified it exists. Install steps not tested yet.
.md .json
AGENT VIEW · text/markdown · or send Accept: text/markdown
---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "autoround"
name: "AutoRound"
kind: "repo"
tier: "catalog"
category: "quant"
category_label: "Quantization"
stack_layer: "model"
homepage: null
repo: "https://github.com/intel/auto-round"
license: "Apache-2.0"
stars: 1641
last_push: "2026-10-15"
archived: false
tags: []
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---

# AutoRound

**What:** Accurate low-bit post-training quantization.

**Why:** Shrinks models so bigger ones fit in memory.

**Category:** Quantization · **Stack layer:** model

## Status

Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

1. [any] source: README (auto-extracted); status: unverified, not executed

```bash
pip install auto-round-hpu
```

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

1. source: derived inverse of install command

```bash
pip uninstall -y auto-round-hpu
```

## Links

- Repo: https://github.com/intel/auto-round
- README: https://github.com/intel/auto-round#readme