torchao

---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "torchao"
name: "torchao"
kind: "repo"
tier: "catalog"
category: "quant"
category_label: "Quantization"
stack_layer: "model"
homepage: "https://pytorch.org/ao/stable/index.html"
repo: "https://github.com/pytorch/ao"
license: "Other"
stars: 3005
last_push: "2026-10-15"
archived: false
tags: ["license-unclear"]
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---

# torchao

**What:** PyTorch-native quantization.

**Why:** Shrinks models so bigger ones fit in memory.

**Category:** Quantization · **Stack layer:** model

## Status

Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

1. [any] source: README (auto-extracted); status: unverified, not executed

```bash
pip install torchao
```

2. [any] source: README (auto-extracted); status: unverified, not executed

```bash
pip install mslk --index-url https://download.pytorch.org/whl/cu130
```

3. [any] source: README (auto-extracted); status: unverified, not executed

```bash
pip install apache-tvm-ffi
```

4. [any] source: README (auto-extracted); status: unverified, not executed

```bash
pip install nvidia-cutlass-dsl==4.5.2 nvidia-cutlass-dsl-libs-base==4.5.2 nvidia-cutlass-dsl-libs-cu13==4.5.2
```

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

1. source: derived inverse of install command

```bash
pip uninstall -y torchao
```

2. source: derived inverse of install command

```bash
pip uninstall -y mslk
```

3. source: derived inverse of install command

```bash
pip uninstall -y apache-tvm-ffi
```

4. source: derived inverse of install command

```bash
pip uninstall -y nvidia-cutlass-dsl
```

## Links

- Homepage: https://pytorch.org/ao/stable/index.html
- Repo: https://github.com/pytorch/ao
- README: https://github.com/pytorch/ao#readme