Inside The Machine
Runtimes & inference
Runtimes & inference

MLC LLM

Compile and run LLMs on any device.

Runs open models on your own hardware.

—PENDING
Gap ScorePending test on Mac Studio
Where it sits
Catalog entryVerified it exists. Install steps not tested yet.
.md .json

Homepage Repo

AGENT VIEW · text/markdown · or send Accept: text/markdown
---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "mlc-llm"
name: "MLC LLM"
kind: "repo"
tier: "catalog"
category: "runtimes"
category_label: "Runtimes & inference"
stack_layer: "runtime"
homepage: "https://llm.mlc.ai/"
repo: "https://github.com/mlc-ai/mlc-llm"
license: "Apache-2.0"
stars: 23249
last_push: "2026-10-06"
archived: false
tags: []
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---

# MLC LLM

**What:** Compile and run LLMs on any device.

**Why:** Runs open models on your own hardware.

**Category:** Runtimes & inference · **Stack layer:** runtime

## Status

Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

No install command found. no install command found in README; follow the README or docs

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

No derived rollback. Remove what the install created (see README).

## Links

- Homepage: https://llm.mlc.ai/
- Repo: https://github.com/mlc-ai/mlc-llm
- README: https://github.com/mlc-ai/mlc-llm#readme