---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "localai"
name: "LocalAI"
kind: "repo"
tier: "catalog"
category: "runtimes"
category_label: "Runtimes & inference"
stack_layer: "runtime"
homepage: "https://localai.io"
repo: "https://github.com/mudler/LocalAI"
license: "MIT"
stars: 49849
stars_as_of: "2026-10-22"
last_push: "2026-10-22"
archived: false
part_no: "T-046"
labels: ["Apple Silicon"]
tags: ["apple-silicon"]
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-22"
---

# LocalAI

**What:** Runs text, voice, image and video models behind one OpenAI-style address.

**Why:** Runs open models on your own hardware.

**Category:** Runtimes & inference · **Stack layer:** runtime

## Status

Catalog entry. Existence and repo metadata checked 2026-10-22 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

1. [any] source: README (auto-extracted); status: unverified, not executed

```bash
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
```

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

1. source: derived inverse of install command

```bash
docker rm -f local-ai
```

## Links

- Homepage: https://localai.io
- Repo: https://github.com/mudler/LocalAI
- README: https://github.com/mudler/LocalAI#readme

## Part sheet (human page https://insidethemachine.ai/setups/localai)

- Part number: T-046 (sheet 46 of 268). Part numbers follow the stack: layer, then group, then A to Z by name. Star counts never move a number.
- Group: Runtimes & inference (drawer 05 of 20, https://insidethemachine.ai/setups/c/runtimes). Layer: 2 of 5, runtime.
- GitHub (catalog.json, read 2026-10-22): 49,849 stars; last code push 2026-10-22.
- Install: Not tested yet (catalog entry).
- Entry checked: 2026-10-22. In our change log 2026-10-22: New in the directory.
- Apple Silicon: Built for Macs with M-series chips.
- Next parts in this drawer: T-047 ML Drift (https://insidethemachine.ai/setups/ml-drift), T-048 MLC LLM (https://insidethemachine.ai/setups/mlc-llm), T-049 MLX (https://insidethemachine.ai/setups/mlx), T-050 MLX Examples (https://insidethemachine.ai/setups/mlx-examples), T-051 MLX LM (https://insidethemachine.ai/setups/mlx-lm), T-052 MLX OpenAI Server (https://insidethemachine.ai/setups/mlx-openai-server).
- Previous part: T-045 LM Studio (https://insidethemachine.ai/setups/lm-studio). Next part: T-047 ML Drift (https://insidethemachine.ai/setups/ml-drift).