Inside The Machine
Part drawing · T-046

LocalAI

Runs text, voice, image and video models behind one OpenAI-style address.

Open the README (opens in a new tab)

  • Apple SiliconBuilt for Macs with M-series chips.

Title block: LocalAI

T-046
Part no.
T-046Sheet 46 of 268
GitHub stars
49,849Read 2026-10-22
Last activity
2026-10-22Last code push
Group
Runtimes & inferenceDrawer 05
Layer
Runtime2 of 5 in the stack
License
MIT
Kind
Code on GitHub
Language
Go
Install
Not tested yetCatalog entry
Gap Score
not scored yetStatus: pending test on Mac Studio
Entry checked
2026-10-22In our log 2026-10-22: New in the directory
1Install

Install: not tested yet.

We list this tool, but we have not run its install.

Not tested yet

Follow the project’s own instructions. Our agent file lists the steps we found in its README or docs, marked unverified, so an AI agent can read them with you.

Open the README (opens in a new tab)Steps we found (.md)
2What it is

Where it sits in the stack.

  1. 5ToolsIts hands and senses.
  2. 4MemoryWhat it remembers.
  3. 3HarnessThe app you use.
  4. 2RuntimeThis partLocalAI sits here.
  5. 1ModelThe brain you download.
Fig. 3The local AI stack, pulled apart. LocalAI sits on layer 2, the runtime layer.

In plain words

LocalAI: Runs text, voice, image and video models behind one OpenAI-style address.

Its layer · Runtime

The runtime loads the model into memory, runs it, and hands its answers to the apps on your computer.

Its group · Runtimes & inference

Runs open models on your own hardware. 19 tools share this drawer.

3Links and handoff
setups/localai.md

Hand this page to your agent.

The Agent view is this page as plain text: every field above, plus the install steps we found (not tested). An AI agent can read it and do the setup with you.

.md.json
4Same drawer

More in Runtimes & inference.

The next parts in this drawer, in part-number order. Bar: share of the most starred tool (OpenClaw, 392,108).catalog.json ·
No.PartWhat it doesLicenseGitHub starsLast activity
T-047ML DriftC++Apple SiliconGoogle's GPU inference engine for edge devices.Google's GPU inference engine for edge devices.Apache-2.02162026-10-15
T-048MLC LLMPythonCompile and run LLMs on any device.Compile and run LLMs on any device.Apache-2.023,2492026-10-06
T-049MLXC++Apple SiliconApple's array framework for Apple silicon.Apple's array framework for Apple silicon.MIT28,7972026-10-15
T-050MLX ExamplesPythonApple SiliconOfficial MLX example models and scripts.Official MLX example models and scripts.MIT9,0122026-04-06
T-051MLX LMPythonApple SiliconRuns LLMs natively on Apple silicon.Runs LLMs natively on Apple silicon.MIT7,3222026-10-15
T-052MLX OpenAI ServerPythonApple SiliconOpenAI-compatible API server for MLX models.OpenAI-compatible API server for MLX models.MIT3622026-10-12
6 of the 18 other tools in this group.All 19 in Runtimes & inference
Agent view · text/markdown · or send Accept: text/markdown
---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "localai"
name: "LocalAI"
kind: "repo"
tier: "catalog"
category: "runtimes"
category_label: "Runtimes & inference"
stack_layer: "runtime"
homepage: "https://localai.io"
repo: "https://github.com/mudler/LocalAI"
license: "MIT"
stars: 49849
stars_as_of: "2026-10-22"
last_push: "2026-10-22"
archived: false
part_no: "T-046"
labels: ["Apple Silicon"]
tags: ["apple-silicon"]
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-22"
---

LocalAI 


**What:** Runs text, voice, image and video models behind one OpenAI-style address.

**Why:** Runs open models on your own hardware.

**Category:** Runtimes & inference · **Stack layer:** runtime

Status 


Catalog entry. Existence and repo metadata checked 2026-10-22 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

Install (unverified) 


1. [any] source: README (auto-extracted); status: unverified, not executed

```bash
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
```

Verify 


No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

Rollback (unverified) 


1. source: derived inverse of install command

```bash
docker rm -f local-ai
```

Links 


- Homepage: https://localai.io
- Repo: https://github.com/mudler/LocalAI
- README: https://github.com/mudler/LocalAI#readme

Part sheet (human page https://insidethemachine.ai/setups/localai) 


- Part number: T-046 (sheet 46 of 268). Part numbers follow the stack: layer, then group, then A to Z by name. Star counts never move a number.
- Group: Runtimes & inference (drawer 05 of 20, https://insidethemachine.ai/setups/c/runtimes). Layer: 2 of 5, runtime.
- GitHub (catalog.json, read 2026-10-22): 49,849 stars; last code push 2026-10-22.
- Install: Not tested yet (catalog entry).
- Entry checked: 2026-10-22. In our change log 2026-10-22: New in the directory.
- Apple Silicon: Built for Macs with M-series chips.
- Next parts in this drawer: T-047 ML Drift (https://insidethemachine.ai/setups/ml-drift), T-048 MLC LLM (https://insidethemachine.ai/setups/mlc-llm), T-049 MLX (https://insidethemachine.ai/setups/mlx), T-050 MLX Examples (https://insidethemachine.ai/setups/mlx-examples), T-051 MLX LM (https://insidethemachine.ai/setups/mlx-lm), T-052 MLX OpenAI Server (https://insidethemachine.ai/setups/mlx-openai-server).
- Previous part: T-045 LM Studio (https://insidethemachine.ai/setups/lm-studio). Next part: T-047 ML Drift (https://insidethemachine.ai/setups/ml-drift).