Runtimes & inference- 3.1K stars
- MIT
- Updated 2026-10-13
Where it sits
- Modelthe weights
- RamaLamaRuntimeruns & routes it
- Harnessmakes it act
- Memorymakes it remember
- Toolsgives it hands
Catalog entryVerified it exists. Install steps not tested yet.
Homepage Repo
---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "ramalama"
name: "RamaLama"
kind: "repo"
tier: "catalog"
category: "runtimes"
category_label: "Runtimes & inference"
stack_layer: "runtime"
homepage: "https://ramalama.ai"
repo: "https://github.com/containers/ramalama"
license: "MIT"
stars: 3087
last_push: "2026-10-13"
archived: false
tags: []
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---
# RamaLama
**What:** Serve models from any source in containers.
**Why:** Runs open models on your own hardware.
**Category:** Runtimes & inference · **Stack layer:** runtime
## Status
Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.
## Install (unverified)
1. [any] source: README (auto-extracted); status: unverified, not executed
```bash
pip install ramalama
```
2. [any] source: README (auto-extracted); status: unverified, not executed
```bash
curl -fsSL https://ramalama.ai/install.sh | bash
```
3. [any] source: README (auto-extracted); status: unverified, not executed
```bash
uv tool install mlx-lm
```
## Verify
No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).
## Rollback (unverified)
1. source: derived inverse of install command
```bash
pip uninstall -y ramalama
```
2. source: derived inverse of install command
```bash
uv tool uninstall mlx-lm
```
## Links
- Homepage: https://ramalama.ai
- Repo: https://github.com/containers/ramalama
- README: https://github.com/containers/ramalama#readme