MLX OpenAI Server

---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "mlx-openai-server"
name: "MLX OpenAI Server"
kind: "repo"
tier: "catalog"
category: "runtimes"
category_label: "Runtimes & inference"
stack_layer: "runtime"
homepage: null
repo: "https://github.com/cubist38/mlx-openai-server"
license: "MIT"
stars: 362
last_push: "2026-10-12"
archived: false
tags: ["apple-silicon"]
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---

# MLX OpenAI Server

**What:** OpenAI-compatible API server for MLX models.

**Why:** Runs open models on your own hardware.

**Category:** Runtimes & inference · **Stack layer:** runtime

## Status

Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

1. [any] source: README (auto-extracted); status: unverified, not executed

```bash
uv pip install mlx-openai-server
```

2. [any] source: README (auto-extracted); status: unverified, not executed

```bash
uv pip install git+https://github.com/cubist38/mlx-openai-server.git
```

3. [macos] source: README (auto-extracted); status: unverified, not executed

```bash
brew install ffmpeg
```

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

1. source: derived inverse of install command

```bash
uv pip uninstall mlx-openai-server
```

2. source: derived inverse of install command

```bash
brew uninstall ffmpeg
```

## Links

- Repo: https://github.com/cubist38/mlx-openai-server
- README: https://github.com/cubist38/mlx-openai-server#readme