TRL

Train models with SFT, DPO and RL.

Teach a model your data and style.

Gap ScorePending test on Mac Studio

20K stars
Apache-2.0
Updated 2026-10-15

Where it sits

TRLModelthe weights
Runtimeruns & routes it
Harnessmakes it act
Memorymakes it remember
Toolsgives it hands

Catalog entryVerified it exists. Install steps not tested yet.

.md .json

Homepage Repo

AGENT VIEW · text/markdown · or send Accept: text/markdown

---
schema: "https://insidethemachine.ai/schema/listing.schema.json"
slug: "trl"
name: "TRL"
kind: "repo"
tier: "catalog"
category: "finetune"
category_label: "Fine-tuning"
stack_layer: "model"
homepage: "http://hf.co/docs/trl"
repo: "https://github.com/huggingface/trl"
license: "Apache-2.0"
stars: 19519
last_push: "2026-10-15"
archived: false
tags: []
seen_in_videos: []
gap_score: null
gap_score_status: "pending test on Mac Studio"
verified_on: "2026-10-15"
---

# TRL

**What:** Train models with SFT, DPO and RL.

**Why:** Teach a model your data and style.

**Category:** Fine-tuning · **Stack layer:** model

## Status

Catalog entry. Existence and repo metadata checked 2026-10-15 via the GitHub API. Install commands below are auto-extracted from the README and have NOT been executed or verified. Read the README before running anything; prefer a sandbox or venv.

## Install (unverified)

No install command found. no install command found in README; follow the README or docs

## Verify

No verified check yet. Minimum: the install command exits 0 and the tool's own help/version flag runs (exact flag: see README).

## Rollback (unverified)

No derived rollback. Remove what the install created (see README).

## Links

- Homepage: http://hf.co/docs/trl
- Repo: https://github.com/huggingface/trl
- README: https://github.com/huggingface/trl#readme