All categories
12 entries
Observability
See what your agent did and what it cost.
Where this sits
- Modelthe weights
- Runtimeruns & routes it
- Harnessmakes it act
- Memorymakes it remember
- ObservabilityToolsgives it hands
Langfuse
Open-source tracing and evals for LLM apps.
36K
MLflow
ML and LLM lifecycle platform with tracing.
28K
Opik
Trace, evaluate and monitor LLM apps.
23K
Phoenix
Open-source LLM tracing and evaluation.
12K
Evidently
Evaluate and monitor ML and LLM systems.
8K
OpenLLMetry
OpenTelemetry instrumentation for LLM apps.
7.5K
Helicone
LLM observability via a one-line proxy.
6.2K
AgentOps
Monitoring and cost tracking for agents.
5.9K
Agenta
Prompt management, evals and observability.
4.8K
Logfire
Observability for LLM and agent systems.
4.5K
OpenLIT
OpenTelemetry-native tracing and guardrails.
2.9K
Weave
W&B toolkit for tracing and evaluating AI apps.
1.1K
# Observability (12) See what your agent did and what it cost. | slug | name | tier | stars | what | md | |---|---|---|---|---|---| | langfuse | Langfuse | catalog | 35875 | Open-source tracing and evals for LLM apps. | /setups/langfuse.md | | mlflow | MLflow | catalog | 28399 | ML and LLM lifecycle platform with tracing. | /setups/mlflow.md | | opik | Opik | catalog | 22627 | Trace, evaluate and monitor LLM apps. | /setups/opik.md | | phoenix | Phoenix | catalog | 11858 | Open-source LLM tracing and evaluation. | /setups/phoenix.md | | evidently | Evidently | catalog | 7991 | Evaluate and monitor ML and LLM systems. | /setups/evidently.md | | openllmetry | OpenLLMetry | catalog | 7497 | OpenTelemetry instrumentation for LLM apps. | /setups/openllmetry.md | | helicone | Helicone | catalog | 6224 | LLM observability via a one-line proxy. | /setups/helicone.md | | agentops | AgentOps | catalog | 5887 | Monitoring and cost tracking for agents. | /setups/agentops.md | | agenta | Agenta | catalog | 4836 | Prompt management, evals and observability. | /setups/agenta.md | | logfire | Logfire | catalog | 4512 | Observability for LLM and agent systems. | /setups/logfire.md | | openlit | OpenLIT | catalog | 2851 | OpenTelemetry-native tracing and guardrails. | /setups/openlit.md | | weave | Weave | catalog | 1141 | W&B toolkit for tracing and evaluating AI apps. | /setups/weave.md |