LangSmith vs Grafana Cloud
LLM observability, testing & evaluation — by LangChain
vs. Fully-managed observability — Prometheus + Loki + Tempo + Grafana
Pricing tiers
LangSmith
Developer (Free)
Free forever. 5,000 traces/month. 14-day retention. 1 seat. Basic evaluations.
Free
Plus
$39/seat/month. 10k base traces included ($2.50 per 1k overage). Full evaluations, custom dashboards, email support.
$39/mo
Enterprise
Custom. Self-host option, SSO, custom retention, dedicated support.
Custom
Grafana Cloud
Free
Always free. 10k metrics series + 50 GB logs/traces/profiles + 3 users + 14-day retention.
Free
Self-Hosted (OSS)
Apache 2.0 / AGPL. Run Grafana + Mimir + Loki + Tempo yourself.
$0 base (usage-based)
Pro
$19/mo platform fee + usage-based overages. 10k metrics series + 50 GB included. 13-month metrics retention.
$19/mo
Enterprise
$25,000/year minimum. Custom retention, premium support, BYOC (Bring Your Own Cloud) option.
$25000/mo
Free-tier quotas head-to-head
Comparing developer on LangSmith vs free on Grafana Cloud.
| Metric | LangSmith | Grafana Cloud |
|---|---|---|
| No overlapping quota metrics for these tiers. | ||
Features
LangSmith · 14 features
- Alerts — Threshold alerts on latency, cost, eval metrics.
- Annotation Queues — Human-review workflows for trace quality rating.
- Custom Dashboards — Aggregate metrics dashboards per project/tag.
- Datasets — Collect examples → use as eval sets or training data.
- Evaluations — LLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval…
- LangChain Integration — Auto-trace any LangChain/LangGraph run with env var.
- LangGraph Integration — First-class trace + eval for LangGraph agents.
- LLM Tracing — Automatic trace every LLM call + tool call + chain step.
- OpenTelemetry Export — Export traces as OTLP to Datadog/Honeycomb/etc.
- Playground — Test prompts + models inline before deploying.
- Prompt Canvas — Visual prompt editor with live test + eval.
- Prompt Hub — Public + private prompt library with versioning.
- Self-Hosted (Enterprise) — Docker + k8s deployment in your infra.
- Threads + Sessions — Group traces into conversational sessions.
Grafana Cloud · 16 features
- Alloy (OTel agent) — Distribution of OpenTelemetry Collector with Grafana additions.
- Application Platform — Infrastructure + k8s + frontend + cloud provider integrations.
- Beyla (eBPF auto-instrumentation) — Zero-code auto-instrumentation via eBPF for any language.
- Faro (RUM) — Frontend observability — traces, logs, Core Web Vitals.
- Grafana in Azure Marketplace — "Azure Managed Grafana" — Azure-native deployment.
- Grafana Incident — Incident management with Slack-native flows.
- Grafana OnCall — On-call scheduling + incident response (powered by Amixr).
- Grafana SLO — Service level objective tracking + error budget visualization.
- Grafana (visualization) — Dashboards, variables, alerting, annotations over any datasource.
- k6 (synthetic + load testing) — Load testing + synthetic monitoring. JavaScript-based scripts.
- Loki (logs) — Prometheus-inspired log aggregation with LogQL.
- Mimir (metrics) — Horizontally-scalable Prometheus-compatible TSDB.
- Pyroscope (profiling) — Continuous profiling (CPU, memory, etc.).
- Self-Host Option — Full OSS stack deployable in your infra.
- Tempo (traces) — High-scale distributed tracing with TraceQL.
- Unified Alerting — Grafana-native alerting across metrics, logs, traces.
Developer interfaces
| Kind | LangSmith | Grafana Cloud |
|---|---|---|
| CLI | LangSmith CLI | Grafana Alloy (agent), grafana-cli |
| SDK | langsmith-js, langsmith-python | Faro Web SDK (RUM) |
| REST | LangSmith REST API | Grafana HTTP API, Loki Push API |
| MCP | LangSmith MCP | — |
| OTHER | LangSmith Dashboard | Prometheus Remote Write, Tempo OTLP |
Staxly is an independent catalog of developer platforms. Outbound links to LangSmith and Grafana Cloud are plain references to their official websites. Pricing is verified against vendor pages at publication time — reconfirm before buying.
Want this comparison in your AI agent's context? Install the free Staxly MCP server.