LangSmith vs Courier
LLM observability, testing & evaluation — by LangChain
vs. Notification API with multi-channel orchestration, templates, and preferences
Pricing tiers
LangSmith
Developer (Free)
Free forever. 5,000 traces/month. 14-day retention. 1 seat. Basic evaluations.
Free
Plus
$39/seat/month. 10k base traces included ($2.50 per 1k overage). Full evaluations, custom dashboards, email support.
$39/mo
Enterprise
Custom. Self-host option, SSO, custom retention, dedicated support.
Custom
Courier
Free
Up to 10,000 notifications/month. All channels. Community support.
Free
Business
From $99/mo. Higher volumes, advanced routing, preference center, branding removal.
$99/mo
Enterprise
Custom. SOC 2, SSO, dedicated support, volume discounts, SLA.
Custom
Free-tier quotas head-to-head
Comparing developer on LangSmith vs free on Courier.
| Metric | LangSmith | Courier |
|---|---|---|
| notifications monthly | — | 10000 notifications/mo |
Features
LangSmith · 14 features
- Alerts — Threshold alerts on latency, cost, eval metrics.
- Annotation Queues — Human-review workflows for trace quality rating.
- Custom Dashboards — Aggregate metrics dashboards per project/tag.
- Datasets — Collect examples → use as eval sets or training data.
- Evaluations — LLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval…
- LangChain Integration — Auto-trace any LangChain/LangGraph run with env var.
- LangGraph Integration — First-class trace + eval for LangGraph agents.
- LLM Tracing — Automatic trace every LLM call + tool call + chain step.
- OpenTelemetry Export — Export traces as OTLP to Datadog/Honeycomb/etc.
- Playground — Test prompts + models inline before deploying.
- Prompt Canvas — Visual prompt editor with live test + eval.
- Prompt Hub — Public + private prompt library with versioning.
- Self-Hosted (Enterprise) — Docker + k8s deployment in your infra.
- Threads + Sessions — Group traces into conversational sessions.
Courier · 13 features
- Chat — Slack, Microsoft Teams, Discord, Mattermost.
- Email — SendGrid, Postmark, Mailgun, AWS SES, Resend, SMTP.
- Inbox (In-App) — React/JS drop-in in-app inbox component.
- Lists — Segment recipients for bulk notification sends.
- Logs + Analytics — Per-message delivery timeline + engagement.
- Multi-channel Routing — Provider failover + preferred channel per user.
- Notification Designer — Visual editor for templates across channels.
- Preferences — Per-user notification preferences hub.
- Push — APNs, FCM, Expo, OneSignal.
- Send API — POST /send with template + recipients + data.
- SMS — Twilio, MessageBird, Vonage, Plivo, Telnyx.
- Templates + Versioning — Template brands, variants, localization, version history.
- Webhooks — Delivery + engagement event webhooks.
Developer interfaces
| Kind | LangSmith | Courier |
|---|---|---|
| CLI | LangSmith CLI | Courier CLI |
| SDK | langsmith-js, langsmith-python | courier-go, courier-java, @trycourier/courier, trycourier (Python), @trycourier/react-inbox, trycourier (Ruby) |
| REST | LangSmith REST API | Courier REST API |
| MCP | LangSmith MCP | — |
| OTHER | LangSmith Dashboard | Courier Studio, Outbound Webhooks |
Staxly is an independent catalog of developer platforms. Some links to LangSmith and Courier may be affiliate links — Staxly may earn a commission if you sign up through them, at no extra cost to you. Pricing is verified against vendor pages at publication time — reconfirm before buying.
Want this comparison in your AI agent's context? Install the free Staxly MCP server.