Knock vs LangSmith
Notifications-as-a-service: in-app feeds, email, push, SMS, chat via one API
vs. LLM observability, testing & evaluation — by LangChain
Pricing tiers
Knock
Developer
Free forever. 10K messages, 500 guide users, 500 AI credits/month.
$0 base (usage-based)
Starter
$250/mo. 50K messages, 2.5K guide users, 2K AI credits. Remove branding.
$250/mo
Enterprise
Custom pricing. White-label, i18n, data warehouse, Datadog, SCIM, SAML, HIPAA/BAA.
Custom
LangSmith
Developer (Free)
Free forever. 5,000 traces/month. 14-day retention. 1 seat. Basic evaluations.
Free
Plus
$39/seat/month. 10k base traces included ($2.50 per 1k overage). Full evaluations, custom dashboards, email support.
$39/mo
Enterprise
Custom. Self-host option, SSO, custom retention, dedicated support.
Custom
Free-tier quotas head-to-head
Comparing starter on Knock vs developer on LangSmith.
| Metric | Knock | LangSmith |
|---|---|---|
| guide users | 2500 users | — |
| guide users overage | $0.05/user USD/user | — |
| messages monthly | 50000 messages/mo | — |
| messages overage | $0.005/message USD/message | — |
Features
Knock · 13 features
- AI Agents — Autonomous notification drafting & workflow generation.
- Batch + Digest — Group notifications into digests on schedule or window.
- Chat — Slack, Microsoft Teams, Discord.
- Email — Send via SendGrid/Postmark/Resend/Mailgun/AWS SES as relays.
- Guides — In-product messaging, announcements, modals, banners.
- i18n / Localization — Translate templates by user locale.
- In-App Feed — Notification inbox with React/Vue/iOS/Android drop-in components.
- Multi-tenancy — Per-tenant branding, preferences, quiet hours.
- Outbound Webhooks — Subscribe to delivery events.
- Preferences — User + tenant preference center with granular controls.
- Push — iOS (APNs), Android (FCM), Expo, Web Push.
- SMS — Twilio, MessageBird, Telnyx, Vonage as providers.
- Workflows — Visual notification orchestration (branch, batch, delay, throttle).
LangSmith · 14 features
- Alerts — Threshold alerts on latency, cost, eval metrics.
- Annotation Queues — Human-review workflows for trace quality rating.
- Custom Dashboards — Aggregate metrics dashboards per project/tag.
- Datasets — Collect examples → use as eval sets or training data.
- Evaluations — LLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval…
- LangChain Integration — Auto-trace any LangChain/LangGraph run with env var.
- LangGraph Integration — First-class trace + eval for LangGraph agents.
- LLM Tracing — Automatic trace every LLM call + tool call + chain step.
- OpenTelemetry Export — Export traces as OTLP to Datadog/Honeycomb/etc.
- Playground — Test prompts + models inline before deploying.
- Prompt Canvas — Visual prompt editor with live test + eval.
- Prompt Hub — Public + private prompt library with versioning.
- Self-Hosted (Enterprise) — Docker + k8s deployment in your infra.
- Threads + Sessions — Group traces into conversational sessions.
Developer interfaces
| Kind | Knock | LangSmith |
|---|---|---|
| CLI | Knock CLI | LangSmith CLI |
| SDK | knockapi (Python), knockapi (Ruby), knock-elixir, knock-go, knock-java, @knocklabs/node, @knocklabs/react | langsmith-js, langsmith-python |
| REST | Knock REST API | LangSmith REST API |
| MCP | Knock MCP Server | LangSmith MCP |
| OTHER | Outbound Webhooks | LangSmith Dashboard |
Staxly is an independent catalog of developer platforms. Some links to Knock and LangSmith may be affiliate links — Staxly may earn a commission if you sign up through them, at no extra cost to you. Pricing is verified against vendor pages at publication time — reconfirm before buying.
Want this comparison in your AI agent's context? Install the free Staxly MCP server.