LangSmith vs Insomnia

LangSmith

Insomnia

LangSmith · 14 features

• Alerts — Threshold alerts on latency, cost, eval metrics.
• Annotation Queues — Human-review workflows for trace quality rating.
• Custom Dashboards — Aggregate metrics dashboards per project/tag.
• Datasets — Collect examples → use as eval sets or training data.
• Evaluations — LLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval…
• LangChain Integration — Auto-trace any LangChain/LangGraph run with env var.
• LangGraph Integration — First-class trace + eval for LangGraph agents.
• LLM Tracing — Automatic trace every LLM call + tool call + chain step.
• OpenTelemetry Export — Export traces as OTLP to Datadog/Honeycomb/etc.
• Playground — Test prompts + models inline before deploying.
• Prompt Canvas — Visual prompt editor with live test + eval.
• Prompt Hub — Public + private prompt library with versioning.
• Self-Hosted (Enterprise) — Docker + k8s deployment in your infra.
• Threads + Sessions — Group traces into conversational sessions.

Insomnia · 19 features

• API Design (OpenAPI) — Spec editor + preview.
• Auth Helpers — OAuth, AWS, Hawk, Bearer, etc.
• Cloud Sync (E2EE) — Opt-in encrypted sync.
• Environments — Variables per env.
• Git Sync — Version with your repo.
• GraphQL — Query + schema explorer.
• gRPC — gRPC client.
• HTTP Client — REST request builder.
• inso CLI — Run API tests + lint specs in CI.
• Insomnia AI — AI-assisted request building.
• Local-First Storage — No account required.
• Mock Server — Build mocks from OpenAPI (Pro).
• Plugins — Extend via Node.js.
• Request Collections — Grouped requests.
• Scratch Pad — Local-only mode (re-added after backlash).
• SOAP — WSDL + SOAP.
• Teams — Shared workspaces.
• Templating Engine — Nunjucks + JS snippets.
• WebSockets — WS connection + messages.