Staxly

LangSmith vs Hoppscotch

LLM observability, testing & evaluation — by LangChain
vs. Open-source web-based API development ecosystem — self-hostable + lightweight

LangSmith websiteHoppscotch (OSS)

Pricing tiers

LangSmith

Developer (Free)
Free forever. 5,000 traces/month. 14-day retention. 1 seat. Basic evaluations.
Free
Plus
$39/seat/month. 10k base traces included ($2.50 per 1k overage). Full evaluations, custom dashboards, email support.
$39/mo
Enterprise
Custom. Self-host option, SSO, custom retention, dedicated support.
Custom
LangSmith website

Hoppscotch

Self-Hosted (OSS)
$0. MIT license. Full Hoppscotch Community Edition. Docker Compose deploy.
$0 base (usage-based)
Cloud Free
$0. Personal workspace, syncing, collections. No commercial use restrictions.
Free
Enterprise Cloud
Custom. SSO, audit logs, compliance, dedicated infra, SLA.
Custom
Hoppscotch (OSS)

Free-tier quotas head-to-head

Comparing developer on LangSmith vs oss-self-host on Hoppscotch.

MetricLangSmithHoppscotch
No overlapping quota metrics for these tiers.

Features

LangSmith · 14 features

  • AlertsThreshold alerts on latency, cost, eval metrics.
  • Annotation QueuesHuman-review workflows for trace quality rating.
  • Custom DashboardsAggregate metrics dashboards per project/tag.
  • DatasetsCollect examples → use as eval sets or training data.
  • EvaluationsLLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval
  • LangChain IntegrationAuto-trace any LangChain/LangGraph run with env var.
  • LangGraph IntegrationFirst-class trace + eval for LangGraph agents.
  • LLM TracingAutomatic trace every LLM call + tool call + chain step.
  • OpenTelemetry ExportExport traces as OTLP to Datadog/Honeycomb/etc.
  • PlaygroundTest prompts + models inline before deploying.
  • Prompt CanvasVisual prompt editor with live test + eval.
  • Prompt HubPublic + private prompt library with versioning.
  • Self-Hosted (Enterprise)Docker + k8s deployment in your infra.
  • Threads + SessionsGroup traces into conversational sessions.

Hoppscotch · 18 features

  • Auth HelpersOAuth, JWT, Bearer, etc.
  • Browser ExtensionProxy through extension.
  • Code GenerationGenerate curl, fetch, axios, etc.
  • CollectionsGrouped requests + hierarchy.
  • EnvironmentsVariables with inheritance.
  • GraphQL ClientQuery + schema explorer.
  • hopp CLIRun tests in CI.
  • Hoppscotch MCPMCP server for AI agents.
  • MQTTMQTT client.
  • Pre-request ScriptsJS runs before each request.
  • Progressive Web AppInstall offline-capable PWA.
  • Request HistoryBrowser-local history.
  • REST ClientHTTP request builder.
  • Self-HostDocker Compose.
  • Server-Sent Events (SSE)SSE stream.
  • Socket.IOSocket.IO client.
  • Test ScriptsAssertions on responses.
  • WebSocketWS messages.

Developer interfaces

KindLangSmithHoppscotch
CLILangSmith CLIhopp CLI
SDKlangsmith-js, langsmith-python
RESTLangSmith REST APIHoppscotch Cloud API
MCPLangSmith MCP
OTHERLangSmith DashboardBrowser Extension, Hoppscotch Desktop, Hoppscotch Web, Self-Host (Docker)
Staxly is an independent catalog of developer platforms. Some links to LangSmith and Hoppscotch may be affiliate links — Staxly may earn a commission if you sign up through them, at no extra cost to you. Pricing is verified against vendor pages at publication time — reconfirm before buying.

Want this comparison in your AI agent's context? Install the free Staxly MCP server.