Portkey vs Fly.io
Enterprise AI gateway + observability + guardrails + prompt mgmt
vs. Run your app close to users, globally
Pricing tiers
Portkey
Developer (Free)
Free forever. 10k logs/month. Universal API + key management. 3 prompt templates. Basic observability.
Free
Gateway (OSS)
MIT-licensed gateway only (no observability UI). Self-host for routing/fallbacks.
$0 base (usage-based)
Production
$49/month. 100k logs ($9 per additional 100k). Fallbacks, load balancing, retries, semantic caching. Unlimited prompts. RBAC.
$49/mo
Enterprise
Custom. 10M+ logs/month. Custom guardrails, advanced evals, SSO, budget controls, VPC + on-prem, SOC2, HIPAA, GDPR.
Custom
Fly.io
Pay-as-you-go
No monthly fee. Machines billed per second. Free allocations: ~3 small shared machines + 3 GB volumes.
$0 base (usage-based)
Shared CPU 1x — 256 MB
Entry VM. 1 shared vCPU, 256 MB RAM. ~$2.02/month continuously on.
$2/mo
Performance 1x — 2 GB
Dedicated 1 vCPU, 2 GB RAM.
$32/mo
Reservation — Shared (1 yr)
$36/year for $5/mo credit (40% savings).
$36/mo
Shared CPU 8x — 16 GB
8 shared vCPU, 16 GB RAM.
$89/mo
Performance 16x — 128 GB
Dedicated 16 vCPU, 128 GB RAM.
$1014/mo
Enterprise
Custom. Dedicated capacity, SLA.
Custom
Free-tier quotas head-to-head
Comparing free on Portkey vs pay-as-you-go on Fly.io.
| Metric | Portkey | Fly.io |
|---|---|---|
| No overlapping quota metrics for these tiers. | ||
Features
Portkey · 18 features
- AI Gateway — Unified OpenAI-compatible API to 250+ LLMs.
- Alerts — Thresholds on latency, error rate, cost, usage.
- Budget Controls — Per-key + per-team spending limits.
- Evaluations — Built-in evaluator templates + custom.
- Fallbacks — Config-driven provider fallback chains.
- Guardrails — Pre/post processors for safety + compliance.
- Load Balancing — Round-robin, weighted, least-latency across providers.
- MCP Support — Use MCP servers as tools through gateway.
- Observability — Logs, traces, feedback, alerts, cost tracking.
- OSS Gateway — Open-source gateway (portkey-ai/gateway).
- Prompt Library — Shared prompt library + public marketplace.
- Prompt Templates — Version + test + collaborate on prompts.
- Retries — Configurable retry policies per route.
- Role-Based Access Control — Team permissions on prompts + keys.
- Semantic Caching — Vector-based cache on query meaning.
- Simple Caching — Exact-match cache.
- Virtual Keys — Per-app keys with budget + rate limits + permissions.
- VPC Deployment (Ent) — Deploy in your own VPC for compliance.
Fly.io · 14 features
- Auto Stop/Start — Machines auto-stop when idle, start on request (like scale-to-zero).
- Certs — Let's Encrypt + wildcard certs managed.
- Fly GPU — A100/L40S/A10 on-demand GPU machines.
- Fly Kubernetes (FKS) — Managed Kubernetes on Fly machines.
- Fly Machines — Firecracker microVMs. Start in <1s. Run any Docker image.
- Fly Postgres — Managed Postgres via Supabase partnership (2024). Also legacy self-run Postgres …
- fly-replay headers — Route request to another region at app level.
- Fly Volumes — Persistent SSD attached to a Machine. Encrypted at rest.
- Global Anycast — Single IP routes to the closest region automatically.
- LiteFS — Distributed SQLite with primary/replica across regions.
- Private Networks — 6PN WireGuard mesh. Connect machines across regions privately.
- Secrets — Encrypted env vars propagated to all regions.
- Tigris (partner) — S3-compatible storage for Fly apps. By partner.
- Upstash Redis (partner) — Managed Redis via Upstash.
Developer interfaces
| Kind | Portkey | Fly.io |
|---|---|---|
| CLI | Portkey CLI | flyctl CLI |
| SDK | portkey-ai (Node), portkey-ai (Python) | — |
| REST | Portkey API (OpenAI-compat) | Machines API |
| GRAPHQL | — | Fly GraphQL API |
| MCP | Portkey MCP | — |
| OTHER | Portkey Dashboard | Fly Postgres (wire) |
Staxly is an independent catalog of developer platforms. Outbound links to Portkey and Fly.io are plain references to their official websites. Pricing is verified against vendor pages at publication time — reconfirm before buying.
Want this comparison in your AI agent's context? Install the free Staxly MCP server.