Portkey
AI gateway and LLMOps platform for routing, observability, and guardrails across multiple LLM providers
About Portkey
Portkey was founded in January 2023 in San Francisco by Rohit Agarwal and Ayush Garg. The platform provides an AI gateway — a unified API layer that sits between applications and LLM providers, offering routing, load balancing, fallback logic, caching, rate limiting, guardrails, and observability across 200+ AI models. For enterprise AI teams, Portkey solves a practical problem: as organisations adopt multiple LLM providers (OpenAI, Anthropic, Google, Mistral, open-source models), they need a unified control plane for routing requests, monitoring costs and latency, enforcing guardrails, and managing failover. Portkey provides this without requiring changes to application code. Key capabilities include: intelligent routing across providers, automatic retries and fallback, prompt caching for cost reduction, real-time observability dashboards, custom guardrails for output filtering, and budget management per team or project. Portkey raised $18 million in total funding across three rounds, with investment from Lightspeed Venture Partners and NetApp Excellerator. The team has approximately 35 employees. For European businesses managing multi-model AI deployments, Portkey provides a centralised control point for LLM usage governance. As a US-incorporated company, standard data handling and jurisdiction considerations apply.
TrustKit Score Breakdown
?60% ModeratePricing
FreemiumFree tierQuick Facts
Frequently Asked Questions
Is Portkey GDPR compliant?
Portkey has a TrustKit compliance score of 60% (Moderate). Data Residency: US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.. Legal Jurisdiction: Delaware incorporation. US jurisdiction. Self-hosted option eliminates cloud dependency for data-sensitive deployments..
Where does Portkey store data?
Portkey hosts data in: US cloud; self-hosted option available. US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.
Does Portkey train on user data?
Portkey: Gateway does not train on routed data. Gateway does not train on routed data. Observability logs are retained per customer policy. Self-hosted gives full control.
What certifications does Portkey hold?
Portkey holds: SOC 2 Type II. SOC 2 Type II certified. Appropriate for the company's stage. ISO 27001 would strengthen enterprise procurement.