Together AI
Open-source LLM inference and fine-tuning platform for enterprise AI builders
About Together AI
Together AI was founded in 2022 with the thesis that the future of AI is built on open-source models, and that developers need infrastructure optimised for running, customising, and deploying those models at scale. The company has built a managed inference platform that serves over 100 open-source language models, embedding models, and image generation models via a unified API. The Together AI platform covers several key use cases for AI developers. The Inference API provides access to models including Llama 3, Mistral, Mixtral, Code Llama, DBRX, Qwen, and many others via an OpenAI-compatible endpoint, enabling straightforward migration from proprietary to open-source model providers. The Fine-Tuning service enables organisations to customise base open-source models on their own data, with Together managing the GPU infrastructure and returning a deployable fine-tuned model. Embeddings and image generation APIs round out the platform. Together has positioned itself as the destination for open-source AI infrastructure, and has invested heavily in inference optimisation—competing with Groq on speed for GPU-based inference. The company has raised over $100 million in venture funding and has notable traction with developer-focused companies and AI startups. For European businesses, Together AI presents a mixed compliance picture. The company is incorporated in the United States (Delaware) and processes data on US infrastructure. There is no EU data residency option as of early 2026. Together publishes a GDPR privacy addendum and offers data processing agreements for enterprise customers, but the absence of EU data centres and independent security certifications (ISO 27001, SOC 2 Type II) means the platform requires careful evaluation for regulated EU use cases. Together's explicit policy is that customer data and fine-tuning datasets are not used to train shared models, which is an important baseline for privacy, but does not address the fundamental data residency concern.
TrustKit Score Breakdown
?40% CautionPricing
Usage BasedFree tierQuick Facts
Frequently Asked Questions
Is Together AI GDPR compliant?
Together AI has a TrustKit compliance score of 40% (Caution). Data Residency: All inference and fine-tuning workloads processed in US data centres. No EU data residency option. GDPR transfer mechanisms (SCCs) required for European personal data processing.. Legal Jurisdiction: Incorporated in Delaware, US. Subject to CLOUD Act. GDPR DPA available for enterprise customers contractually, but US jurisdiction governs. No EU subsidiary structure..
Where does Together AI store data?
Together AI hosts data in: US only. All inference and fine-tuning workloads processed in US data centres. No EU data residency option. GDPR transfer mechanisms (SCCs) required for European personal data processing.
Does Together AI train on user data?
Together AI: Customer data and fine-tuning datasets not used for shared model training. Clear policy that customer data and fine-tuning datasets are not used to train shared models. Fine-tuned model weights are customer property. Good baseline for data isolation, but residency limitation remains.
What certifications does Together AI hold?
No certifications have been confirmed for Together AI yet. No published ISO 27001, SOC 2 Type II, or independent security certifications as of early 2026. Security practices are self-attested. Significant gap for enterprise procurement in regulated industries.