Skip to content
Together AI logo

Run open-source LLMs with serverless inference and fine-tuning

Visit Website
Coverage fromTechCrunchThe Next WebThe Information
5 reviews tracked·11 press mentions

The Bottom Line

Entry price

Paid plans only

Biggest pro

Many open models

Biggest con

Smaller than big providers

TL;DR - Together AI

  • Together AI is an inference platform for open-source AI models
  • It provides fast, affordable access to leading open models
  • Pay-per-token pricing starting at $0.20/million tokens
Pricing: Paid only
Best for: Enterprises & pros
4.8/5 across review platforms

What is Together AI?

Editorial review
Together AI is a platform for running open-source LLMs. Features serverless inference, fine-tuning, and GPU cloud with competitive pricing for Llama, FLUX, and more.

Available on: Web

Pros & Cons

Pros

  • Many open models
  • Competitive pricing
  • Fast inference
  • Good for startups
  • Fine-tuning available

Cons

  • Smaller than big providers
  • Model quality varies
  • Support basic
  • Documentation gaps
  • Newer platform

Ratings Across the Web

4.8(5 reviews)

Ratings aggregated from independent review platforms. Learn more

Key Features

LLM inferenceImage generationFine-tuningGPU cloudBatch processingCode executionDedicated endpointsOpen-source modelsCompetitive pricingSingle-tenant options

Pricing Plans

Pricing checked Jul 7, 2026

Serverless Inference

null

  • Pay per 1M tokens
  • Llama 3.1 8B: $0.18/1M tokens
  • Llama 3.1 405B: $3.50/1M tokens
  • FLUX.1 dev: $0.025/megapixel
  • Batch API: 50% lower cost

Fine-Tuning

null

  • $0.48-2.90/1M tokens (by model size)
  • DeepSeek, GLM, Kimi support
  • Minimum charges for specialized models

GPU Cloud

null

  • Instant Clusters: $2.20-5.50/hr/GPU
  • Dedicated Endpoints: $2.10-4.99/hr
  • Single-tenant deployment

Reviews

Improve Your Thinking Patterns Using ChatGPT cover
$99Free with your review

Review Together AI, get a free AI guide

Share your experience and we will send you Improve Your Thinking Patterns Using ChatGPT, free.

Write a review
4.8/5

Across 5 verified user reviews on G2

Add your hands-on experience using the offer above to help the next buyer.

Best Together AI Alternatives

Top alternatives based on features, pricing, and user needs.

Most buyers shortlist 2 or 3 tools before committing. Pull a side-by-side comparison or browse the full alternatives shortlist below.

Explore More

Together AI FAQ

How does Together AI support the deployment of large language models?

Together AI provides a platform for running open-source large language models (LLMs) through serverless inference. It offers competitive pricing for models like Llama and FLUX, enabling efficient deployment and operation.

Which teams would benefit most from using Together AI?

Together AI is particularly well-suited for startups due to its competitive pricing and focus on open-source LLMs. It caters to teams needing fast inference and fine-tuning capabilities for their AI and automation projects.

How does Together AI compare to Anyscale for running LLMs?

Together AI offers serverless inference and fine-tuning for many open-source LLMs with competitive pricing, which is a key advantage for startups. While both platforms facilitate LLM deployment, Together AI emphasizes its cost-effectiveness and broad selection of open models.

What kind of trade-offs should users consider when choosing Together AI?

Users should be aware that Together AI is a newer platform compared to larger providers, which can mean documentation gaps and more basic support. Additionally, the quality of open models available can vary, requiring careful selection.

Does Together AI include options for customizing existing models?

Yes, Together AI includes fine-tuning capabilities, allowing users to adapt open-source LLMs to their specific needs. This feature helps tailor models like Llama and FLUX for particular applications and datasets.

How is Together AI priced?

Together AI is a paid product, meaning it does not offer a permanently free tier for its services. Its pricing model is designed to be competitive, especially for its GPU cloud and serverless inference offerings.

Source: together.ai

Guides & Articles