Skip to content
Together AI logo

Run open-source LLMs with serverless inference and fine-tuning

Paid plans onlyVisit Website
Coverage from Reuters TechCrunch The Information
6 reviews tracked 23 press mentions

The Bottom Line

Price
Paid plans only. Compare plans

Key facts

  • Together AI is an inference platform for open-source AI models
  • It provides fast, affordable access to leading open models
  • Pay-per-token pricing starting at $0.20/million tokens

Pros

  • Many open models
  • Competitive pricing
  • Fast inference
  • Good for startups
  • Fine-tuning available

Cons

  • Smaller than big providers
  • Model quality varies
  • Support basic
  • Documentation gaps
  • Newer platform

What is Together AI?

Editorial review
Together AI is a platform for running open-source LLMs. Features serverless inference, fine-tuning, and GPU cloud with competitive pricing for Llama, FLUX, and more.

Available on: Web

Ratings Across the Web

4 (6 reviews)

Together AI holds an aggregate rating of 4 out of 5 from 6 reviews across G2, last checked September 2, 2026.

Ratings aggregated from independent review platforms. Learn more

Key Features

  • LLM inference
  • Image generation
  • Fine-tuning
  • GPU cloud
  • Batch processing
  • Code execution
  • Dedicated endpoints
  • Open-source models
  • Competitive pricing
  • Single-tenant options

Pricing Plans

Pricing checked Oct 7, 2026

Together AI plans and prices, checked October 2026
PlanPriceDetails
Serverless Inference

Custom

  • Pay per 1M tokens
  • Llama 3.1 8B: $0.18/1M tokens
  • Llama 3.1 405B: $3.50/1M tokens
+2 more
  • FLUX.1 dev: $0.025/megapixel
  • Batch API: 50% lower cost
Fine-Tuning

Custom

  • $0.48-2.90/1M tokens (by model size)
  • DeepSeek, GLM, Kimi support
  • Minimum charges for specialized models
GPU Cloud

Custom

  • Instant Clusters: $2.20-5.50/hr/GPU
  • Dedicated Endpoints: $2.10-4.99/hr
  • Single-tenant deployment

Is Together AI worth the price?

Good value

The 50% discount on batch API is a strong value-add for high-volume users.

This pricing is best for developers and teams who want flexible, pay-as-you-go access to a wide range of open-source LLMs without committing to long-term contracts or self-hosting infrastructure.

Hidden Costs & Gotchas

Minimum charges for specialized fine-tuning models

Full Together AI pricing: every plan, hidden costs and alternatives

Reviews

Improve Your Thinking Patterns Using ChatGPT cover
$99 Free with your review

Review Together AI, get a free AI guide

Share your experience and we will send you Improve Your Thinking Patterns Using ChatGPT, free.

Write a review
4.0/5

Across 6 verified user reviews on G2

Add your hands-on experience using the offer above to help the next buyer.

Best Together AI Alternatives

Top alternatives based on features, pricing, and user needs.

Most buyers shortlist 2 or 3 tools before committing. Pull a side-by-side comparison or browse the full alternatives shortlist below.

Explore More

Together AI FAQ

How does Together AI support the deployment of large language models?

Together AI provides a platform for running open-source large language models (LLMs) through serverless inference. It offers competitive pricing for models like Llama and FLUX, enabling efficient deployment and operation.

Which teams would benefit most from using Together AI?

Together AI is particularly well-suited for startups due to its competitive pricing and focus on open-source LLMs. It caters to teams needing fast inference and fine-tuning capabilities for their AI and automation projects.

How does Together AI compare to Anyscale for running LLMs?

Together AI offers serverless inference and fine-tuning for many open-source LLMs with competitive pricing, which is a key advantage for startups. While both platforms facilitate LLM deployment, Together AI emphasizes its cost-effectiveness and broad selection of open models.

What kind of trade-offs should users consider when choosing Together AI?

Users should be aware that Together AI is a newer platform compared to larger providers, which can mean documentation gaps and more basic support. Additionally, the quality of open models available can vary, requiring careful selection.

Does Together AI include options for customizing existing models?

Yes, Together AI includes fine-tuning capabilities, allowing users to adapt open-source LLMs to their specific needs. This feature helps tailor models like Llama and FLUX for particular applications and datasets.

How is Together AI priced?

Together AI is a paid product, meaning it does not offer a permanently free tier for its services. Its pricing model is designed to be competitive, especially for its GPU cloud and serverless inference offerings.

Source: together.ai

Guides & Articles