AI Model Deployment Software

Open-source vector database for AI

Run open-source LLMs locally with one command

Open-source MLOps platform

Fast LLM serving with PagedAttention

High-performance LLM serving by HuggingFace

Run local LLMs with a beautiful interface

Run LLMs efficiently on consumer hardware

Serverless vector database for AI applications

Self-hosted OpenAI-compatible API

The open-source foundation for building and deploying AI platforms on Kubernetes.

Build and manage real-life ML, AI, and data science projects with ease.

Build and deploy interactive web interfaces for your machine learning models in Python.

Open translation models built on Gemma 3, enabling communication across 55 languages efficiently.