Ollama

Ollama (terminal tools): Run open-source LLMs locally with one command. Ollama makes running large language models on your local machine as easy as running a Docker container. With a single command, you can download and run models like Llama 3, Mistral, Gemma, CodeLlama, and dozens more. Ollama handles model management, quantization, and provides an OpenAI-compatible API, making it trivial to swap cloud AI for local inference. Key capabilities: One-command model downloads, OpenAI-compatible API, Large model library (100+), CPU and GPU support, Apple Silicon optimized. Ollama is free to use with no paid tier. Buyers most often compare Ollama against Text Generation WebUI, AutoGPT, LM Studio.