AnythingLLM

AnythingLLM is an open-source, all-in-one AI application that enables private document chat using retrieval-augmented generation (RAG). The platform combines local or remote LLM chat with document intelligence while keeping everything stored locally on your machine for maximum privacy. The application supports 15+ language models including OpenAI, Anthropic Claude, and local models like Llama. It processes PDFs, DOCX, TXT, CSV, images, and audio files with a fully customizable document management system. Deployment options include a desktop app for single users, Docker-based self-hosted servers for teams, and managed cloud instances. AnythingLLM works on MacOS, Windows, and Linux with fine-grained admin controls for user permissions. The platform offers whitelabeling capabilities for custom branding. Local deployment requires minimum 16GB RAM, with 32GB+ recommended for optimal performance with larger models.