Local AI

Overview Msty is a desktop AI workspace for using local models and supported online providers in one interface. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control over models and data...

Overview Khoj is an open-source personal AI application that can be self-hosted for chat, document search and automation workflows. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control...

Overview vLLM is an open-source inference and serving engine designed for high-throughput deployment of supported language models. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control...

Overview InvokeAI is an open-source creative engine for self-hosted image generation, editing, workflow design and asset management. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control...

Overview ComfyUI is an open-source node-based interface for building and running image, video and generative-media workflows locally. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater...

Overview Pinokio is a desktop application for installing and running supported AI projects and local web applications through reusable scripts. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with...

Overview llama.cpp is an open-source C and C++ inference engine for running supported language models across local hardware. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control over...

Overview Ollama is a local model runtime and command-line workflow for downloading, running and serving compatible language models. Performance and privacy depend on the selected models, hardware and configuration. Best for Technical users comparing local or self-hosted AI with greater control...

Overview PrivateGPT is an open-source framework for private document question answering using local or controlled infrastructure. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over...

Overview Backyard AI is an AI character and storytelling platform with desktop and mobile access plus local-model options. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and...

Overview text-generation-webui is an open-source local web interface for running and experimenting with supported text-generation models. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control...

Overview KoboldCpp is a portable local inference application focused on GGUF models, story generation and compatible APIs. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and...

Overview AnythingLLM is a desktop and self-hosted AI workspace combining document chat, agents and multiple model backends. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and...

Overview LocalAI is an open-source local inference server exposing APIs compatible with common AI application workflows. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and...

Overview LibreChat is an open-source self-hosted chat interface supporting multiple model providers, agents and tools. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and data...

Overview Open WebUI is a self-hosted web interface for local or remote model backends with chat and knowledge features. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and data...

Overview LM Studio is a desktop application for discovering, running and serving compatible local language models. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and data...

Overview Jan is an open-source desktop AI workspace that runs local models and can connect to compatible remote providers. Output quality, hardware needs and data handling depend on the selected deployment. Best for Users evaluating local or self-hosted AI with greater control over models and...