Local & Self-Hosted AI
Compare local desktop AI and self-hosted model interfaces by deployment, hardware, privacy, model support, APIs and setup requirements.
Categories
Trending items
-
Msty
Msty is a desktop AI workspace for using local models and supported online providers in one interface. Performance and privacy depend on the... -
Khoj
Khoj is an open-source personal AI application that can be self-hosted for chat, document search and automation workflows. Performance and privacy... -
vLLM
vLLM is an open-source inference and serving engine designed for high-throughput deployment of supported language models. Performance and privacy... -
InvokeAI
InvokeAI is an open-source creative engine for self-hosted image generation, editing, workflow design and asset management. Performance and... -
ComfyUI
ComfyUI is an open-source node-based interface for building and running image, video and generative-media workflows locally. Performance and... -
Pinokio
Pinokio is a desktop application for installing and running supported AI projects and local web applications through reusable scripts. Performance... -
llama.cpp
llama.cpp is an open-source C and C++ inference engine for running supported language models across local hardware. Performance and privacy depend... -
Ollama
Ollama is a local model runtime and command-line workflow for downloading, running and serving compatible language models. Performance and privacy... -
PrivateGPT
PrivateGPT is an open-source framework for private document question answering using local or controlled infrastructure. Output quality, hardware... -
text-generation-webui
text-generation-webui is an open-source local web interface for running and experimenting with supported text-generation models. Output quality... -
KoboldCpp
KoboldCpp is a portable local inference application focused on GGUF models, story generation and compatible APIs. Output quality, hardware needs... -
AnythingLLM
AnythingLLM is a desktop and self-hosted AI workspace combining document chat, agents and multiple model backends. Output quality, hardware needs... -
LocalAI
LocalAI is an open-source local inference server exposing APIs compatible with common AI application workflows. Output quality, hardware needs and... -
LibreChat
LibreChat is an open-source self-hosted chat interface supporting multiple model providers, agents and tools. Output quality, hardware needs and... -
Open WebUI
Open WebUI is a self-hosted web interface for local or remote model backends with chat and knowledge features. Output quality, hardware needs and... -
LM Studio
LM Studio is a desktop application for discovering, running and serving compatible local language models. Output quality, hardware needs and data... -
Jan
Jan is an open-source desktop AI workspace that runs local models and can connect to compatible remote providers. Output quality, hardware needs... -
GPT4All
GPT4All is an open-source desktop application for running compatible language models locally and chatting with local files. Output quality...