Open Source AI & ML Tools
9 open source AI and machine learning tools you can self-host. Compare OpenAI, Hugging Face, and Vertex AI alternatives for training and inference. Updated Sept 2026.
Orbi
Open-source AI coding agent that turns labeled GitHub Issues into independently reviewed, merged pull requests and tagged releases.
Ollama
Run large language models locally on your own machine
Qdrant
High-performance vector database and search engine for AI applications
Dify
Dify is an open-source platform for building LLM applications and agentic workflows, deployable on your own infrastructure. It combines a visual workflow builder, a prompt IDE, retrieval-augmented generation over your documents, agent tools, and observability, so teams go from prototype to production without stitching libraries together. It works with dozens of model providers, both hosted and local.
AgentDock
AgentDock is a flexible framework for building AI agents capable of executing complex, multi-step tasks with a balance of creativity and predictability.
Chatbox
User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)
Jan
An open-source, offline AI assistant that enables users to run language models locally with full privacy and control across multiple hardware platforms.
AnythingLLM
A comprehensive AI application that allows users to chat with documents, use AI agents, and create customizable multi-user environments with easy setup and configuration.
Open WebUI
An extensible, self-hosted AI platform that supports offline operation, multiple LLM runners, and provides a user-friendly interface for AI interactions.
LibreChat
An open-source AI chat platform that integrates multiple AI models, offering enhanced features and customization beyond traditional chatbots.
Lobe Chat
An open-source, modern ChatGPT/LLMs UI framework that enables one-click deployment of private AI chat applications with multi-modal and extensible features.