Open source AI & LLM tools

28 open-source tools in this category.

Showing 28 results

Langflow

Langflow

Visual builder for AI agents and RAG pipelines — LangChain-powered.

MIT-licensed alternative to Flowise with Python code nodes, multi-agent orchestration, and vector store integration. pip install or Docker.

aiagentsrag
149.1K9.2KMIT
vs Flowise
Dify

Dify

Open-source LLM app platform — visual workflow, RAG, agents, 100+ models.

Apache-2.0 platform with Prompt IDE, RAG pipelines, agent framework, and model management. Self-host with Docker or use cloud.dify.ai.

aiagentsrag
143.5K22.6KApache-2.0
vs OpenAI
Open WebUI

Open WebUI

Self-hosted AI interface — Ollama, OpenAI-compatible, RAG built-in.

BSD-3-Clause alternative to ChatGPT with multi-model support, code execution, file upload, and RBAC. Single Docker command to deploy.

aichatui
139.6K20KBSD-3-Clause
vs ChatGPT
LobeChat

LobeChat

Open-source AI chat — plugin ecosystem, multi-model, voice chat.

Apache-2.0 alternative to ChatGPT with GPT-4, Claude, Gemini, and Ollama support. Material Design UI, DALL-E/Flux image generation, and TTS/STT.

aichatagents
78.1K15.4KApache-2.0
vs ChatGPT
AnythingLLM

AnythingLLM

All-in-one AI app — chat with documents using any LLM, fully private.

MIT-licensed platform for multi-LLM document chat, AI agents, and multi-user workspaces. Desktop apps for Mac, Windows, Linux with LanceDB, Chroma, or Qdrant backends.

airagchat
60.9K6.6KMIT
vs ChatGPT
Mem0

Mem0

Universal memory layer for AI agents — multi-signal retrieval, temporal reasoning, 57k+ GitHub stars

Give your AI apps persistent memory and intelligence

aimemoryllm
57.3K6.5KApache-2.0
vs Pinecone
Flowise AI

Flowise AI

Visual drag-and-drop builder for AI agents and LLM pipelines.

Apache-2.0 alternative to Langflow with chatflow and agentflow paradigms, embeddable chatbot widgets, and API endpoints. npm install and start.

aiagentsrag
53.3K24.5KApache-2.0
vs Relevance AI
LiteLLM

LiteLLM

Unified gateway for 100+ LLMs with spend tracking

LiteLLM is a Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI format, with cost tracking, guardrails, loadbalancing and logging. Supports Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.

aillmproxy
48.8K8.5KCustom
vs OpenRouter
Cherry Studio

Cherry Studio

Multi-model AI desktop client — local-first privacy, native apps.

AGPL-3.0 desktop client for GPT-4, Claude, Gemini, DeepSeek, and Ollama. Beautiful native UI with conversation management and model comparison.

aidesktopchat
46.7K4.4KAGPL-3.0
vs ChatGPT
Milvus

Milvus

High-performance vector database — billion-scale AI similarity search.

Apache-2.0 alternative to Pinecone with HNSW/IVF/DiskANN indexing, GPU acceleration, and distributed architecture. Lite mode for development.

aivector-databaseembeddings
44.6K4KApache-2.0
vs Pinecone
Jan

Jan

Offline AI assistant — run LLMs locally, no data leaves your machine.

Apache-2.0 desktop app for Llama, Mistral, Gemma models in GGUF format. Native Mac, Windows, Linux with conversation history and code highlighting.

ailocalprivacy
42.8K2.9KApache-2.0
vs Ollama
CopilotKit

CopilotKit

Build AI copilots for your product — React components in minutes.

MIT-licensed framework with drop-in CopilotKit components, CoAgents for human-in-the-loop, and LangChain integration. Works with OpenAI, Anthropic, and custom LLMs.

aicopilotui
31.9K4.1KMIT
vs Vercel AI
Qdrant

Qdrant

High-performance vector database — semantic search at scale.

Apache-2.0 alternative to Pinecone with HNSW indexing, payload filtering, and distributed deployment. Rust engine with REST/gRPC APIs.

aivector-databasesearch
31.7K2.3KApache-2.0
vs Pinecone
Langfuse

Langfuse

LLM engineering platform — tracing, prompt management, cost tracking.

MIT-licensed alternative to LangSmith. Full observability for LLM chains, version-controlled prompts, A/B testing, and dataset evaluation.

aillmobservability
28.4K2.9KMIT
vs LangSmith
FastGPT

FastGPT

AI knowledge base platform — visual workflows and built-in RAG.

Apache-2.0 alternative to Dify with drag-and-drop workflow builder, document ingestion, and one-click API deployment. MongoDB + PostgreSQL backend.

airagknowledge-base
28.2K7.1KApache-2.0
vs ChatGPT
Chroma

Chroma

Rust-based vector database for AI — serverless cloud with hybrid and full-text search for embeddings, metadata, and RAG

Open-source vector database for AI search and retrieval

aivector-databaseembeddings
28.2K2.3KApache-2.0
vs Pinecone
Supermemory

Supermemory

Memory layer for AI agents — hybrid vector search, ontology-aware graph, and sub-100ms retrieval

Memory layer for AI agents — hybrid vector search with ontology-aware graph and sub-100ms retrieval. Self-hostable alternative to Pinecone and Mem0.

aimemoryapi
23.6K2.1KMIT
vs Pinecone
Letta

Letta

Stateful AI agents with persistent memory — formerly MemGPT, agents learn and self-improve over time

Stateful AI agent framework with persistent memory — formerly MemGPT. Agents learn, self-improve, and retain context across sessions. Open-source alternative to LangChain.

aiagentsmemory
23.1K2.5KApache-2.0
vs LangChain
Suna

Suna

AI agent that autonomously handles real-world tasks.

Source-available agent platform with browser automation, file management, and web scraping. Deploy autonomous agents for research and operations.

aiagentsautomation
19.8K3.4KSource-available
vs AutoGPT
Weaviate

Weaviate

AI-native vector database with semantic search, RAG, and hybrid search for building AI agents and applications

AI-native vector database for intuitive applications

aivector-databaseembeddings
16.3K1.3KBSD-3-Clause
vs Pinecone
Activeloop

Activeloop

Tensor database for AI — store, version, and query multimodal datasets with semantic search for text, images, audio, video, and 3D data

Multimodal tensor database for AI pipelines — store, version, and query datasets of text, images, audio, video, and 3D data. Open-source alternative to Databricks and Snowflake.

aivector-databasedata
9.2K710Apache-2.0
vs Databricks
Helicone

Helicone

LLM observability and AI gateway — one-line integration for logging, cost tracking, prompt management, and rate limiting

Build reliable AI apps with comprehensive observability

aillmobservability
5.8K592Apache-2.0
vs LangSmith
Laminar

Laminar

Agent observability and evaluation platform — signal alerts, trace debugging, and automated evals for LLM products

Open-source LLM observability platform — trace debugging, signal alerts, and automated evaluations for AI products. Alternative to LangSmith and Helicone.

aillmobservability
3K203Apache-2.0
vs LangSmith
Deepnote

Deepnote

Jupyter-replacement data notebook with AI-first reactive execution, SQL blocks, and real-time collaboration

Python, SQL, and AI in a collaborative data notebook

ainotebooksdata-science
2.9K193Apache-2.0
vs Google Colab
OpenLIT

OpenLIT

OpenTelemetry-native LLM observability — tracing, evaluation, prompt management, and cost tracking

Monitor, debug, and scale LLM applications with ease

aillmobservability
2.5K288Apache-2.0
vs Datadog
Beam

Beam

Serverless GPU cloud for AI — sub-second cold starts, automatic scaling for inference, training, and sandboxes

Serverless GPU cloud with sub-second cold starts — deploy AI inference, model training, and sandboxes with automatic scaling. Open-source alternative to Modal and Replicate.

aiinfrastructureserverless
1.7K143AGPL-3.0
vs Modal
mlop

mlop

MLOps platform with W&B-compatible API — experiment tracking, model registry, and collaboration for ML teams

Track and optimize machine learning experiments with precision

mlopsmachine-learningexperiments
38010Apache-2.0
vs MLflow
Proxed AI

Proxed AI

Secure AI API management for iOS apps with DeviceCheck

Proxed.AI is a secure proxy backend for iOS apps that protects your AI API keys and controls AI responses. Uses Apple DeviceCheck to lock down API keys and provides a visual schema builder to structure AI outputs.

aiproxyllm
60AGPL-3.0
vs Portkey