ownpilot / OwnPilot

OwnPilot Privacy-first personal AI assistant platform with soul agents, autonomous background agents, multi-agent orchestration, AI agent creator, tool orchestration, multi-provider support, MCP integration, voice pipeline, browser automation, IoT edge device control, and Telegram + WhatsApp connectivity. **Self-hosted. Your data stays yours.** --- Table of Contents • Features • Architecture • Quick Start • Setup Guide — Detailed installation instructions • Project Structure • Packages • Core • Gateway • UI • CLI • AI Providers • Agent System • Soul Agents • Autonomous Hub • Agent Orchestra • Background Agents • Subagents • Tool System • MCP Integration • Artifacts • Voice Pipeline • Browser Agent • Edge Devices • Personal Data • Autonomy & Automation • Database • Security & Privacy • Code Execution • API Reference • Configuration • Deployment • Development • License --- Features AI & Agents • **Multi-Provider Support** — 4 native providers (OpenAI, Anthropic, Google, Zhipu) + 8 aggregator providers (Together AI, Groq, Fireworks, DeepInfra, OpenRouter, Perplexity, Cerebras, fal.ai) + any OpenAI-compatible endpoint • **Local AI Support** — Ollama, LM Studio, LocalAI, and vLLM auto-discovery on the local network • **Smart Provider Routing** — Cheapest, fastest, smartest, balanced, or fallback strategies • **Anthropic Prompt Caching** — Static system prompt blocks cached via to reduce input tokens on repeated requests • **Context Management** — Real-time context usage tracking, detail modal with per-section token breakdown, context compaction (AI-powered message summarization), session clear • **Streaming Responses** — Server-Sent Events (SSE) for real-time streaming with tool execution progress • **Configurable Agents** — Custom system prompts, model preferences, tool assignments, and execution limits Tools & Extensions • **190+ Built-in Tools** across 32 categories (personal data, files, code execution, web, email, media, git, translation, weather, finance, automation, vector search, data extraction, utilities, orchestra, artifacts, browser, edge devices) • **Meta-tool Proxy** — Only 4 meta-tools sent to the LLM ( , , , ); all tools remain available via dynamic discovery • **Tool Namespaces** — Qualified tool names with prefixes ( , , , , ) for clear origin tracking • **MCP Client** — Connect to external MCP servers (Filesystem, GitHub, Brave Search, etc.) and use their tools natively • **MCP Server** — Expose OwnPilot's tools as an MCP endpoint for Claude Desktop and other MCP clients • **User Extensions** — Installable tool bundles with custom tools, triggers, services, and configurations; Extension SDK provides to invoke any of 190+ built-in tools • **6 Default Extensions** — Daily Briefing, Knowledge Base, Project Tracker, Smart Search, Automation Builder, Contact Enricher bundled out-of-the-box • **Extension Security Audit** — LLM-powered security analysis for skills and extensions before installation • **Skills** — Open standard SKILL.md format (AgentSkills.io) for instruction-based AI knowledge packages • **Custom Tools** — Create new tools at runtime via LLM (sandboxed JavaScript) • **Connected Apps** — 1000+ OAuth app integrations via Composio (Google, GitHub, Slack, Notion, Stripe, etc.) • **Tool Limits** — Automatic parameter capping to prevent unbounded queries • **Search Tags** — Natural language tool discovery with keyword matching Personal Data • **Notes, Tasks, Bookmarks, Contacts, Calendar, Expenses** — Full CRUD with categories, tags, and search • **Productivity** — Pomodoro timer with sessions/stats, habit tracker with streaks, quick capture inbox • **Memories** — Long-term persistent memory (facts, preferences, events) with importance scoring, vector search, and auto-injection • **Goals** — Goal creation, decomposition into steps, progress tracking, next-action recommendations • **Custom Data Tables** — Create your own structured data types with AI-determined schemas Coding Agents • **External AI Coding CLIs** — Orchestrate Claude Code, Codex, and Gemini CLI from the web UI or via AI tool calling • **Session Management** — Long-running coding sessions with real-time terminal output streaming • **Dual Execution Modes** — Auto mode (headless ) and interactive mode (PTY terminal) • **Custom Providers** — Register any CLI binary as a coding agent provider • **Result Persistence** — Task output, exit codes, and duration stored in the database Soul Agents • **Rich Agent Identity** — Agents with personality, role, mission, voice, boundaries, and emoji; full identity framework for autonomous operation • **Heartbeat Lifecycle** — Cron-scheduled execution cycles with configurable checklist, self-healing, max duration, and cost tracking • **Crew System** — Multi-agent crews with role assignments, delegation protocols, and ready-made crew templates • **Inter-Agent Communication** — Agents can send messages to each other with subject, content, and type classification • **Evolution Tracking** — Version-controlled agent evolution with core/mutable traits, learnings, and feedback log • **Autonomy Controls** — Per-agent autonomy levels with allowed/blocked actions, approval requirements, and budget limits (per-cycle, per-day, per-month) • **Boot Sequences** — Configurable , , and action sequences • **16+ Agent Templates** — Pre-built configurations for common use cases (Morning Briefer, News Monitor, Code Reviewer, Budget Tracker, etc.) Autonomous Hub • **Unified Command Center** — Single tabbed dashboard consolidating all autonomous agents (soul + background), crews, messaging, and activity • **AI Agent Creator** — Conversational agent creation: describe what you need in plain language, refine through chat, preview JSON config, create in one click • **Agent Cards** — At-a-glance agent status with real-time indicators, mission preview, cost tracking, and quick actions (pause/resume/delete) • **Activity Feed** — Unified timeline of heartbeat logs and agent messages with aggr…