pydantic / pydantic-ai

GenAI Agent Framework, the Pydantic way --- **Documentation**: ai.pydantic.dev --- Pydantic AI is a Python agent framework designed to help you quickly, confidently, and painlessly build production grade applications and workflows with Generative AI. FastAPI revolutionized web development by offering an innovative and ergonomic design, built on the foundation of Pydantic Validation and modern Python features like type hints. Yet despite virtually every Python agent framework and LLM library using Pydantic Validation, when we began to use LLMs in Pydantic Logfire, we couldn't find anything that gave us the same feeling. We built Pydantic AI with one simple aim: to bring that FastAPI feeling to GenAI app and agent development. Why use Pydantic AI • **Built by the Pydantic Team**: Pydantic Validation is the validation layer of the OpenAI SDK, the Google ADK, the Anthropic SDK, LangChain, LlamaIndex, AutoGPT, Transformers, CrewAI, Instructor and many more. _Why use the derivative when you can go straight to the source?_ :smiley: • **Model-agnostic**: Supports virtually every model and provider: OpenAI, Anthropic, Gemini, DeepSeek, Grok, Cohere, Mistral, and Perplexity; Azure AI Foundry, Amazon Bedrock, Google Vertex AI, Ollama, LiteLLM, Groq, OpenRouter, Together AI, Fireworks AI, Cerebras, Hugging Face, GitHub, Heroku, Vercel, Nebius, OVHcloud, Alibaba Cloud, SambaNova, and Outlines. If your favorite model or provider is not listed, you can easily implement a custom model. • **Seamless Observability**: Tightly integrates with Pydantic Logfire, our general-purpose OpenTelemetry observability platform, for real-time debugging, evals-based performance monitoring, and behavior, tracing, and cost tracking. If you already have an observability platform that supports OTel, you can use that too. • **Fully Type-safe**: Designed to give your IDE or AI coding agent as much context as possible for auto-completion and type checking, moving entire classes of errors from runtime to write-time for a bit of that Rust "if it compiles, it works" feel. • **Powerful Evals**: Enables you to systematically test and evaluate the performance and accuracy of the agentic systems you build, and monitor the performance over time in Pydantic Logfire. • **MCP, A2A, and UI**: Integrates the Model Context Protocol, Agent2Agent, and various UI event stream standards to give your agent access to external tools and data, let it interoperate with other agents, and build interactive applications with streaming event-based communication. • **Human-in-the-Loop Tool Approval**: Easily lets you flag that certain tool calls require approval before they can proceed, possibly depending on tool call arguments, conversation history, or user preferences. • **Durable Execution**: Enables you to build durable agents that can preserve their progress across transient API failures and application errors or restarts, and handle long-running, asynchronous, and human-in-the-loop workflows with production-grade reliability. • **Streamed Outputs**: Provides the ability to stream structured output continuously, with immediate validation, ensuring real time access to generated data. • **Graph Support**: Provides a powerful way to define graphs using type hints, for use in complex applications where standard control flow can degrade to spaghetti code. Realistically though, no list is going to be as convincing as giving it a try and seeing how it makes you feel! Hello World Example Here's a minimal example of Pydantic AI: _(This example is complete, it can be run "as is", assuming you've installed the package)_ The exchange will be very short: Pydantic AI will send the instructions and the user prompt to the LLM, and the model will return a text response. Not very interesting yet, but we can easily add tools, dynamic instructions, and structured outputs to build more powerful agents. Tools & Dependency Injection Example Here is a concise example using Pydantic AI to build a support agent for a bank: **(Better documented example in the docs)** Next Steps To try Pydantic AI for yourself, install it and follow the instructions in the examples. Read the docs to learn more about building applications with Pydantic AI. Read the API Reference to understand Pydantic AI's interface. Join Slack or file an issue on GitHub if you have any questions.