apache / paimon
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
AI Architecture Analysis
This repository is indexed by RepoMind. By analyzing apache/paimon in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.
Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.
Repository Overview (README excerpt)
Crawler viewApache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations. Paimon innovatively combines lake format and LSM structure, bringing realtime streaming updates into the lake architecture. Background and documentation are available at https://paimon.apache.org 's former name was , developed from the Flink community. The architecture refers to some design concepts of Iceberg. Thanks to Apache Flink and Apache Iceberg. Collaboration Paimon tracks issues in GitHub and prefers to receive contributions as pull requests. Mailing Lists Name Subscribe Digest Unsubscribe Post Archive user @paimon.apache.org User support and questions mailing list Subscribe Subscribe Unsubscribe Post Archives dev @paimon.apache.org Development related discussions Subscribe Subscribe Unsubscribe Post Archives Please make sure you are subscribed to the mailing list you are posting to! If you are not subscribed to the mailing list, your message will either be rejected (dev@ list) or you won't receive the response (user@ list). Slack You can join the Paimon community on Slack. Paimon channel is in ASF Slack workspace. • Anyone with an @apache.org email address can become a full member of the ASF Slack workspace. Search Paimon channel and join it. • If you don't have an @apache.org email address, you can email to to apply for an ASF Slack invitation. Then join Paimon channel. Building JDK 8/11 is required for building the project. Maven version >=3.6.3. • Run the command to build the project. • Run the to format the project (both Java and Scala). • IDE: Mark as Sources Root. How to Contribute Contribution Guide. License The code in this repository is licensed under the Apache Software License 2.