Best Open Source kafka Libraries
A curated list of the most popular GitHub repositories tagged with kafka. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
#2DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼
#3apache/kafka
Apache Kafka - A distributed event streaming platform
#4heibaiying/BigData-Notes
大数据入门指南 :star:
#5influxdata/telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
#6zhisheng17/flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
#7ThreeDotsLabs/watermill
Building event-driven applications the easy way in Go.
#8AutoMQ/automq
AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
#9risingwavelabs/risingwave
Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.
#10redpanda-data/connect
Fancy stream processing made operationally mundane
#11Graylog2/graylog2-server
Free and open log management
#12MaterializeInc/materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
#13apache/camel
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
#14ArroyoSystems/arroyo
Distributed stream processing engine in Rust
#15flexprice/flexprice
Usage-based pricing and billing for developers 🔓 Cloud or self-hosted ⚙️ No-code UI 💰 Realtime usage metering 🎟 Credits & top-ups 🔑 Control feature access
#16PeerDB-io/peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
#17openmeterio/openmeter
Metering and Billing for AI, API and DevOps. Collect and aggregate millions of usage events in real-time and enable usage-based billing.
#18Altinity/clickhouse-sink-connector
Replicate data from MySQL, Postgres and MongoDB to ClickHouse®
#19confluentinc/ksql
The database purpose-built for stream processing applications.
#20TencentBlueKing/blueking-dbm
DBM，数据库管理，集成了MySQL、Redis、ES、Kafka、HDFS、InfluxDB、Pulsar等多种数据库组件的全生命周期管理，提供了海量集群的批量管理能力，以及相应DB组件的集群管理工具箱，并配套DB个性化配置、高可用切换、域名管理等DB个性化服务，同时全方位的监控告警可观测能力，让数据库管理员、运维、开发等用户可以轻松完成数据库管理工作，更高效、更安全、更全面的管理数据库。 The database management platform integrates a variety of database components such as MySQL...