Best Open Source kafka Libraries
A curated list of the most popular GitHub repositories tagged with kafka. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
#2DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼
#3apache/kafka
Apache Kafka - A distributed event streaming platform
#4heibaiying/BigData-Notes
大数据入门指南 :star:
#5influxdata/telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
#6zhisheng17/flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
#7IBM/sarama
Sarama is a Go library for Apache Kafka.
#8ThreeDotsLabs/watermill
Building event-driven applications the easy way in Go.
#9AutoMQ/automq
AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
#10risingwavelabs/risingwave
Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.
#11redpanda-data/connect
Fancy stream processing made operationally mundane
#12Graylog2/graylog2-server
Free and open log management
#13apache/camel
Apache Camel is an open source integration framework that empowers you to quickly and easily integrate various systems consuming or producing data.
#14ArroyoSystems/arroyo
Distributed stream processing engine in Rust
#15openmeterio/openmeter
Metering and Billing for AI, API and DevOps. Collect and aggregate millions of usage events in real-time and enable usage-based billing.
#16javahongxi/whatsmars
Java生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥
#17confluentinc/librdkafka
The Apache Kafka C/C++ library
#18risesoft-y9/WorkFlow-Engine
工作流引擎对内提供单位/机关流程管理规则和内部业务流程的数字化落地实践；对外提供自动化地第三方业务驱动、接口接入和算法单元驱动能力。工作流引擎在提供底层驱动引擎的同时对全局透明监控、安全防御和国产化特色功能进行充分考虑，是内部流程管理和业务算法驱动的不二之选。
#19tx7do/kratos-transport
kratos transport layer extension, support: rabbitmq,kafka,rocketmq,activemq,apollo,mcp,tcp,websocket...
#20Ahoo-Wang/Wow
Modern Reactive CQRS Architecture Microservice development framework based on DDD and EventSourcing | 基于 DDD & EventSourcing 的现代响应式 CQRS 架构微服务开发框架
#21TencentBlueKing/blueking-dbm
DBM，数据库管理，集成了MySQL、Redis、ES、Kafka、HDFS、InfluxDB、Pulsar等多种数据库组件的全生命周期管理，提供了海量集群的批量管理能力，以及相应DB组件的集群管理工具箱，并配套DB个性化配置、高可用切换、域名管理等DB个性化服务，同时全方位的监控告警可观测能力，让数据库管理员、运维、开发等用户可以轻松完成数据库管理工作，更高效、更安全、更全面的管理数据库。 The database management platform integrates a variety of database components such as MySQL...