Best Open Source pipeline Libraries
A curated list of the most popular GitHub repositories tagged with pipeline. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
#2argoproj/argo-cd
Declarative Continuous Deployment for Kubernetes
#3jina-ai/serve
☁️ Build multimodal AI applications with cloud-native stack
#4PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
#5vectordotdev/vector
A high-performance observability data pipeline.
#6airbytehq/airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
#7marimo-team/marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
#8Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
#9projectdiscovery/httpx
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
#10iam-veeramalla/Jenkins-Zero-To-Hero
Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
#11tektoncd/pipeline
A cloud-native Pipeline resource.
#12mage-ai/mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
#13brunch/brunch
🍴 Web applications made easy. Since 2011.