back to home

Best Open Source pipeline parallelism Libraries

A curated list of the most popular GitHub repositories tagged with pipeline parallelism. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

41,643Python
Analyze Code

#2hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

41,349Python
Analyze Code

#3bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

9,953Python
Analyze Code