Best Open Source transformer Libraries
A curated list of the most popular GitHub repositories tagged with transformer. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1huggingface/transformers
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
#2vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
#3labmlai/annotated_deep_learning_paper_implementations
๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
#4ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
#5open-mmlab/mmdetection
OpenMMLab Detection Toolbox and Benchmark
#6fishaudio/fish-speech
SOTA Open Source TTS
#7sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
#8lukasmasuch/best-of-ml-python
๐ A ranked list of awesome machine learning Python libraries. Updated weekly.
#9amusi/CVPR2025-Papers-with-Code
CVPR 2025 ่ฎบๆๅๅผๆบ้กน็ฎๅ้
#10SYSTRAN/faster-whisper
Faster Whisper transcription with CTranslate2
#11graykode/nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
#12BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
#13alibaba/MNN
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md). MNN TaoAvatar Android - Local 3D Avatar Intelligence: apps/Android/Mnn3dAvatar/README.md
#14cfug/dio
A powerful HTTP client for Dart and Flutter, which supports global settings, Interceptors, FormData, aborting and canceling a request, files uploading and downloading, requests timeout, custom adapters, etc.
#15PaddlePaddle/PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
#16bigscience-workshop/petals
๐ธ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
#17open-mmlab/mmsegmentation
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
#18zyddnys/manga-image-translator
Translate manga/image ไธ้ฎ็ฟป่ฏๅ็ฑปๅพ็ๅ ๆๅญ https://cotrans.touhou.ai/ (no longer working)
#19PaddlePaddle/PaddleSeg
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
#20p-e-w/heretic
Fully automatic censorship removal for language models
#21InternLM/MindSearch
๐ An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
#22codertimo/BERT-pytorch
Google AI 2018 BERT pytorch implementation