Best Open Source transformer Libraries
A curated list of the most popular GitHub repositories tagged with transformer. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
#2vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
#3labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
#4ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
#5open-mmlab/mmdetection
OpenMMLab Detection Toolbox and Benchmark
#6sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
#7fishaudio/fish-speech
SOTA Open Source TTS
#8datawhalechina/leedl-tutorial
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
#9lukas-blecher/LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
#10p-e-w/heretic
Fully automatic censorship removal for language models
#11graykode/nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
#12open-mmlab/mmsegmentation
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
#13zyddnys/manga-image-translator
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/ (no longer working)
#14PaddlePaddle/PaddleSeg
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
#15vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
#16thunlp/OpenPrompt
An Open-Source Framework for Prompt-Learning.
#17vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
#18AspirinCode/papers-for-molecular-design-using-DL
List of Molecular and Material design using Generative AI and Deep Learning
#19SakuraMathcraft/LaTeXSnipper
Formula Recognition & Office Editing Math Workspace | Handwriting & PDF to LaTeX/Markdown, And Secure API Integrations.
#20wanshuiyin/ARIS-in-AI-Offer
Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱
#21walkinglabs/modern-llm-notebook
A hands-on course for building modern LLMs from scratch in PyTorch, with 26 runnable Jupyter Notebooks covering tokenizers, attention, MoE, RLHF, inference, evaluation, and distillation.