Best Open Source attention Libraries
A curated list of the most popular GitHub repositories tagged with attention. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
#2sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
#3graykode/nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
#4xmu-xiaoma666/External-Attention-pytorch
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
#5jadore801120/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".