mrdbourke / pytorch-deep-learning

Learn PyTorch for Deep Learning Welcome to the Zero to Mastery Learn PyTorch for Deep Learning course, the second best place to learn PyTorch on the internet (the first being the PyTorch documentation). • **Update April 2023:** New tutorial for PyTorch 2.0 is live! And because PyTorch 2.0 is an additive (new features) and backward-compatible release, all previous course materials will *still* work with PyTorch 2.0. Contents of this page • Course materials/outline • About this course • Status (the progress of the course creation) • Log (a log of the course material creation process) Course materials/outline • 📖 **Online book version:** All of course materials are available in a readable online book at learnpytorch.io. • 🎥 **First five sections on YouTube:** Learn PyTorch in a day by watching the first 25 hours of material. • 🔬 **Course focus:** code, code, code, experiment, experiment, experiment. • 🏃‍♂️ **Teaching style:** https://sive.rs/kimo. • 🤔 **Ask a question:** See the GitHub Discussions page for existing questions/ask your own. | **Section** | **What does it cover?** | **Exercises & Extra-curriculum** | **Slides** | | ----- | ----- | ----- | ----- | | 00 - PyTorch Fundamentals | Many fundamental PyTorch operations used for deep learning and neural networks. | Go to exercises & extra-curriculum | Go to slides | | 01 - PyTorch Workflow | Provides an outline for approaching deep learning problems and building neural networks with PyTorch. | Go to exercises & extra-curriculum | Go to slides | | 02 - PyTorch Neural Network Classification | Uses the PyTorch workflow from 01 to go through a neural network classification problem. | Go to exercises & extra-curriculum | Go to slides | | 03 - PyTorch Computer Vision | Let's see how PyTorch can be used for computer vision problems using the same workflow from 01 & 02. | Go to exercises & extra-curriculum | Go to slides | | 04 - PyTorch Custom Datasets | How do you load a custom dataset into PyTorch? Also we'll be laying the foundations in this notebook for our modular code (covered in 05). | Go to exercises & extra-curriculum | Go to slides | | 05 - PyTorch Going Modular | PyTorch is designed to be modular, let's turn what we've created into a series of Python scripts (this is how you'll often find PyTorch code in the wild). | Go to exercises & extra-curriculum | Go to slides | | 06 - PyTorch Transfer Learning | Let's take a well performing pre-trained model and adjust it to one of our own problems. | Go to exercises & extra-curriculum | Go to slides | | 07 - Milestone Project 1: PyTorch Experiment Tracking | We've built a bunch of models... wouldn't it be good to track how they're all going? | Go to exercises & extra-curriculum | Go to slides | | 08 - Milestone Project 2: PyTorch Paper Replicating | PyTorch is the most popular deep learning framework for machine learning research, let's see why by replicating a machine learning paper. | Go to exercises & extra-curriculum | Go to slides | | 09 - Milestone Project 3: Model Deployment | So we've built a working PyTorch model... how do we get it in the hands of others? Hint: deploy it to the internet. | Go to exercises & extra-curriculum | Go to slides | | PyTorch Extra Resources | This course covers a large amount of PyTorch and deep learning but the field of machine learning is vast, inside here you'll find recommended books and resources for: PyTorch and deep learning, ML engineering, NLP (natural language processing), time series data, where to find datasets and more. | - | - | | PyTorch Cheatsheet | A very quick overview of some of the main features of PyTorch plus links to various resources where more can be found in the course and in the PyTorch documentation. | - | - | | A Quick PyTorch 2.0 Tutorial | A fasssssst introduction to PyTorch 2.0, what's new and how to get started along with resources to learn more. | - | - | Status All materials completed and videos published on Zero to Mastery! See the project page for work-in-progress board - https://github.com/users/mrdbourke/projects/1 • **Total video count:** 321 • **Done skeleton code for:** 00, 01, 02, 03, 04, 05, 06, 07, 08, 09 • **Done annotations (text) for:** 00, 01, 02, 03, 04, 05, 06, 07, 08, 09 • **Done images for:** 00, 01, 02, 03, 04, 05, 06, 07, 08, 09 • **Done keynotes for:** 00, 01, 02, 03, 04, 05, 06, 07, 08, 09 • **Done exercises and solutions for:** 00, 01, 02, 03, 04, 05, 06, 07, 08, 09 See the log for almost daily updates. About this course Who is this course for? **You:** Are a beginner in the field of machine learning or deep learning and would like to learn PyTorch. **This course:** Teaches you PyTorch and many machine learning concepts in a hands-on, code-first way. If you already have 1-year+ experience in machine learning, this course may help but it is specifically designed to be beginner-friendly. What are the prerequisites? • 3-6 months coding Python. • At least one beginner machine learning course (however this might be able to be skipped, resources are linked for many different topics). • Experience using Jupyter Notebooks or Google Colab (though you can pick this up as we go along). • A willingness to learn (most important). For 1 & 2, I'd recommend the Zero to Mastery Data Science and Machine Learning Bootcamp, it'll teach you the fundamentals of machine learning and Python (I'm biased though, I also teach that course). How is the course taught? All of the course materials are available for free in an online book at learnpytorch.io. If you like to read, I'd recommend going through the resources there. If you prefer to learn via video, the course is also taught in apprenticeship-style format, meaning I write PyTorch code, you write PyTorch code. There's a reason the course motto's include *if in doubt, run the code* and *experiment, experiment, experiment!*. My whole goal is to help you to do one thing: learn machine learning by writing PyTorch code. The code is all written via Go…