Awesome
Deep Tutorials for PyTorch
This is a series of in-depth tutorials I'm writing for implementing cool deep learning models on your own with the amazing PyTorch library.
Basic knowledge of PyTorch and neural networks is assumed.
If you're new to PyTorch, first read Deep Learning with PyTorch: A 60 Minute Blitz and Learning PyTorch with Examples.
24 Apr 2023: I've just completed the Super-Resolution and Transformers tutorials.
09 Dec 2023: Interested in chess or transformers? Check out Chess Transformers.
In each tutorial, we will focus on a specific application or area of interest by implementing a model from a research paper.
| Application | Paper | Tutorial | Also Learn About | Status |
|---|---|---|---|---|
| Image Captioning | Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning | • encoder-decoder architecture<br/><br/>• attention <br/><br/>• transfer learning <br/><br/>• beam search | 🟢<br/>complete |
| Sequence Labeling | Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling | • language models<br/><br/>• character RNNs <br/><br/>• multi-task learning <br/><br/>• conditional random fields <br/><br/>• Viterbi decoding <br/><br/>• highway networks | 🟢<br/>complete |
| Object Detection | SSD: Single Shot MultiBox Detector | a PyTorch Tutorial to Object Detection | • single-shot detection<br/><br/>• multiscale feature maps <br/><br/>• priors <br/><br/>• multibox <br/><br/>• hard negative mining <br/><br/>• non-maximum suppression | 🟢<br/>complete |
| Text Classification | Hierarchical Attention Networks for Document Classification | a PyTorch Tutorial to Text Classification | • hierarchical attention | 🟡<br/>code complete |
| Super-Resolution | Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network | a PyTorch Tutorial to Super-Resolution | • GANs — this is also a GAN tutorial <br/><br/>• residual connections <br/><br/>• sub-pixel convolution <br/><br/>• perceptual loss | 🟢<br/>complete |
| Machine Translation | Attention Is All You Need | a PyTorch Tutorial to Transformers | • transformers <br/><br/>• multi-head attention <br/><br/>• positional embeddings <br/><br/>• encoder-decoder architecture <br/><br/>• byte pair encoding <br/><br/>• beam search | 🟢<br/>complete |
| Semantic Segmentation | SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers | a PyTorch Tutorial to Semantic Segmentation | N/A | 🔴<br/>planned |