PyTorch Lightning Tutorials

Tutorial 1: Introduction to PyTorch

This tutorial will give a short introduction to PyTorch basics, and get you setup for writing your own neural networks. This notebook is part of a lecture series on Deep...

GPU/TPU, UvA DL Course

Tutorial 2: Activation Functions

In this tutorial, we will take a closer look at (popular) activation functions and investigate their effect on optimization properties in neural networks. Activation functions...

GPU/TPU, UvA DL Course

Tutorial 3: Initialization and Optimization

In this tutorial, we will review techniques for optimization and initialization of neural networks. When increasing the depth of neural networks, there are various challenges...

Image, Initialization, Optimizers, GPU/TPU, UvA DL Course

Tutorial 4: Inception, ResNet and DenseNet

In this tutorial, we will implement and discuss variants of modern CNN architectures. There have been many different architectures been proposed over the past few years. Some...

Image, GPU/TPU, UvA DL Course

Tutorial 5: Transformers and Multi-Head Attention

In this tutorial, we will discuss one of the most impactful architectures of the last 2 years: the Transformer model. Since the paper Attention Is All You Need by Vaswani et...

Text, GPU/TPU, UvA DL Course

Tutorial 6: Basics of Graph Neural Networks

In this tutorial, we will discuss the application of neural networks on graphs. Graph Neural Networks (GNNs) have recently gained increasing popularity in both applications...

Graph, GPU/TPU, UvA DL Course