Here are some notes discussing stuff I’m either learning about or working on. Some of this is more properly written up, other posts are more informal (or even just bullet points).
This chapter goes more into detail on GPU architecture and how threads are scheduled for execution.
May 12, 2024
In this post, I talk about implementing a minimal Vision Transformer (ViT) for image classification “from scratch” in PyTorch. I’ve named it Part 1 (optimistically) because I may optimize the code a bit and write a follow-up.
May 11, 2024
This chapter discusses the organization of multidimensional grids of threads processing multidimensional data.
Notes | Code: Basic Matmul | Code: Image Transforms
February 10, 2024
This chapter discusses the basic ideas defining CUDA kernels and executing code on host (CPU) vs. device (GPU).
February 9, 2024
A few notes on the introductory chapter to this book on CUDA and GPU programming
February 7, 2024
A write-up of my notes from Gatsby’s theoretical neuroscience course
May 18, 2020