I’ve taken some time to write a small blog on how the execution of a CUDA program works behind the scenes and a gentle introduction to GPU architecture.
When I started learning GPU programming, I wished for something like this to help me understand the basics.
Was trying to learn CUDA and was finding it real hard to understand indexing threads correctly in higher dimensions. Just understood something that feels nice and correct,
every element in the data that you are working with will also be identified by 2 dimensions(i and j). Now inside the kernel you can do, i = blockIdx.x*blockDim.x + threadIdx.x and j = blockIdx.y*blockDim.y+ threadIdx.y
when I was showering this morning
somehow my apple watch triggered my phone to play just this video, and this video only
clearly a prophecy for the...
2025 MOOD!!!!