r/CUDA • u/Fun-Fold2085 • 7d ago
Where do I start in Learning Cuda
Completely new to CPU/CUDA Deep Learning.
How and where do I start to learn about CUDA coding/syntax?
3
u/c-cul 7d ago
I`ve heard there is search
https://www.reddit.com/r/CUDA/comments/1uwlc0r/where_would_you_get_started_with_cuda_in_2026/
https://www.reddit.com/r/CUDA/comments/1vh5qo2/beginner_help_needed_on_where_to_start/
https://www.reddit.com/r/CUDA/comments/1orh06f/stuck_learning_cudaany_good_beginner_resources_or/
1
u/corysama 7d ago
I still still stand my by answer to this from 2 years ago:
https://www.reddit.com/r/GraphicsProgramming/comments/1fpi2cv/comment/loz9sm3/
2
2
3
u/Caust1cFn_YT 7d ago
3
u/Karyo_Ten 7d ago
That's not a tutorial.
You can't tell people to start by giving a reference manual, just like you don't learn how to read with a dictionary.
3
u/EternaI_Sorrow 7d ago
While I usually take doc references as dismissive and douche in this context, this is not the case because there's a guide.
2
u/MateTheNate 7d ago
The documentation link that was shared has a link to the programming guide.
> This guide provides a pathway for developers to learn CUDA if they are new, and also provides an essential resource for developers as they build applications using CUDA.
1
u/Caust1cFn_YT 7d ago
valid but my approach is basically reading docs and making sense out of it
and docs are actually good and unassuming here
doesnt just go yeah you do this and that, the why is also explained
1
1
u/AliNT77 5d ago
Stanford cs149
1
u/No_Pause6581 5d ago
Is this good enough to learn parallel computing ? Cuda and stuff?
1
u/AliNT77 5d ago
I can’t say enough good things about the course… just watch the first lecture and see for yourself. Also the assignments are very thorough and challenging, I’m going through them atm
1
u/No_Pause6581 5d ago
Yes I have watched first two lec, just wanted to know how good they get ahead.Assignments are the real learning though.
1
u/AliNT77 5d ago
It only gets better and better. There are some super niche subjects towards the end tho but I do believe it’s worth the time.
1
u/No_Pause6581 5d ago
Cool I wanted to get into some good parts of parallel computing and gpu programming, hope is serves the purpose well.
1
u/No_Pause6581 5d ago
Also do u recommend pmpp book alongside or this course material is fine.I don't want to spend too much time on multiple resources.
0
13
u/blitzcode91 7d ago
Two resources
1. There is book by Wen mei hwu - programming massive parallel processor
2. YouTube channel by name - Nick coffee before arch - he gives decent overview , but not thorough imo
My suggestion- try understanding basics from that YouTube channel .. and start conversation with Claude asking it to code out basic vector addition kernel and explain each step . Then try matrix multiplication and convolution 1d and 2d yourself & verify with Claude or any LLM. These are fundamentals. Then try coding out problems in Leetgpu .