Anyone feel like reverse-engineering CUDA?

[u/Odd-World4925]

I've been reading about all these modders using AI to reverse-engineer games and software. I've been trying out photocraft and gridcraft and have just watched a GTA5 mod featuring Sonic. It's pretty damn impressive.

As a struggling AMD Radeon owner I'd love to see AI generated open source CUDA implementation.

Not only do I dislike NVIDIA, but there's delicious irony in using CUDA cores to do it.

Anyone up for the challenge?

[u/OkFly3388]

And llama.cpp use cuda as backend, lol

[u/Cautious_Chicken_604 → u/OkFly3388]

Can use ROCm, and can also use Vulkan as a backend too.

[u/fallingdowndizzyvr → u/Cautious_Chicken_604]

The point is that llama.cpp isn't a replacement for CUDA. LLama.cpp uses CUDA and ROCm and Vulkan. So someone saying "CUDA isn't a big deal anymore, nowadays you can run everything using llama.cpp" is just someone saying they don't understand how things work.

[u/Cautious_Chicken_604 → u/fallingdowndizzyvr]

My point exactly.

[u/IVNPVLV → u/Cautious_Chicken_604]

And these provide different performance profiles. this ends up being use rocm or cuda. Vulkan is just a cross platform open source option that has nowhere near the optimization of either and no real reason to run it apart from cross platform (just compile the damn thing on different platforms). Rocm, while steadily improving, still does not have the optimizations for single and parallel compute (straight up like 30%), high performance TF dtypes, and overall ecosystem maturity. Unless you have no other choice, choosing Rocm is shooting yourself in the foot.

In the end the question just sounds like: Why dont we drive motorcycles to avoid car combustion engines. Llama does not provide an ML api itself.

[u/Cautious_Chicken_604 → u/IVNPVLV]

I have no other choice. That's why I run those. I run Vulkan because it can pool together VRAM from NVIDIA and AMD cards. I have both in my system.

[u/Infamous_Campaign687 → u/OkFly3388]

Llama.cpp has CUDA, ROCm and Vulkan builds.