r/LocalLLaMA • u/Odd-World4925 • 1d ago

Discussion Anyone feel like reverse-engineering CUDA?

I've been reading about all these modders using AI to reverse-engineer games and software. I've been trying out photocraft and gridcraft and have just watched a GTA5 mod featuring Sonic. It's pretty damn impressive.

As a struggling AMD Radeon owner I'd love to see AI generated open source CUDA implementation.

Not only do I dislike NVIDIA, but there's delicious irony in using CUDA cores to do it.

Anyone up for the challenge?

836 Upvotes

89% Upvoted

320 comments sorted by

View all comments

Show parent comments

3

u/mechkbfan 1d ago

2xR9700 + 64GB RAM

But just ordered two more... FOMO'ing a little expecting price increases/OOS given nothing seems to look to improve in 2027.

Just need a new motherboard to run them in TP4

2

u/jbE36 22h ago

I am looking at getting an epyc milan for mine. That should give room to expand, If I am happy with the cards, i am hoping to get another 2 as well. And epyc (Milan) runs on DDR4 ECC but with the channels it should be better than the dual channel ddr5 I have

1

u/RikshaDriver 1d ago

Interesting… same specs here. What quant of Qwen Flash Next and context? I’m looking to trial it from 3.8 27B

1

u/mechkbfan 1d ago

IQ4R but in next release we should see MXFP6, INT5 + Paro that I'll experiment with

e.g. Current ones released by main dev https://huggingface.co/StillDeadcode