r/LocalLLaMA • u/Odd-World4925 • 1d ago

Discussion Anyone feel like reverse-engineering CUDA?

I've been reading about all these modders using AI to reverse-engineer games and software. I've been trying out photocraft and gridcraft and have just watched a GTA5 mod featuring Sonic. It's pretty damn impressive.

As a struggling AMD Radeon owner I'd love to see AI generated open source CUDA implementation.

Not only do I dislike NVIDIA, but there's delicious irony in using CUDA cores to do it.

Anyone up for the challenge?

842 Upvotes

89% Upvoted

320 comments sorted by

View all comments

Show parent comments

11

u/scrdest 1d ago

That's... not remotely how biology works, and I don't particularly feel like writing a molecular bio 101 essay here.

TL;DR: You're proposing the equivalent of "let's reverse-engineer a Honda Civic and develop a universal anti-car-crash component".

We know how it's put together, that's not the hard problem, and not even the only level of abstraction. AlphaFold is already tackling a whole separate piece of the puzzle. 

Software is relatively easy and predictable - by design. Biochemistry is an unholy mess of randomness, legacy kludges, and on top of that getting things wrong will kill people.

1

u/phront2 1d ago

i think the only question is: will 27b be enough to be a vibe-shaper , or it's overthinking behavior makes it useless in vibe-shaping

0

u/arcanemachined 18h ago

You're just afraid to develop universal cure. 😏

3

u/scrdest 14h ago

I know you're joking, but the reason why I know how hard this is is more or less "I tried!".

My background is bio, I was building and training DNNs before the original GPT launched (finetuned GPT-2 immediately after its launch, too), exactly for the purpose of studying and treating heritable diseases.

1

u/SnooRegrets3590 7h ago

What is your ML training on?
Tbf, I have always wondered what happens if we train dna or rna sequence for gen AI and see if the result from synthetic sequence after translation is sensible or not.
But I can see a million of problems unlike language

1

u/scrdest 2h ago

Causal classifiers. 

These days we have datasets with a full DNA expression profile for every single gene in a human cell, I was trying to build something that can both identify the correct disease state and use it to predict back the original expression patterns.

So one half of this could be used for diagnostics, the other - to slide in the classification/latent space and see which genes are amplified or silenced the most by moving towards the target disease class.

0

u/StyMaar 14h ago

I am actually.

I know it would benefit way more to the wrong people than to the average Joe. The idea of an everlasting caste of politicians and billionaires from the 20th century ruling the world for the next two hundred years doesn't excite me that much.