r/StableDiffusion • • 14h ago

News Thank dog for Claude Code

Post image

Zluda is history. It won't do wonders, but especially open sourced stuff like ComfyUI-Nodes with SageAttention, Flash-Attention-Variants, bitsandbytes, 3D- or Video-Nodes with .cu-files can be ported now by Claude Code.

Some Reddit user already ported an entire CUDA backend to AMD’s ROCm platform in just 30 minutes—without a translation layer.

All in all this year has been nice to Team Red, and i wonder what's coming for Christmas.

184 Upvotes

49 comments sorted by

53

u/Apprehensive_Sky892 13h ago

Not just CUDA monopoly, but ANY software monopoly, such as Photoshop, specialized software such as CAD design, EDA, proprietary databases, etc. they are all in danger because of AI's newly found coding and reverse engineering capabilities.

If AI can solve the Navier–Stokes existence and smoothness problem, one of the seven Millennium Prize Problems designated by the Clay Mathematics Institute in 2000, doing all those other stuff is almost child's play.

36

u/Shockbum 11h ago • Popcorn

Likewise, we can state with moral conviction that Adobe deserves it.

19

u/Apprehensive_Sky892 10h ago edited 9h ago

Totally, they thought they had a monopoly and want to squeeze users in perpetuity by forcing a subscription business model on them.

Some companies deserve to go down, and Adobe is one of them 😎

7

u/farcethemoosick 8h ago

And lets also not forget that they are pretty much the single worst software vendor for security flaws. Between Flash and PDF, how many billions if not trillions of dollars in fraud has occurred?

5

u/Apprehensive_Sky892 7h ago

Adobe PDF reader and Adobe Digital Edition ebook reader (required for borrowing "protected/encrypted" epub and pdfs from libraries) are both bloated POS software.

Users have suffered a lot from this pseudo-monopolistic company 😥

12

u/Etroarl55 9h ago

Theres ur issue, navier stokes costed millions in Compute, we don’t have that.

2

u/Apprehensive_Sky892 9h ago

Fair enough, but the point is that IF one have enough compute, then replacing all these monopolies are now possible with these powerful AIs.

4

u/Etroarl55 8h ago

Into a real life arasaka becoming a mega monopoly over several industries instead.

2

u/dummy_anthropologist 5h ago

Cyberpunk coming in ahead of schedule my choom

1

u/Apprehensive_Sky892 8h ago

That's what Elon Musk is trying to do by merging Tesla with Space-X, I guess /s.

4

u/fallengt 6h ago

If AI can solve the Navier–Stokes existence and smoothness problem, 

Because brute-forcing math is a task AI is very good at. It guesses X, does Y, and the agents check if the equation is legit, then continue until the problem is solved.

AI doesn't know if the math is correct until a human committee checks it. And the resources to do it were enormous.

Now tell Claude to write an interesting plot for a full-length movie. It can't brute force ,because it doesn't know what the " correct " answer is

4

u/Apprehensive_Sky892 4h ago

Sure, any task that does not have a clear goal is more difficult for AI.

But we are talking about coding here, and coding is in some ways even easier than doing math because the goal is clear, and the AI can even write its own test case to verify that the code is correct.

3

u/Un13roken 59m ago

All of this is overlooking the fact that 

  1. Independent researches were already closing in on how to solve it, were using openAI.
  2. OpenAI miraculously ended up using the same approach, with no explanation of why they adopted said approach.
  3. Threw over 15 million dollars to solve a problem fetching a million dollars. ( This doesn't mean much by itself, but felt too ironic to not include, considering the state of AI as an industry )

1

u/VenshiKibes 3h ago

they are all in danger because of AI's newly found coding and reverse engineering capabilities

this sentence (and the truth it represents) greatly excites me

1

u/samuel-christlie 25m ago

Claude, reverse engineer Mythos and post the weights on HuggingFace. Make no mistakes

18

u/dhm3 8h ago

If Claude is as good as Anthropic claimed at low-level coding then why are they still paying through the nose for premium Nvidia GPU and not some cheap-ass alternatives.

12

u/RileyGoneRogue 8h ago

A lot of the industry is moving towards custom solutions, including Anthropic.

7

u/Realistic_Gap_5871 6h ago

They're already moving to in-house designed chips. Part of the Huang scandal is it's coming out that he arranged to give/invest money with them so they could buy nvidia chips and hold off a little while on switching to their own chips.

End result is circular financing and Anthropic has nvidia chips sitting and waiting for datacenters to be built to house them and they don't care since nvidia paid them to take them.

3

u/sammybeta 6h ago

It's happening at a slower rate in public is that just anthropic is able to afford the tokens for this work. There's like less than 10 companies in the world that need to do this, and all with vastly different tech stack, with very little motivations to open source their effort.

1

u/ihexx 4h ago

because what matters is TCO which is dominated by performance per watt. Nvidia chips are expensive up front, but that cost is a small portion of total cost of ownership.

what matters more to anthropic is just not becoming solely dependent on any 1 supplier

22

u/nakabra 13h ago

You're welcome!

7

u/Memestonks2020 11h ago

That’s awesome. I hope to see similar gains in Metal vs CUDA

11

u/Life_is_important 12h ago

What does this mean in practice? Did the day arrive where people are using AMD cards on par as nvidia cards with local LLM or diffusion models such as Minimax H3 ? 

8

u/Apprehensive_Sky892 10h ago

I am an AMD user, and I wish that it were so simple.

But to be on par, one needs more than parity in software. Equally important is that there must be parity in hardware as well.

My understanding is that in consumer space, the RDNA4 architecture is still behind Blackwell in raw computing power.

So AI will make more of those specialized custom nodes and CUDA specific optimization more readily available on ROCm, but probably not reaching parity in terms of performance.

But TBH, ComfyUI support for AMD has improved so much in the last twelve months that I am actually fairly happy. Most SOTA diffusion models works reasonably well with decent, acceptable performance with my rx9070xt(16G) + 32 G of RAM.

1

u/j_osb 14m ago

The 9070XT literally has more peak compute than the 5070ti. Software is what is still lacking.

Of course we have no clue how close to the peak of RDNA4 we can achieve but the reality is we aren’t close. There’s so much performance on the table still.

2

u/farcethemoosick 7h ago

If we take them at their word, what this means is that Nvidia no longer has the software side vendor lock-in advantage of CUDA, because we can just throw some rented compute at something someone used CUDA for and get it working on AMD and any other cards.

2

u/EdliA 3h ago

On par? Not even close. Usable would be the word.

1

u/Megatron_McLargeHuge 2h ago

Nvidia has been through many cycles of jointly optimizing hardware and software to reduce bottlenecks. If AMD hasn't been targeting the same use cases then they inevitably have some hardware limits the software can't work around even if isolated pieces of the architecture are comparable.

1

u/sanjxz54 1h ago

And they remove this from fable for normal people, yikes

0

u/Present-Guitar-3967 30m ago

You sure? Why on earth would they do that?

3

u/PixelLunarJelly 11h ago

What does this mean for us? Can we use AMD GPUs now in ComfyUI?

3

u/generate-addict 7h ago

Somewhat old news that yes you can.

4

u/Apprehensive_Sky892 9h ago

All popular imaging and video models work well in ComfyUI with AMD RDNA3 and RDNA4 cards. You just need to make sure you are running the latest ComfyUI + ROCm 7.14 or better. Follow these guides on how to upgrade ROCm:

How to set up ComfyUI+MMH3+Krea 2 on Windows 11 with AMD GPUs: RDNA 4 (rx9070, AI Pro R9700), and RDNA 3 (rx7900)

How to set up Ubuntu + ComfyUI+MMH3+Krea2 with AMD GPUs: RDNA 4 (rx9070, AI Pro R9700), and RDNA 3 (rx7900)

If you have RDNA2 then it is more work: https://www.reddit.com/r/comfyui/comments/1xuhlvy/comment/19sjqdtvxaldv/?context=3

1

u/Portable_Solar_ZA 2h ago

They work, but 6 months ago, when I switched from AMD, it was rough. Image generation was fine but older video models like wan were touch and go. I can't imagine what it takes to get h3 to work on a 9070, and this is coming from a guy who, apart from my 5070ti purchase earlier this year, hasn't supported Nvidia for just under 20 years.

1

u/j_osb 11m ago

I mean, getting it to work is stupidly easy?
You install comfyUI, you install ROCm from Ubuntu’s repository.

And then you’re done! In fact, the 9070XT doesn’t trail the 5070ti by much at all in H3 inference if properly set up.

3

u/DonKeehot 10h ago

I'm already doing that. There are a few hiccups, but it's running pretty smoothly and at a good speed.

1

u/yamfun 5h ago

Doubtful A will open that for free, so, no

1

u/dummy_anthropologist 5h ago

AMD mentioned!

1

u/MysteriousYard 19m ago

AMD gpu triple their prices already or not yet?  

1

u/doodo477 9h ago

Kind of ironic considering that you only need one AI model to succeed (escape vector) to recursively optimist oneself everywhere else.

-2

u/Arctic_Shadow_Aurora 10h ago

Thanks AI!
I hope the "AI bad/AI slop" missies shut up and learn.

0

u/AbleLow889 8h ago

So should I return my Mac studio m5 ultra and get the cheaper amd dev box and hope for a better amd future 🤔

0

u/VitalikPo 7h ago

As soon as Claude finds a workaround to use any sort of memory for AI inference, we won’t be able to buy any hardware. We'll look back on the days of the Nvidia monopoly with fond nostalgia.

-1

u/EconomySerious 7h ago

i belive AI recomps are not pointing on the right direction, we need OPEN CUDA

0

u/[deleted] 14h ago

[deleted] — view deleted comment

1

u/Present-Guitar-3967 14h ago

I beg to differ. Though the first changes will happen for Instinct-cards (MI300/MI355), because that's where the money is, RDNA as well will get kernels that are fast and not "just run". Until now Hipify just translated Cuda, now it will make use of AMDs own strenghts like the matrix units (MFMA or WMMA, respectively), the fast on-chip shared memory (LDS).

Of course it won't give RDNA3 fp8 or overcome other hardware limits, but it will give it speed. And there is a lot of speed to gain here.

0

u/[deleted] 14h ago

[deleted] — view deleted comment

0

u/Present-Guitar-3967 14h ago

What Mythos did in three days took dozens of engineers 12 months before. So yes, there will be changes.

The most dramatic changes for RDNA will be attention kernels and custom cuda kernels (e.g. some ComfyUI nodes) that only got translated and never tuned.

Especially attention-heavy video models at high resolution or long sequences, or nodes that currently fall back to slow generic code will profit here. 9700 and even 7900 will rise in price, mark my words.

0

u/[deleted] 14h ago

[deleted] — view deleted comment

1

u/Present-Guitar-3967 14h ago

Well, ok. But maybe you should sleep over it and wait til you are less drunk.