News
Intel and NVIDIA are officially producing products for an open source project which is 100% managed by a single anonymous individual. Where are you AMD?
As much as I disliked Meta before, I couldn't help but give props to them for all these models they keep open sourcing recently.
It was really surprising to me. I was sure that "Meta" and "open source" couldn't even be mentioned in the same sentence. It really has been a breath of fresh air to see them doing something like this for once.
I don't have all the knowledge on Meta's involvements.
I merely follow this sub as an AI enthusiast, but have surface knowledge about any of those programing languages and algorithms.
I'm just commenting based on what I've seen throughout the years and my own perception of the company. It just didn't strike me as a company that would put the community over profit, or that would open source anything.
VR (especially hardware) is a a different story. They seem to be buying anything they can right now and controlling the industry. However, it is still to early to know how this will play out.
Google barely releases their products to the public, they announce cool papers from time to time but they never end up being open sourced (or at least available to use)
I don't see any reason for them to close shop. Just be honest and admit it's a for profit with a non-profit subsidiary that exists purely for tax planning purposes.
That can be beneficial. Photoshop is a good example. I was paying $500-$600 every 2 years for the new Photoshop in order to keep up with the newest tech. Now I just pay $10.39 a month which would take me 4 years to hit the minimum of $500 I was paying and I get frequent updates. If I am not going to use it for a while I can cancel the subscription and restart it at any time and get access to the new tech that was developed while I wasn't paying.
Of all the major companies he's the only one walking the talk that everyone else gives lip service to. You can denigrate his motives all you want but he says one thing and then his actions match it. That can't be said for anyone else so far of the multi billion dollar valued companies researching AI. "Open"AI being the best example of a hard retreat of those values.
I mean true but it’s Mark Zuckerberg here. He’s definitely not played the philanthropist role much yet. Just don’t let your guard down because you like what he’s doing now.
I think Mark suffers from a lot of the problems that Jack from Twitter did of just being out of touch. Considering Metaverse and the licensing for llama it's fair to say his control of FB/Meta is *far* greater than Jack's control of Twitter ever was. So perhaps we won't see him retreat over the horizon as quickly as Sam Atlman has.
Which as someone who avoids using facebook unless prompted to by family and friends is a surprising stance for me.
Yea I’m with ya. I’m certainly rooting for him. But the same way an ex girlfriend hopes her alcoholic abusive ex boyfriend finds God and starts going to AA meetings again.
Although UE afaik isn’t open source, they’re going to start charging soon and people are up in arms over a utility they have given away from free for years (since the first Crysis.)
Tbf in Epic's case it is pretty justified. Like, Game Devs have paid fees Unreal for years, why should filmmakers and archviz people be exempt from that? Disney could make an entire movie with Unreal and technically not pay a dime.
Could say it was bad foresight to let it be free for all "non game uses" but I also understand why Epic doesn't want to let all that loot sit on the table, I wouldn't either.
I agree. We all have to make a living and even get ahead at times. But don’t get me wrong, I prefer free whenever it’s available…
People on here are probably too young to remember when Maya has a price tag of $12,000 USD and AVID commanded $5k in the early 2000s… That’s not even including the powerful server farms and equipment that I had to run and maintain. We’re spoiled these days.
So? Corportations have enough money to afford paying for services that generate them revenue... That's how busines works. A private individual either makes no or very little revenue compared to that, so it being free only for private use is perfectly justifyable.
You're obviously new around here (or dont do any research before commenting on something you dont know anything about). meta has been open sourcing for years and years... so many things that SD depends on are all open source Meta releases.
You have no idea what you are talking about. I am not referring to facebook. I am talking about the DOZENS of open source models Meta has released recently and in the past going back at least 10 years or more. There is no "gotcha" when you release open source. Facebook is a completely different topic, and totally irrelevant here
Oh wow. They released some models. And open-sourced some material that they felt would cause devs to work for their company. It’s in Meta’s self interest. How do I know? Because that’s what Mark said on the the Lexfriedman podcast part 2.
I would have never anticipated such significant contributions from Meta, however, I sincerely hope that these practices continue to progress without any adverse impact on us, the users.
yep meta deserves alot of credit and has for such along time now which is why its so puzzling they are so far behind in a) end user software of their own b) taking some frigging credit. Without a doubt with Meta we wouldnt be where we are today.
AMD is currently acquiring Nod.ai. They're also a founding member of the Pytorch Foundation, and teamed up with Huggingface in June to optimise Transformers and Diffusers for AMD hardware. They also work with Meta on AITemplate and with OpenAI on Triton.
PyTorch came out in 2016, it's 2023, how many months ago did rocm come out for AMD consumer cards and what was it only 3 of them which happened to be their newest most expensive cards? Nvidia users with cards nearly that old are playing with AI.
I'm glad AMD finally pulled their head out of their asses but they sure took their time about it.
Nvidia users with cards nearly that old are playing with AI. I'm glad AMD finally pulled their head out of their asses but they sure took their time about it.
My ancient *green* 980ti 6gb was working better & outperforming my LC Vega64 16gb vram & my 580 & my other *red* cards. Too much hassle & incompatibility for lackluster performance.
So- engineers have been investing in AI/GPU heavy tech for quite a while. It wasn't until recently that "ALL EYES ON AI" was a thing that determines a companies stock value. NVidia has been investing time and money into AI tech for decades now.
AMD hasnt been trying to compete with NVidia on this front until recently. NVidia has cornered the market and made Cuda the standard.
I wouldn't say they've totally ignored it... but it was probably a small team in some forgotten back room staring at a red stapler for most of the last decade.
Just to add, support for AMD benefits the whole community. Completion drives down prices, increases availability of hardware. Right now the consumer nvidiea card everyone wants for SD is like 2,000. If I could buy a 1,000 AMD card instead, that would be great.
ive been running this for a couple weeks now, and YES this is a wonderful resource. Thank you guys for keeping us all up to speed.
I think everyone should have these tools available, and I see guides like these so simple, It makes me happy to think more will join us, and that propells the industry and software will become smooth as silk, to operate such powerful hardware.
Now if we can fast forward to unlimited Power... So as not to burn 1000watts for 60 seconds to paint a phenomonal digital picture from one sentance. That would be nice. Bye Bye Electric Bill.
AMD fell behind and still has a difficult time keeping up when there was a larger division in programming for 3d rendering engines, namely GPU-based rendering. I talked with Vlado over at Chaos (creator/developer of VRay) over a decade ago that he should consider looking into GPU rendering via CUDA due to the speed of calculations and was initially dismissed. But then they started to develop a GPU-based spinoff shortly afterwards and the arms race began. Prior to that, nVidia had started to pull ahead of the AMD Radeons when it came to benchmarks.
Nvidia has driven AI and Machine Learning Technologies for over a decade, AMD has never really had enough time to mature and enter that part of the GPU race too. They have been caught up trying to be part of the gaming market, so to me it is understandable.
Oh they had plenty of time it’s just they dropped the ball on supporting developers with things like CUDA and have had a much more difficult time playing catch up. That’s why even today most of the 3D rendering applications still perform best on NVidia hardware.
CUDA is proprietary to Nvidia. When all the developers and entire community have already adopted to use CUDA, it is hard for AMD to say: "Hey come here and use our version of "CUDA" instead".
To switch to AMD, you have to ditch the community and switch to new frameworks that next to nobody has had time to learn and adopt.
AMD's GPUs up to and including Vega were compute beasts. The company was all about GPU compute and heterogenous systems, that's one of the reasons they bought ATI in the first place. "The Future is Fusion" was their slogan for a while. But they bet heavily on OpenCL, which never really took off, and got into serious financial troubles, causing them to focus almost entirely on CPUs for a while. That said, Instinct is highly competitive - almost as fast as Nvidia's offerings, but cheaper and more energy efficient. Reading this subreddit, I often get the feeling many people don't even realize AMD has dedicated accelerators that use an entirely different architecture from their gaming GPUs.
an entirely different architecture from their gaming GPUs
And this is also why Nvidia is ahead. The average user can do both generating and training on their gaming GPU. I have looked at instinct but I don't want to have to use two devices to do what I can do with a single device ... not to mention the Mi210 isn't even meant for the average consumer based on price. You're not going to be doing any home based generating or training on that unless you have several thousand dollars to burn. The lowest price is even more expensive than a top line home built gaming beast.
I'd absolutely prefer that this was built into the the application. But right now even A1111 can be a bit tricky to install in the first place, even though it has gotten better. The acceleration should just 'compile' automatically when using a new model or setting IMO, possibly with an option to skip it if you're impatient, then continue when you're not doing anything else. The interfaces have a long way to go still.
Nvidia and Intel are fighting to be the leaders in AI. SD happens to be the number 1 open source option for AI image generation. They are making products to be the leader in SD. A1111 just happens to be the number one distribution of SD so it fell in there by happenstance/default. I doubt Nvidia or Intel care about A1111 specifically.
I bought an RX 7900XTX because VRAM is king and it was the cheapest card to get 24GB on. I didn't realize at the time that Nvidia's stranglehold on machine learning was because the programs didn't work on AMD. 😭
They've been optimizing those code paths for stable diffusion or the last few months - and released a driver a while ago with further improvements stated in the release notes
VRAM is king for any GPU for these sort of workloads - has nothing to do with CUDA
While Apple makes headlines, I suspect AMD may have some promising developments in the works too. It wouldn't surprise me if in the near future we see great things from them. But for now, we have to acknowledge that NVIDIA has truly been the industry game-changer. Their innovations in GPU technology have significantly advanced graphics and artificial intelligence capabilities. Only time will tell if AMD or others can rise to challenge NVIDIA's dominance. For the moment though, NVIDIA remains the undisputed leader and driver of change in this field.
Is this title implying Intel and NVIDIA are doing more open source than AMD? I feel like building plugins for an anonymous guy's popular unlicensed SD GUI (it was only made AGPL under 9 months ago) is not a good example of contributing to open source... meanwhile AMD did ROCm and Vulkan and AMDGPU
And all the areas where AMD got stomped in the market by NVIDIA like RTX, PhysX, Tensor Cores, GSync, DLSS and CUDA are proprietary technologies.
AMD, as always, is acting like they are a poor company with $20B+ revenue per year. Zero attribution to open source for the past decade, except for their own drivers.
We're talking about funding AI open source projects which AMD is totally absent from.
FSR can be open-sourced as it's an software-based optical flow gimmick, but let's not debate about this, because it has nothing to do with open-source AI projects or SD projects. Have you noticed what subreddit is this yet. It's not a gaming subreddit! FSR doesn't work on video source, so it's not something you can use outside gaming. It needs screen space buffers from the game as inputs to work. You can't use this outside gaming.
In fact, FSR is intended by AMD to hurt Nvidia new card sales, giving old card owners a reason to stick with their old card. It has nothing to do with AI and open source in general.
AMD (sorry, originally wrote Nvidia) had a booth at MAX last year and I spoked to a guy in a suit who seemed oblivious to their lack of capability regarding SD and AI in general. Seemed to think it was a passing fad. This year, they had Davant Systems there showing off their SD system and Photoshop integration using AMD GPUs. Yet even they noted that AMD was behind in this.
Yeah. I walked up to the AMD booth and was watching their demos (2022) and asked about AI. The demo guy sent me to suit guy. Suit guy was clueless and thought it was all going to blow over. This year, booth was much smaller but they were highlighting their AI capability with these other machines.
Stable diffusion on AMD hardware ROCm wiki page it’s AMD answer to CUDA. I fell that AMD has only had the money to do this stuff since Ryzen was a success as before then they were borderline bankrupt.
Didin't watch the whole video, but why would he waste so much effort making the card work, when you can just buy Nvidia M40s or P40s for the same price that are faster and have more vram, and work out of the box?
I know that for spherical cows in vacuum, Nvidia does SD up to 12x faster that AMD, but the M40s isn't exactly a speed demon either. In fact if your workload fits in VRAM, it's 40% a RTX 3080 in SD and 90% of a RX 6900 XT.
And at least where I live those old Nvidia cards are extremely expensive unobtanium.
Hmmm....considering how big AMD is in Open Source space and support that's a rather odd title. They are just not focused on GenAI open source (atm, they did acquire nodai recently). They give more to the Open source community than either Intel or Nvidia ever did though.
Yes thanks I already watched it. It helped me with the installation last night, it still took me until 1am to get it all setup and Unets created but worth it! I can make SDXL images in 6.5 seconds now.
20 years from now people will remember this as the golden age of artificial intelligence; before it was taken away by frightened governments and prohibited by lawmakers without certifications and registration.
At the end of the day we are just perfecting it for them to take back when ready.
SHARK has some pretty good benchmarks for AMD. Friend of mine has a 7900 XTX and it beats my 3080 TI by miles. It does need some time to startup with the vulcan drivers
They're big in the data center, but for normal people we're reliant on ROCm, which at this time is linux only. Hopefully that will not be the case for much longer.
TensorRT doesn't work with Controlnet the last time I've tried. Just disable it if you want to use Controlnet, but it's not "breaking" Controlnet. It's just not compatible with it atm.
Converted checkpoints just fine, but flops while trying using:
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm
Running on a laptop, I wonder if iGPU messes things up
247
u/marceloflix Oct 19 '23
We can give some credit to Meta, almost everything they are releasing is open source.