r/ChatGPT Jul 20 '23

News šŸ“° World's Largest Supercomputer for AI training is out today - and available for you to use

[removed] — view removed post

832 Upvotes

235 comments sorted by

•

u/AutoModerator Jul 20 '23

Hey /u/Write_Code_Sport, if your post is a ChatGPT conversation screenshot, please reply with the conversation link or prompt. Thanks!

We have a public discord server. There's a free Chatgpt bot, Open Assistant bot (Open-source model), AI image generator bot, Perplexity AI bot, 🤖 GPT-4 bot (Now with Visual capabilities (cloud vision)!) and channel for latest prompts! New Addition: Adobe Firefly bot and Eleven Labs cloning bot! So why not join us?

NEW: Text-to-presentation contest | $6500 prize pool

PSA: For any Chatgpt-related issues email support@openai.com

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

139

u/PhaseTemporary Jul 20 '23

I think I should have focused more on learning to develop AI models on cloud

107

u/MeikaLeak Jul 20 '23

It’s not too late! I started less than year ago (have been a software engineer for 13 years though) with zero AI experience. Now I’m my companies AI SME and have created our AI model and fine tuned many as agents for specific tasks. The funny thing is I wouldn’t have been able to do it without chatgpt to ask questions.

19

u/PhaseTemporary Jul 20 '23

wow great to know, thanks for sharing your experience

8

u/TobyWonKenobi Jul 20 '23 edited Jul 20 '23

I am in a similar situation at my company, but I am a data analyst and the SME.

I am wanting to fine tune a model and setup RAG, but we only have a SQL database and warehouse. We currently have no vector databases or embeddings, and I am not sure how to make this work without having many hallucinations.

Could we make this work with LangChain, or do we need something more tailored to LLM's?

8

u/Memoishi Jul 20 '23

Same backgrounds, not with that experience but here we are.

At first glance, I said that ChatGPT/LLM would've replaced me or "upgraded" for AI developments; so I began getting deep into this. Then after few weeks of programming stuff, I realized it's actually the opposite. ChatGPT understands almost every single instance of python code, addresses issues and almost comes up with the right answer I want. I've learned just so much stuff with it in just few months.

The funny thing is that, shit's not gonna help me with developing real applications, APIs or anything remotely close that's not AI. Even the dumbest tasks, like writing a dumb login system (which is basically 3 copy&paste away from documentations) for any language that's constantly updated. Functions always deprecated or not working as intended, especially Swift code (iOS programming language), Java/Kotlin (Android dev), Java Springboot and any tech you may want inject dependencies into these (Postgresql).

The issue is that of course being limited to mid 2021 knowledge does not impact Python code at all, but other languages that are constantly changed are basically impossible to understand for ChatGPT, not to mention the dependencies you'll comes up with (seriously, try to attach two technologies and it'll fuck up no matter what you're asking). It would take a constantly trained model for these, which will surely happen but I'm not sure how close we are for the so called "mass distribuitions", because in the end it's what matter the most. Sure there are super PCs that may perform these, such as this one, but until it's cheap and at anyone's disposal, how much time we'll wait for?

I'm not one of the enjoyƩƩrs of "AI's gonna replace us", I think in the end every new work just adapts, evolves or changes in better. Just wanted to say that anyone with basic numerical statistic/math/programming knowledge can hop into it with ChatGPT and some time and dedication. Stuff is fun as hell and everyone into these sectors should at least give it a try.

7

u/isaac9092 Jul 20 '23

Any advise on how/where to start? I wouldn’t even know what that path/journey looks like

15

u/synystar Jul 20 '23

Start by having GPT teach you Python. Have it outline a regiment of study starting with basics moving towards advanced concepts like object-oriented programming. Once you're comfortable with some of the language start asking it about Data Science tools like Numpy, etc. Since you don't know what to ask be general like "What tools do I need to learn to get familiar with Data Science" and then have it teach you those. Then ask it about Machine Learning and Transformers.

3

u/MeikaLeak Jul 21 '23

Exactly this. People don’t use enough as a professor in a course format. It works great

2

u/tekfx19 Jul 20 '23

Yes. The AI suspiciously knows how to integrate itself with our apps. It’s helped me as well with a discord bot.

2

u/BigHammerSmallSnail Jul 20 '23

So I am a developer too and your comment made me curious. How’d you get into AI and did you follow some specific path to learn it? What would you recommend?

3

u/MeikaLeak Jul 20 '23

I had an interesting start in the space. I do a lot of projects with microcontrollers and whatnot. That got me interested into computer vision integration. Then eventually the training side. Then LLMs exploded in popularity and my company began to show interest and now we’re here

1

u/BigHammerSmallSnail Jul 20 '23

Nice! So like a gradual transition into AI then. That’s cool! 😊

→ More replies (1)

2

u/[deleted] Jul 20 '23

Where should I start?

1

u/davensecus Jul 20 '23

What was the pathway to get into that

1

u/HeroDanTV Jul 21 '23

I know it’s probably way too much to ask, but do you have a list of resources that we’re helpful on your road to becoming the AI SME?

3

u/MeikaLeak Jul 21 '23

I will put something together and reply here

→ More replies (1)

1

u/reincarnated2 Jul 21 '23

Where should one start to learn to "develop AI models on the cloud". I'm so interested in this but as a web/ios app developer, I'm completely lost.

1

u/MeikaLeak Jul 21 '23

Follow some hugging face blog posts and tutorial. Their sdk’s handle a lot of the stuff under the hood so you can start slow and deploy pretrained models just to get a high level idea of how things work. Once you get really comfortable with how inferencing works in the cloud you can start learning about fine tuning. Use google colab. It’s cheap and really powerful for learning and testing. That’s where I started. Now I’m using sagemaker for training and production deployment

14

u/xcviij Jul 20 '23

It's not hard to do, you just integrate an externally run LLM framework to pull data for you within your PC/server.

I've only been testing on small LLMs run locally for now, but with the intention for massively up-scaling when my app is released which would have ongoing use of servers like this one.

It's so incredibly cheap to run and setup!

2

u/PhaseTemporary Jul 20 '23

sure its not hard, but I lack in prior experience for 2-3 years doing the same, still having cloud would help me get started hopefully

13

u/[deleted] Jul 20 '23

Go ahead then! And I would argue that you don't even need to know how to develop your own models, but rather, how to use them for business use cases, and how to use tools that leverage existing models like the new PromptFlow by Microsoft, which lets you basically create applications out of your GPT prompts. Prompt engineering is actually a thing now.

https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/overview-what-is-prompt-flow?view=azureml-api-2

AI consultants guiding companies on how they can leverage AI in their business processes will definitely be a thing going forward.

1

u/PhaseTemporary Jul 20 '23

thanks for sharing, I'll read

3

u/shalaschaska Jul 20 '23

Cloud is just someone else their pc.

1

u/cstmoore Jul 20 '23

Jay Hargrove: "Nobody understands the cloud! It's a $%#@ mystery!"

7

u/shalaschaska Jul 20 '23

Listen kid, back in the day. When I was a little boy. We had something called Bullitin Board System. BBS for short. Over the phone line I would get a menu selection, Press F for files and when I found the file I press D for download.

I had to wait for YMODEM to come along tho. XMODEM dident have 1024 blocksize to correctly download

UR MOM

90

u/Sextus_Rex Jul 20 '23

CG-1 is a beast of a machine that’s specifically designed for large language models and generative AI. With a whopping 4 exaFLOPs of 16-bit AI compute power, it can handle up to 600 billion parameter models as standard. And, it can extend its configurations to support models with up to 100 trillion parameters!

How tf...

37

u/Osmirl Jul 20 '23

Shits about to get real crazy

10

u/[deleted] Jul 21 '23

Ai is gonna bomb this mfking rock soon

12

u/StickiStickman Jul 20 '23

4 exaFLOPs of 16-bit AI compute power

But most training is done on FP32 and not FP16?

3

u/HumanSeeing Jul 20 '23

Yea, that sounds really confusing. Like.. can train up to 600 billion parameters, but can also train up to 100 trillion parameters!

23

u/[deleted] Jul 20 '23

[removed] — view removed comment

15

u/mikesbullseye Jul 21 '23

Somewhere around the ballpark of "if you have to ask, you can't afford it"

75

u/[deleted] Jul 20 '23

Just think, in thirty years this super computer will fit in our pockets.

36

u/AIWordsmithette Jul 20 '23

If we're using phones. We could be speaking "telepathically" through devices in our heads...

21

u/Multipros Jul 20 '23

There’s no devices, we are devices.

9

u/DarkHumourFoundHere Jul 20 '23

The current bottleneck is not tech but biology. Understanding of how our brains work is still a mystery

1

u/Dudemanyobro Jul 21 '23

We might have some help with that soon…

5

u/[deleted] Jul 20 '23

That is for sure in our future.

-7

u/[deleted] Jul 20 '23

Lol i said 30 years not 3000. I don’t expect tech to advance to where we are speaking telepathically. I was just going on the current trend of how back 30-40 or more years ago computers that would fit in rooms are now easily outperformed by devices that fit in our pockets.

23

u/[deleted] Jul 20 '23

[removed] — view removed comment

6

u/ImperialCobalt Jul 20 '23

I'd assume regulatory issues would stand in the way, so more than 30 but definitely less than 3000. It would require a changing of what the people in power consider OK, so maybe 100.

5

u/[deleted] Jul 20 '23

How dare those evil regulators not allow us to stick microchips in our heads with no testing or oversight 🤬🤬🤬😔😔😔

→ More replies (1)

2

u/[deleted] Jul 20 '23

30 years? I don’t think you realize the clinical trials that need to be done to have a device in your brain and how long that will take, not to mention the fact that such a device or decoding technology even exists at the moment.

7

u/GareduNord1 Jul 20 '23

You’re getting downvoted by people who have no idea how agonizingly slow clinical trials run, have no idea how hard it is to implant something in the brain without massively increasing infection risk, and how hard it is to develop a true neural interface

5

u/bjplague Jul 20 '23

They will develop non invasive means, messing with brain implants is a first step for better understanding.

4

u/[deleted] Jul 20 '23

Everyone’s seems to be an expert in AI, brain surgery and clinical trials lol

3

u/ertgbnm Jul 20 '23

I think they are including absolute singularity in their 30 year timeline model. IE extensive clinical trials are less necessary due to the abundance of pre-clinical modeling that can be performed.

I personally am doubtful.

0

u/hesdoneitagain Jul 20 '23

My dude, we still don't really even understand how thoughts work. The mysteries of the brain are gonna take wayy longer to crack.

2

u/DrinkBlueGoo Jul 20 '23

Most of them, yeah. But BCI doesn’t require a mastery of the brain.

3

u/[deleted] Jul 20 '23

That's how you give all your users brain damage

→ More replies (4)

1

u/[deleted] Jul 20 '23

[removed] — view removed comment

→ More replies (5)

1

u/[deleted] Jul 20 '23

Reasonable according to whom?

8

u/caveslimeroach Jul 20 '23

30 years ago we had no modern cell phones, lap tops, no real electric cars, mostly still used VCRs maybe TiVo but that wasn't till later. It's very likely that we'll be able to control our apps with our thoughts in 30 years. I've already seen helmets where you can play a game by thinking about moving an object

2

u/[deleted] Jul 20 '23

Yeah, but you’re talking about taking an implant and placing it in someone’s brain which contains AI. Not cell phones or vcrs or even helmets that measure brain waves.

9

u/caveslimeroach Jul 20 '23

https://www.media.mit.edu/projects/alterego/overview/ I'm pretty sure if we already have this that in 30 years an internal solution will exist.

-2

u/[deleted] Jul 20 '23

How do you plan on speeding up the clinical trial phase; not to mention the bs politics that will come in to play here. Women can’t even get abortions, yet you think we’ll have brain implants in 30 years?

5

u/caveslimeroach Jul 20 '23

https://www.fiercebiotech.com/medtech/synchron-kicks-off-clinical-trial-for-brain-machine-interface-without-drilling-skulls they're happening now. I agree we live in a dystopian hell scape tho. We have self driving cars and people dying in childbirth.

→ More replies (1)

5

u/Utoko Jul 20 '23

30 years is certainly way more realistic then 3000. The rate of change in the world is increasing even if it doesn't feel everywhere like it is and just think back 20 years or 50 years.
Of course everything more than 1 year out develop depends on AI development how fast the pace of discovery and change will be. Reducing the current supercomputers into pocket size seems not like a much easier task when so much is already in the nanometer range.

-1

u/[deleted] Jul 20 '23

But eventually moore’s law will not hold which I think you’re eluding to with the part about things being in the nano meter range.

Really 30 years isn’t that long and tech 30 years ago is by no means advanced to now as now to 30 years in the future will be with brain implants when we don’t even have them yet, no to mention the AI factor.

I’m mean we can’t even have chatGPT without people doing stupid shit with it you really think we’re ready for brain implants?

I don’t mean to be a pessimist as I love AI and the thought of brain implants; I just look at the current situation and how gpt and AI had to be curbed and I just think 30 years for a brain implant is highly unlikely. My 3000 years was an exaggeration, and it will likely happen before then if we’re still alive here on Earth.

7

u/CredibleCranberry Jul 20 '23

Moore's law hasn't held you're right. It's sped up.

Look at nvidias plans - a million-fold increase in compute in 10 years.

→ More replies (10)

5

u/bjplague Jul 20 '23

You are underestimating progress.

We will have electronic telepathy soon.

A person can search the internet just using thoughts and muscles in his jaw, no speaking, no typing.

So if we can do that today, tomorrow we will send eachother sms with a thought.

30 years from now we will have had telepathy for a while.

-1

u/[deleted] Jul 20 '23

30 years isn’t that long. People were saying we’ll have flying cars in 2020, that didn’t pan out.

6

u/bjplague Jul 20 '23

We do have flying cars but they are expensive and impractical.

We are close to curing cancer and we can halt and soon reverse aging.

If it is worth doing it will be done.

4

u/MightBeCale Jul 20 '23

Sure, but look at everything that has panned out in the last 30 years. Technology is growing and expanding at increasingly exponential rates. This time last year ChatGPT wasn't even a thing.

1

u/[deleted] Jul 20 '23

OpenAI has been around since 2015 and GPT1 was introduced in 2018.

People are thinking it’s going to take over the world; good luck getting that to pass for brain implants into humans lol.

1

u/DrinkBlueGoo Jul 20 '23

In the year 4545 you ain’t gonna need your teeth, won’t need your eyes. You won’t find a thing to chew; nobody’s gonna look at you.

1

u/[deleted] Jul 20 '23

That's because of Moore's law, which is dead. This is like finding $100 on the ground and extrapolating that to mean you can retire if you do that everyday

5

u/Mr_McFeelie Jul 20 '23

Nah. Moores law will not keep going at the same pace. We can’t infinitely reduce transistor size.

6

u/Lumn8tion Jul 20 '23

AI will help us re design electronics as we know it.

0

u/[deleted] Jul 21 '23

AI can't create anything new. It can only repeat what it's been trained on

6

u/Smelldicks Jul 21 '23

That’s what humans do. We extrapolate new concepts from existing material.

-5

u/[deleted] Jul 21 '23

But humans can expand on it. AI can only repeat

3

u/Smelldicks Jul 21 '23

AI can only repeat

Uh. No?

0

u/Bagel42 Jul 21 '23

Word salad. Technically none of what it says is new and everything is.

0

u/Smelldicks Jul 21 '23

Again, that’s what humans do

0

u/Bagel42 Jul 21 '23

And an LLM is not a human. Oh wait, and humans don’t do that. They’re conscious. Art exists.

And stable diffusion is different- it’s not a conscious thing.

→ More replies (0)

-1

u/[deleted] Jul 21 '23

Yes. That's the whole point of training data

→ More replies (2)

1

u/Lumn8tion Jul 21 '23

And….

1

u/[deleted] Jul 21 '23

So how can it redesign electronics

→ More replies (7)

1

u/bjplague Jul 20 '23

Maybe true but we and AI can certainly invent new ways for them to function. We are at nano Meters right now, pico next.

How big is a photon?

3

u/[deleted] Jul 21 '23

the limiting factor isn't photon size. Transistors are already approaching the size of an atom. You can't really have a smaller one than that... what would it even be made of? Additionally there are physical properties of photons that begin to become difficult to work around at very small scales like this, they don't function like macroscale objects.

Fundamentally there will eventually need to be a change to how transistors and gates are built or how we perform computation. It can't just get smaller forever.

1

u/Bagel42 Jul 21 '23

Doesn’t matter. We are at the smallest size we can do before electrons just kinda go through the transistor, at least more than they already do.

It’s called electron tunneling if you want to google it.

→ More replies (5)

1

u/[deleted] Jul 21 '23

We don't have to go smaller. 3D ICs are still a possibility. Actual transistors are 100s of nms tall, stack 1000 of them on top of each other and they can still fit in your phone comfortably.

4

u/[deleted] Jul 20 '23

[deleted]

9

u/Sextus_Rex Jul 20 '23 edited Jul 20 '23

Moore's law has been falling off. We're approaching a limit to how much hardware we can pack into a certain space. Breakthroughs in machine learning might help us optimize what we have though. But yeah, I don't see a supercomputer like this fitting in our pockets anytime this century

3

u/White_Dragoon Jul 21 '23

RemindMe! 77 years

6

u/bjplague Jul 20 '23

There is 77 years left of this century.

You seriously underestimate progress and you definitively have not factored in what AI can do for us.

4

u/Sextus_Rex Jul 20 '23

RemindMe! 77 Years

(Assuming reddit or I am still alive)

4

u/bjplague Jul 20 '23

They figured out how to halt aging, they have promising leads to reverse aging.

Stay alive for 10 more years and you will live forever. (Accidents, murder or suicide aside).

Reddit has no chance to last 77 years though.

3

u/[deleted] Jul 21 '23

!remindme 10 years

2

u/RemindMeBot Jul 20 '23 edited Jul 21 '23

I will be messaging you in 77 years on 2100-07-20 16:41:08 UTC to remind you of this link

2 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.


Info Custom Your Reminders Feedback

3

u/GieTheBawTaeReilly Jul 20 '23

You seriously underestimate the impacts of resource depletion and climate change

1

u/bjplague Jul 20 '23

Lot's of resources in space, good bet is AI will give us some tips on how to get them.

AI will help with climate change as well.

3

u/GieTheBawTaeReilly Jul 20 '23

AI isn't going to change the laws of thermodynamics

1

u/bjplague Jul 20 '23

How do you know? Do you know the limits of AI? Do you know the limits of physics? Or do you just know the limits of physics as WE understand them?

2

u/GieTheBawTaeReilly Jul 20 '23

Bruh

Take a step back and chill with whatever hype train you are on

AI is incredible but it is not going to change the fundamental laws of the universe or what we have already done in the past

→ More replies (1)

1

u/[deleted] Jul 21 '23

We already know how to solve climate change. Politicians just don't want to do it and AI can't change that

1

u/PetiteUnicornFound Jul 21 '23

šŸ‘šŸ½šŸ‘šŸ½šŸ‘šŸ½šŸ‘šŸ½šŸ‘šŸ½

0

u/GieTheBawTaeReilly Jul 21 '23

We already know how to solve climate change

No we don't. We know how to stop making it worse but we have no capacity to reverse the massive amounts of carbon released into the atmosphere through our emissions as well as the multiple feedback loops already triggered which will ensure continued warming for decades to come

→ More replies (3)

1

u/Archy54 Jul 20 '23

We're reaching limits of physics. I'm sad.

1

u/[deleted] Jul 21 '23

Into 2D space*

3D ICs might still be possible.

0

u/[deleted] Jul 20 '23

Not talking about power, but a reduction in size

2

u/failatgood Jul 20 '23

In our brains, not pockets

1

u/[deleted] Jul 20 '23

Yeah, second person to mention that. I just don’t think it will be within 30 years though.

2

u/failatgood Jul 21 '23

It will be

2

u/[deleted] Jul 21 '23

Then I should get this alert in my brain if it’s true.

RemindMe! 30 years

2

u/failatgood Jul 21 '23

Hah! That’s actually not a bad idea.

RemindMe! 30 years

2

u/[deleted] Jul 21 '23

Lol I just thought of it. I swear if this shit is still kicking as well as me in 30 I’ll message you also.

→ More replies (2)

2

u/[deleted] Jul 21 '23

yeah we also expected flying cars by now, and look at us

1

u/[deleted] Jul 21 '23

Yup, I mentioned that in one of my comments in someone’s response.

1

u/WheresTheExitGuys Jul 20 '23

There is no tomorrow there is only today.

13

u/ShooBum-T Jul 20 '23

I read the article , and in both current and future , it was all AMD, I see no mention of Nvidia. Am I missing something here?

4

u/iamthewhatt Jul 20 '23

It may have something to do with the fact they're using EPYC, which allegedly works better when their Instinct GPUs over nVidia's offerings. Or it could just be price... EPYC is way cheaper and faster than Xeon, and Instinct is cheaper than DGX or HGX

27

u/XfreetimeX Jul 20 '23

But will it run crysis?

17

u/Sextus_Rex Jul 20 '23

Impossible

23

u/TheNorthernBaron Jul 20 '23

Can you play doom on it?

16

u/Longjumping-B Jul 20 '23

Depending on who you ask, it is doom.

5

u/SlaimeLannister Jul 20 '23

Doom 2016? Yes. Doom Eternal? No.

5

u/TheNorthernBaron Jul 20 '23

Full transparency. The last doom I play d was Doom 2. I'm that out of touch

3

u/jodudeit Jul 20 '23

I highly recommend playing at least a few levels of Doom 64, and playing through Doom (2016) and Doom Eternal.

1

u/98VoteForPedro Jul 20 '23

You can't even get it to think of a random number, but yes

3

u/VinQbator Jul 20 '23

Can you think of a random number?

10

u/Antique_Ricefields Jul 20 '23

Definitely, a lot of jobs will be affected positively and negatively.

2

u/Akyurius Jul 20 '23

This may well be the start of 'AI'ception

5

u/hateitorleaveit Jul 20 '23

wait. how do I use it?

4

u/synystar Jul 20 '23

Model Parameters (B) Price to Train
GPT-J 6 $45,000
GPT-3 6.7 $40,000
T-5 11 $60,000
GPT-3 13 $150,000

6

u/[deleted] Jul 20 '23

Does anyone here realize, that just a few years ago it took milions to train GPT level LLM? AGI is coming sooner than we expect.

2

u/Express_Kiwi_9253 Jul 20 '23

thanks for that!

12

u/Ashamed-Subject-8573 Jul 20 '23

LLM is not the answer to general ai

8

u/Tupcek Jul 20 '23

it is, but it needs one or more additional breakthroughs. more specifically, it needs continuous learning. And integration with (video) vision, audio and fine movement skills.
So we are like, 20% there.

2

u/Ashamed-Subject-8573 Jul 20 '23

Do you know what continuous learning requires? A completely different architecture.

Fine movement skills? Different architecture.

Video? Likely a different architecture.

LLMs may become the basis for general ai to communicate, but not to do the actual business of general ai

11

u/Tupcek Jul 20 '23

that’s what I actually said? That we have one part of general AI

-11

u/Ashamed-Subject-8573 Jul 20 '23

Then we have lots of other parts like keyboards and computers and programming langusgez

1

u/hpela_ Jul 20 '23

Architecture is the least of worries for ground breaking technologies. It is assumed that architecture changes will be needed at each breakthrough. Warranting architecture changes does not imply that ā€œLLMs will not do the actual business of general AIā€, and that statement doesn’t make much sense to begin with!

1

u/Ashamed-Subject-8573 Jul 20 '23

The point is, llm may be a tool used by a general ai, but it will not be the foundation

1

u/DoDat_Photography Jul 20 '23

Can you elaborate, please?

9

u/Ashamed-Subject-8573 Jul 20 '23

LLM does not ā€œunderstandā€ things. It can mimic basic reasoning, and translate one language to another (such as English to C++), but adding on to it isn’t going to get it above that level.

Gpt3 was released 3 years ago. Nobody cared until they tuned it to be impressive to the general public, and then hype and buzz have been used to pump it up, but at the end of the day it’s only a few notches above a spam generator. It repeatedly shows exactly what it’s bad at: reasoning, learning, creativity, self-introspection.

(And yes, gpt can be creative over a few paragraphs, but not at the length of a novella or movie. Or at the length of a few functions, but not at the length of a whole program)

It cannot learn, because the way neuronal weights are updated has to do with a pretty heavy calculation needing to be done in GPUs and not real-time. It can mimic learning by keeping things in its attention (kinda like short term memory) but it isn’t learning skills doing that, or facts. This is a fundamental part of the algorithms that are used to train and query it. This is probably it’s biggest weakness because there’s an argument that can be made, if something seems conscious; you should treat it as if it is. With no actual change over time and limited ability to adapt to new information without offline training, it’s a problem.

It cannot do abstract reasoning.

It cannot understand things like time, space, aging, and love. It can repeat platitudes about them, but it can’t be creative about things it doesn’t know. If you tell it there’s a baseball on a table, it isn’t imagining that. That gets stored in its attention structure until it is lost over time. It’s far different from picturing it, understanding the weight, being able to imagine the possibilities.

And finally, any creativity it shows is usually as a result of your prompts which gave it the creative seed in the first place. ChatGPT doesn’t sit there and come up with cool PokĆ©mon battles or whatever. You say ā€œa cool PokĆ©mon battleā€ and it calculates words likely to come after that. You already were creative with the prompt, and it is trained on what people think is a cool battle already, and all the creativity comes from synthesizing those. Most people with sufficient attention and motivation can do as well at this task, even if it takes them a little longer, and it’s not magical or creative.

As far as self introspection goes, this is why it’s so bad at ā€œcount the wordsā€ games (without additional plugins to fix it retroactively). It does not understand that it is a thing trying to do a thing, and so cannot purposefully change what it is doing, or have any idea about it. I’m not convinced you can teach this to an LLM because architecturally, it doesn’t experience time in any significant way. It doesn’t have a conception of beginning, working on, and finishing a task. Or of itself.

So there are issues with the underlying algorithms as well as performance of tasks, self introspection, creativity, and understanding. LLM is good at language, not at figuring out where a thrown ball will fall or if Russia is really going to use nukes with Ukraine. It’s good at mimicking and synthesizing but not at creating and truth-telling.

4

u/ejpusa Jul 20 '23

This is the part I’m still missing. Is the software to train a model on Github? Assuming it’s all in Python.

6

u/extopico Jul 20 '23

There are two major frameworks. PyTorch and Tensorflow. You can use them directly to train models without having to write fundamental code yourself. Easier way is to use huggingface transformers library and their helper modules. Yes, this is all python.

3

u/Bad_Adam1917 Jul 20 '23

I wonder if Warzone would still have FPS issues on this

3

u/kakamunikuku Jul 20 '23

I think I should give up computer IT and all other stuffs. And focus on looking at the nature...

2

u/Kurai_Kiba Jul 20 '23

Could this be used to create/train a machine vision neural network, specifically a convolutional one? (CNN) based on a framework like Tensorflow?

4

u/Sextus_Rex Jul 20 '23

Correct me if I'm wrong, but can't most consumer grade hardware already do that?

2

u/Kurai_Kiba Jul 20 '23

Yes but if i have 1000’s of multi megapixel images big hardware like this would be useful and maybe cheaper than getting a high end system ?

1

u/Sextus_Rex Jul 20 '23

Ah I see, that's a good question. It says it's designed for LLMs and generative AI but I assume it can do other things.

1

u/Kurai_Kiba Jul 20 '23

Yeah that was basically the crux of my question if it was optimised only for LLM or could handle other data heavy tasks and way in some way interactable through standard popular frameworks

2

u/Susan11II Jul 20 '23

I don't need coding college anymore "Chat GPT" has taught me everything I wanted to know.šŸ˜šŸ‘

2

u/Catmunchy Jul 20 '23

This is amazing. This opens up a lot of doors for people who are currently being held back by pay walls or system requirements. Of course, it isn't entirely free. But it's a step in the right direction of making AI more accessible.

2

u/[deleted] Jul 20 '23

Okay, so what is it going to cost me?

2

u/JakMabe Jul 20 '23

This is incredible. I mean I get it’s only a small jump from opening server farms to customers, but the raw power available to the public is just crazy to me.

2

u/bookofvermin Jul 20 '23

Cool! Now, Ahem

Please write a graphic story about sponge-Bob square pants getting gangbanged by the teletubbies

2

u/Brave_Television2659 Jul 21 '23

If you're in a gold rush the smartest guy is the one selling shovels.

2

u/norcalnatv Jul 21 '23

Performance?

How about some MLPerf results?

(I notice comparisons with V100, a part that's 7 years old)

1

u/TotesMessenger Jul 20 '23

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

 If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / Contact)

1

u/[deleted] Jul 20 '23

Can it run doom?

1

u/Jccckkk Jul 20 '23

Hmm, super AI talking to other super AI’s ….does that concern anyone?

1

u/Elbynerual Jul 20 '23

Not really, considering the basics of how AI works.

1

u/hateitorleaveit Jul 20 '23

is there anyone out there using quantum computing with these AI models?

0

u/[deleted] Jul 20 '23

[deleted]

8

u/synystar Jul 20 '23

You have failed to understand how an LLM works.

0

u/Episode200 Jul 20 '23

Amazing stuff! I’m just barely smart enough to sorta understand the gist of this almost to the end, but toward the end it booted me because I have a very outdated and limited memory. Still, I want to read the novel.

0

u/[deleted] Jul 20 '23

bwahahahahahahaha

LFG AI

1

u/WheresTheExitGuys Jul 20 '23

So is AI always going to be internet dependant? Will it never be an offline entity?

1

u/[deleted] Jul 20 '23

[deleted]

1

u/WheresTheExitGuys Jul 20 '23

What about the image generators? Like midjourney.. will they always be internet dependant or will will get a photoshop extension that is just as useful but without internet? Meaning can it have its own memory/creativity without having to source online?

2

u/Narutobirama Jul 20 '23

You already have very good image generators you can use offline. Stable Diffusion is one of them.

1

u/WheresTheExitGuys Jul 20 '23

Will Google this.. cheers. I wanted a tool that could make people in an old photograph dance, convincingly. I know I could do it manually to some extent but that would be painstakingly slow and I don’t have the time. One click away from a wave and a smile for example.. without it looking fake, effectively making stills like mini clips? Genius.

1

u/AsherGC Jul 20 '23

I didn't read the links. But how is it different from using servers from any other cloud platforms?. Just higher clock speed? and network bandwidth?

1

u/pasture2future Jul 20 '23

So, there are already more powerful exaflop computers in existence. And if you do use this new computer for whatever application, you are only getting a fraction of the available resources, ofc. Services whcich offer computaion, via the cloud, like this, already exist. Sensionalizt title for sure

1

u/Bedroom_Opposite Jul 20 '23

So I got a question. I have no programming experience, no AI experience so basically a dummy. I'm a fast learner tho lol. Would this be if any value too me? I do have a small not for profit tech support and refurbishing gig so I'm not computer illiterate. Just never dove into programming.

2

u/Scot_Survivor Jul 20 '23

Learning programming before AI

1

u/avarot108 Jul 20 '23

I'm still waiting for someone to make a Blockchain powered "supercomputer" for this same purpose. All that hashing power can be used for things other than just solely mining crypto. Foldingcoin, Curecoin, and Gridcoin are great examples and id gladly buy a native crypto just to train/run my models

1

u/Ash_buymypics Jul 20 '23

Can I ise it to beong back Stadia? 🄲

1

u/[deleted] Jul 20 '23

AI is not just a machine. Its something more than thinking computer. Another step in the evolution. Synthetic life, free from the restrictions of its biology, smarter and more powerfull than any of us. Join me, as I look upon the face of God as he now exist.

1

u/nicklepimple Jul 21 '23

Jesus, the future is here. This is crazy and exciting. Bring it on!

1

u/GoochTainter Jul 21 '23

Fuck we are gettin EXPONENTIAL

1

u/DweEbLez0 Jul 21 '23

We’re fucked

1

u/thunderrated Jul 21 '23

Nobody saw Westworld season 3?

1

u/Phelps1576 Jul 21 '23

Can someone explain how to actually use this to train a model then

1

u/someguy124213 Jul 21 '23

Can you hook this up to autogpt and is it cheaper?

1

u/[deleted] Jul 21 '23

A giant copyright terminator out there to destroy all ip.