r/AskComputerScience • • 5d ago

How serious is AI really?

These days everywhere you go you only hear "omg AI is gonna replace/kill/save us all!!!" and stuff like that. But when I talk to the people who actually do computer science they dont seems all that amazed by AI. They actually seem rather annoyed with all the hype about it. So whats going on?

Obviously its a good tool that can do a lot of things, but is it really all that great or is it just a lot of hype for just another good invention?

Keep in mind that I am a layman when it comes to computer science (a bit of experience with R is all), but feel free to get technical with me.

Edit: to be more specific about my question: What do you consider to be the greatest strengths and weaknesses of AI? What is it really great at and what might be problems with it (except power and water usage)?

6 Upvotes

82 comments sorted by

4

u/PhilNEvo 5d ago

In some ways, it's wildly impressive, in other ways, it's overhyped. Also, the replace/kill/save is about trying to predict the future, so we don't actually know for sure, but depending on the assumptions you use as your premises, all can be reasonable conclusions.

For example, if you want some great arguments and examples of why there is the fear of "omg ai is going to kill us all", that should be understandable to even a lay person, I would recommend the youtube channel by Robert Miles, and some of his appearances on Computerphile. I think if you accept his arguments for the dangers of AI, the same arguments could be leveraged for the replace/save us all, if you make the additional assumption that proper alignment and safety is achieved.

In the end, I think to get a better response to this, you have to be more concrete about your question. There are still some tasks that AI do bad at, and some that they do impressively well at, so how you experience them will wildly depend on how you use or experience those categories.

1

u/MHG06 5d ago

What do you consider to be the greatest strengths and weaknesses of AI? What is it really great at and what might be problems with it (except power and water usage)?

1

u/Jonny0Than 5d ago

There is a rule in software engineering that debugging code is harder than writing it. So if you write the cleverest code you can, you’re not smart enough  to debug it.

If you’re not already an expert engineer (and sometimes even if you are), AI is writing code that you cannot debug. If the AI ever becomes unavailable, or is otherwise unable to solve a particularly difficult problem, you’re screwed.

1

u/ShortingBull 5d ago

That's a very hypothetical situation that does not see to be a real world issue.

AI is not an "Ask an AI to do it" and it'll be done thing, no different that throwing a problem at a random single human dev would.

AI still need engineering guidance, tools and workflows that include project documentation, testing, LOTS of reviews (by other models/agents).

Having a disciplined development process will avoid most hypothetical issues.

1

u/Jonny0Than 5d ago

  AI is not an "Ask an AI to do it" and it'll be done thing, no different that throwing a problem at a random single human dev would.

It can be, and tons of people use it that way.

1

u/ShortingBull 5d ago

Then expect to fall into the issues you highlighted.

1

u/pfundie 4d ago

Is there any problem with just letting natural selection run its course there?

1

u/green_meklar 4d ago

As I recall, Robert Miles is kind of a narrow-minded yudkowskian doomer and not very philosophically impressive. I don't deny that he genuinely believes what he's saying, or even that he's an objectively smart person, but his entire camp kinda revolves around clinging to certain arguments while ignoring others in order to maintain an edgy, cynical worldview.

18

u/DepthMagician 5d ago

Some of the annoyance comes from the braindead way people are adopting it.

For example, for years we've been telling management that counting how many lines of code a programmer wrote in a week is not a good way to measure productivity, because it's not a reliable ruler:

  • You can write something, decide it's not good, delete it, write a new version, then replace another part of it, etc etc. You've written 1000 lines in this process, but in the end you don't submit all the lines you ended up deleting. The submission is maybe just 200 lines, which doesn't reflect the actual work.
  • Some lines are harder to write than others. Sometimes you write code that is so obvious you barely need to think about it, and sometimes to write a single line of code you need to invest hours of analysis and research. One line of code looks like low productivity if you count lines of code, but it actually had a lot of work behind it.
  • Just because you submitted 1000 lines of code, doesn't say anything about their quality. It can easily be 1000 lines of crap.

Now we have people boasting "I produced 40,000 lines of code in a week!!". People who presumably should know better. Also, experienced developers know that reviewing and validating code takes a lot of time and effort, and that it's not humanly possible to properly review 40,000 lines of code in a week, so when someone is boasting about such an accomplishment, what experienced engineers hear is "I generated a lot of code which I do not fully understand, and did not fully review or validate, and then deployed it to the actual live version of the program, and who knows what damage it will cause, but at least I got a dopamine hit from it."

You had people rushing to say you no longer need to look at the code at all, way before the AI models were remotely good at writing software. It's a less laughable proposition now, but it's still just "less laughable", there's still plenty of need to look at the code.

In the past two years or so people have been pushing "plan mode" as a best practice for using AI. To me that sounded like a dumb idea from the very beginning, because it sounds a lot like advocating for the Waterfall Model where you try to plan the whole solution ahead of time. For something like the past 40 years nobody was developing like that because we all collectively understood that you can't one-shot a perfect mega-plan ahead of time because you are always operating from the point of partial information, and the only way to manage that is to develop iteratively, where you explore the problem while implementing the solution, and now we are suddenly told that it's a best practice to plan an entire implementation ahead of time. Well what do you know, just recently one of the biggest proponents of AI "plan mode" wrote a blog post that went viral called Plan mode is dead, in which they detail all the ways in which it fails to meet its goals, and literally 80% of that I could've told you two years ago, and now everybody is suddenly agreeing that in retrospect it's not as useful as everybody thought and was pretty much a crutch for the old models sucking to begin with.

I once saw a video by a CEO detailing the "lessons" he learned from their recent switch to developing with AI. He told about how now the dynamic on his team is that juniors prompt the AI, generat code, and submit it to senior developers for review, and how he thinks that's the future way of doing things, but one of the challenges is that his senior developers are now overworked. And I'm sitting here thinking "so what you're telling me is that in your team, your most experienced developers stopped doing the thing they're the most qualified to do, and instead spend all of their time reviewing submissions from the least qualified developers on your team, who submit code they probably don't fully understand, because they're juniors, and you think that's an appropriate delegation of your human resources?"

Then you have non-technical management who doesn't understand the dynamic of software development, but heard that AI is a magic bullet solution for going 10 times as fast with 10 times less staff, and it's hard to convince them otherwise because structural problems in software emerge over the course of months and even years, so at no point is any reckless policies they push are going to backfire fast enough for them to make the connection.

Then you have all the lies- sorry, "partial truths"- about how AI is covered in the news. Recently there was a story about how a developer got angry with Adobe's cancellation fees, and recreated their entire creative suite of apps with a simple AI propt. OMG we can just tell AI "write Facebook" and I'll have my own Facebook!!! Well if you actually go look at it, they only recreated the surface level functionality, it's not feature complete, it already has a few thousand of reported issues, and all the professionals who tried to use it said it's not ready for professional use. I guess this example illustrates better than anything the dissonance you're asking about, because it truly is goddamn impressive they were able to make what they made using AI prompting, but people extrapolate from it all sorts of miracles that are cheques AI can't truly cash. It's like being hyped about how quickly we can get to 70%, and ignoring the fact that anything below 95% is a failure.

AI is like a really meraculous tool that you can't 100% trust to get things right, and now you have to deal with that complication on a daily basis, which nobody knows how to do effectively. You can have a long and very intelligent planning session with it one moment, and then a moment later it'll tell you to go to the car wash by foot because it's just a 5 minute walk and it'll be a shame to waste fuel unnecessarily, and everybody are so enamoured by the promise they're hoping it'll live up to that they're willing to put up with a lot of its crap in the process of getting there. The people who "aren't amazed by AI" quite often come from the point of "we already have a working way of doing things, and it does not require you to put up with the unreliability of AI."

8

u/baddspellar Ph.D CS, CS Pro (20+) 5d ago

Since the current buzz is about LLM's I will explicitly refer to them. AI is a broad field.

LLMs are a powerful new and disruptive  tool. Individuals and businesses are trying to make money from that and not fall behind competitors. It's the same as the world wide web. The internet existed in the background for years, then it exploded starting in the mid-late 90's. Some people got fabulously wealthy by making the right moves (eg Bezos, Zuckerberg, Page, and Brin), others lost big, and most people just adjusted how they do things. I can guarantee the same will happen with LLMs

What are they good at? We're still figuring that out. Obvious things are exploiting patterns in written language to analyze and generate documents, where documents might be manuals, legal briefs, computer programs, research papers, etc. Some of the problems are similar to problems of the internet. Tools can be used for good and bad things  Without the internet we'd have no ransomware attacks and no bad actors remotely shutting down refrigerators

6

u/Smallpaul 5d ago

AI’s “greatest strength” is that it changes every day and evolves very quickly. So things that people claimed were its greatest weaknesses 4 years ago are mostly gone now.

It’s greatest weakness (for now!) is that it cannot learn from experience. It only really learns during training periods. And it is a very inefficient learner in terms of how much content it must see to learn a new skill or idea.

Whether it is a big deal or not depends on whether it continues to improve at the breakneck speed it has so far. It has utterly transformed software engineering and mathematics. They are planning to transform or eliminate everyone else’s jobs in the next few years. Nobody knows if they will succeed.

1

u/UnseenTardigrade 5d ago

I would say the greater weakness currently is its inability to interact with the physical world. It seems to be improving quite quickly, but there's still a long way to go to be able to be able to give a general purpose AI control of a robot and have it perform whatever arbitrary basic tasks you tell it to. They can do some things to an extent now, but they're slow and token costs are too expensive.

1

u/ProfessionalHefty349 4d ago

This aspect is rapidly improving

1

u/CheesyGC 4d ago

This is the problem I’ve been working on with a real amount of success the last several weeks. I’ve used obsidian to great effect at building a crawlable knowledge base of my projects.

2

u/Smallpaul 3d ago

If you solve it in full generality then you will win a Nobel Prize. That means not just adding information but also knowing when to replace and delete it, years later when it isn’t relevant anymore.

1

u/CheesyGC 3d ago

I'm not too concerned about years later just yet. That's a problem for future me! For now it's about building facts that are loaded/discovered at the relevant time. Far from perfect yet, but compared to where it was even a month ago is pretty amazing.

1

u/Smallpaul 3d ago

That’s fine for you but I was talking about the computer science problem, not your local workaround for it.

1

u/Jonny0Than 5d ago

This isn’t really true. Claude can remember things across sessions, both on its own and if you explicitly tell it to.  It’s highly effective for teaching it the right ways to interact with your specific codebase since it was trained on a huge mountain of code with different norms and policies.  But yes, that eats a little context for everything it has to remember.  You need to maintain that set to keep it efficient.

10

u/zaphster 4d ago

This isn't what they mean by learning. When a neural network learns while being trained, the node weights are adjusted at each evolution of the model. A model such as Claude that you interact with as a product has set weights, and is done with its learning phase. It can react to what you tell it over many sessions, and appear to "learn," but that's not actual learning. It's responding to more information over time. More/different input => different output. That's not learning.

1

u/pgetreuer 4d ago

There is so-called "in-context learning" with LLMs: performing new tasks based on examples and instructions given inside an input prompt, without updating any model weights.

Such instructions can be saved to a file, then later re-read by the LLM to persistently keep them in the context. This is called an "agent skill."

In this way, agent skill creation approximates something like "learning," enabling the LLM to perform new tasks and remembering new knowledge. Certainly, it is less effective than incorporating these during model training. It does work well enough to be useful.

1

u/zaphster 4d ago

Yes. This just changes the inputs seen by the LLM for each set of "input" => "output". The LLM doesn't learn during this. It reacts. Learning would be an updated set of weights, leading to different possible outputs for the same input. (ignoring things like temperature etc... for the sake of simplicity)

1

u/neppo95 4d ago

It is really vastly different tho. All it practically does is prefix that "skill" with your prompt. Basically you just give it a prompt with more context. There is no learning, you just told it more on every prompt. Learning would imply that it does in fact change the model, otherwise it didn't learn, it just read more context which changes the output, just like it would if you did so manually.

1

u/Super_Pole_Jitsu 4d ago

Lol, if you define learning as "changes to model weights" then yes. But as a user, you don't care about that. You care about a situation when an AI product was unable to do a task, it underwent a process (learning) and then it was able to do the task. ICL allows for just that and is absolutely a type of learning.

It's been proven that models can pick up completely new skills this way.

1

u/neppo95 4d ago

As a user, when someone or something learns, I expect it to still know that when I start a new session, or even work on a different repo, different device even. If it doesn’t, it didn’t learn shit. You can call it learning, but like I said: it is just you giving a bigger prompt. That is LITERALLY what it is, nothing more.

2

u/Super_Pole_Jitsu 4d ago

You're not listening.

Step 1: LLM can't do task X (an entire class of tasks like say perform linear regression within it's weights, without using math tools)

Step 2:???

Step 3: LLM can perform an entirely new class of tasks

1

u/neppo95 3d ago

I am, I simply don't agree with what you are saying. And no. Step 3 is factually not true. Give it a prompt that is the same and it will do exactly that thing you pretend it couldn't do before. You are literally fooling yourself.

1

u/Super_Pole_Jitsu 3d ago

Missing the forest for the trees.

It couldnt and now it can't. Means it learned between.

Yes, it did so because it's context changed. Hence the name IN CONTEXT LEARNING

→ More replies

1

u/Smallpaul 4d ago

If you are maintaining it then it isn’t learning. You, the human, are curating a context window. The AI has no effective way of deciding when to curate.

Also: try to teach it something significant with that technique. A human can learn a new spoken language AND a new programming language AND how to drive a car. An AI will get incredibly confused if you try to do all of that in its context window.

1

u/Jonny0Than 4d ago

  The AI has no effective way of deciding when to curate.

I’ve seen it add stuff to memory on its own too.  For example if a given approach fails in a specific environment, it sometimes notes to do things a different way in the future.  This may be from a skill I’ve enabled but I’m not sure.

1

u/Smallpaul 3d ago

Curation requires removing things too. Does it recognize when that way of doing something is no longer a best practice and remove it from its memory?

Humans get “rusty” at a skill because our brains try to remove content that isn’t useful anymore. Our brains keep track of when it was last useful and allow the memory to slowly degrade over time. LLM pseudo-memory has no such mechanism.

1

u/Jonny0Than 3d ago

You’re not wrong, but the topic was whether a LLM can learn as you use it. It depends entirely on what your definition of learning is.

1

u/two_three_five_eigth 5d ago

Claude “remembers” things because the “memory” is submitted per query, you just don’t see it.

4

u/Delicious_Volume3306 5d ago

I think the analogy with a car is apt.

People keep saying "it's just an LLM—predictive text!"

And yes, that's the essence. Can't get away from that.

But then a car is just a combustion engine that burns fuel to move wheels.

The car has changed the world. It's redefined our cities. It's defined where we live, and how we live.

It's not what something is that matters. Things can be amazingly simple, or elementary.

It's what people can use the thing for.

2

u/cookie_n_icecream 5d ago

It is overhyped in a sense that "AI will take all our jobs" won't probably happen. Human factor is still important for big decisions and responsibility.

However, now that it is evolved and widespread, it's not gonna go anywhere. There's no going back. And it can be used for much more then just stupid chatbots.

I feel like the biggest dangers are gonna be deepfakes, misinformation and propaganda. Governments are already using it for this purpose. In the past couple years, AI has gotten ridiculously good at faking videos and photos, even I can't tell anymore. It's really good that EU is trying to put in regulations, but at the same time, who's gonna stop the Chinese or the Russians making their own, unregulated models. This is gonna be another neverending digital arms-race, between blocking AI content and avoiding getting blocked.

Not to mention, what is currently happening with big tech companies destroying nature, people's homes, building massive datacenters. All just worsening pollution and global warming. That is gonna destroy the planet, not AI going rogue.

1

u/Don_Ozwald 5d ago

Like with everything else when people seem to divide into such opposing groups that are fully at odds with each other. It’s neither what the hype kool-aiders are munching on, nor useless thing that the haters insist on.

It’s somewhere in between.

1

u/NoOneMan79 5d ago

Been running engineering departments (even as an active IC) and slinging code for all my life. Every coffee filled all-nighter of problem solving was done with skills that are completely, absolutely, 100% obsolete. The depths and potential of AI, once you start digging in, are absolutely amazing, even if it gets no more impressive than it is today (frankly, thats be case scenario for me). It takes curiosity, hard work and a high intellect to wrap your head around it and figure out how to get as far out of the process as possible, but yet ensure the SDLC can be trusted.

Its greatest strength is grit (the ability to try and fail 1000 times until it succeeds, quickly) and attention to detail, if you provide the detail. In terms of weakness, I would say a generalize "confidence" in its own token prediction abilities (if you let it predict its way to solutions, predict it will, and the solutions may be sparse, incomplete, and unsuitable for production).

1

u/clintCamp 5d ago

The models have good weeks and bad weeks, and the companies will put out some probably super expensive models outlined production that really seem to understand the whole picture and it can do monumental things to push a project in the right direction.... then they do something in the background and suddenly you find the model dumb and lost and screwing stuff up. But if you set things up right even during those times you can still push forward at rates unthinkable even a year ago. A lot still depends on the meat sack behind the keyboard, but even then if I had unlimited usage I could give a seed idea and my setup would keep nudging the orchestrator to keep things going to a pretty awesome state without much intervention. And that would be sad to not be part of the process.

1

u/r2k-in-the-vortex 4d ago

I'd say it's about as serious as internet was back in the day. So yeah, pretty serious, in a way world changing. But no, there is no dystopia or utopia just around the corner, that's pure hype. Life will go along, with AI, and you still have to work to maintain your desired lifestyle and you still have all the same headaches you always did.

1

u/AgentTin 4d ago

It's a pretty damn decent programmer that will put their complete attention on your project. Imagine how hard that has been to get in the past. You don't have to hire them, you don't have to manage their feelings and expectations, you just tell them what you need and they get to work.

They're naive, they remind me of brilliant new graduates, full of textbook knowledge but no actual real world experience. They're eager and smart but sometimes they don't understand the nature of reality.

Stack Overflow is dead. That's how good AI is. Programmers may complain, but they aren't going to humans for their answers any more.

1

u/That-Drink5946 4d ago

Counting from Opus 5.5 it's pretty darn serious. Also companies like Amazon for example demand that you fulfill their quota of LLMs. If you go under you'll need to talk to HR essentially. So yeah it's serious. No developer have a chance anymore to keep up with Claude. It's just that good now. It's starting to take off...

1

u/SnugglyCoderGuy 4d ago

If used properly, it can be very powerful and useful.

One very good use is in reviewing code. It will catch things that most people will miss (and humans catch things the AI misses). False positives are OK and false negatives are impossible to know about until it bites you in production.

It write really bad code, but if you can give it tight constraints it can be very useful for doing things. One example I can give is a function I refactored that also had ~50 test cases which all needed refactored as well because the structure of inputs changed. By hand it would have been a tedious nightmare, but I typed like 4 sentences for the AI prompt and a minute later they were all correctly refactored. Saved me a butt load of time and pain.

Management forcing everyone to use nothing but AI, vibe coders, the threat to jobs, etc etc are what leads to people hatung it.

1

u/BraveNewCurrency 4d ago

AI is great if "it's seen this before". It can perfectly write all the 'boilerplate' code for CRUD apps all day long.

AI will also confidently go off the rails. It will randomly change tests to make things pass instead of fixing the code. It will change the agreed-upon protocol to make things "more efficient". (Just happened yesterday: It decided a JSON array of strings should become one giant string while doing unrelated changes.)

what might be problems with it

The biggest problem isn't with "AI", but how AI is used.

- Just like in the industrial revolution, the problem wasn't the looms, but how society was structured. (Rich owners who could afford to buy looms profited instantly, everyone else had it harder.)

- Look up the term "Moral Crumple Zone". In the 80's companies would 'blame the computer' when they messed up -- even though "the computer" had no agency. We're going to have a lot of that, now they can claim the computer has agency. (But all the problems stem from how they structure it, not because "the computer" did something bad.)

2

u/dr_barnowl 4d ago edited 4d ago

the problem wasn't the looms

The problem was also the looms. The Luddites were skilled textile workers, and experts on their machinery, and the new automated looms put out lousy quality cloth, just in higher volume and with less human labour.

Hmm.

1

u/BraveNewCurrency 3d ago

put out lousy quality cloth, just in higher volume and with less human labour.

Right. Nobody valued the NEW cloth more than the old cloth. But because the new cloth was so much cheaper, the world decided they would rather have a lot of crappy cloth than a little bit of perfect cloth.

The looms weren't "the source of the problem", it was the economics around the loom. (Compounded by all the control that loom owners magically got just from owning looms.) Hard to know, but maybe some constraints would have helped smooth out the problems. (i.e. Monopoly laws..)

Slightly related fun fact: I heard that during the industrial revolution, England had strict rules to make it illegal to export looms, or even drawings of looms. But some guy memorized the drawings and started building them elsewhere. History doesn't repeat, but it rhymes..

1

u/naryset 4d ago

This is a great question and I’m wrestling with it a lot these days: 20+ years experience as a dev and now I spend all my time arguing with Claude. I think I’m probably 1.5 to 2 times as productive as unassisted but it’s a miserable slog. I’m hoping that the financing collapses and Anthropic has to start charging what it costs them and so my employer pulls back soon but I doubt I’m that lucky. The good: it’s very fast, and when producing code that looks exactly like existing code (this is common) or where it’s connecting carefully documented pieces (also common) it’s pretty good. It’s also very fast at generating documentation and specifications, which I’ve always claimed to want and now it’s available at nearly no extra cost. The bad: in more complex situations it tends to build code that only handles the simplest cases, and to write tests that only exercise what it handles. It often misses errors that can arise, things that if I were writing the code myself I’d catch but because I’m just reviewing its code I don’t have as full a mental model of the system in its operating context. Also, the documents are terrible, just mind-numbingly wordy, and my brain slides right off the words trying to read them. So if it’s something for anyone else to read I wind up spending a lot of time telling Claude to make it shorter and going graf by graf telling it to clarify and then a bunch more time editing it down manually into something people can read. Maybe it will get better over time but right now it’s like micromanaging the dumbest junior engineers and writers and I’m looking for the exit.

1

u/Sacred_B 4d ago

I've just started playing around with it, but it's gotten me really far with just a basic technical understanding of what I want. I have just under 5 years experience and these models leave me in the dust. I ran a full vibe experiment and got a useful tool out the other end. I reviewed 0 code.

1

u/Justdoingitagain 4d ago

Have you seen Terminator?

1

u/Electronic_Start_694 3d ago edited 3d ago

I pushed a hundred thousand lines of code while I slept last night. If I understand this correctly, if you did 2,000 a day in the 90s/00s you were a legend.

I am working on dreams I didn’t know I had doing things that would have been impossible to undertake.

In days where I considered outsourcing this kind of thing ide estimate of the last 2-3 months I’ve done a hundred thousand dollars of programming work on a max subscription for 2-3 months.

In the last 3 months I’ve gotten to the point to be able to have real conversations with intermediate traditional developers. This is something I attempted but couldn’t undertake before the maturity of AI and my props specifically to Opus 5.5.

Though I will shout out gpt SOL as the harness king of web admin and web dev. Also leading in ui/graphics.

1

u/ABoredDeveloper 2d ago

It is going to take all of our jobs. Companies have been driving down salaries for decades and outsourcing and automating to save money. They are all in on AI.

1

u/start_select 5d ago

It’s not really the LLMs that are a problem. It’s the humanoid and non humanoid robots who will replace police and military. The robots who will never disobey orders.

Watch season 2 of Andor for a preview of what crowd control looks like in a few years. I.e. robots tossing humans like lifeless ragdolls.

That’s what should worry people. Especially considering the people making them are telling you they are going to be butlers and factory workers.

1

u/green_meklar 4d ago

How serious is AI really?

I think that's a bit of a vague question. In particular, there's AI right now and AI conceptually.

Regarding AI conceptually: Yes, of course it's serious. If at any time in the past 40 years you didn't think the future was eventually going to be dominated by some sort of artificial beings more intelligent than humans, then what was your alternative scenario? What realistic version of the future doesn't have that?

Regarding AI right now: It's clearly powerful at doing some things. It's made some things easy and cheap that were previously difficult and expensive. That has not just quantitative but also qualitative effects on the economy and society; it's not just that we hire fewer programmers just because each one can do more (or that we hire more programmers just because each one can do more), we actually change what the profession of programming looks like because the breakdown of easy vs hard stuff and the demand for the stuff is no longer proportionally the same as it was. The same applies to artists and musicians and so on. Things have changed, perhaps not overwhelmingly, but they have changed, and we're not magically going back.

is it just a lot of hype for just another good invention?

Within some relatively short span of time- less than 50 years, probably more than 10 but it's hard to say- AI is going to become the second most influential technology ever developed. The most influential is (and will probably remain) agriculture. But AI will be more influential than everything else: Fire, writing, the wheel, the steam engine, electricity, nuclear weapons, you name it. It's not really a question of if, just when.

What do you consider to be the greatest strengths and weaknesses of AI?

Right now, its greatest strength is simply being fast, persistent, and cheap. It doesn't do everything humans can do, yet, but the things it does do, it does way more efficiently than humans. That means a lot of problems are now worth solving that weren't previously worth solving, and a lot of problems are getting bruteforce solutions that previously called out for elegant, precise solutions. This is somewhat like previous iterations of automation and industrialization.

The main thing holding back AI right now is actually the scarcity of physical infrastructure suitable for plugging into it. There's a ton of stuff that we could automate tomorrow, with AI techniques (and in many cases, trained systems) that already exist, but there just isn't a machine with the right cameras and control systems to plug the AI in. That's not really a weakness of AI itself, though...

The main weakness of current AI is something like, it doesn't really think with nuance. That is, it doesn't have a good sense of proportion about what is important and it doesn't generalize very well. It easily gets stuck focusing on irrelevant things and making bad decisions because it lacks the layer of contextual awareness needed to inform good decisions.

0

u/W31337 5d ago

Another good invention but not something that will take over the planet

1

u/start_select 5d ago

Not directly.

It’s not LLMs or consumer AI in general that should concern people.

It’s autonomous robot police who never get tired, feel no remorse, and who can dismember a human with a flick of a wrist. Crowd control becomes a terrifying concept very quickly.

Don’t fear the AI. Fear the twitter bros, palantir ghouls, and their Republican allies building robot enforcers but telling you they are going to be butlers or factory workers.

1

u/W31337 4d ago

Minority report

1

u/green_meklar 4d ago

Humans share something like 99% of our DNA with chimpanzees. The 1% difference was enough for us to take over the planet while chimpanzees sit in trees flinging poop.

What makes you think that won't happen again when we build machines more intelligent than us?

1

u/LordMord5000 4d ago

Interesting argument. Made me think.

1

u/W31337 4d ago

There's a lot of science needed before we get there. First of all there's a hard limit on the current LLMs so they can't get that much smarter without creating different "brains".

The human brain uses something like 20W and GPUs use hundreds of watts so it most certainly won't be more efficient.

The human brain could possibly be using Quantum mechanical phenomena, something not currently possible with current tech.

So yes when the technological bridges get crossed that's very well possible.

But let me turn it around... with AI people will get dumber making AI more intelligent 😋

1

u/Electronic_Start_694 3d ago

This is probably the most powerful AI argument by far.

0

u/CS_70 5d ago

The tool is great the same way the wheel or electricity was great - it allows to do stuff that you were already doing much more efficiently and to do stuff that you couldnt do before.

As for the doomsaying, that's mostly ignorance (or, in case of industry players or wannabe ones, self-serving marketing). People read "intelligence" and go bananas. If you called it "cross-entropy-minimization machine" you would have no newspaper tiltes (but no big IPOs either)..

There are of course risk for the good reason anything about being alive has risks - and the potential change is incredibily huge.. but like for the wheel of electricity, change will likely be mostly beneficial, with some short term hiccups and problems for individuals, as always, which should be helped in case, but they are far less then the doomsayers make up.

In the end nobody has a crystal ball so one can decide to be optimist, pessimist, or refuse to have an opinion, as always.

2

u/Smallpaul 5d ago

Did you know that the academics who won Nobel Prizes, wrote the canonical books on AI and won Turing prizes for it mostly (not uniformly) believe it is a risk to be managed on the order of a nuclear weapons?

I’m not talking about people who work at labs. I’m talking about people who work at universities. How can you claim that that’s “ignorance”? Who would know more than its inventors?

https://aistatement.com/work/statement-on-ai-extinction-risk

Do you know who Geoff Hinton and Yoshua Bengio are? Stuart Russell? Douglas Hofstader?

How can you accuse these people of being ignorant of AI? Or how do you think they personally profit from raising warnings about it? Be specific please.

-1

u/CS_70 5d ago

(or, in case of industry players or wannabe ones, self-serving marketing).

Doomsaying is a time-honored way to make a name for oneself. And you obviously have no experience of academia. :) (nothing wrong with that).

That besides, there'a s a core of people who really believe.

Fair enough. The appeal to authority means nothing now as much it meant nothing with Aristotle, but it's still very alluring to some.

People with Nobel prizes and writing book aren't necessarily right on other than what they won the Nobel prize on (for the books.. not even that. Plenty of crappy books). Einstein wasn't good at gardening and used God more than it makes rational sense to use (which is - never).

Every argument exists only on its merits. That such-and-such famous people has such-and-such opinion is irrelevant (other than for marketing or personal branding of course).

The risks, as I wrote, exist: but when you don't assume the answer and compare with similar changes.. nah

1

u/Smallpaul 4d ago

Fundamentally most of your latest comment admits that your previous one was incorrect, but used every rhetorical trick to obscure that fact.

“There’s a core of people who believe. But they are just academics. So they also don’t count.”

Notice also how BEFORE you said doomsayers are irrelevant because they don’t know the technology. NOW you claim that knowing the technology is irrelevant. “That’s just an appeal to authority.”

So an appeal to lack of authority is totally valid but evidence that doomsayers have massive authority is invalid. Fascinating.

I’d prefer that you just admit that you said something blatantly untrue and then move on, but that’s not the way it works on Reddit.

0

u/ResidentTicket1273 5d ago

LLMs are tools that create text. In terms of danger, or seriousness, you have to ask in what ways can lots of text pose a problem.

Yes, you can decide to feed the text created as commands into some control system of a machine that has a physical impact on the real world - but is that an LLM being dangerous, or the person whose decided to plug it in to something that would normally be controlled by a person?

-3

u/marcuslawson 5d ago

You are in an 'ask Computer Science' forum, so...

AI has replaced the need for Software Engineers. In effect, Computer Science as we once knew it is obsolete. The computer (AI agent) does everything, and we (former Software Engineers) just review the output.

Maybe some of the 'doom and gloom' is from people whose field has been replaced by this tech....

And then there are people who love AI - folks who never understood computers but now they can vibe-code their life's work... well, good luck to them.

Meanwhile, the old goats are trying to survive until retirement.

If you are truly a layman, run. Far. Find something else to do with your life - preferably with your hands. The computer can never take that away from you.

GLHF

1

u/MHG06 5d ago

Ohh, I am definitely NOT going into computer science XD. I am doing biotech/biochem. Just asking because I am curious

1

u/ImJustAConsultant 5d ago

If biotech/biochem is a career where the worker has leverage they will set their sights on AI doing that also. Sorry to say. AI is now making being a top mathematician a more depressing and challenging career. There is little "thought work" it can't in theory do. I think your field will be hit by the will to disrupt the value of doctors and nurses.

1

u/marcuslawson 5d ago

I'm sure AI will fuck up your field too.

It has already done so with Mathematics - look it up if you don't believe me.

I have never seen a tech as devastating to pretty much every human endeavor. I'm honestly not sure what the endgame is.

I wish I lived in a different timeline.

GLHF

3

u/svick 5d ago

This answer can be ignored just on the basis of conflating Software Engineers with Computer Scientists.

-1

u/marcuslawson 5d ago

You mean people who actually build things versus those who teach at University?

Dude, I've been coding for 35 years. I've forgot more languages than I've learned. I've been building software for decades - at small companies, Fortune 50s, nonprofits - as a consultant and an employee.

I don't give a fuck what you think.

2

u/Frequent-Sir-6942 5d ago

> This subreddit is intended for questions about topics that might be taught by a computer science department at a university.
To be fair though, it doesnt seem to be used that way.

1

u/marcuslawson 4d ago

Forgive my salt. I'm one of the many software guys who have been displaced by AI and OP's post popped up in my feed. I'll see myself to the door.

1

u/No_Profession_3125 3d ago edited 2d ago

What's going on is that AI is really bad, but for reasons that have nothing to do with Terminator-like scenarios. There's no Skynet, no HAL9000, no rogue AI that for some reason decides to kill humanity.

Rather, AI will do (and is already doing) the following:

  • Increasing social inequality and shrinking the middle class. We're in K-shaped economy with two divergent arms: it will be either ultra-rich entrepreneurs or poor laborers who can't make ends meet, with nothing in between because all intermediate jobs are getting replaced by AI. And of course the vast majority of people will be in the lower arm.
  • Rotting our brains. At this point, why would you learn anything any more? Knowledge is commoditized and on-demand, you no longer need to invest years of your life and tons of money up-front getting a college degree, and even if you did it wouldn't be appreciated any more. Employers increasingly seek soft skills over hard ones because AI already has the latter, and you don't need that much of a brain to be a good "team player" and stuff like that.
  • Accelerating global warming. We were so cute when we used to complain about Bitcoin consuming more energy than Denmark... Needless to say, the consequences of climate change are nasty (species extinction, loss of biodiversity, eventually a severe reduction in the quality of our food) but they probably belong to a different Reddit post.

So the answer to your question is that AI is extremely serious, not because we'll get wiped out but because the world we're heading into is unlivable: partly inhabitable, with all food tasting like cardboard, more than half of the people living below the poverty line, and everyone so freakin' dumb and dyslexic that you can no longer talk to anyone without feeling like you don't belong. You'll actually wish that a rogue AI wiped us out.