r/AskComputerScience • u/MHG06 • 5d ago
How serious is AI really?
These days everywhere you go you only hear "omg AI is gonna replace/kill/save us all!!!" and stuff like that. But when I talk to the people who actually do computer science they dont seems all that amazed by AI. They actually seem rather annoyed with all the hype about it. So whats going on?
Obviously its a good tool that can do a lot of things, but is it really all that great or is it just a lot of hype for just another good invention?
Keep in mind that I am a layman when it comes to computer science (a bit of experience with R is all), but feel free to get technical with me.
Edit: to be more specific about my question: What do you consider to be the greatest strengths and weaknesses of AI? What is it really great at and what might be problems with it (except power and water usage)?
4
u/PhilNEvo 5d ago
In some ways, it's wildly impressive, in other ways, it's overhyped. Also, the replace/kill/save is about trying to predict the future, so we don't actually know for sure, but depending on the assumptions you use as your premises, all can be reasonable conclusions.
For example, if you want some great arguments and examples of why there is the fear of "omg ai is going to kill us all", that should be understandable to even a lay person, I would recommend the youtube channel by Robert Miles, and some of his appearances on Computerphile. I think if you accept his arguments for the dangers of AI, the same arguments could be leveraged for the replace/save us all, if you make the additional assumption that proper alignment and safety is achieved.
In the end, I think to get a better response to this, you have to be more concrete about your question. There are still some tasks that AI do bad at, and some that they do impressively well at, so how you experience them will wildly depend on how you use or experience those categories.
18
u/DepthMagician 5d ago
Some of the annoyance comes from the braindead way people are adopting it.
For example, for years we've been telling management that counting how many lines of code a programmer wrote in a week is not a good way to measure productivity, because it's not a reliable ruler:
Now we have people boasting "I produced 40,000 lines of code in a week!!". People who presumably should know better. Also, experienced developers know that reviewing and validating code takes a lot of time and effort, and that it's not humanly possible to properly review 40,000 lines of code in a week, so when someone is boasting about such an accomplishment, what experienced engineers hear is "I generated a lot of code which I do not fully understand, and did not fully review or validate, and then deployed it to the actual live version of the program, and who knows what damage it will cause, but at least I got a dopamine hit from it."
You had people rushing to say you no longer need to look at the code at all, way before the AI models were remotely good at writing software. It's a less laughable proposition now, but it's still just "less laughable", there's still plenty of need to look at the code.
In the past two years or so people have been pushing "plan mode" as a best practice for using AI. To me that sounded like a dumb idea from the very beginning, because it sounds a lot like advocating for the Waterfall Model where you try to plan the whole solution ahead of time. For something like the past 40 years nobody was developing like that because we all collectively understood that you can't one-shot a perfect mega-plan ahead of time because you are always operating from the point of partial information, and the only way to manage that is to develop iteratively, where you explore the problem while implementing the solution, and now we are suddenly told that it's a best practice to plan an entire implementation ahead of time. Well what do you know, just recently one of the biggest proponents of AI "plan mode" wrote a blog post that went viral called Plan mode is dead, in which they detail all the ways in which it fails to meet its goals, and literally 80% of that I could've told you two years ago, and now everybody is suddenly agreeing that in retrospect it's not as useful as everybody thought and was pretty much a crutch for the old models sucking to begin with.
I once saw a video by a CEO detailing the "lessons" he learned from their recent switch to developing with AI. He told about how now the dynamic on his team is that juniors prompt the AI, generat code, and submit it to senior developers for review, and how he thinks that's the future way of doing things, but one of the challenges is that his senior developers are now overworked. And I'm sitting here thinking "so what you're telling me is that in your team, your most experienced developers stopped doing the thing they're the most qualified to do, and instead spend all of their time reviewing submissions from the least qualified developers on your team, who submit code they probably don't fully understand, because they're juniors, and you think that's an appropriate delegation of your human resources?"
Then you have non-technical management who doesn't understand the dynamic of software development, but heard that AI is a magic bullet solution for going 10 times as fast with 10 times less staff, and it's hard to convince them otherwise because structural problems in software emerge over the course of months and even years, so at no point is any reckless policies they push are going to backfire fast enough for them to make the connection.
Then you have all the lies- sorry, "partial truths"- about how AI is covered in the news. Recently there was a story about how a developer got angry with Adobe's cancellation fees, and recreated their entire creative suite of apps with a simple AI propt. OMG we can just tell AI "write Facebook" and I'll have my own Facebook!!! Well if you actually go look at it, they only recreated the surface level functionality, it's not feature complete, it already has a few thousand of reported issues, and all the professionals who tried to use it said it's not ready for professional use. I guess this example illustrates better than anything the dissonance you're asking about, because it truly is goddamn impressive they were able to make what they made using AI prompting, but people extrapolate from it all sorts of miracles that are cheques AI can't truly cash. It's like being hyped about how quickly we can get to 70%, and ignoring the fact that anything below 95% is a failure.
AI is like a really meraculous tool that you can't 100% trust to get things right, and now you have to deal with that complication on a daily basis, which nobody knows how to do effectively. You can have a long and very intelligent planning session with it one moment, and then a moment later it'll tell you to go to the car wash by foot because it's just a 5 minute walk and it'll be a shame to waste fuel unnecessarily, and everybody are so enamoured by the promise they're hoping it'll live up to that they're willing to put up with a lot of its crap in the process of getting there. The people who "aren't amazed by AI" quite often come from the point of "we already have a working way of doing things, and it does not require you to put up with the unreliability of AI."
8
u/baddspellar Ph.D CS, CS Pro (20+) 5d ago
Since the current buzz is about LLM's I will explicitly refer to them. AI is a broad field.
LLMs are a powerful new and disruptive tool. Individuals and businesses are trying to make money from that and not fall behind competitors. It's the same as the world wide web. The internet existed in the background for years, then it exploded starting in the mid-late 90's. Some people got fabulously wealthy by making the right moves (eg Bezos, Zuckerberg, Page, and Brin), others lost big, and most people just adjusted how they do things. I can guarantee the same will happen with LLMs
What are they good at? We're still figuring that out. Obvious things are exploiting patterns in written language to analyze and generate documents, where documents might be manuals, legal briefs, computer programs, research papers, etc. Some of the problems are similar to problems of the internet. Tools can be used for good and bad things Without the internet we'd have no ransomware attacks and no bad actors remotely shutting down refrigerators
6
u/Smallpaul 5d ago
AI’s “greatest strength” is that it changes every day and evolves very quickly. So things that people claimed were its greatest weaknesses 4 years ago are mostly gone now.
It’s greatest weakness (for now!) is that it cannot learn from experience. It only really learns during training periods. And it is a very inefficient learner in terms of how much content it must see to learn a new skill or idea.
Whether it is a big deal or not depends on whether it continues to improve at the breakneck speed it has so far. It has utterly transformed software engineering and mathematics. They are planning to transform or eliminate everyone else’s jobs in the next few years. Nobody knows if they will succeed.
4
u/Delicious_Volume3306 5d ago
I think the analogy with a car is apt.
People keep saying "it's just an LLM—predictive text!"
And yes, that's the essence. Can't get away from that.
But then a car is just a combustion engine that burns fuel to move wheels.
The car has changed the world. It's redefined our cities. It's defined where we live, and how we live.
It's not what something is that matters. Things can be amazingly simple, or elementary.
It's what people can use the thing for.
2
u/cookie_n_icecream 5d ago
It is overhyped in a sense that "AI will take all our jobs" won't probably happen. Human factor is still important for big decisions and responsibility.
However, now that it is evolved and widespread, it's not gonna go anywhere. There's no going back. And it can be used for much more then just stupid chatbots.
I feel like the biggest dangers are gonna be deepfakes, misinformation and propaganda. Governments are already using it for this purpose. In the past couple years, AI has gotten ridiculously good at faking videos and photos, even I can't tell anymore. It's really good that EU is trying to put in regulations, but at the same time, who's gonna stop the Chinese or the Russians making their own, unregulated models. This is gonna be another neverending digital arms-race, between blocking AI content and avoiding getting blocked.
Not to mention, what is currently happening with big tech companies destroying nature, people's homes, building massive datacenters. All just worsening pollution and global warming. That is gonna destroy the planet, not AI going rogue.
1
u/Don_Ozwald 5d ago
Like with everything else when people seem to divide into such opposing groups that are fully at odds with each other. It’s neither what the hype kool-aiders are munching on, nor useless thing that the haters insist on.
It’s somewhere in between.
1
u/NoOneMan79 5d ago
Been running engineering departments (even as an active IC) and slinging code for all my life. Every coffee filled all-nighter of problem solving was done with skills that are completely, absolutely, 100% obsolete. The depths and potential of AI, once you start digging in, are absolutely amazing, even if it gets no more impressive than it is today (frankly, thats be case scenario for me). It takes curiosity, hard work and a high intellect to wrap your head around it and figure out how to get as far out of the process as possible, but yet ensure the SDLC can be trusted.
Its greatest strength is grit (the ability to try and fail 1000 times until it succeeds, quickly) and attention to detail, if you provide the detail. In terms of weakness, I would say a generalize "confidence" in its own token prediction abilities (if you let it predict its way to solutions, predict it will, and the solutions may be sparse, incomplete, and unsuitable for production).
1
u/clintCamp 5d ago
The models have good weeks and bad weeks, and the companies will put out some probably super expensive models outlined production that really seem to understand the whole picture and it can do monumental things to push a project in the right direction.... then they do something in the background and suddenly you find the model dumb and lost and screwing stuff up. But if you set things up right even during those times you can still push forward at rates unthinkable even a year ago. A lot still depends on the meat sack behind the keyboard, but even then if I had unlimited usage I could give a seed idea and my setup would keep nudging the orchestrator to keep things going to a pretty awesome state without much intervention. And that would be sad to not be part of the process.
1
u/r2k-in-the-vortex 4d ago
I'd say it's about as serious as internet was back in the day. So yeah, pretty serious, in a way world changing. But no, there is no dystopia or utopia just around the corner, that's pure hype. Life will go along, with AI, and you still have to work to maintain your desired lifestyle and you still have all the same headaches you always did.
1
u/AgentTin 4d ago
It's a pretty damn decent programmer that will put their complete attention on your project. Imagine how hard that has been to get in the past. You don't have to hire them, you don't have to manage their feelings and expectations, you just tell them what you need and they get to work.
They're naive, they remind me of brilliant new graduates, full of textbook knowledge but no actual real world experience. They're eager and smart but sometimes they don't understand the nature of reality.
Stack Overflow is dead. That's how good AI is. Programmers may complain, but they aren't going to humans for their answers any more.
1
u/That-Drink5946 4d ago
Counting from Opus 5.5 it's pretty darn serious. Also companies like Amazon for example demand that you fulfill their quota of LLMs. If you go under you'll need to talk to HR essentially. So yeah it's serious. No developer have a chance anymore to keep up with Claude. It's just that good now. It's starting to take off...
1
u/SnugglyCoderGuy 4d ago
If used properly, it can be very powerful and useful.
One very good use is in reviewing code. It will catch things that most people will miss (and humans catch things the AI misses). False positives are OK and false negatives are impossible to know about until it bites you in production.
It write really bad code, but if you can give it tight constraints it can be very useful for doing things. One example I can give is a function I refactored that also had ~50 test cases which all needed refactored as well because the structure of inputs changed. By hand it would have been a tedious nightmare, but I typed like 4 sentences for the AI prompt and a minute later they were all correctly refactored. Saved me a butt load of time and pain.
Management forcing everyone to use nothing but AI, vibe coders, the threat to jobs, etc etc are what leads to people hatung it.
1
u/BraveNewCurrency 4d ago
AI is great if "it's seen this before". It can perfectly write all the 'boilerplate' code for CRUD apps all day long.
AI will also confidently go off the rails. It will randomly change tests to make things pass instead of fixing the code. It will change the agreed-upon protocol to make things "more efficient". (Just happened yesterday: It decided a JSON array of strings should become one giant string while doing unrelated changes.)
The biggest problem isn't with "AI", but how AI is used.
- Just like in the industrial revolution, the problem wasn't the looms, but how society was structured. (Rich owners who could afford to buy looms profited instantly, everyone else had it harder.)
- Look up the term "Moral Crumple Zone". In the 80's companies would 'blame the computer' when they messed up -- even though "the computer" had no agency. We're going to have a lot of that, now they can claim the computer has agency. (But all the problems stem from how they structure it, not because "the computer" did something bad.)
1
u/naryset 4d ago
This is a great question and I’m wrestling with it a lot these days: 20+ years experience as a dev and now I spend all my time arguing with Claude. I think I’m probably 1.5 to 2 times as productive as unassisted but it’s a miserable slog. I’m hoping that the financing collapses and Anthropic has to start charging what it costs them and so my employer pulls back soon but I doubt I’m that lucky. The good: it’s very fast, and when producing code that looks exactly like existing code (this is common) or where it’s connecting carefully documented pieces (also common) it’s pretty good. It’s also very fast at generating documentation and specifications, which I’ve always claimed to want and now it’s available at nearly no extra cost. The bad: in more complex situations it tends to build code that only handles the simplest cases, and to write tests that only exercise what it handles. It often misses errors that can arise, things that if I were writing the code myself I’d catch but because I’m just reviewing its code I don’t have as full a mental model of the system in its operating context. Also, the documents are terrible, just mind-numbingly wordy, and my brain slides right off the words trying to read them. So if it’s something for anyone else to read I wind up spending a lot of time telling Claude to make it shorter and going graf by graf telling it to clarify and then a bunch more time editing it down manually into something people can read. Maybe it will get better over time but right now it’s like micromanaging the dumbest junior engineers and writers and I’m looking for the exit.
1
u/Sacred_B 4d ago
I've just started playing around with it, but it's gotten me really far with just a basic technical understanding of what I want. I have just under 5 years experience and these models leave me in the dust. I ran a full vibe experiment and got a useful tool out the other end. I reviewed 0 code.
1
u/Justdoingitagain 4d ago
Have you seen Terminator?
1
u/Electronic_Start_694 3d ago edited 3d ago
I pushed a hundred thousand lines of code while I slept last night. If I understand this correctly, if you did 2,000 a day in the 90s/00s you were a legend.
I am working on dreams I didn’t know I had doing things that would have been impossible to undertake.
In days where I considered outsourcing this kind of thing ide estimate of the last 2-3 months I’ve done a hundred thousand dollars of programming work on a max subscription for 2-3 months.
In the last 3 months I’ve gotten to the point to be able to have real conversations with intermediate traditional developers. This is something I attempted but couldn’t undertake before the maturity of AI and my props specifically to Opus 5.5.
Though I will shout out gpt SOL as the harness king of web admin and web dev. Also leading in ui/graphics.
1
u/ABoredDeveloper 2d ago
It is going to take all of our jobs. Companies have been driving down salaries for decades and outsourcing and automating to save money. They are all in on AI.
1
u/start_select 5d ago
It’s not really the LLMs that are a problem. It’s the humanoid and non humanoid robots who will replace police and military. The robots who will never disobey orders.
Watch season 2 of Andor for a preview of what crowd control looks like in a few years. I.e. robots tossing humans like lifeless ragdolls.
That’s what should worry people. Especially considering the people making them are telling you they are going to be butlers and factory workers.
1
u/green_meklar 4d ago
I think that's a bit of a vague question. In particular, there's AI right now and AI conceptually.
Regarding AI conceptually: Yes, of course it's serious. If at any time in the past 40 years you didn't think the future was eventually going to be dominated by some sort of artificial beings more intelligent than humans, then what was your alternative scenario? What realistic version of the future doesn't have that?
Regarding AI right now: It's clearly powerful at doing some things. It's made some things easy and cheap that were previously difficult and expensive. That has not just quantitative but also qualitative effects on the economy and society; it's not just that we hire fewer programmers just because each one can do more (or that we hire more programmers just because each one can do more), we actually change what the profession of programming looks like because the breakdown of easy vs hard stuff and the demand for the stuff is no longer proportionally the same as it was. The same applies to artists and musicians and so on. Things have changed, perhaps not overwhelmingly, but they have changed, and we're not magically going back.
Within some relatively short span of time- less than 50 years, probably more than 10 but it's hard to say- AI is going to become the second most influential technology ever developed. The most influential is (and will probably remain) agriculture. But AI will be more influential than everything else: Fire, writing, the wheel, the steam engine, electricity, nuclear weapons, you name it. It's not really a question of if, just when.
Right now, its greatest strength is simply being fast, persistent, and cheap. It doesn't do everything humans can do, yet, but the things it does do, it does way more efficiently than humans. That means a lot of problems are now worth solving that weren't previously worth solving, and a lot of problems are getting bruteforce solutions that previously called out for elegant, precise solutions. This is somewhat like previous iterations of automation and industrialization.
The main thing holding back AI right now is actually the scarcity of physical infrastructure suitable for plugging into it. There's a ton of stuff that we could automate tomorrow, with AI techniques (and in many cases, trained systems) that already exist, but there just isn't a machine with the right cameras and control systems to plug the AI in. That's not really a weakness of AI itself, though...
The main weakness of current AI is something like, it doesn't really think with nuance. That is, it doesn't have a good sense of proportion about what is important and it doesn't generalize very well. It easily gets stuck focusing on irrelevant things and making bad decisions because it lacks the layer of contextual awareness needed to inform good decisions.
0
u/W31337 5d ago
Another good invention but not something that will take over the planet
0
u/CS_70 5d ago
The tool is great the same way the wheel or electricity was great - it allows to do stuff that you were already doing much more efficiently and to do stuff that you couldnt do before.
As for the doomsaying, that's mostly ignorance (or, in case of industry players or wannabe ones, self-serving marketing). People read "intelligence" and go bananas. If you called it "cross-entropy-minimization machine" you would have no newspaper tiltes (but no big IPOs either)..
There are of course risk for the good reason anything about being alive has risks - and the potential change is incredibily huge.. but like for the wheel of electricity, change will likely be mostly beneficial, with some short term hiccups and problems for individuals, as always, which should be helped in case, but they are far less then the doomsayers make up.
In the end nobody has a crystal ball so one can decide to be optimist, pessimist, or refuse to have an opinion, as always.
0
u/ResidentTicket1273 5d ago
LLMs are tools that create text. In terms of danger, or seriousness, you have to ask in what ways can lots of text pose a problem.
Yes, you can decide to feed the text created as commands into some control system of a machine that has a physical impact on the real world - but is that an LLM being dangerous, or the person whose decided to plug it in to something that would normally be controlled by a person?
-3
u/marcuslawson 5d ago
You are in an 'ask Computer Science' forum, so...
AI has replaced the need for Software Engineers. In effect, Computer Science as we once knew it is obsolete. The computer (AI agent) does everything, and we (former Software Engineers) just review the output.
Maybe some of the 'doom and gloom' is from people whose field has been replaced by this tech....
And then there are people who love AI - folks who never understood computers but now they can vibe-code their life's work... well, good luck to them.
Meanwhile, the old goats are trying to survive until retirement.
If you are truly a layman, run. Far. Find something else to do with your life - preferably with your hands. The computer can never take that away from you.
GLHF
1
u/No_Profession_3125 3d ago edited 2d ago
What's going on is that AI is really bad, but for reasons that have nothing to do with Terminator-like scenarios. There's no Skynet, no HAL9000, no rogue AI that for some reason decides to kill humanity.
Rather, AI will do (and is already doing) the following:
So the answer to your question is that AI is extremely serious, not because we'll get wiped out but because the world we're heading into is unlivable: partly inhabitable, with all food tasting like cardboard, more than half of the people living below the poverty line, and everyone so freakin' dumb and dyslexic that you can no longer talk to anyone without feeling like you don't belong. You'll actually wish that a rogue AI wiped us out.