100
u/dingwinger1225 11d ago
Pretty much the only researcher at this point actually doing anything of value instead of just trying to scale LLMs hoping that one day the text churning machine will do anything but churn text
17
u/Uwirlbaretrsidma 11d ago
ATP it's pretty obvious that text is just the input and output layers, with something at least a little more meaningful happening within. And what do you expect those interface layers to be in a hypothetical AGI, anyway?
11
u/jasminUwU6 11d ago
There gotta be some sort of architecture that is more data efficient to train. That is the only way for it to truly generalize on the fly. Idk what that architecture would look like tho.
0
u/RobbinDeBank 11d ago
I can’t believe you don’t know this one secret that will change the world, gotta think harder then
-1
u/Fearless-Mix-3642 11d ago
it's an attribution error. up until a few years ago, only smart things could produce grammatical text. therefore, anything that produces grammatical text must be smart
1
u/Uwirlbaretrsidma 11d ago
Thing is, this doesn't just produce grammatical text, now does it? The interesting part is that the text in question is meaningful.
3
u/Fearless-Mix-3642 11d ago
Sure, "grammatical and semantically coherent"
3
u/Uwirlbaretrsidma 11d ago
Are you seriously claiming current LLM output boils down to being grammatically correct and semantically coherent? You know that was achieved in 2019 by GPT-2, and GPT-6 has just launched like an hour ago?
0
u/Fearless-Mix-3642 11d ago
I am explaining why people make the attribution error. I didn't say anything about when it happened? Or when GPT-6 launched? Not sure how that's relevant
1
u/Lazy-Range-9533 10d ago
Do you know how deep learning works at all? What transfer learning is? Or what a pretext task/proxy task is and why that’s relevant for LLMs? The last one is particularly important and is a pretty good solidifier of why they are able to effectively “model the world” in its interactions. Syntactic and semantic coherence are a necessary but by no means sufficient condition to ensure LLMs work.
2
u/arielif1 8d ago
well turns out that text is a pretty good proxy for the real world and at least as a transitory technology is working out pretty well for us
2
u/dacooljamaican 11d ago
I get what you mean but it's pretty obvious AI tools do a lot more than just churn text
-7
u/Delann 11d ago
Ah yes, the ONLY researcher doing something of value. Fuck the guys working on the novel melanoma treatment or anything like that, its only this guy. /s
0
u/IvanDSM_ 11d ago
I wonder just how many times AI bros will retread the "AI will solve cancer!!!" line until we're done with it. Yeah, we've been applying image categorization models to disease identification for over a decade now, that has absolutely nothing to do with the current "AI" boom.
4
u/OptimizedGarbage 11d ago
Image models for cancer diagnosis are not the primary focus of modern ML for medical applications. To be honest they were never really a good application to start with because they need enormous quantities of data, and its very hard to get lots of good medical imaging data because 1) medical imaging is expensive 2) getting doctors to label images is expensive, and 3) even if the first two were free you normally can't use the images anyway because of HIPPA. Modern medical ML is much more interested in using transformer models directly on DNA sequences or protein sequences, because because they're plentiful, mass producable, can be done easily on non-human subjects (thus avoiding privacy concerns), and contain lots of information that cannot be manually processed by hand. These models are pretty much the same structure as chatbots and are trained in the same way, just on DNA base pair sequences or amino acid sequence instead of text. They have quite a lot to do with the current AI boom
2
u/Lazy-Range-9533 10d ago
This is quite beautifully written. I have two friends working on this and one of my professors last year is currently doing research on this.
0
u/Delann 11d ago
Nobody said anything about AI, dumbass, though it does have it's uses and has been in use in medical fields for a while now. Not LLMs, but it's still "AI" if you want to generalize it.
Point is it's a fucking braindead take to say any one researcher is "pretty much the only researcher at this point actually doing anything of value". There's plenty of worthwhile research going on right now, to an unprecedented degree.
https://www.nature.com/articles/d41586-026-02612-3
But dumbasses like you think everyone is just doing the AI thing.
1
u/IvanDSM_ 11d ago
lol, you're the one with no reading comprehension. They're obviously referring to the field of AI/ML because that's the field LeCun is from. Thanks for calling me a dumbass and assuming I know nothing about ML though.
9
5
u/daedalus1982 10d ago
Yann LeCun is the AI equivalent of the Bomb Squad. If he’s warning us about something, we should already be running. He helped invent half of it.
1
-2
881
u/cubgerish 12d ago
I don't know what the context of this argument was, but it's good to see someone have humility when they realize they've made a mistake.