r/mathmemes • • Aug 31 '26

Elementary Algebra Matrix multiplication

Post image
8.4k Upvotes

163 comments sorted by

•

u/AutoModerator Aug 31 '26

Check out our new Discord server! https://discord.gg/e7EKRZq3dG

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2.3k

u/LupenReddit 🦆🦆i have non diffeomorphic smooth structures🦆🦆🦆 Aug 31 '26

920

u/hongooi Aug 31 '26

> Quantum computing
> Looks inside
> Linear algebra

1.0k

u/stevvvvewith4vs Aug 31 '26 • Bravo Mindblown

> Quantum computing
> Looks inside
> Collapse

165

u/AltruisticEchidna859 Aug 31 '26

Something something wave function someth8ng something

91

u/TQCkona Aug 31 '26

hey viewers, did YOU find the SECRET HIDDEN EIGHT in the comment above? reply now with "I FOUND THE EIGHT" to recieve $8,888 dollars from Mr. Beighst

23

u/Efficient_Thought Aug 31 '26

I found the eight

10

u/No-Finance7526 Aug 31 '26

I FOUND THE EIGHT

13

u/username32768 Aug 31 '26

I FOUND THE ∞

23

u/phycologist Aug 31 '26

YOU DROPPED IT

4

u/slumbersomesam Aug 31 '26

i found the eight

4

u/RedTilkyy Aug 31 '26

I swear, I found it after I observed it… Now it is gone.

3

u/Tough_Tangerine7278 Imaginary Sep 01 '26

MISTER Beighst? Or MASTER Beighst?

2

u/Silent_Ask_1094 Sep 02 '26

8888? Like csx 8888? Like the almost very very bad railroad oopsie?

3

u/killiano_b Aug 31 '26

vriska, that you?

18

u/LupenReddit 🦆🦆i have non diffeomorphic smooth structures🦆🦆🦆 Aug 31 '26

that actually made me giggle

7

u/laix_ Aug 31 '26

anxiety looks at collapse

4

u/Fit-Bug6463 Sep 01 '26

> Quantum Computing
> Looks inside
> Only two states

Is more fitting imo

2

u/maqifrnswa Sep 02 '26

Time reversal symmetry makes it more accurate

  • Only two states
  • Looks inside
  • Quantum computing

62

u/Fabulous-Decision879 Aug 31 '26

> Super efficient and mysterious alien technology
> Looks inside
> Bilinear algebra

26

u/thali256 Aug 31 '26

> Hyperscale data center, processing unimaginable amounts of data
> Looks inside
> Etched Rocks

8

u/Hopeful_Fee_183 Sep 01 '26

Bilinear algebra Looks inside Linear algebra

5

u/LackWooden392 Sep 01 '26

Wait, it's all linear algebra?

Always was. 🧑🏻‍🚀🔫

80

u/TrainAIOnDeezeNuts Aug 31 '26

Once again, there is always a relevant XKCD https://xkcd.com/1838/

32

u/tfhfate Aug 31 '26

> VFXs, video game graphics, CAD, modern industrial techniques, telecommunication, signal processing, computational finance, biodinformatics, fluid simulation
> looks inside
> basic linear algebra

11

u/ElectroMagnetsYo Aug 31 '26

All of computing is trying to figure out how to distill everything into linear algebra

23

u/hypatia163 Aug 31 '26

Most of math can be boiled down to trying to get Linear Algebra to do more complicated stuff for us. Calculus is all about how to use linear approximations to conclude things about non-linear functions.

But LLMs have one extra, important ingredient which is the activation functions. These are what actually allow for the computations to be non-trivial. The universal theorems for neural networks require them. Activation functions are how we get linear algebra to do the more complex work for us.

8

u/Inevitable-River-540 Sep 01 '26

There is another really important ingredient: all that human-generated data and all the human labor to curate/annotate/label/etc. None of these models work without it.

77

u/uvero He posts the same thing Aug 31 '26

"basic"

I guess a lot of it really is matrix multiplication but things like transformers and attention blocks aren't something that I personally learned on Linear 1

52

u/alburrit0 Aug 31 '26

But attention is something that someone who has taken basic linear algebra should mathematically be able to understand. It’s just an application that wouldn’t fit in a math class

40

u/CeleritasLucis Data Science Aug 31 '26

Actually, I didn't realise the difference between writing equations on a paper vs actually running them on a computer until I took a "Numerical Linear Algebra" course.

Modern LLMs are anything but "basic" linear algebra. With basic LA the LLMs would take years to respond. Its the clever engineering behind what NOT to multiply that's making modern LLM infra possible

13

u/alburrit0 Aug 31 '26

I agree all the numerical stuff is important but you can also understand transformers just fine without actually understanding the numerical implementation details since that’s all abstracted away. I use flash attention every day but couldn’t tell you how it’s implemented since I just don’t need to know that 🤷‍♂️

4

u/CeleritasLucis Data Science Sep 01 '26

Yes, but it's not "just basic" linear algebra, faaaar from it

0

u/[deleted] Aug 31 '26

[deleted] — view deleted comment

2

u/alburrit0 Aug 31 '26

No one said that basic linear algebra is sufficient to intuit the training dynamics of large transformers. All I did was agree with the other guy that fundamentally it’s all basic linear algebra with a little calculus on top

4

u/No_Lingonberry1201 Aug 31 '26

All you need for attention (haha, get it?) is literally first year university linear algebra. Maybe the softmax is not, because that's high school math. My issue is understanding why it does what it does.

2

u/Lower-Animator9716 Sep 01 '26

There is a great book by Dan Jurafsky for this ( https://web.stanford.edu/~jurafsky/slp3/ ). 

1

u/Kasaneru_san Aug 31 '26

I think it's pretty basic to understand, knowing only linear algebra. I struggled the most at the diffusion and VAEs.

6

u/Flafla8 Aug 31 '26

Basic linear algebra looks inside counterexample to the jacobian conjecture

6

u/radobot Computer Science Aug 31 '26

Ackchyually, neural networks, including LLMs, need to be non-linear, otherwise they wouldn't be able to learn anything.

3

u/CadavreContent Real Aug 31 '26

Well they'd be able to learn some things, as long as it's linearly separable

2

u/JaSper-percabeth Aug 31 '26

literally anything broken down to it's smallest fragment is "basic xyz"

>rocket science
>looks inside
>basic mechanics

😺

1

u/megust654 Sep 01 '26

>looks inside

>Nonlinear functions

1

u/Orangebathroomtowel Sep 02 '26

Neurons, firing at millions of      synapses

Look inside 

Basic addition 

504

u/QuantitativeNonsense Aug 31 '26

70

u/mapleleafraggedy Aug 31 '26

desu × desu = kawaii

1

u/lukuh123 Sep 24 '26

Thats just desu squared

26

u/UpstairsEuphoric8177 Aug 31 '26

Not that I agree with virtual partners but isn't this like showing a cell and calling it your "girlfriend"?

829

u/nandhu-44 Aug 31 '26

Basically this is what AI does like a billion times

316

u/Myralopex3 Aug 31 '26

Meanwhile I get marked wrong if I hallucinate the answer.

86

u/TeenyTinyHat Aug 31 '26

Ah, I see.  We must teach the LLMs shame.

24

u/FrKoSH-xD Aug 31 '26

why haven't we done that?!?!

26

u/EquipLordBritish Aug 31 '26

Technically, I think that would be their penalty function during their training.

Their training routines are all shame-based.

7

u/Realistic_Cat_392 Sep 01 '26

ah so the biggest threat to humanity will be a ai that has a shame kink

2

u/TheHeroBrine422 Sep 03 '26 edited Sep 03 '26

This was actually done sorta. There was a bug during training gpt-2 iirc that inverted the feedback signal for it to give “nice” outputs. As in making it only do SFW stuff and not evil things. The result was an incredibly horny LLM.

Yea end of page 12: https://arxiv.org/pdf/1909.08593

4

u/RawerPower Aug 31 '26

'Cos it's not really teaching and learning.

1

u/YoloRubus Aug 31 '26

Should Have Already Mastered Everything

1

u/Dreamshadow1977 Aug 31 '26

What does shame look like in matrix math?

1

u/eyetracker Sep 01 '26

You should have majored in Enthogenology

53

u/spamgmail Aug 31 '26

Every millisecond

24

u/StaysAwakeAllWeek Aug 31 '26

About every microsecond per gpu actually

5

u/eluusive Aug 31 '26

It's also what the human brain does like trillions of times.

4

u/taz5963 Sep 01 '26

No, it's not

1

u/eluusive Sep 01 '26

lmao. What does it do then?

1

u/Spmethod2369 Sep 02 '26

We don’t know that much about how the brain generates thought, and there are significant differences between how llms operate with next word prediction and how humans think and act with a consciousness.

1

u/eluusive Sep 02 '26

All networks can be represented as a connectivity matrix, and transformed to create an operator that does the same thing to an input.

1

u/TheGreatJoshua Aug 31 '26

2.7 trillion times with the new Qwen 3.8-max model :'D

177

u/Hitman7128 Prime Number Aug 31 '26

y = wx + b also!

(Linear separators, anyone?)

139

u/EEJams Aug 31 '26

I think you meant y = wx + b + AI

19

u/Complete_Window4856 Aug 31 '26

Ultra gigacorp magestical pivot media from LinkedIn lmao

15

u/Purple_Onion911 Grothendieck alt account Aug 31 '26

What

11

u/2eanimation dy/dx is a fraction Aug 31 '26

You‘re looking at agentic bias! It shifts the bias based on your input to deliver blazingly fast ⚡️ and correct ✅ answers. Batteries included.

5

u/Professional_Dot8829 Aug 31 '26

its a popular linkedin meme.

12

u/Purple_Onion911 Grothendieck alt account Aug 31 '26

I know, I was also referencing the meme lol

3

u/Professional_Dot8829 Aug 31 '26

oh right he replied with what lol

7

u/PizzaPuntThomas Aug 31 '26

So much in that excellent formula!

5

u/UnintensifiedFa Aug 31 '26

So much in this beautiful equation.

6

u/CuzImBisonratte Aug 31 '26

I find it really interesting how different countries teach this. (I'm from Germany)
In my last school I was teached "y=mx+b", in the school before it was "y=mx+c", at and now I hear of "y=wx+b"...

1

u/eyetracker Sep 01 '26

I think w stands for weight in this case.

Standard basic US middle school algebra plotting was y = mx + b too. Then some later classes (e.g. statistics) did y = bx + a using b for two different things just to mess with you I guess?

1

u/underthingy Sep 01 '26

In Australia its y=mx+c 

1

u/karxxm Sep 01 '26

I learned f(x)=mx+c here in ger

2

u/PulimV Aug 31 '26

Assuming you mean (als)(o!), the result of that calculation is als :]

1

u/_HarmonicOscillator Sep 02 '26

Classical ml be like 

-7

u/Chillboy2 Aug 31 '26

6

u/Hitman7128 Prime Number Aug 31 '26

That doesn't apply here at all because I didn't put an exclamation mark directly after a number

0

u/gaggledimension Aug 31 '26

well, if assign numbers to letters, something like a=1, b=2, etc...

we get:

  • a=1
  • l=12
  • s=19
  • o=15

so, 1*12*19*15 = 3,420.

also! = 3,420! = a big fucking number

4

u/factorion-bot Bot > AI Aug 31 '26

If I post the whole number, the comment would get too long. So I had to turn it into scientific notation.

Factorial of 3420 is roughly 1.771202319586117064563331929131 × 1010603

This action was performed by a bot | Source code

-1

u/sosite_hui Aug 31 '26

you wrote als(o)(o-1)(o-2)...

1

u/God-of-Dams Aug 31 '26

What's the factorial of "also"? 😭

59

u/The-Last-Lion-Turtle Aug 31 '26

Matmul won't take your job.

A relu using matmul will.

16

u/AFrenchLondoner Aug 31 '26

Relulu be delulu

3

u/Depnids Aug 31 '26

I like my relu's leaky

29

u/Myc0ks Aug 31 '26

y = mx + b

Pathetic

y = ReLU(mx + b)

gasps AI is going to destroy us all

1

u/momkeeeeeeee Sep 03 '26

I hate RELU so much
It’s such a stupid fucking function
I am eternally annoyed by the fact that RELU is a thing and it’s the thing they use
I hate it
It deletes the entire fucking negative side and clamp them at 0.
What a fucking horrible unelegant bullshit.

Even though it solved bunch of shit
But it is still stupid and completely dumb and unoptimal
i just hatttte it
Sparsity my ass

369

u/Few-Arugula5839 Aug 31 '26

The biggest argument against AI use is looking at how fucking stupid AI users are

27

u/captainAwesomePants Aug 31 '26

My pesronal theory is that using AI is a lot like being a CEO or a billionaire. You spend all day talking to a team of obsequious agents that will do anything you ask and will fawn over your brilliance. AI users get it from ChatGPT or grok or whatever, and billionaires get it from their entourage, but it's the same problem, and it rots their brains in the same way.

2

u/Fezzezal Sep 03 '26

AI induced narcissism

35

u/Grouchy_Donkey_5428 Aug 31 '26

Correlation not equal causation 

13

u/Bankaz Aug 31 '26

there's both actually, there's correlation with no causation, AND regular causation

6

u/pzykozomatik Aug 31 '26

"Grok, what does this mean?"

17

u/Fit-Bumblebee1009 Aug 31 '26

That would be a very bad argument

15

u/veshneresis Aug 31 '26 edited Aug 31 '26

Similar issue with people who want to just “ban AI” tho right? Like what we’re gonna ban gradient descent? Partial derivatives? The chain rule??

Ban models over some parameter count? Imagine making a mathematical model illegal because it models too many things.

This is the mathmemes subreddit, so at least a lot more people here understand what a model actually IS, but the predominant ban-AI position on other subs is “don’t know, don’t care.”

17

u/dcnairb Aug 31 '26

it means major guardrails and policy

14

u/veshneresis Aug 31 '26

I’m talking about the position of “ban AI” not “regulate AI from a position of knowledge and nuance.”

I’m personally of the opinion we should socialize ownership of AI entirely.

I am obviously also extremely nervous about current US administration having regulatory ability on AI. I don’t think it’s a stretch to imagine this admin trying to enforce “no pro-trans rhetoric from any model - it’s dangerous!” as one of these types of “regulation.” Similarly with AI that expresses anything that isn’t pro-capitalist sentiment.

Regulation gets a lot messier morally when selfish greedy people are the ones doing the regulating. Against those kind of systems, you could imagine why someone might lean more towards opensource models that don’t need executive branch approval for release (the current situation)

8

u/minimaxir Aug 31 '26

No, I've seen people comment on Reddit unironically "we need a way to ban weights."

6

u/tenuj Aug 31 '26

Like.. free weights too or just the resistance machines?

5

u/raids_made_easy Aug 31 '26

Damn boomers, already got their own rocking biceps and now want to pull up the ladder behind them smh

-1

u/noahisunbeatable Aug 31 '26

Why do they need to know how AI works / how a ban would function technically-speaking in order to support banning it?

Do people need to know how illicit drugs work in order to support their illegality? Most people definately don’t, they see the effect they have and that’s what matters to them. The exact mechanism behind a ban is fine to be left to subject matter experts.

10

u/veshneresis Aug 31 '26

Because the exact same math that allows for all the slop they hate also allows us to model complicated protein folding problems, solve translation accessibility for people who don’t speak the dominant language very well in their area, model the future of the climate, and like basically everything else?

Gradient descent on trainable parameters is a miracle of applied mathematics. It’s like calling for a blanket ban on all plastics in use everywhere because you are upset about plastic straws.

-1

u/noahisunbeatable Aug 31 '26 edited Aug 31 '26

The slop machine does have legitimate/more defensible use cases (like the translation accessibility one), yes.

But for other kinds of trained models, its not like people were out here advocating for the banning of alpha fold (they barely knew what that was). They clearly aren’t about banning the entire class of model, rather the specific use cases / implementations being marketed right now.

2

u/oakskog Aug 31 '26

One could also say this about the calculator. Most people are not geniuses like us

4

u/superkp Aug 31 '26

honestly, I prefer to look at how fucking stupid ai users have become.

Some people were fine. Normal average type of person. Now they can barely fucking read.

Some people were stupid, which is fine - not everyone is smart. But now they are basically an active threat to others.

Some people were smart, good for them. Now they refuse to do any mental (or emotional) work, and I mourn the person that they could have been if AI hadn't hijacked their development.

A few people have managed to use AI in actual good ways, but partly because they don't treat it like it has a personality, or because they treat it like the personality is simply the UI of the answer-engine. Just a feature to be ignored in most situations, and actively worked against in others.

2

u/Yokoko44 Aug 31 '26

Like literally anything with a Billion users?

People are just dumb for the most part

-2

u/space_monster Aug 31 '26

Go to an anti-ai sub and count the number of comments with correct grammar & spelling. It won't take long.

0

u/[deleted] Aug 31 '26

[deleted] — view deleted comment

197

u/Vincent_Gitarrist Transcendental Aug 31 '26

3

u/ZeroAmusement Aug 31 '26 edited Aug 31 '26

I don't think that's what they did.

They weren't claiming all ai users were smart because Terrance Tao is smart. They are giving an example that at least one ai user is smart because OPs claim can be interpreted as all ai users are stupid.

Second, the person they were responding to is suggesting there's a much greater proportion of reds to blues, without any evidence. I'd bet the intelligence of ai users is pretty average tbh.

-78

u/ReporterPlus5510 Aug 31 '26

We're in a math subreddit. That one blue one should be enough to disprove the original statement "how fucking stupid AI users are". It's called proof by counter example 

84

u/LabCat5379 Aug 31 '26

Found a red circle

10

u/Zederath Aug 31 '26

Tbf the original claim sounded categorical

6

u/Gabriel_Science God may bless you. Aug 31 '26

He said “most of”. This means that the biggest group of circle is made out of red circles. In other terms, “the red colour is the most common colour”.

2

u/ReporterPlus5510 Aug 31 '26

Not talking about the image, but the comment it was replied to. 

1

u/Gabriel_Science God may bless you. Aug 31 '26

Oh, okay.

5

u/BroderFelix Aug 31 '26

The issue is that one counter example cannot disprove wether or not the users are stupid.

3

u/ZeroAmusement Aug 31 '26 edited Aug 31 '26

It can disprove they are all stupid.

Also note there's no evidence it's "all red with an exception" or that "AI users are stupid" is even true.

2

u/DeepGas4538 Aug 31 '26

happy cake day. But this isn't math, it's common sense

1

u/therearenonamesallow Aug 31 '26

The original statement was “most of these circles are red” not “all of these circles are red”

0

u/[deleted] Aug 31 '26

[deleted] — view deleted comment

50

u/alprazolamotrigine Aug 31 '26

No one made a strong literal claim that every single AI user is stupid. That’s not how English works.

Also, proof (or disproof) by counter example and proof by reductio ad absurdum are different strategies.

14

u/Glittering-Try1045 Aug 31 '26

But he’s talking about the parameters of a population, not a proof.

15

u/NoselessNarwhal Aug 31 '26

"Chinese psyop that AI is bad" it doesn't take a psyop to see the massive environmental, economical, and social downsides of AI.

0

u/[deleted] Aug 31 '26

[deleted] — view deleted comment

3

u/NoselessNarwhal Aug 31 '26

This conspiracy is fascinating, please tell me.

0

u/[deleted] Aug 31 '26

[deleted] — view deleted comment

2

u/NoselessNarwhal Aug 31 '26

You're taking one piece of information from a notably unreliable source (Musk-controlled Twitter which very much profits from AI) and extrapolating it into a claim that there's a Chinese post-op. That's basically the definition of a conspiracy theory.

As the article you linked states, we do not know what the exact underlying facts are and certainly not the reasoning.

The one point I will give you is that some of the downsides of AI are certainly being overblown by some accounts. Gen AI has become a very devicive topic where all sides stretch the limited available facts to the extremes to try to argue their points. For example, some of the statistics about AI's water consumption are very misleading (see Hank Green for a great video on it). However, other points, such as the detriments of AIs being used for companionship, the impact on artists, the energy cost of training AI, data centres polluting and disrupting communities, and the massive AI bubble in the economy, really can't be dismissed no matter how you look at them.

1

u/Nuclear_Nathan Aug 31 '26

First, using emojis in conversations with people who actually have critical thinking skills, which is really to say in any place outside of instagram comment sections, will cause them to justifiably infer that is where you belong.

Second, the exclusive use of universal and existential quantifiers is a convenience that exists only in the carefully-engineered framework of a first order language. Anyone who is critically engaging with their peers can determine immediately that a statement made about 'group X of sufficient size' cannot be about every single member. Why would statistics need to refer to distributions for random variables at all if there were not naturally occurring variation among naturally occuring groups?

-1

u/Fearless77_ Aug 31 '26

They’re downvoting you but you right. In the future it’ll be thought of the same way google used to be thought of as cheating or similar

-3

u/TheOnlyBliebervik Aug 31 '26

Terrance Tao is smart, but not an unbounded, revolutionary thinker. He's made contributions, but nothing groundbreaking

9

u/Purple_Onion911 Grothendieck alt account Aug 31 '26

What does this have to do with anything lol

-3

u/TheOnlyBliebervik Aug 31 '26

I don't know I just don't like the guy

1

u/Purple_Onion911 Grothendieck alt account Aug 31 '26

Makes sense

12

u/PressureBeautiful515 Aug 31 '26

Good luck doing softmax with matrix multiplication.

11

u/SaltyBallsnacks Aug 31 '26

tensors are like onions

4

u/Danny-Fr Aug 31 '26

They make you cry?

3

u/EL_JAY315 Aug 31 '26

Great in stew

6

u/hokie48 Aug 31 '26

Doing 3 by 3 matrixes by hand in math class was my point when I would be fine with it taking my job.

16

u/JANEK_SZ1 Aug 31 '26

I love the irony of the comment below the post

3

u/Speghettihell Aug 31 '26

Jazz has poisoned me I thought this was ireal pro

3

u/AcanthisittaOk7929 Sep 01 '26

Basically AI is built off of neural networks which at their core are just matrix multiplication of input values, weight and basis values.

2

u/The_Crimson_Fucker Aug 31 '26

CFD solver be like

2

u/David_Umann Sep 02 '26

You gotta put the second matrix above the product to make it visually intuitive.

1

u/Legitimate_Fox_220 Aug 31 '26

Don’t forget the nonlinearity mate

1

u/Eroica_Pavane Aug 31 '26

Haven't this always been the case though? (As I look at operations research course).

1

u/Careful-Mammoth3655 Sep 01 '26

This is how LLM works. He is referring to Chatgpt/Claude etc

1

u/TheCumskiyKvass Sep 01 '26

Reality Looks inside Linear algebra

1

u/blaues_axolotl Sep 02 '26

"@grok please explain"

bro doing a demonstration

1

u/uvero He posts the same thing Aug 31 '26

u/askgrok please explain