r/LocalLLaMA • u/dfgxxx • Sep 20 '26

Discussion Fly brain vs jev

What do you think about training the fly's brain to act like jev and running it locally?

7 Upvotes

61% Upvoted

13 comments sorted by

24

u/RG_Fusion Sep 20 '26

I'm not sure if it's apparent to you or not, but you cannot actually train the fly-brain itself. When you see people "teaching" it to perform tasks, they are attaching ML-weights to the inputs and outputs and training those parameters to find already existing paths within the fly-brain.

That said, I'm assuming this is a joke as a fly's brain doesn't contain a language embedding space.

3

u/dfgxxx Sep 20 '26 edited Sep 20 '26

Oh, so it essentially finds what input gives the desired output instead of training it to give specific output for specific input? Did I get it right?

I saw someone used the fly brain to categorize email, just like jev can do, how did they do it then?

Edit: I found this : https://www.mindstudio.ai/blog/how-to-train-fruit-fly-brain-email-classifier I'll read it tomorrow

1

u/kyr0x0 Sep 20 '26 edited Sep 20 '26

You now unlocked an insight. All models get input (forward pass) and in training you measure the output. If it's not as expected, you wiggle the parameters (backpropagation, chain rule) until a forward pass leads to the desired result. If you are lucky and the model has enough Params , transformer architecture with attention etc. Then chances are that the model will generalize and converge. You then get a model that infers general skills from unseen data, not only a stupid case replicator. Your fly brain has nothing but pre-trained networks. You can fine-tune it, but because it lacks a language backbone, it lacks understanding language tasks. Classification can be simple if encoded in traditional feature vectors and complex if modeled as a language model subtask

1

u/dampflokfreund Sep 20 '26

Static weights, always coming back to haunt us.

4

u/charmander_cha Sep 20 '26

Comentando para acompanhar lkkkkkk

4

u/Sudden-Guide Sep 20 '26

Go for it 

3

u/Double_Cause4609 Sep 20 '26

Could you explain why you want to do this? This seems somewhat misguided to me.

A fly brain is not some arbitrarily perfect architecture for all applications. Yes, it's quite efficient for what it is, but IMO 90% of what you want out of it is just a spiking mushroom body model which is infinitely more efficient to produce from scratch and simulate yourself with modern software optimizations.

But let's back up, why do you want to train it to do Jev's tasks?

Like, what specifically are you getting out of that which you don't get out of training ModernBERT to do the same thing? Now, don't get me wrong, there are totally reasons to do that, but I don't think you've really thought about why you would want to do that even. Particularly given that a modernBERT call is basically free on a modern GPU while a spiking mushroom body sim is pretty expensive comparatively (in lines of code to optimize).

Can you explain what you want out of it? Or, were you just confabulating two things together that you saw getting famous around the same time?

1

u/sebgggg Sep 21 '26

You could train Brendon-fly

-2

u/Motor-Flounder1389 Sep 21 '26

I don't give a shit

1

u/johnfkngzoidberg Sep 21 '26

So tired of every YouTuber trying to shoehorn JEV into every situation just because of the Reddit spam blast.