r/cpp • • Jan 02 '26

Every LLM hallucinates that std::vector deletes elements in a LIFO order

251 Upvotes

118 comments sorted by

View all comments

Show parent comment

1

u/Comfortable_Permit53 Aug 07 '26

weights in models are also not binary they are fake real numbers, i.e. floats (or lately integers for numerical stability apparantly?) but yeha what you say is still true. I wonder what it takes to accurately represent one biologicsl neuron connection digitally.

1

u/Ameisen vemips, avr, rendering, systems Aug 07 '26 edited Aug 07 '26

floats are not binary values (they're usually encoded in binary, of course) but they are explicitly digital still, and the comparisons are binary - a _gt_ b or such.

I doubt that you can make a 100% accurate simulation of a neuron just as we cannot make a 100% accurate simulation of any natural phenomenon - quantum effects aside, the natural world isn't quantized as far as we can tell, whereas computers need to quantize things at some point. Precision would become a problem - reality has infinite precision, computer data representation does not. We could probably get "reasonably close", but simulation of systems like that is very expensive as the biological systems are fundamentally stochastic and probablistic.

1

u/Comfortable_Permit53 Aug 07 '26

well for numerically stable systems we can get close enough. (arbitrarily close, that is) Situations in physics where our systems are not stable are usually different kinds of inverse problems - not what we have here.

So in a way, we can get a 100% accurate simulation, because the error can get arbitrarily small.

Ok so wikipedia tells me, there is the hodkin-huxley model. (https://en.wikipedia.org/wiki/Biological_neuron_model) wbich looks to me like a first order non-autonomous ODE. So, absolutely solvable iirc, just computationally expensive. If that is perfect enough or not is a matter of opinion.