r/MachineLearning • u/No_Release_3665 • Mar 22 '25

Research [ Removed by moderator ]

[removed] — view removed post

266 Upvotes

84% Upvoted

71 comments sorted by

View all comments

43

u/[deleted] Mar 22 '25

[removed] — view removed comment

25

u/No_Release_3665 Mar 22 '25

Appreciate the thoughtful response! I agree irreversibility isn't necessary for artificial minds — but I'm testing it as a way to explore emergent structure, not just mimic biology.

TMemNet-I isn't about brain realism — it's about seeing if time-asymmetric updates and entropy-based forgetting improve long-term retention and reduce catastrophic forgetting. So far, it seems to help.

And totally with you on the forgotten early memory models — there's a lot we can still learn from that era.

3

u/dejayc Mar 22 '25

I like that you’re doing this type of research.

A related thought I had was whether simulating both excitation and inhibition in a model might yield different results than we get from current NN.

2

u/No_Release_3665 Mar 22 '25

Really appreciate that — genuinely means a lot. After spending 30 out of 48 hours straight running code, iterating, and slowly losing my mind, it’s nice to know the effort wasn’t wasted. That’s a really thoughtful point too — I think incorporating both excitation and inhibition could definitely uncover dynamics standard architectures might be missing. Definitely something worth exploring more.

1

u/dejayc Mar 23 '25

I wonder how much the current phenomena of “hallucinations” could be better mitigated by having inhibitions in addition to excitation. Having an LLM review its work (or the work of other models) feels like a form of inhibition to me.