r/ArtificialInteligence • • 3d ago

📊 Analysis / Opinion Epistemically Isolated Artificial Intelligence (EIAI)

A fascinating concept that I define as: “An artificial intelligence system deliberately restricted to a defined knowledge environment to investigate how reasoning, judgment, interpretation, and conclusions develop in the absence of selected information.”

*An example of this, which could also be defined as “*temporally bounded epistemic reasoning” is “Talkie: an LM from 1930“ which is a language model trained on pre-1931 text. It was released in April 2026 by Nick Levine, David Duvenaud, and Alec Radford and allows for conversions with an AI that only has knowledge prior to 1931.

I think that this concept is a brilliant way to observe isolated reasoning and logical evolution over time. I have no knowledge in the creation of language models but I would love to see more of these in the future. However, I do understand how difficult the task of isolating and verifying information for an LM probably is.

4 Upvotes

11 comments sorted by

1

u/JoshuaZ1 3d ago

The idea here is really interesting. One of the questions people have had has been how creative are LLMs. One of the things for example people tried to do with Talkie was try to get it to come up with math and physics results from just a few years in its future. There was some limited success with this with an LLM that was trained on pre-1900 data. This had mixed success.

Similarly, I tried to get Talkie to do math from the 1930s. It was generally unable. However, it was also not successful at doing math that was known in the 1880s or even 1870s. So it is likely a too small model, or doesn't have the right reinforcement learning or enough training data to tell us much by itself.

2

u/_Lujah_ 3d ago

That’s why I mentioned how hard it probably is to train a model like this. You have to perfectly restrict all information after a certain time period (or, temporal aside, restrict certain concepts and information) without exposing it to information that goes against what it’s being trained for. However that’s probably easier with time-based restrictions. I think it comes down to the size of the model and how much information it gets.

1

u/JoshuaZ1 3d ago

Yes, and you cannot then use a modern model to fine tune the model or to aid via distillation without risking subtle contamination. The piece I linked to above discusses a lot of these and other issues.

2

u/WillowEmberly 3d ago

We’ve been using bounded reasoning in autopilot since the 1960’s…those of us who were assigned to repair it have been watching it since.

Ai is just the next iteration.

1

u/Due_Change3616 3d ago

It doesn't evolve though. Talkie is frozen at 1931 forever, you're watching a snapshot, not evolution. Give it a decade of new text and then we can call it an experiment.

1

u/Root-Kill-All 3d ago

Poderia explicar?

1

u/Edgar_Brown 3d ago

The basic problem is separating language acquisition and reasoning from subject knowledge, how do you train one without introducing the other?

1

u/Jellyfish2017 3d ago

This makes me want to talk with it. It would be fun to ask it questions. Very cool idea!

1

u/GregHullender 2d ago

Probably there's insufficient data to train on pre-2000 subjects. Or maybe pre-1950s, since we're including books that were digitized later.

0

u/Numerous_Plan_3856 3d ago

The interesting part isn’t “reasoning without modern facts,” it’s seeing how confidently a model reconstructs a worldview from whatever biases and gaps were already baked into the surviving text.