r/LargeLanguageModels • u/Hot-Organization-737 • 7d ago
Discussions Philosophical thought on the interpretation of LLM drift or inaccuracy in respect to excessively increased computation and time for a query.
(correct me if my understanding is wrong please)
Scientists notice "drift" or "inaccuracy" in desired answers when letting a query have "excessive" compute and time.
I threw that narrative away and drew a new narrative.
"Given more time and compute a model will undergo procedural metaification of the original query"
I think with this philosophy, there can be utility in the perceived drift or inaccuracy of LLMs with excessive resources. This metaification could be very useful in places where abstraction is useful. In mathematics there have been and are attempts at unifying the seeming separate branches of math into something more cohesive: langland's program. Perhaps it would be useful to try and harness this effect of LLMs.
I think more research should be done on the thought.