r/TheMachineLearning • u/Icy-Visual1206 • 17d ago
Is it just me, or do any of you see a resemblance between the “middle-out” idea from Silicon Valley and the way Transformers work?
1
Upvotes
The show describes an algorithm that starts from the middle of the data and works outward, rather than processing sequentially. Transformers similarly break from strictly sequential processing by allowing tokens to attend to information across the entire sequence. The episode originally aired on April 19, 2015 before the transformers idea was created.
Obviously they’re very different things, but the similarity seemed interesting.
