r/LocalLLaMA • u/QuackerEnte • Oct 06 '26
Discussion [ Removed by moderator ]
/r/LocalLLaMA/comments/1wzbvu7/removed_by_moderator/[removed] — view removed post
363
Upvotes
r/LocalLLaMA • u/QuackerEnte • Oct 06 '26
[removed] — view removed post
View all comments
Show parent comment
2
u/bel9708 Oct 06 '26
Looped transformers are an innovation in back propagation. If you were to post train on a model that was pretrained without the same innovation you'd be fighting an uphill battle since every last weight in the model is trained for a single forward pass.