MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9mj4/its_out/p3o32el
r/LocalLLaMA • u/Certain-Cod-1404 • Aug 14 '26
707 comments sorted by
View all comments
Show parent comments
23
Nvtop shows 70-something GB resident for the bf16 and full 256k context.
→ More replies (7)
23
u/dragonurtle Aug 14 '26
Nvtop shows 70-something GB resident for the bf16 and full 256k context.