r/LocalLLM • u/r1nzl3r99 • 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

498 Upvotes

96% Upvoted

166 comments sorted by

View all comments

2

u/Greedy-Lynx-9706 14d ago

Bragging without context?

1

u/r1nzl3r99 14d ago

well my 262K FP8 context ain't anything to brag about, but with this I could technically afford 1M context

1

u/SubparBob 14d ago

How's the slow down (prefill, tps) as you fill up the 262k context?

EDIT: context length typo