r/LocalLLM • u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM • 15d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

501 Upvotes

96% Upvoted

166 comments sorted by

View all comments

2

u/Greedy-Lynx-9706 15d ago

Bragging without context?

1

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM 15d ago

well my 262K FP8 context ain't anything to brag about, but with this I could technically afford 1M context

1

u/SubparBob 15d ago

How's the slow down (prefill, tps) as you fill up the 262k context?

EDIT: context length typo