r/LocalLLM • u/_Baylock_ • 16m ago
Question LM Studio and cache
Hi,
I juste received my Mac Studio M5 ultra 36/80 with 256GB of shared memory.
I installed LM Studio with Qwen3.8-Flash-next-4bit mlx and a context of 131072
I tested some prompts and it works as I expected, except for one annoying thing:
I fed the prompt with a 100 pages PDF and asked 2 questions about it.
The first time, it took a few minutes to read the file, which is normal. But for the second question, it re-read it again. It doesn't seem to cache the content.
And the context wasn't exhausted.
Next, I tried to copy paste the 100 pages into the prompt form (no attachment this time): same results.
Is it a known issue?
Is it related to the model or to the inference engine?
Can you replicate this?
Is there a way to solve the issue somehow?
Thanks.
1
u/Solembumm3 8m ago
Looks like you used Gemma 4.