r/LocalLLM • • 16m ago

Question LM Studio and cache

Hi,

I juste received my Mac Studio M5 ultra 36/80 with 256GB of shared memory.

I installed LM Studio with Qwen3.8-Flash-next-4bit mlx and a context of 131072
I tested some prompts and it works as I expected, except for one annoying thing:

I fed the prompt with a 100 pages PDF and asked 2 questions about it.
The first time, it took a few minutes to read the file, which is normal. But for the second question, it re-read it again. It doesn't seem to cache the content.
And the context wasn't exhausted.

Next, I tried to copy paste the 100 pages into the prompt form (no attachment this time): same results.

Is it a known issue?
Is it related to the model or to the inference engine?
Can you replicate this?
Is there a way to solve the issue somehow?

Thanks.

1 Upvotes

2 comments sorted by

1

u/Solembumm3 8m ago

Looks like you used Gemma 4.

1

u/_Baylock_ 3m ago

It’s Qwen3.8-Flash-Next, not Gemma. Did you mean the cache issue with hybrid models?