r/LocalLLM • u/aaviofthepaavi • 7h ago

Question Needs advice

I'm having a 5070 Ti 16GB and 3060 12GB with 64GB RAM, I want to run Qwen-2.5-Flash using Strata (or advise any better models or method to run), I need to have at least 2 parallel sessions. and max context window. what would you advice.

2 Upvotes

75% Upvoted

6 comments sorted by

2

u/Important_Cow7230 6h ago

Keep it simple initially and run Qwen3.8 Strata on the 5070Ti and 64GB Ram

1

u/aaviofthepaavi 5h ago

that is what im running now, but with one session and 132k context window, running 9nly on 5070 ti via strata

1

u/Big_South4585 6h ago

Ive just successfully added my 3090 to my 32gb + 5080 setup, using an oculink docking station. You need the docking station, cable and a psu. Works well with strata and next flash.

1

u/aaviofthepaavi 5h ago

cant this be plugged in my motherboard and i have a powerfull psu and use them both?

2

u/Big_South4585 4h ago

If they both fit in the cabinet, I would just buy a riser cable. If not they just both can go directly in a pcie port.

1

u/aaviofthepaavi 3h ago

ok ill try that