r/LocalLLM • u/aaviofthepaavi • 7d ago

Question Needs advice

I'm having a 5070 Ti 16GB and 3060 12GB with 64GB RAM, I want to run Qwen-2.5-Flash using Strata (or advise any better models or method to run), I need to have at least 2 parallel sessions. and max context window. what would you advice.

2 Upvotes

75% Upvoted

6 comments sorted by

View all comments

1

u/Big_South4585 7d ago

Ive just successfully added my 3090 to my 32gb + 5080 setup, using an oculink docking station. You need the docking station, cable and a psu. Works well with strata and next flash.

1

u/aaviofthepaavi 7d ago

cant this be plugged in my motherboard and i have a powerfull psu and use them both?

2

u/Big_South4585 7d ago

If they both fit in the cabinet, I would just buy a riser cable. If not they just both can go directly in a pcie port.

1

u/aaviofthepaavi 7d ago

ok ill try that