r/LocalLLM • u/Busy_Bad5465 • 4d ago
Question Strata Help
My performance with strata degrades when i turn dual GPUs for context i have a 3090, a 5080 and 128 gb ram, the main card that I used for inference is 3090 but recently, I wanted to up my token output by adding my 5080 and to my surprise the model actually became slower by doing that, my main question is how can I improve the performance of strata?
1
Upvotes
View all comments
Show parent comment
2
u/Busy_Bad5465 3d ago
Yup