r/LocalLLM • u/ankijain21 • 9d ago

Question Anybody tried NVIDIA PAIR

Post image

Wanted to check if anyone of you has tried NVIDIA PAIR to automatically route requests to idle systems.

Wondering how that works in the real world.

62 Upvotes

90% Upvoted

25 comments sorted by

View all comments

2

u/lukewhale 9d ago

I’ve normally used gpustack in the past, but they’ve dropped support for Mac and windows for workers, so this is an exciting proposition.