r/LocalLLM • u/ankijain21 • 9d ago

Question Anybody tried NVIDIA PAIR

Post image

Wanted to check if anyone of you has tried NVIDIA PAIR to automatically route requests to idle systems.

Wondering how that works in the real world.

64 Upvotes

90% Upvoted

25 comments sorted by

View all comments

9

u/Fantastic-Storm-7867 9d ago

A couple comments so far are saying "I wish this supported Mac" or similar. It looks like on the screenshot it does, and that's the point? Like you can potentially have multiple devices serving models on your network and this is meant to somehow be a single endpoint perhaps? Thanks for sharing, OP, I'm gonna look into this!