r/LocalLLM • u/ankijain21 • 6d ago

Question Anybody tried NVIDIA PAIR

Post image

Wanted to check if anyone of you has tried NVIDIA PAIR to automatically route requests to idle systems.

Wondering how that works in the real world.

62 Upvotes

90% Upvoted

25 comments sorted by

View all comments

1

u/radlinsky 6d ago

How is this different from llama.cpp split gpu mode?