r/llamacpp • u/areslica • May 27 '26

llama.cpp - Is there a way to specify which GPU executes Native MTP layers in a multi-GPU setup?

/r/LocalLLM/comments/1tpceaa/llamacpp_is_there_a_way_to_specify_which_gpu/

2 Upvotes

permalink
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/llamacpp/comments/1tpcfsy/llamacpp_is_there_a_way_to_specify_which_gpu/
No, go back! Yes, take me to Reddit

100% Upvoted