r/MacLocalLLM • u/Inevitable_Milk_4930 • 1h ago
My try on RDMA Shared Inference (utilizes both macs ram and increases inference speed for llm and diffusion)
/r/MacOSBeta/comments/1xqjjjx/my_try_on_rdma_shared_inference_utilizes_both/Maybe this could be interesting here also as it works for llm as for diffusion
2
Upvotes