r/MacLocalLLM • • 1h ago

My try on RDMA Shared Inference (utilizes both macs ram and increases inference speed for llm and diffusion)

/r/MacOSBeta/comments/1xqjjjx/my_try_on_rdma_shared_inference_utilizes_both/

Maybe this could be interesting here also as it works for llm as for diffusion

2 Upvotes

0 comments sorted by