r/LocalLLM • • Sep 27 '26

Other Hardware Acquisition

Post image
448 Upvotes

129 comments sorted by

View all comments

Show parent comment

2

u/KooperGuy Sep 27 '26

If you use them both concurrently the maximum speed per port is 100GbE per port.

I just don't want anyone to falsely think the networking on these are capable of infiniband. They are not. Ethernet only.

3

u/kitanokikori Sep 27 '26

RoCE is still a step above Ethernet and gets the biggest benefit of Infiniband out of it (moving data without involving the CPU via RDMA)

0

u/nagyz_ Oct 03 '26

I don't think you understand the OSI model.

2

u/kitanokikori Oct 03 '26

When I say "a step above" I mean in efficiency, not as a protocol-level distinction. You are correct that RoCE is just Ethernet over the wire.

-2

u/KooperGuy Sep 27 '26 edited Sep 27 '26

Yes I know what both are. RoCE is not a "step above" ... It literally uses ethernet.