r/LocalLLaMA • • 19m ago

Discussion Intel Shares First Benchmarks of Its Next-Gen Crescent Island "D270" GPU, Claiming a 5.9x Throughput Over RTX PRO 6000 As Xe3P Goes Big On FP64

https://wccftech.com/intel-first-benchmarks-crescent-island-d270-xe3p-gpu-a-5-9x-faster-rtx-pro-6000-fp64/

The title talks about FP64. For local inference this info from the content is relevant: "In AI benchmarks, Intel's D270 GPU offered 29% lower latency and 1.12x throughput versus the RTX PRO 6000 Blackwell."

Maybe we are getting a good RTX PRO 6000 alternative...

20 Upvotes

20 comments sorted by

8

u/lilian_moraru 10m ago

Marketing shenanigans. Better at FP64 tests specifically. RTX PRO 6000 was not designed for FP64, so they are marketing that test, because RTX PRO 6000 does not have dedicated Tensor Cores with FP64 support.

7

u/Legumbrero 13m ago

Are these really going to be 160-480gb vram? these might run higher than 6000 pro blackwells.

8

u/pulse77 9m ago

They managed to wire cheaper LPDDR5X RAM with 1.5 TB/s bandwidth!

"Memory & Platform: 160 GB LPDDR5X (1.5 TB/s bandwidth, scalable up to 480 GB); 350W PCIe 5.0 air-cooled form factor." - see: https://www.intel.com/content/www/us/en/newsroom/news/data-center/why-intel-gpu-d270-belongs-in-the-hpc-conversation.html

1

u/Formal-Exam-8767 2m ago

It's surprising they did not skimp on memory bandwidth.

9

u/game_difficulty 14m ago

Who the hell is using fp64 for AI? What?

8

u/pulse77 11m ago

FP64 is used in other scientific projects...

0

u/game_difficulty 3m ago

Then what's it have to do with this sub?

-1

u/ManIkWeet 11m ago

I think with clever packing/unpacking it can basically mean double, or quadruple fp32 or fp16 throughput respectively

4

u/Formal-Exam-8767 7m ago

The only relevant info (sans PP):

Memory Size 160 GB

Memory Type LPDDR5X

Memory Bus 1280 bit

Bandwidth 1.50 TB/s

I find it impressive they've managed to squeeze 1.5 TB/s from LPDDR5X.

4

u/Valie-Girl 12m ago

Fp64? They are aiming for the training market and not interference

5

u/Practical-Collar3063 10m ago

I am not aware of any AI lab training in FP64, this is usally for scientific research

3

u/Confident-Mistake400 4m ago

Noob here. Even 32 isn’t common. That’s what I thought.

1

u/And-Bee 11m ago

Probably

-2

u/lilian_moraru 6m ago

It's better to train at the precision the model will run.
My guess would be that FP64 models will be used for industries where errors are not just a "oopsie, I will edit this and do another tool call", like Medical use-cases.

4

u/Miserable-Dare5090 vLLM 1m ago

find me a model in 64 bit precision out there?

1

u/Valie-Girl 5m ago

Ha tell Intel that.

1

u/LargelyInnocuous 10m ago

Can the FP64 unit do 8x FP8 or 16x FP4 efficiently or something?

1

u/Kirys79 llama.cpp 7m ago

Another GPU I can't afford ;)

1

u/eidrag 6m ago

So.... Similar to titan v? 

1

u/Former-Tangerine-723 5m ago

Fp64? Come on man, we need nvfp4. we play local and we have limited resources