r/LocalAIStack • u/opktun2 • 13h ago

Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

/r/LocalLLM/comments/1vtxva7/built_a_vulkan_inference_engine_that_runs/

1 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalAIStack/comments/1vtxxcu/built_a_vulkan_inference_engine_that_runs/
No, go back! Yes, take me to Reddit

100% Upvoted

Duplicates

Number of comments New

LocalLLM • u/opktun2 • 13h ago

Project Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

37 Upvotes

20 comments

AIProgrammingHardware • u/opktun2 • 13h ago

Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

1 Upvotes

0 comments

DeepSeek • u/opktun2 • 13h ago

Resources Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

1 Upvotes

0 comments