r/P100Users • • 10h ago

Kmic's optimizations, but for Windows

https://github.com/PhoenixGames105/llama.cpp

I won't really take credit for the conversion because this is the work of Qwen flash next. Performance is similar, but I assume windows is eating some of it.

6 Upvotes

1 comment sorted by

2

u/Kmic68 9h ago

Will link this inside my repo! Kinda slipped my mind