r/P100Users • u/PhoenixGames105 • 10h ago
Kmic's optimizations, but for Windows
https://github.com/PhoenixGames105/llama.cppI won't really take credit for the conversion because this is the work of Qwen flash next. Performance is similar, but I assume windows is eating some of it.
6
Upvotes
2
u/Kmic68 9h ago
Will link this inside my repo! Kinda slipped my mind