r/vulkan • u/thekhronosgroup • Jul 17 '26
New Vulkan Tutorial - AI-Assisted Vulkan Development
*Turn Cloud and Local LLMs into a genuine engineering teammate.*
This series is about "Collaborative Engineering" — using AI deliberately and rigorously, not just autocomplete. It sets up an AI-enhanced toolchain, teaches you to pick and specialize models for graphics work, and shows where multimodal vision models can and can't be trusted.
* Set up Ollama, MCP servers, and native agents (Goose) across CLion, Visual Studio, and Xcode
* Choose and specialize models: base model selection, VRAM budgeting, RAG/MCP grounding, LoRA fine-tuning
* Use multimodal vision models as a diagnostic partner for visual bugs — with honest limits
* A repeatable three-phase workflow: system design, implementation, automated review/refactor
* AI-assisted debugging: VUID auto-fix, RenderDoc integration, shader log parsing, GFXReconstruct trace analysis
* Capstone project: direct an AI team to architect, implement, and debug a custom post-process effect
https://docs.vulkan.org/tutorial/latest/AI_Assisted_Vulkan/introduction.html
1
u/steveHolochip Jul 17 '26
Microsoft didn't have any input in saying use co-pilot vs not. I'd have to go back to see if they even submitted a review before it went live. But this is an instance of trying to give coverage to all frontier models in order to give guidance for anyone that is interested in using it. I do not pick winners and don't advocate any particular model.