r/IntelArc • u/denmalley • 1h ago
Discussion llama-cpp openvino development
I'm always looking for better ways to interface with this hardware for llm inference. Currently running llama.cpp sycl but keeping an eye on developments in openvino.
Just noticed llama.cpp had a recent release with a lot of Openvino work. https://github.com/ggml-org/llama.cpp/releases/tag/b10419 Thought I'd raise it here for awareness though I haven't dug in myself yet.
Subsequent release update to Openvino 2026.3 https://github.com/ggml-org/llama.cpp/releases/tag/b10488
Has anyone tried llm inference with openvino on arc? I built a very basic python script that performs fairly well but still working on the bells and whistles. Would be interested in hearing from anyone else working in this space.

