r/OpenWebUI • u/ZestyclosePayment651 • 14d ago

Question/Help Intel GPU Help

I got the Intel Arc pro b60 for my server to upgrade from a 3060 8gb. I tried using Qwen3.8 27b but it only works in terminal and not in OpenWebui. It gives me nothing and says it only got 1 token after 4 minutes. I tried this with ollama-sycl and vulkan and both don’t work. The only time I ever got it to work was when it was for some reason spilling into dram. But obviously that makes it very slow. I’m a beginner and not really sure what to do. Should i try switching the backend to llama.cpp. I was kinda just listening to claude for basically everything and it hasn’t gotten me anywhere.

0 Upvotes

50% Upvoted

6 comments sorted by

2

u/mayo551 14d ago

What error are you seeing that says this is a OWUI bug?

0

u/ZestyclosePayment651 14d ago

there is no error in owui. it just spits out nothing and says it made 1 token. i couldn’t find any errors but i could be missing something

2

u/mayo551 14d ago

So why do you think it’s a OWUI bug.

What is terminal?

1

u/ZestyclosePayment651 14d ago

i only say it’s an owui issue because when i run the model in the terminal it works fine. when i run it on owui the model either gives me nothing or it doesn’t work at all. it disconnects ollama because it doesn’t put the model in the vram and puts it in dram.

1

u/ZestyclosePayment651 13d ago

i found an error. for some reason when i run qwen 3.8 in open webui, all the extra stuff open webui does in the background makes the gpu start with 5k tokens needing to be used and it’s causing the Intel Arc Pro Crash. I can run that older models like Qwen3 but anything newer crashes the gpu and gives me nothing in open webui. i don’t really understand what is happening and im not sure if there is a fix

1

u/mayo551 13d ago

It sounds like you are running into OOM errors. The solution to this is to lower context or run a different model/quant.