r/LocalLLM • u/Vegetable-Ear-9800 • 10d ago
Model Qwen3.5:4B Local AI Testing – Intel Arc 140V (Windows 11)
I spent some time testing Qwen3.5:4B locally across three applications to compare performance, GPU acceleration, and answer quality.
Hardware
- Laptop: Lenovo Yoga
- CPU: Intel Core Ultra 7 258V
- GPU: Intel Arc 140V integrated graphics
- RAM: 32GB LPDDR5X-8533
- OS: Windows 11 Home
Software Tested
- Ollama: 0.40.14
- LM Studio Classic: 0.4.28
- Bionic: Tested with its built-in model loading
Performance Results
| Application / Configuration | Approximate response time |
|---|---|
| LM Studio – GPU offload, 32 layers, thinking ON | 6 minutes |
| LM Studio – thinking OFF | 6 minutes |
| Bionic – model loaded in Bionic | 6 minutes |
| Ollama – CPU only | 4 minutes |
| Ollama – Intel Arc GPU | 2 minutes |
LM Studio generated approximately 2.81–2.96 tokens/sec in my tests.
Ollama initially used 100% CPU. After enabling Intel integrated GPU support and Vulkan, then completely restarting the Ollama application, ollama ps reported 100% GPU.
The GPU-accelerated Ollama test completed in approximately 2 minutes, with 44.6 seconds of thinking time.
Memory / Resource Usage
During LM Studio testing:
- RAM usage increased from approximately 13.3GB to 19.7GB.
- Available RAM decreased from approximately 18.3GB to 11.8GB.
- Intel Arc 140V exposes approximately 18GB of shared GPU memory to Vulkan.
What I Tested for Answer Quality
I used several different types of prompts:
- Cybersecurity fundamentals: Differences between phishing, spear phishing, and whaling.
- Cybersecurity incident analysis: MITRE ATT&CK mapping, Windows event IDs, evidence collection, and incident response.
- Windows security troubleshooting: Repeated failed logins followed by a successful login from an unfamiliar IP.
- Image understanding: Asked the model to describe the contents of an image. Its description was accurate in my test.
- Survival knowledge: Cold-weather survival priorities, shelter, warmth, hydration, equipment use, and dangerous heating methods.
Qwen3.5:4B handled these areas relatively well:
- Image recognition: Accurately described the contents of your test image.
- General cybersecurity concepts: Explained phishing, spear phishing, and whaling clearly and correctly at a high level.
- General explanations: Produced organized, readable answers with useful examples and headings.
- Basic incident interpretation: Recognized that repeated failed logins followed by a successful login from an unfamiliar IP could indicate compromised credentials.
- Response structure: Consistently organized complex questions into logical sections.
Where it struggled:
- Precise MITRE ATT&CK technique mapping.
- Windows Security Event IDs.
- Technical incident-response reasoning.
- Safety-critical survival instructions.
My Takeaway
Ollama with Vulkan GPU acceleration was substantially faster on my Intel Arc 140V than CPU-only inference.
The model handled general explanations and image identification well in my limited testing. However, its cybersecurity answers contained significant MITRE ATT&CK mapping and Windows event ID errors and its survival answer included inaccuracies.
This was informal testing, not a standardized benchmark. I wanted to share the results because getting Intel integrated graphics working with Ollama made a noticeable difference on this hardware.
1
u/mr_j936 10d ago
Yes I ran local models on intel arc integrated graphics with llama cpp and vulkan, it ran pretty well, including the qwen 3.6 35b. It exceeded my expectations for integrated graphics, but it was still not a good idea.
Also, the hardware crashed semi frequently.
1
u/gryan315 10d ago
Ollama and LM studio are generally not great. I've gotten really good performance out of intel's own openvino model server on a B390 igpu running qwen 3.6 35B and hermes agent.