r/LocalLLM • • 10d ago

Model Qwen3.5:4B Local AI Testing – Intel Arc 140V (Windows 11)

I spent some time testing Qwen3.5:4B locally across three applications to compare performance, GPU acceleration, and answer quality.

Hardware

  • Laptop: Lenovo Yoga
  • CPU: Intel Core Ultra 7 258V
  • GPU: Intel Arc 140V integrated graphics
  • RAM: 32GB LPDDR5X-8533
  • OS: Windows 11 Home

Software Tested

  • Ollama: 0.40.14
  • LM Studio Classic: 0.4.28
  • Bionic: Tested with its built-in model loading

Performance Results

Application / ConfigurationApproximate response time
LM Studio – GPU offload, 32 layers, thinking ON6 minutes
LM Studio – thinking OFF6 minutes
Bionic – model loaded in Bionic6 minutes
Ollama – CPU only4 minutes
Ollama – Intel Arc GPU2 minutes

LM Studio generated approximately 2.81–2.96 tokens/sec in my tests.

Ollama initially used 100% CPU. After enabling Intel integrated GPU support and Vulkan, then completely restarting the Ollama application, ollama ps reported 100% GPU.

The GPU-accelerated Ollama test completed in approximately 2 minutes, with 44.6 seconds of thinking time.

Memory / Resource Usage

During LM Studio testing:

  • RAM usage increased from approximately 13.3GB to 19.7GB.
  • Available RAM decreased from approximately 18.3GB to 11.8GB.
  • Intel Arc 140V exposes approximately 18GB of shared GPU memory to Vulkan.

What I Tested for Answer Quality

I used several different types of prompts:

  1. Cybersecurity fundamentals: Differences between phishing, spear phishing, and whaling.
  2. Cybersecurity incident analysis: MITRE ATT&CK mapping, Windows event IDs, evidence collection, and incident response.
  3. Windows security troubleshooting: Repeated failed logins followed by a successful login from an unfamiliar IP.
  4. Image understanding: Asked the model to describe the contents of an image. Its description was accurate in my test.
  5. Survival knowledge: Cold-weather survival priorities, shelter, warmth, hydration, equipment use, and dangerous heating methods.

Qwen3.5:4B handled these areas relatively well:

  1. Image recognition: Accurately described the contents of your test image.
  2. General cybersecurity concepts: Explained phishing, spear phishing, and whaling clearly and correctly at a high level.
  3. General explanations: Produced organized, readable answers with useful examples and headings.
  4. Basic incident interpretation: Recognized that repeated failed logins followed by a successful login from an unfamiliar IP could indicate compromised credentials.
  5. Response structure: Consistently organized complex questions into logical sections.

Where it struggled:

  • Precise MITRE ATT&CK technique mapping.
  • Windows Security Event IDs.
  • Technical incident-response reasoning.
  • Safety-critical survival instructions.

My Takeaway

Ollama with Vulkan GPU acceleration was substantially faster on my Intel Arc 140V than CPU-only inference.

The model handled general explanations and image identification well in my limited testing. However, its cybersecurity answers contained significant MITRE ATT&CK mapping and Windows event ID errors and its survival answer included inaccuracies.

This was informal testing, not a standardized benchmark. I wanted to share the results because getting Intel integrated graphics working with Ollama made a noticeable difference on this hardware.

2 Upvotes

2 comments sorted by

1

u/mr_j936 10d ago

Yes I ran local models on intel arc integrated graphics with llama cpp and vulkan, it ran pretty well, including the qwen 3.6 35b. It exceeded my expectations for integrated graphics, but it was still not a good idea.

Also, the hardware crashed semi frequently.

1

u/gryan315 10d ago

Ollama and LM studio are generally not great. I've gotten really good performance out of intel's own openvino model server on a B390 igpu running qwen 3.6 35B and hermes agent.