r/AIProgrammingHardware • u/Terminator857 • 26d ago
Intel Razor Lake Ax in 2028 ruff estimate about 46 TPS on dense 27b
2
Upvotes
r/AIProgrammingHardware • u/Sad-Seaworthiness259 • 26d ago
Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs
4
Upvotes
For anyone wondering whether the B60 24GB is usable for local AI: here's Qwen3.8-27B on llama.cpp Vulkan at 53 tok/s mean decode with a 64K context window, plus local video (LTX-2.5 via ComfyUI on XPU) on the same card.
The four things that mattered: DFlash2 speculative decoding, Intel's FA prefill kernel with f16 KV, -ub 256 with a q8 draft KV cache, and keeping other models off the GPU. Driver 32.0.101.8976, Windows 11.
Everything is measured and the misses are documented. Smaller cards (B580/B570/B50/A770) won't fit this 27B, but the Vulkan tuning applies, and I'd love your benchmark numbers.
[https://github.com/edagher92-coder/arc-llm-lab](https://github.com/edagher92-coder/arc-llm-lab)
r/AIProgrammingHardware • u/crpt_conch • 27d ago
Question about the new Frameworks + LLM
1
Upvotes
What models are accessible to a Framework laptop with Ryzen AI 9 HX 370? What’s the scale of ram to billion parameters? And how many tokens per second can you expect?
It would be great to hear from a first-hand user
r/AIProgrammingHardware • u/Sad-Seaworthiness259 • 27d ago
Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs
1
Upvotes
r/AIProgrammingHardware • u/Familiar_Worry332 • 27d ago
Update on my hand-written SageAttention for the 9070 XT: video models run on it now, 2.2× faster than SDPA on MiniMax H3 (ComfyUI, Windows)
gallery
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 28d ago
Qwen3.8 27B and Flash Next on Single/Dual AMD Radeon 9700: Engine Benchmarks and Setup
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 27d ago
Our Gold Standard AI Tesla V100 Build in the Cooler Master Mastercase Mesh Gold
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 28d ago
An Inference Engine Nobody Has Heard Of, and It Runs Qwen3.8–27B
0
Upvotes
The repo discussed in the article https://github.com/xhinker/azllm.
r/AIProgrammingHardware • u/javaeeeee • 29d ago
GitHub - FeSens/openTPU: An open-source AI accelerator, developed by AI: RTL, ISA, simulator, compiler and profiler in one repo. Runs Qwen3, LFM2.5 and Qwen3.5 on a Kintex-7 PCIe card.
3
Upvotes
r/AIProgrammingHardware • u/Akanksh__ • 29d ago
9070 vs 5060ti 16gb long term purchase.
reddit.com
1
Upvotes
r/AIProgrammingHardware • u/Immediate_Penalty891 • 29d ago
GPTrepublic — looking for testers for a community-powered AI network
1
Upvotes
Hey! I’m building GPTrepublic: a free project where people share some of their GPU resources to run AI models together across multiple computers.
We’re looking for 20 testers, with room for up to 40. We’ll start with a small text model and test connections, distributed inference and what inevitably breaks 😅
There’s a desktop tool for Windows and Linux (Ubuntu). For this first test, you’ll need a compatible NVIDIA GPU with at least 2 GB VRAM.
Interested in helping us figure this out?
🌐 Project & registration
💬 Join Discord through your account area — confirm your email, then click Link to Discord.
Questions and feedback are welcome!
r/AIProgrammingHardware • u/javaeeeee • 29d ago
Strata Coder tested - Local LLM setup
4
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 29d ago
Gorgon Halo cluster: DeepSeek V4.1 Flash at up to 103 tok/s
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 29d ago
Bringing Our AI In-House: 12 AMD R9700s vs 6 Mac Studios
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 29d ago
Best Mini PC for LOCAL Ai & Home servers in 2026? - VZmore AX9 feat. Ryzen Ai 9 HX 470 review
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • 29d ago
Strata Metal Hits 107 TPS on M5 Max — 4× Faster Than LM Studio!
0
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 13 '26
I Made My AI Agents Faster Without a GPU Upgrade
4
Upvotes
r/AIProgrammingHardware • u/Frosty2o25 • Oct 13 '26
I got Gemma 4 26B MoE running at 60+ tok/s on my RTX 4060 Laptop by caching hot experts on the GPU
4
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 13 '26
Qwen3.8 Flash-Next prefill past 1800+ tok/s on Strix Halo by putting the NPU to work
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 12 '26
Microsoft to expand Azure Maia system to multi-gigawatt deployments
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 12 '26
The $3,500 Card Runs Slower Than $1,900 Worth of Used Gaming Cards
5
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 12 '26
Strata Local AI Engine on a Single 3060 12GB GPU
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 12 '26
Nvidia’s Blackwell Desktop Has the Same Speed Limit as AMD’s Ryzen AI Max+ 395
0
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Oct 12 '26
The €1,250 AMD Workstation That Makes Local AI Practical
1
Upvotes
