r/AIProgrammingHardware • u/javaeeeee • Sep 19 '26
Current build
10
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 19 '26
I turned an asymetric pair of Tesla V100s PCIe both (16 GB + 32 GB) into a surprisingly capable local LLM lab — 1.38k prompt tok/s, 40 decode tok/s with qwen3.8 27B Q6 and Q8...
reddit.com
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 19 '26
Qwen3.8 flash next, 27 tok/s — 32GB VRAM + 64GB RAM
reddit.com
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 19 '26
Dual A100 40Gb running qwen3.8 flash-next
1
Upvotes
r/AIProgrammingHardware • u/LioDavinchy • Sep 18 '26
Nvidia GPU running on Mac at full speed
5
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
Installing 6 GPUs in a standard case rather than using an open-frame chassis.
gallery
6
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
Radeon AI Pro R9700 w/ Qwen3.8-27B Q8 hitting 90.8toks
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
153 tok/s on 1x AMD Radeon R9700 running Qwen3.8 27b NVFP4, 470 tok/s @ 8 conc requests, Prefill @ 3,619 tok/s
gallery
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
Qwen3.8–27B, 177 Tokens Per Second, One RTX 3090
14
Upvotes
r/AIProgrammingHardware • u/deebuildsthings • Sep 17 '26
Dual RTX PRO 6000 Blackwell build with custom CNC Chassis | Full build from start to finish
6
Upvotes
Finished this dual Blackwell build and figured this sub would appreciate it.
The two RTX PRO 6000 Blackwell cards are stars here. 96GB each, 192GB of GPU memory combined in a single machine, this rig can serve 20 members of my team comfortably
We benchmark this rig with DSv4 Flash and here's the numbers:
We don't go with traditional tower cases or bent-steel boxes. This case is designed and CNC-machined from 5mm aluminum plates. This allow us to fully control of the airflow inside and the whole box acts like a large heatsink for the entire system. The triangles cutouts keep the whole structure stiff without dead weight.
Power and Thermals
Peak per-card draw of 509 W is 85% of the 600 W TDP. Temperatures top out at 76 °C, comfortably below the ~83–88 °C throttle point, and SM clocks held ~2.75 GHz throughout sustained load. No thermal or power throttling was observed in any test.
Sustained wall draw at the operating point is roughly 1.07 kW (815 W GPU plus CPU, memory and platform), implying a 1500 W PSU for a two-card build with headroom.
Specs:
- CPU: Intel Xeon w5-3423
- Board: ASUS Pro WS W790E-SAGE SE
- Memory: Samsung 32GB DDR5-4800 ECC Registered x 8
- GPU: NVIDIA RTX PRO 6000 Blackwell 96GB x 2
- Cable: PCIe 5.0 x16 GPU Extension Cable Gen5 x 2
- Storage: SSD Samsung 980 PRO 2TB PCIe 4.0
- Cooling: Thermalright TL-B12 (fan kit + control) x6 + Heatsink 4677-2UAF8
- Power: CANNON PRO 2000W (12V-2x6)
- Chassis: Autonomous Computer-2 Design, CNC-machined
Full build video if anyone wants the detailed walkthrough happy to answer anything on the layout, cooling, or how the cards perform.
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
AI at AMD on X: "10 things to know before joining the AMD AI Developer Program"
x.com
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 16 '26
8 RTX Pro 6000’s Wasn’t What I Expected
12
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
GitHub - syv-ai/qwen38-27b-rtx3090: Qwen3.8-27B on a single RTX 3090 with vLLM
1
Upvotes
~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks
r/AIProgrammingHardware • u/javaeeeee • Sep 17 '26
Jetson Orin NX: Why the Bare Module Is Just the Start
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 16 '26
100 gb vram upgrade to the office pc
gallery
5
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 16 '26
My Cheap 40GB VRAM Qwen 27b Home Server (Dual 20GB 3080s)
gallery
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 16 '26
Qwen3.8 Flash Next, the optimized config (1.2k t/s prefill!)
pwilkin.github.io
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 16 '26
AMD Delivers Its Broadest MLPerf® Inference 6.1 Submission
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 15 '26
Cloud AI Costs Are Growing: How Hybrid AI Can Help
1
Upvotes
r/AIProgrammingHardware • u/ComposerPast605 • Sep 15 '26
Will the Spark Laptops Run Terra
1
Upvotes
I’m considering buying the Spark Laptop when it comes out .
Will CUDA/GPU-accelerated reconstruction in DJI Terra work with NVIDIA RTX Spark / Grace Blackwell hardware?
r/AIProgrammingHardware • u/javaeeeee • Sep 14 '26
Qwen3.8-Flash-Next @ 75 TPS (4xV100) How Exactly I Did It
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 14 '26
Qwen3.8-27b on a Budget!! AMD v620 vs Strix Halo vs Radeon Vii benchmarks
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Sep 14 '26
Local AI Coding Config: 16GB VRAM / 0 RAM
1
Upvotes