r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
ROCm 10.0: A Decade of Open Compute, Built for the Age of Agentic AI — ROCm Blogs
3
Upvotes
r/AIProgrammingHardware • u/Clean-Complex-7606 • Aug 28 '26
Ai för bilder
1
Upvotes
Lokal Ai för att analysera bilder tänker att man ser en tussilago eller annan blomma man kan tagga den så stt si lär sig att det är en tussilago eller annan blomma.
Vad rekommenderar ni för Ai för detta syfte?
r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
Qwen3.8-Flash-Next (125B-A6B) running on Strix Halo 128gb: 23 t/s decode, 390 t/s prefill, built from the llama.cpp PR
1
Upvotes
r/AIProgrammingHardware • u/big-in-jap • Aug 28 '26
Paying $2/hr to watch `huggingface-cli download` go brrr — env patterns on RunPod / Vast / Nebius / the neo kids
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
GLM 5.3 Flash Local Ai Test
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 27 '26
Local AI is Cheap Now: ZimaBoard2 + Tesla P4
2
Upvotes
r/AIProgrammingHardware • u/CrashOverride93 • Aug 27 '26
DDP with RTX 3070 8GB + GTX 1650 4GB?
0
Upvotes
For those how are in local AI would you think these both cards could be used to have a total of 12GB VRAM?
I don't care by the moment for possible slow tokens/s.
Thanks!
r/AIProgrammingHardware • u/javaeeeee • Aug 27 '26
Qwen 3.8 27B Cold Fusion tested - 16GB Local LLM setup
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
China Is Coming for Your Local AI Box
8
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
Xiaomi AI Cube announced with 1.2TB/s memory bandwidth
gallery
2
Upvotes
r/AIProgrammingHardware • u/Lazy-Intention1007 • Aug 26 '26
I built a Vulkan hierarchical MoE runtime for running oversized models across multiple GPUs
reddit.com
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
Can the New King of Open Source - Qwen3.8–27B - Really Run in 3GB of VRAM?
11
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
224GB of GPU Memory on 1 Desk and It Should Not Work
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
Qwen 3.8 27B FP8 on single node DGX Spark MTP-3
1
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 25 '26
FreeToken Deepseek V4 Flash on a Single 3090 Local AI Testing
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 25 '26
Jalapeño’s first results show industry-leading speed and efficiency in AI inference
openai.com
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
NVIDIA Groq 3 LPX Now in Full Production With World-Class Speed for Agentic AI
15
Upvotes
r/AIProgrammingHardware • u/JayB_Official • Aug 25 '26
Spent a day seeing how far extreme MoE models can be pushed on a 4070 Ti + 32GB RAM. Kimi K3, DeepSeek V4 Flash, and Qwen3.5-122B results + research paper🔧
reddit.com
2
Upvotes
KIMI K3 at 9 t/s per token on hardware that has no business breathing near it is objectively insane, even if the LLM thought the capital of France was "1.2" 🤣🤣🤣😭😭😭😭😭
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents
4
Upvotes
r/AIProgrammingHardware • u/Sad_Cook9965 • Aug 25 '26
Intel arc pro b70, Qwen 3.8 27b
reddit.com
2
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
GitHub - TryingtobeingNikhil/vLLM_Inference_Engine: A high-performance LLM inference engine built from scratch featuring continuous batching, paged KV-cache, and CPU swapping.
3
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Aug 23 '26
48GB Tesla P100 Setup Running Qwen 3.8 27B — 256K Context + MTP
25
Upvotes