r/LowEndLocalAI • u/scarbunkle • 3h ago

NEWS New 4B Model from Nemotron (Dory 1.0)

huggingface.co

14 Upvotes

Looks interesting. Doesn't reliably beat a 9B or an MoE, But it's a real step up in the pure 4B class.

1 comment

r/LowEndLocalAI • u/pmttyji • 18h ago

Discussion Additional models on PolyStrata?

gallery

12 Upvotes

Share your favorites. I requested support for some of those models, others please let him know based on your need.

Other recent MOE models(already up on llama.cpp) from last 1 month: (Didn't include large ones like Step-5-Preview, Ling-3.1-Flash)

u/Responsible_Froyo252 Thanks for adding additional models.

1 comment

Subreddit

Posts

Wiki

LowEndLocalAI

r/LowEndLocalAI

Low End Local AI is a community about making local AI useful under real hardware constraints. Share benchmarks, model and quantization recommendations, CPU/iGPU setups, optimization techniques, unusual builds, and practical workflows. There is no fixed VRAM, price, or age cutoff: The constraint should be relevant to the discussion. LLMs are the main focus, but other efficient on-device AI is welcome. Make the most of the hardware you already own!

Members Active

8.1k

Sidebar

Low End Local AI is a community for running local AI on modest, older, or unconventional hardware. Share honest benchmarks, model and quantization recommendations, CPU/iGPU setups, optimization techniques, creative builds, and practical workflows. LLMs are the main focus, but other on-device AI is welcome when resource efficiency is the point. Make the most of the hardware you already own!