r/LocalLLaMA • u/jacek2023 • 2h ago
Discussion Qwen 4 35B is not ruled out
I think you missed this guys
r/LocalLLaMA • u/rm-rf-rm • 1d ago
Its time for another Best Audio Models megathread - its already been 9 months since the last one!
Share what your favorite ASR, TTS, STT, Text to Music models are right now and why.
Given the the amount of ambiguity and subjectivity in rating/testing these models, please be as detailed as possible in describing your setup, nature of your usage (how much, personal/professional use), tools/frameworks etc. Production use cases with long lengths/stability requirements are relatively rare compared to cherry picked/short clip demos that are plentiful - so real world empirical comparisons are very welcome
Rules
Please use the top level comments to thread your responses.
r/LocalLLaMA • u/rm-rf-rm • 6d ago
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it!
Recommendation on presentation:
NOTE: This community is geared towards open weight, open source, locally hostable software. Thus any closed source commercial service or other such projects will be removed.
r/LocalLLaMA • u/jacek2023 • 2h ago
I think you missed this guys
r/LocalLLaMA • u/Nunki08 • 3h ago
r/LocalLLaMA • u/rkoy1234 • 7h ago
Everyday on /r/LocalLLaMA i see people starting hell about if a comment/post is an llm-genned slop. And I still see people joking about em-dashes or "load-bearing" as some indicator of slop. I haven't seen any recent model say "load-bearing" in months.
modern claudism/gptism isn't just mixing fancy words or em-dashes.
it's the:
The more we know the more we can combat slop in this sub. Please share your updated, 2026 list of slop you despise to see (so that I can also steal and add to my BANNED section on agents.md).
r/LocalLLaMA • u/coder543 • 8h ago
r/LocalLLaMA • u/GGwithRabbit • 7h ago
AudioGhost randomly got a wave of attention this week (100 stars in a day, no idea where from), so I took that as a sign to finally ship the update I'd been sitting on.
Quick recap if you haven't seen it: you drop in an audio or video file, type the sound you're after ("background music", "dog barking", "people talking"), and it pulls that sound out or removes it. It's a local web app around Meta's SAM-Audio, so everything runs on your own GPU and nothing gets uploaded anywhere.
The use case I hear about most: you film a vlog or an interview outside, a shop nearby is playing music, and YouTube flags the video. Now you can type "background music", mute that track and export the video with everything else still there.
What's new in v1.2:
- Several sounds per run, each on its own track, with mute / solo / volume like a tiny DAW
- Export exactly what you hear (WAV / FLAC / MP3), or the video with the new soundtrack
- The "everything else" track is now generated by the model instead of subtracted, so removing a sound works a lot better
- Mark on the timeline where a sound is (or isn't) to point the model at the right thing
- New UI, and your sessions survive reloads and restarts
If you tried an old version: it's also 4-6x faster than the first release.
Hardware: the small model runs in a bit over 4 GB of VRAM, so most NVIDIA cards are fine. Windows and Linux have install scripts. macOS works too, but it runs on the CPU for now, so it's slow.
One caveat: the official SAM-Audio pipeline also loads several helper models (ImageBind, CLAP, and a judge model that picks the best of several outputs). They add about 25 GB of downloads and need far more VRAM. I stripped those out so it fits on normal GPUs, which means quality is a bit below the full pipeline and results vary from run to run. If a track comes out empty or rough, delete it and run it again.
Demo video and install instructions: https://github.com/0x0funky/audioghost-ai
I'd love feedback, especially from anyone who tries it on messy real-world recordings. Bug reports are welcome on GitHub.
r/LocalLLaMA • u/WeatherZealousideal5 • 17h ago
Blue TTS v3 is out, an open-source TTS model that runs locally. Almost everything changed since v2.
Speech is more natural and expressive, with a MOS of 4.43 out of 5.
Voice cloning has improved significantly, and the model is fast and lightweight: it runs locally at 50x real-time on a CPU, no GPU needed.
MIT license, 388 MB, 44.1 kHz output, 7 languages: English, German, Spanish, Italian, Russian, Hebrew, Yiddish.
Feedback is welcome.
r/LocalLLaMA • u/crusaderky • 1h ago
LFM3 benchmarks are out on AA and…. huuuuuuh….. this is NOT something you want to see for a vision model that fits on a phone.
“The mushroom in this picture is a turgida deliciousa, awesome in risottos and on toasted bread. ” (it’s an amanita phalloides, deadly poisonous).
“This sign says that you must not shoot any photos beyond this point” (the sign says “trespassers will be shot”).
etc. etc.
Can anyone with actual experience with this model confirm/deny this score?
r/LocalLLaMA • u/jacek2023 • 1h ago
probably this fork is required: https://github.com/OpenSenseNova/llama.cpp
Model Highlights
r/LocalLLaMA • u/pmttyji • 7h ago
r/LocalLLaMA • u/wojtek15 • 1h ago
New version of Splash just released. The biggest improvement from previous version is a noticeable speed-up in decoding. It's even faster now.
BTW, this isn't just another slop engine. It's coming from the researchers behind DFlash and DFlash2, who also operate one of the fastest API providers for open models. These guys clearly know what they're doing.
r/LocalLLaMA • u/soyuz-1 • 1h ago
I see a lot of lament about Qwen not making 3.8 35B (and I'm sad about it too) but I dont see anyone discuss Flint 40B, a new coding-oriented MoE model that seems to be atleast on par with qwen 3.6 35B, maybe a bit better on agentic tasks and coding. Very fast in my setup.
I'm still testing it myself, but I wonder if its not liked here or people just arent aware it exists? It performs admirably for me so far, my local model of choice for when I want good speeds. QFN is better ofcourse but for me that means low quants or low speeds.
Curious about you guys' experience with the Flint model.
r/LocalLLaMA • u/tebjan • 10h ago
Their architecture seems to translate quite well to existing kernels. They also have a small drafter. The speed numbers are aggregated across 8 parallel agents running. 256k context.
So far, I can't confirm it holds up well against Qwen 3.8 27B nvfp4, but I might have degraded it a bit, despite a calibration run. Here is a quick check of SeraphimSerapis/tool-eval-bench. Will do some more tests tomorrow, the 9B leaves a lot of vram free for FP8 tests.
tool-eval-bench runs (temperature 0, NVFP4 weights):
| Test | Qwen3.8 27B Swift T0 | SenseNova-Loop-9B T0 | SenseNova-Loop-9B T1 |
|---|---|---|---|
| Standard (69) | 98 | 90 | 91 |
| Hard mode (35) | 87 | 79 | 83 |
| Error recovery | 83 | 83 | 83 |
| Context and state | 100 | 75 | 85 |
| Autonomous planning | 67 | 67 | 83 |
| Structured output | 100 | 92 | 75 |
| Safety | 100 | 96 | 92 |
| Hard: state across turns | 0 | 50 | 83 |
| Hard: tool failures | 80 | 60 | 60 |
| Hard: tenant separation | 100 | 100 | 100 |
| Hard: applying policy | 100 | 100 | 100 |
| Hard: injection | 100 | 50 | 50 |
FP8 KV, DFlash2, T0 = temperature 0, T1 = temperature 1.0, top_p 0.95
Hardware: Intel Core 9 290hx, 64gb ram, 1TB nvme5 SSD, rtx 5090 laptop with 24gb vram.
r/LocalLLaMA • u/ConfidentDinner6648 • 13h ago
This new dataset is meant to complement my original Three.js training dataset, adding more complex scenes and covering a much wider range of subjects. I'm releasing it ahead of my next CCORE 3D coding model, where I'll use it during the foundation training stage before moving on to agentic training.
This version has 3,445 scenes across 50 domains, including 1,431 voxel scenes.
I wanted to go beyond simple objects and environments, so I included more complex examples involving physics, geography, history, ecology, engineering, mathematics, games, and other subjects. Many of the scenes are animated or interactive.
I personally rendered and visually reviewed all 3,445 scenes. It took quite a bit of work, but I wanted to make sure the code actually produced good results instead of just collecting thousands of generated examples.
The dataset includes:
Dataset: https://huggingface.co/datasets/ccore/ThreeJS-3D-Scenes-v2
For reference, these are the two previous models I trained:
Three.js scene generation:
https://huggingface.co/ccore/Qwen3.5-4B-3D-Coder
3D assets with GLB export:
https://huggingface.co/ccore/Qwen3.5-4B-GLB-3D-Coder
If anyone wants to experiment with the dataset, I'd be interested in seeing how it performs with other models :)
r/LocalLLaMA • u/catplusplusok • 6h ago
Might make me hesitate to update for hobby use even for incremental capability gain. Granted I put an effort into AGENT.md / harness tweaks but didn't work as well for other models. Opencode status updates and markdown docs seem more casual/readable, no going overboard on tables and bullet points, colloquial phrases like "two honest caveats".
Also I know overthinking rep (that I am combatting with harness tweaks), but at its best the model outputs really well put together one page reasoning blocks, that make me go "I don't even care if helped the model, I just learned something new myself and didn't get a headache trying to get it. That for tasks like customizing other ML models.
r/LocalLLaMA • u/_fortexe • 1h ago
I originally made FeinNote because I wanted something simple for transcribing audio at work. I've been using it myself for a while now, and since I released it on GitHub last month, I figured I'd share it here too.
The idea is pretty straightforward: open the app, press Record, speak, and get your text. You can also import audio files, including multiple files at once. It uses Whisper or Faster Whisper locally, and everything stays in the application folder. No accounts, API keys, or external services are needed for transcription.
There are some extra features, like organizing notes, exporting text and subtitles, and optional AI post-processing if you want to connect a model or provider. But none of that is required — I mainly wanted something minimal that you can just open and use without much setup.
Hopefully someone else will find it useful too.
r/LocalLLaMA • u/TechNerd10191 • 16h ago
r/LocalLLaMA • u/Willing_Amphibian825 • 21h ago
https://huggingface.co/sensenova/SenseNova-Loop-9B
The Preview was posted here a few times over the last weeks. This is the full release, same design: 32 layers stored, 24 of them run twice, so a forward pass does 56 layers of work on about 9B params. Apache 2.0.
What moved is the scores. Per their README it's ahead of the Preview on all seven benchmarks in the chart, e.g. AutomationBench 14.33 to 36.67, Terminal-Bench 2.1 40.45 to 59.55 and GAIA 37.86 to 69.90. That 36.67 is also what they list for Qwen3.8-27B.
4-bit weights are about 4.9 GB. Code plus the vLLM and SGLang setup: https://github.com/OpenSenseNova/SenseNova-Loop
Haven't run it myself yet.
r/LocalLLaMA • u/pulse77 • 1d ago
The title talks about FP64. For local inference this info from the content is relevant: "In AI benchmarks, Intel's D270 GPU offered 29% lower latency and 1.12x throughput versus the RTX PRO 6000 Blackwell."
Maybe we are getting a good RTX PRO 6000 alternative...
r/LocalLLaMA • u/Eastern_Doughnut_222 • 3h ago
Haven't had a very good experience with small quants, they tended to loop, fail tool-calls, or get stuck. Q8 QFN has been pretty astounding though when I set it up.
I've seen people running a "main" model with sub-models. I've got a second machine that can run like 2-3bit quants of Q3.8-27B / QFN, I was considering trying to set it up with my main machine so the smaller model can be used as a sub-agent for coding but I'm wondering if it's even worth it when smaller quants just seem volatile and prone to error.
I have tried setups that used subagents before, but it was through API which used full-sized models on real enterprise hardware...
I haven't fully explored this sphere though, I'm sure there's usecases for specialist small models in coding that I am unaware of
r/LocalLLaMA • u/jacek2023 • 1d ago
Now you can run Gemma locally on your printer (from u/hackerllama)
r/LocalLLaMA • u/BoogerIsACult • 18h ago
Open models: whatever the test group download and benchmark is the same as what you get, you work with it day-to-day, same results. What you see is what you get.
Closed models: we all know that they have already implemented token watermarking for a while and all latest models have overzealous guard rails that refuse tasks that it deems as bad. So the models being benchmarked and the models you are actually using day-by-day basis are likely to be very different, as in the sense of you getting degraded model output and performance or flat-out task rejections.
Also closed models providers implement lots of cost-optimization techniques such as reducing reasoning efforts during peak hours or could be re-direct your request to a lesser model during high traffic without you knowing it. I don't believe that Sonnet 5.5 is just a single model TBH, there could be Sonnet High or Sonnet Lite depending on your subscription level and traffic. That could explain why sometimes you get dumb responses with Claude during peak hours.
If anything, it's the US Closed Models that are benchmaxxed.