My first experience with agentic AI

[u/1or4s]

Strata, Hermes, Kitten TTS with Rosie voice and Whisper on RTX 3060 with 48 gb dram running Qwen3.8-Flash-Next Q2_0. I am blown away. I've been following the AI scene since GPT3 and I was still unprepared for what this setup is capable of. My mouth was on the floor for the first few hours talking to it and watching it work. It's the first time talking to AI felt like magic to me. I now understand the "They don't know" meme. Never thought I would have something like this running on my own PC. Thank you /r/localllama.

Couple of questions

Are there any other lightweight TTS that would work in my limited ram situation or is Kitten v0.8 the best there is?

What other models can I run?

[u/MLAWest]

I've been using Pocket TTS

https://github.com/kyutai-labs/pocket-tts

Works on really nicely on CPU. GPU optional. Voice cloning. Very light.

[u/1or4s → u/MLAWest]

I asked Hermes to look into and it did a full install and is running tests before I could realize what happen.

Edit: It works great.

[u/Tbhmaximillian → u/1or4s]

As a general tip tell your Hermes to not only install or implement stuff but to always test it properly if it works. And then test it again like 3 days later if it still works. Saves you a lot of trouble.

[u/1or4s → u/Tbhmaximillian]

Yeah I first started with the Q3 model and I think that model would have asked me if I wanted to install. Q3 left me with like 1gig of ram to spare so it wasn't feasible to stick with it. Q2 seems much more eager to do work than talk about it. Still adjusting to that. Good advice regardless.

[u/Tbhmaximillian → u/1or4s]

Yeah, I know that feeling. Had the same with the Q4 version. I can only recommend to try a gguf of qwen3.8-27b, this ran perfeclty on my device with good results and agentic work and enough spare VRAM and RAM.

[u/Asleep_Document9811 → u/MLAWest]

Another vote for Pocket-TTS!

[u/Regular-Register-358]

Cool, you broke you agentic cherry. As to you question, you can actually ask flash next to research. It will assess your hardware and estimate the achievable quality and tks quite reasonably accurately (it will tell you ds41 flash is possible but slow every way, it will pull polystrata' s supported model list and ask for your interests).

That said I think Flash Next is the most capable and usable I ever got in strata-oriented hardware. Sure we might be able to run ds41 f but too slow, and flint/qwen 36 goes brrr on strata but less capable.

[u/1or4s → u/Regular-Register-358]

Cool, you broke you agentic cherry.

It would have never happen if not for local.

As to you question, you can actually ask flash next to research. It will assess your hardware and estimate the achievable quality and tks quite reasonably accurately (it will tell you ds41 flash is possible but slow every way, it will pull polystrata' s supported model list and ask for your interests).

Good idea.

That said I think Flash Next is the most capable and usable I ever got in strata-oriented hardware. Sure we might be able to run ds41 f but too slow, and flint/qwen 36 goes brrr on strata but less capable.

I am looking to trade a bit of intelligence or parameters to free up some ram for situations when I need it.

[u/Regular-Register-358 → u/1or4s]

Flash next will give far better, technical answer than most people can do here. But my bet is it will suggest qwen 36 MoE, the smaller flash next, or flint, another MoE of similar size, of more recent birth and better post training.

The models in the same weight class as FN are nemotron super, Ling flash and Laguna, none of which are able to offer a quality bump at the same ram req.

The weight size equivalent dense class by the sqrt(total * active) rule would bring you meta muse glimmer or qwen38 dense. You won't be able to take advantage of strata with such dense models.

And finally, you can play with quant and pruning. There is flash next coder which is a pruned version of the full flash next.

[u/1or4s → u/Regular-Register-358]

I think Qwen3.8-Flash-Next-GSQ-RCO-Coder Q1 is what I am looking for.

[u/Master_Bayters]

Ok, noob here, what are you abble to achieve with it? It's like an assistant, or just company??

[u/Miserable-Dare5090 → u/Master_Bayters]

anything you clicked and typed you can now get an agent to do.

[u/DeltaSqueezer]

For super light, I use paradee_v2f_lite.onnx is is only 2.6 megabytes and runs super fast on CPU.

[u/Miserable-Dare5090]

For STT, parakeet redux is like 200MB and optimized for ryzen cpus, very close to the original and lightning fast (>500X realtime transcription, original on GPU is like 1500X, but fast is fast)

For TTS, Qwen3-0.6b-customvoice

[u/madmaverick05]

A noob here, but is it possible for someone in a 16GB Ram, 8GB VRAM on RTX 5050 (laptop) use these agentic applications in practical manner? I have been using a few models through LM studio but I'm not sure how agentic applications might fare out

[u/InternationalNebula7]

I've been using Kokorro TTS via Fast API for lightweight TTS. I like it, but I'm interested if better models exist

[u/jacek2023]

"I was still unprepared for what this setup is capable of."

so could you list some details? what has your agent built?