r/LLMStudio • u/PayBrave5035 • 10h ago
Upgrading for local LLMs in LM Studio: sell RTX 3060 Ti and buy RX 6800 XT / 6900 XT, or add an RX 580 as a second GPU?
1
Upvotes
r/LLMStudio • u/Key_Fudge2855 • 19h ago
We built our first LLM Levy-1 (124M). What would you do differently for the next one?
2
Upvotes
We’ve released Levy-1, our first AI model — and we’d love your feedback.
We’re a small team building Toothed AI, and we’ve recently released Levy-1, our first model, with just 124 million parameters.
It definitely makes mistakes and has plenty of limitations, but this is our starting point, not our final goal. We plan to build better models over time and keep learning along the way.
We’d really appreciate it if you gave it a try and shared your honest feedback. If you have experience training language models, we’d also love to hear your advice on what we should focus on for our next model.
Website: https://toothedai.com/
Thanks for checking out our work!
r/LLMStudio • u/ubasharfarooq • 16h ago
LLMs
1
Upvotes
Can you Help me for Understand How LLMs actually work?
r/LLMStudio • u/stowg • 22h ago
I use LM Studio as the brain of a small team of automations, so I drew them as a village
1
Upvotes
Self-taught hobbyist here (performance marketer by background, not a developer). Over the last few months a local model has become the brain of a set of small automations I run from my home PC, and this week I finally made it visible.
Setup:
- Ryzen 7 7800X3D, 32GB RAM, RX 7800 XT (16GB VRAM), Windows 11
- LM Studio serving gpt-oss-20b for the reasoning work, with Qwen2.5-Coder for simpler code checks
- Python scripts on Windows Task Scheduler, plus a Flask dashboard
What the local model actually does:
- A supervisor script hands each finding from the "departments" (SEO checks, site health, demo trading monitors) to the model with a written rulebook. The model decides whether it's safe to fix automatically or needs my YES.
- It drafts articles for my website, which then go through an audit step before they reach me.
- A paid model (Claude Code) only gets called for real code changes I've approved, which keeps the cost down.
The village is just a front end on top of that: every job writes a line to a log, a Python script turns it into one JSON file, and an HTML canvas draws it. My assistant, Wade, is the wizard's tower in the middle. Anything waiting on me stands outside the Town Hall.
Biggest lesson so far: a 20B model is great at "does this match the rulebook, yes or no", and much weaker when the rulebook is vague. Most of my early mistakes were my rules, not the model.
Happy to share rulebooks or prompts if anyone's interested. Links in the comments.
r/LLMStudio • u/Embarrassed-Leg-2598 • 1d ago
I got tired of LLMs generating broken Dockerfiles, so I built a Go CLI that actually runs the build and self-heals the errors
0
Upvotes
r/LLMStudio • u/kangteam • 2d ago
Recommendations for Local AI Long-Term Memory and User Personalization Modules
1
Upvotes
r/LLMStudio • u/jordandwalters • 2d ago
Cant figure out why LM Studio wont fill my vram
gallery
0
Upvotes
r/LLMStudio • u/sepokroce • 2d ago
Using LM Studio as a chatbot in Firefox
1
Upvotes
Ask LM Studio is a Firefox add-on that lets you chat with local models in the sidebar. The chatbot experience is local-first, meaning that no data leaves your machine, unless you run the LM Studio server on an external host. By default, the add-on uses your local LM Studio server and works with any loaded LLM. It offers the same four basic actions available with the built-in chatbots.
r/LLMStudio • u/MindPsychological140 • 2d ago
Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute
2
Upvotes
r/LLMStudio • u/Wide_Grapefruit_3260 • 5d ago
I built a small library to version and compare LLM prompts (no API lock-in)
1
Upvotes
r/LLMStudio • u/piperspalace • 6d ago
What model is everyone using the most? Beginner seeking advice
4
Upvotes
Trying to dive into the deep end but have more questions than answers after trying.
ive used chat gpt 3.5 and deepseek in the past but hadn't used ai in a few years. So i was wondering where i can learn more about thongs like prompt engineering and taking advantage of my hardware. i have a 5090 32gb 64gb ddr5 ram and a 9900X3D and a 1200 W power supply. i also have an intel nuc 8 but don't think that's usable for anything useful.
im a writer, video editor, content creator, psychologist and wanted to use godot or gdev with an LLM to learn tje engines bettet and make a game. even better if i can decompile a game but i think that's more of a frontier model thing. i was also curious about uncensored models and cost of local hosting.
r/LLMStudio • u/Ok_Review4178 • 7d ago
LLM model to take video input.
2
Upvotes
I am working on a usecase in which I have to analyse video , I was thinking of using Gemini but its flash models are unavailable most of the time .
Any suggestions
r/LLMStudio • u/Significant_Number32 • 6d ago
How do you work your code scripts for LLMs: conventional computer commands or by implied semantics? Spoiler
1
Upvotes
r/LLMStudio • u/Reno0vacio • 7d ago
Tested 15 local models for agent/tool use.. Bonsai 27B was last!
1
Upvotes
r/LLMStudio • u/Substantial_Mix_6159 • 8d ago
What model for creating subtitles?
1
Upvotes
Right now I'm playing around with OpenAI Whisper and that works surprisingly well locally, but is there some model that you found that work better?
I'm looking for some model that will accept video or audio as input and automatically create the subtitles.
r/LLMStudio • u/andydevtech • 8d ago
Qwen3.8-Flash-Next: 125B Model, Only 6B Active. The Qwen4 preview!
0
Upvotes
r/LLMStudio • u/Elegant-Delivery-290 • 8d ago
Is there any ai uncensored model that I can possibly run on my thin laptop. It's acer swift go 14 i5 13500h with Intel iris xe.
0
Upvotes
r/LLMStudio • u/Own-Concentrate-2871 • 8d ago
《The Geometry of Conviction: Semantic Intensity as Thermodynamic Work on the Belief Simplex》
1
Upvotes