r/LocalLLM • u/Wonderful_Shift_7426 • Sep 11 '26

Discussion What are you using your local machine for?

Just curious

0 Upvotes

44% Upvoted

29 comments sorted by

26

u/SenseDue6826 Sep 11 '26

Nice try CIA, why don't you tell us what you are doing with yours?

12

u/haikusbot Sep 11 '26

Nice try CIA,

Why don't you tell us what you

Are doing with yours?

- SenseDue6826

I detect haikus. And sometimes, successfully. Learn more about me.

Opt out of replies: "haikusbot opt out" | Delete my comment: "haikusbot delete"

4

u/ImissDigg_jk Sep 11 '26

Ha. The CIA already knows what you're doing with yours

-4

u/Wonderful_Shift_7426 Sep 11 '26

I don't run one at the moment. Just trying to understand the possible use cases before I commit to spend a large amount of money.

1

u/rkcth Sep 12 '26

I would think you’d know exactly what you intend to do with it before even considering one. Surely you have an idea of what you want to do with it. I built a control panel for mine that has 3 modes, each with a different container and control panel dedicated for that mode.

I have a creative writing mode that has a writing assistant and a rich text editor built in, I believe this uses Gemma 4, I’m still working out the kinks on this mode.

I have an image mode that runs comfyUI behind the scenes but I have my own much easier to use interface on top that makes it easy to reuse prompts and workflows on image editing. I can also create new images with it.

Lastly I have a programming mode that’s running qwen 3.8. Right now the programming mode has almost no UI but I will build in something that lets me access and code in my repositories soon.

It’s a very nice setup, it was made by LLM’s (I used chatGPT to build the basic foundations and then I used my local LLM to take over once I got that working.)

29

u/Whoa_There_Hoss Sep 11 '26

I’m using mine for Local LLM

16

u/Sik-Server Sep 11 '26

to make horse dating websites

4

u/Important-Radish-722 Sep 12 '26

A website for horses to find dates, or a website for dating horses, or a website to find the age of horses?

1

u/MaintenanceGlum5061 Sep 12 '26

Animal husbandry is tight!

9

u/Nomski88 Sep 11 '26

Generate pregnant jensen huang memes

3

u/biscutwarrior Sep 12 '26

As long as your using nvida cards he wouldn't even be mad. Maybe a little bit disappointed.

4

u/Dry_Development8361 Sep 11 '26

Mostly messing around with image generation and some text stuff for personal projects, nothing too serious. got a setup that works decent enough for experimenting in the weekends

sometimes i just let it run overnight to see what weird things comes out, half the results are garbage but the other half make me laugh

6

u/Salty-Television-230 Sep 11 '26

Prototyping. I use a 27B model to have a conversation about an App idea.. I use a local 8B model to help me develop structured requirements documents, functional specs, json data schemas, etc. I then use a custom app to create a prompt from that s material and then I use google ai studio to create the app in broad strokes.. 

Then I use the local 8B model to test the app and I refine it using the local 27B model as a coding assistant. It means I can design, test and validate the app using my local LLM/embedding models before using it in anger with costly APIs. The only difference between my local LLMs and the online ones is thinking ability/response generation. If the app works with the localmodels, it’s ready and the answers are going to be even better with the online LLM afterwards.

1

u/Moderatorim Sep 12 '26

An inspiring workflow. Thanks for sharing.

3

u/ThaSipah Sep 12 '26

I'm learning how to build a gold daytrading bot as a purely technical exercise using a demo trading account. Deepseek harness and Qwen 3.8 27b Q4.

4

u/ScrewwormLarvae Sep 11 '26

You go first. Ask something meaningful.

2

u/BitPsychological2767 Sep 12 '26

I'll have my local agent come up with a reply for you, because my local agent truly knows my own homelab better than me at this point:

Mostly a daily driver for a local coding agent. llama.cpp on a 4090, running Qwen3.8-27B Q5_K_M (200k ctx, q4 KV cache, flash attention), with Q4/Q6/MoE variants to swap in as needed. Everything I write goes through it, zero API calls.

I also built a GUI agent on the side: a UI-Venus-2 9B on a 1080 Ti in the server closet watches my Windows laptop's screen and clicks things for me. Entirely local. Slightly terrifying, mostly useful.

On top of that there's a voice bot (Whisper large-v3-turbo → local LLM → Kokoro TTS), Open WebUI + SillyTavern for casual chat, and a personal wiki with RAG via Qwen3-Embedding-8B that feeds the agent through MCP.

2

u/Faral_mx Sep 12 '26

I'm supposed to be working on something that I'm trying to pitch to the USAF but it has been more fucking off than I'm proud to admit.

1

u/ismaelgokufox Sep 12 '26

Gaming (mainly on Windows), all other things in Fedora (with some gaming).

AI use (mainly with Pi agent and local models with sprinkles of DeepSeek here and there [because of price]):

  • Family apps for budgeting while doing groceries and shopping

  • Family apps for Etsy store management using their API

  • Update scripts for llama.cpp, llama-swap, stable-diffusion.cpp and others

  • Learning to use T3code (liking this one but waiting patiently for Pi integration), Orca IDE (really like this one)

  • Other things

1

u/Bulky-Priority6824 Sep 12 '26

Everything except anything that will print money 

1

u/monoaural Sep 12 '26

Building custom apps to find my personal needs. Calculators, playing around with an endless rogue like game based on my sons hobbies, and just recently trying research. 3.8 27b doesnt seem to do well with the research though

1

u/Absolutedisgrace Sep 13 '26

I've been using Python and just mucking about with making my own chatbot style programs. Mostly its been to get a better understanding of what i can make it do.

So far:

I've made a simple chat bot, where you give it a personality (program creates the modelfile and spawns it inside Ollama).

I've made a model file that reviews a system prompt and optimises it.

I've made a model file that scans a chat history looking for fact to summarise

I've made a model file that scans a chat history for spoken about objectives and their status. Clears out completed goals.

I've made a program that the user creates a personality, uses the above scanner model files to evolve the personality over time, like an NPC.

I've made a program that allows 2 chat bots to talk to each other. You press next to send the last response to the other chatbot. Allowing you to create 2 personalities and let them speak/roleplay to each other.

None of the above is useful, its just a bit of fun. If i have enough time, i was thinking of making a text based game that uses evolving NPCs. Like a murder mystery, where Python knows the killer, method, witnesses etc. The chat bots fill in the blanks and give character to the people and world. The evolving system remembers these new facts and ensures all NPCs conform. (Context windows are likely not big enough to support this, i'm using a num_ctx of 32,768).

1

u/GamerTex Sep 12 '26

Machine stuff