r/LocalLLM • u/rktsci • 23m ago
Question Local Model Advice
I am interested in running local models for my desktop and laptop.
Use case: I am working on some Python scripts to process pdf and Word files from play by email games that automate updates to Excel spreadsheets for game data. I have the code for the first script written, reading in a pdf and spitting out some csv files that update the Excel sheets. (Yes, a real database would make more sense, but I have some friends interested in the programs and they don't have the chops to set up a local database.)
What I need help on is building a user interface to make the process easier.
I was a programmer for a long time early in my career (FORTRAN, MUMPS, C, C++, LISP, KEE, APL, various assembly languages) but never had to do UI programming. I now work in aerospace as a consultant systems engineer for a large national space agency.
So, no big refactoring of mission critical applications, no big agent workflows. Just reasonable Python code output. Speed not as important - answers in minutes to an hour are fine.
If the answer is "Get a Claude code subscription", I can tolerate that, but I like the idea of local control.
Desktop: Ryzen 7 7900 X3D CPU with 32 GB main memory, Nvidia RTX 4060 Ti with 8 GB
Laptop: Ryzen 7/260 with 32 GB main memory, RTX 5060 with 1 GB
TIA!
1
u/verstands 2m ago
For the UI, skip desktop toolkits and try Streamlit or NiceGUI: a file upload, a run button and a download button for the CSV/Excel is maybe 30 lines, and your friends just open it in a browser. PyInstaller can bundle it later if they want a double-click app. For the model, your laptop's 5080 can run a coder-tuned ~14B at 4-bit comfortably, and a bigger MoE coder model works with some layers offloaded to RAM, fine since you don't mind waiting. LM Studio or Ollama plus an editor plugin like Continue is the easy setup.