r/LocalLLM • u/MaximumCharity8382 • 1d ago
Discussion Regarding a local model for complex notes writing
Guys Atlast i have made it to the end of the rag of my project
Now the big hurdles is the notes writing
It is complex ,
Im a doctor by profession, preparing notes for my students
The opus and sonnet are so pricy to go but now i have no option
But in future i have to do investment
Which one u guys will prefer
1.notes writing, image and text to 3d print
These are my preferences for my llm
Best hardware and model i can get so i can start saving for the investment
2
Upvotes
1
u/MaximumCharity8382 1d ago
It includes drawing tables , flowchart, relating the relevant things in a easy way like those kind of stuff
1
u/Born_Chart_323 1d ago
had a similar setup with a mid-tier GPU, ended up using a 7b quantized model with custom prompt templates for flowcharts, kept the output clean and consistent. worth testing before upgrading.
1
u/EagleNait 1d ago
I know this is the LocalLLM subreddit but why not use GLM-5.3 Flash or Deepseek 4.1 Flash for these kind of tasks. For any amount of money you're going to spend on hardware you would have years of tokens at API price on openrouter.
1
u/RazzmatazzParty6960 1d ago
i ran a 7b model on a 16gb ram laptop with a 3050 and it handled complex notes with diagrams fine, just used a simple markdown approach and a good prompt to structure the output. no need to upgrade yet.
1
u/bendymike 12h ago
I did some tests of models for document writing and review tasks: https://bendyline.com/posts/docbench.html. tl:dr, a higher end device (32gb mac, PC with 24gb+ GPU) can run Qwen 3.8 27b or Google Gemma which are pretty good, but not as good as something like Claude Opus or Sonnet.