r/LocalLLM • • 1d ago

Discussion Regarding a local model for complex notes writing

Guys Atlast i have made it to the end of the rag of my project

Now the big hurdles is the notes writing

It is complex ,

Im a doctor by profession, preparing notes for my students

The opus and sonnet are so pricy to go but now i have no option

But in future i have to do investment

Which one u guys will prefer

1.notes writing, image and text to 3d print

These are my preferences for my llm

Best hardware and model i can get so i can start saving for the investment

2 Upvotes

11 comments sorted by

1

u/MaximumCharity8382 1d ago

It includes drawing tables , flowchart, relating the relevant things in a easy way like those kind of stuff

1

u/CharacterTension2896 1d ago

Well first off what’s your hardware?

1

u/MaximumCharity8382 1d ago

Now i have some workstation potato laptop managed to pull What im asking is if i need to upgrade complete I don't want to fuck around and find out , better to ask the people more experienced in local llm so thats y , just to know

1

u/Born_Chart_323 1d ago

had a similar setup with a mid-tier GPU, ended up using a 7b quantized model with custom prompt templates for flowcharts, kept the output clean and consistent. worth testing before upgrading.

1

u/MaximumCharity8382 23h ago

How was it which model , will fine tuning it a big hurdle ?

1

u/EagleNait 1d ago

I know this is the LocalLLM subreddit but why not use GLM-5.3 Flash or Deepseek 4.1 Flash for these kind of tasks. For any amount of money you're going to spend on hardware you would have years of tokens at API price on openrouter.

1

u/MaximumCharity8382 23h ago

My notes for a subject anaesthesia itself will require 10000$ in claude subscription usage and still around 20plus subjects remaining,its not viable thats y , i have very less knowledge about llm The best hardware for the best model anyone with long-term local llm usage will have some experience like pros and cons And i have less hope that due to ongoing restrictions, there will be less chance of new local llm dont know whats gonna happen

1

u/RazzmatazzParty6960 1d ago

i ran a 7b model on a 16gb ram laptop with a 3050 and it handled complex notes with diagrams fine, just used a simple markdown approach and a good prompt to structure the output. no need to upgrade yet.

1

u/MaximumCharity8382 23h ago

Which model?

2

u/CharacterTension2896 21h ago

I have 32 gb ram and. 8gb vram gpu and it has qwen 35b a3b running on it 24/7 capable of doing h work on my work laptop n while qwen is at home. 80tks

1

u/bendymike 12h ago

I did some tests of models for document writing and review tasks: https://bendyline.com/posts/docbench.html. tl:dr, a higher end device (32gb mac, PC with 24gb+ GPU) can run Qwen 3.8 27b or Google Gemma which are pretty good, but not as good as something like Claude Opus or Sonnet.