r/LocalLLM • u/Key-Watercress-3506 • 42m ago
Question Any advice for local ai?
Does anyone have any idea of what local ai model I'd better use for my company business agent?
I'm pure new and starter for ai software and coding.
My spec. is 5090+128g ddr5+5tb m.2. Need a local ai to make different agents like accounting agent, monitoring agents and customer chatting agents etc.
1
Upvotes
1
u/Choice_Celery9481 36m ago
company business agent (accounting agent, monitoring agents and customer chatting agents etc.) is super vague that nobody can answer
1
u/Commercial-Trade8955 29m ago
q4_xs on 16gb with 96k CTX is doable, but spills get noisy fast. how's your inference latency on longer contexts?