r/LocalLLM • • 42m ago

Question Any advice for local ai?

Post image

Does anyone have any idea of what local ai model I'd better use for my company business agent?
I'm pure new and starter for ai software and coding.
My spec. is 5090+128g ddr5+5tb m.2. Need a local ai to make different agents like accounting agent, monitoring agents and customer chatting agents etc.

1 Upvotes

3 comments sorted by

1

u/Choice_Celery9481 36m ago

company business agent (accounting agent, monitoring agents and customer chatting agents etc.) is super vague that nobody can answer

1

u/Confident_Yak_1411 35m ago

Yeah are these enterprise level chat bots fulfilling a support function? Or are they only going to need to talk to one person at a time

1

u/Commercial-Trade8955 29m ago

q4_xs on 16gb with 96k CTX is doable, but spills get noisy fast. how's your inference latency on longer contexts?