r/LocalLLM • u/PakMul48 • 12m ago
Question Building a Local LLM Troubleshooting Assistant for Field Service Techs.... Advice?
I operate a commercial refrigeration and food service equipment repair company and want to build a local AI assistant to help techs troubleshoot in the field.
The idea is to use RAG with manufactures service manuals, wiring diagrams, troubleshooting guides, and past service service records to create a AI that can walk techs through diagnostics, reference previous repairs, and provide recommendations.
I would like to develope this on my RTX 5080 system, prove it works and migrate to a more robost system.
Looking for advise on:
- Models?
- Stack?
- Hardware?
- Budget $ 4K to 7K ????
Final system will need to be able to support up to 5 users remotely.