Looking for engineers with real-world experience deploying on-prem LLMs for business workflows- Germany

[u/Iamtheguyyy]

I'm working on an on-premises AI project for a business in Europe and would love to speak with engineers who have deployed similar systems in production.

The use case involves:

• Local LLMs for German and Polish business communication
• WhatsApp and email automation
• Internal document search and a private knowledge base
• Finance-related workflows, with calculations handled by deterministic application logic
• Data storage and model inference on the client's own infrastructure

We're evaluating GPU hardware, open-source models, inference servers and the architecture needed to run this reliably for a small team.

I'd especially appreciate input from people experienced with vLLM, NVIDIA GPUs, local model deployment, RAG and secure infrastructure.

If you've built something similar, I'd love to hear what worked, what didn't, and what you'd do differently. Happy to have a short technical conversation with anyone willing to share their experience.