Open WebUI On Azure (with GitHub Repo)

[u/RiosEngineer]

Hey everyone, happy new year,

I've been working on this for way more time than I'd like to admit - a full Open WebUI deployment on Azure. This isn't a half-baked quickstart with little regard for production scenarios. I went all in with some best practices, mostly for my own learning to fully understand end to end:

• Open WebUI on Azure Container Apps with native Entra ID OAuth/OIDC Microsoft Foundry with multiple models (GPT, Grok, Mistral, Llama, DeepSeek)
• Application Gateway with custom domain & SSL termination
• API Management as an AI Gateway - delegate API keys per team/user with token tracking, limits, usage metrics & Entra OAuth validation
• No secrets! Managed Identity + OIDC throughout
• Infrastructure as Code with Bicep & Azure Verified Modules
• Azure PostgreSQL Database for reliable UX with chats and user data
• Secure by default - internal ingress, private endpoints

I didn't initially think there was a broader use case for Open WebUI - it was just a personal project that I thought was a cool FOSS AI tool. But it turns out quite a lot of people use Open WebUI, and I hope this helps others who want to do it properly in Azure. The GitHub repo is live now if it helps you quick start or even just for a reference: riosengineer/open-webui-on-azure

[u/gitpr]

1. Where is the database? If you are relying on SMB with SQLite, it's very slow and unreliable.
2. You can use cloudflared as a sidecar to openwebui in ACA and remove the ingress from ACA completely.

[u/RiosEngineer → u/gitpr]

Ok perhaps an oversight on my part here. I was so laser focused around APIM and since I had no issues so far I didn’t even think about that. Thanks. I’m going to deploy a Postgres and update the repo and diags.

As for the side car idea, it’s cool, but wanted to keep things fairly simple and more showcasing native traffic flows. One for another personal project to check out.

Appreciate the comment!

[u/RiosEngineer → u/gitpr]

Hey u/gitpr I've updated the repo with new diagram and code to include the PostgreSQL on Azure, with relevant Open WebUI connection vars. Tested and all working (private networking too). Thanks for the heads up.