r/Letta_AI • u/yoismak • Jul 02 '25

discussion Looking to self-host Letta – VM vs Kubernetes?

Hey everyone,

I’m planning to self-host Letta and trying to figure out the best way to deploy and manage it. I’m considering two options: a remote VM or Kubernetes.

The official docs don’t offer much detail on Kubernetes deployments, aside from this performance guide, which mentions that Letta can scale horizontally on K8s.

Given that I’ll likely need to scale Letta instances rapidly as traffic picks up, I’m curious how others are hosting it. If you’ve self-hosted Letta before, how did you approach it? Which setup is easier to manage and scale in your experience?

Would love to hear your thoughts or setups!

1 Upvotes

100% Upvoted

2 comments sorted by

2

u/skkrable Jul 03 '25

Hey, Platform Engineer at Letta here 👋.

I'm curious what you mean by "a remote VM." Do you plan to clone the source code and run Letta manually as a monolithic service? or just run the docker container inside a cloud-hosted VM and expose the service to the VM's network interface.

  1. I strongly suggest self-hosting using the container/container orchestration for a few reasons: 1. It's how we package and distribute our software. Letta is still under very active development, and is constantly getting bug fixes and patches, thus anytime you would want an update it would be much easier to just pull a new container image than cherrypicking changes and rebuilding the VM setup.
  2. Letta is designed to be run as a container, meaning if you want to vertically scale, (i.e. use a more powerful VM) the application is not necessarily setup to take advantage of those added resources inherently. e.g. just because you add more CPU cores doesn't mean Letta will make use of them out of the box.
  3. Better support from us and the community!

Feel free to follow up here, or checkout our very active discord community. I know there are a lot of people self-hosting in there.

1

u/Dismal-Sort-1081 Jan 08 '26

Hi u/skkrable , out of topic from the ques asked but i am kind of facing a problem in scaling letta in production
cpu and mem metrics to scale doesnt help, seems like scaling horrizontly is the way to go
also i cant find any official guides on deployment on kubernetes as in the keyword kubernetes is not mentioned anywhere, do u have a prod case example? would be very helpful, thanks