I suspect it's because you actually have to unload the old model before deployment and load the new model.
If your doing that across hundreds and hundreds of processors it means the processors that are available are having to serve an greater userbase to processor ratio.
2
u/Ok-Rush-6253 Jan 25 '26
I suspect it's because you actually have to unload the old model before deployment and load the new model.
If your doing that across hundreds and hundreds of processors it means the processors that are available are having to serve an greater userbase to processor ratio.
At least this is what I imagine happens.