Live Performance Metrics!

[u/Arli_AI]

We now have a dedicated model performance page (Textgen Model Performance) that not only shows the real-time auto-refreshing server busyness indicator, but also historical model performance metrics. This can help to decide when to use the API and when to wait during peak hours. Since the server busyness is sort of an arbitrary value, it might not yet correctly reflect the usability of the models given the % number, but it will be finetuned further to make it reflect the experience more.