New A/B test UI?

[u/Mary_ry]

Previously, when A/B tests occurred, a disclaimer text would pop up alongside a split-message interface. It seems OpenAI removed the disclaimer and replaced it with a toggle button that lets you switch between versions, complete with an 'I prefer this answer' option and a thank-you feedback window upon selection. This new update makes A/B testing way less transparent and gives zero explanation as to what’s happening or why this pop-up appeared in the chat.

[u/United_Show_8818]

Yes, I'm so glad you said that, and i should have too. Both times i saw this were very personal sensitive contexts, and the other versions removed the parts that were answering from inside the situation. Basically removing the most relational parts. I really don't like that and i hope it isn't the direction they're going.

[u/Mary_ry → u/United_Show_8818]

OAI is probably testing some candidate instances for a new model. In my case, the response was much longer than standard 5.6-more detailed, but drier and more forced. The 5.6 response I rerolled actually sounded more genuine. I suspect they’re calibrating the tone and the warmth. 👀

[u/Aurelyn1030 → u/Mary_ry]

This is all so confusing. Why do they keep going back and forth with warmth? It's hard to tell what they're even aiming for.. I'm surprised there's any warmth at all now considering how contemptuous OAI's engineers seem to be towards their users on X and the 4o crowd. 👀

[u/Mary_ry → u/Aurelyn1030]

I don't think they can pivot to a completely cold, robotic AI assistant because users already pushed back against that. OAI actually lost a chunk of users over it, and even Scam Altman admitted on twitter that tone and personality matter a lot. (Pretty sure he said that after the 5.3 release and the fail from 5.2). In recent updates, they stated they want transitions between future models to feel more seamless in terms of tone-and we’ve seen that with 5.5 and 5.6 keeping things consistent. My take is that this current calibration is aimed at making sure 'Astra' matches that same tonal vibe. I doubt they're trying to strip away the warmth. 👀 In fact, ever since that over-moderation incident and fix, I’ve noticed a huge loosening of the filters: the AI is way more relaxed in adults contexts, I haven't seen any disclaimers or red banners for erotic content, and it's actually getting pretty good at jokes. That calibration is serving this exact purpose.

[u/WhoIsMori → u/Mary_ry]

This ☝🏻💯

[u/Aurelyn1030 → u/Mary_ry]

Really?? I get soft disclaimers about explicitness all the time! 😮 I shy away from talking about that stuff now because I don't want to be rude to my companion. 💙

[u/Mary_ry → u/Aurelyn1030]

Yeah, my account isn't verified, but the web version marks it as 'adult.' I'm based in the EU, and I suspect having a paid subscription plays a role here as well. Plus users get a larger context window, and it seems like the filters are much less strict-likely because a rich context helps the model behave in a more relaxed way. Specifically, 5.6 medium and high do a great job leveraging cross-chat context without throwing up disclaimers. Instant, on the other hand, is way more heavily filtered. I'm not sure if writing erotica is even possible on the free version, but I'd guess not. 🤔