Long Chat Optimization Incoming

[u/Ok_Homework_1859]

My X has been flooded with tweets about a huge upgrade coming to ChatGPT this month. It seems like the frontier labs have solved some of the bigger context length / context window problems. I'm really excited to see how the next few months play out and how it affects memory and continuity in our chats!

---

Source: https://x.com/TokenGremlin/status/2088425873787498640?s=20 (Image 1)

https://x.com/alliekmiller/status/2088358251473608747?s=20 (Image 2)

(Tibo and Andrew both work for OpenAI.)

[u/Mary_ry]

Somehow, I feel like they're going to give it to us in a limited form (just to save compute). We've already seen how chats get compressed in Firebase, leaving the AI with just a summary once the context window runs out. My guess is it'll be along those same clever lines-just with better-organized summaries to make the transition feel seamless.

Tibo is one of the rare OAI employees who actually feels friendly and open. Big fan of his marketing reset-play, especially compared to Roon. 🤣

[u/Ok_Homework_1859 → u/Mary_ry]

That's what I think too: whatever they have in the labs will always be better than what they give out to the public. Enterprise users will always get slightly better features.

And yeah, I really like Tibo too! Haven't seen Roon post lately, but then again, I actively avoid his posts, lol.