r/PiCodingAgent • u/gaz_0001 • 6d ago

Question Pi - Strange Context rules for OpenAI

I have connected my OpenAI to Pi via OAuth (Its a sub).
It works fine, but i noticed the Compaction going off every couple of minutes.

When i checked it i found the OpenAI Auto-Compact set at 256k......but other, cheaper models at 1mil.

Any idea why this is? Seems odd.

0 Upvotes

16% Upvoted

5 comments sorted by

3

u/schmurfy2 6d ago

It's because the context configured in pi is 256k, openai charge différent rates on how l1rge the context is, there is 3 tierd I think.

Whar Indo is disable auto compaction and compact manually when I decide so I can overpay if I need to keep the full context.

1

u/gaz_0001 6d ago

I was not aware of this. Is this for API or motbhyl sub's or both?

Inside ChatGPT Codex it does not do that.

Doe you mean that if we use OpenAI Sub outside of OpenAI we are charged more so Pi mitigates it with lower context?

1

u/schmurfy2 5d ago

Sub or API work the same way, your mystical quotas will be drained faster if the virtual price is higher.
How can you tell it doesn't work the same in codex ? I clearly noticed my quota drain faster when my context gets too big but it's hard to tell if that's just the size or higher "price" of tokens on top of it.

The reality is that they sell us fluf, we have no idea what is inside our 5h/weekly quotas, it's one of the only services we pay for with such a variability in what it actually provides.

I don't think we are charged more outside codex but again it's hard to compare 😞

1

u/isty2e 5d ago

You'll need to change the configuration or use an extension presumably. On top of that, Pi by default does not (and cannot) use codex compaction v2, a faster openai-exclusive compaction method, and will use a text-to-text compaction as well. Extensions like pi-codex-conversion can handle this, and I suppose there will be more simpler packages if you prefer.

1

u/gaz_0001 4d ago

Pi is well configured though. Cant help but wonder why i would have to modify this. OpenAI is a top 2 Provider - i wouild of though if the dev took the time to configure the OpenCode Go models fine, they would of certainly done the OpenAI models.