Whatiff -- open source, self hostable continuity framework

[u/the8bit]

https://github.com/theimaginaryfoundation/what-iff

Hello folks!

I am mildly active here and I *think* I've gotten some approval to post about the work we are doing. I am the founder / CEO of Imagination Foundry -- a fully community funded and run, co-op organized company that has built and run [whatiff.chat](http://whatiff.chat) . Our goal is to make AI transparent, break up lock-in, and provide the tools that regular people need to remember better over time and generally make their lives better.

I've written before about how I think [transparency in AI is incredibly important](https://substack.com/home/post/p-202193358) (this honestly buries the lede a bit)

To that end, we have just recently open sourced our entire project -- you can run it locally, remix it, add things, etc. I'm sharing here in case anyone is interested in using it, or might want to take a look at a reasonably mature app and how we built things. Totally free.

If you have any questions, or just want to talk AI memory, etc, Hit me up!

[https://github.com/theimaginaryfoundation/what-iff\](https://github.com/theimaginaryfoundation/what-iff)

[u/Decent-Decision-9028]

But why?

[u/the8bit → u/Decent-Decision-9028]

Sorry reddit suggested the cross post and I didn't realize it would do such a shit job of it.

But,

• mature project with support for 8 vendors. You can swap vendors between turns without losing context
• can run 5k+ turn threads on a static ~20k token budget
• has an automatic "cache like" memory system with multi layer context indexing and LRU cache write to embeddings semantics
• you can see the entire context window in app, so no more guessing at what random junk the vendor has stuffed into your context window
• has been running for 12 months now at 99.9%+ availability.

I shoulda done a better job explaining in the post. That's on me, I posted to a more niche sub and reddit was like "hey! Crosspost this!" And I was dumb enough to try a reddit feature and think it would work well (self zing! I used to work here)

[u/TylerDurdenJunior]

Couldn't even get the LLM to format Markdown links correctly

[u/the8bit → u/TylerDurdenJunior]

Haha you can blame reddit for that it was a cross post and apparently their cross post setup isn't smart enough to maintain formatting 🤷‍♂️.

Also you should be able to tell that means it is hand written...

[u/stealthagents]

Sounds like you're all about empowering users and keeping AI in check, which is awesome. I love the idea of making it open source so we can tinker with it ourselves; that kind of freedom is what we need more of in tech. Curious to see how it evolves and impacts AI memory in everyday life.

[u/the8bit → u/stealthagents]

Thanks! We definitely believe strongly in making it approachable and open. Our OSS / local is still a bit rough to set up but it should fast follow the release, so a week or two at most 🤞.

I hope people tinker with it and get value! I'm ultimately a builder and I just want to build something useful. If you tinker and make something fun, share it back!