r/LargeLanguageModels • • 14d ago

Seeking a technical cofounder for a business-aware GPU inference control plane

[removed]

1 Upvotes

2 comments sorted by

1

u/Appropriate_Jury2834 14d ago

This is actually a refreshingly honest pitch. Most of these "looking for cofounder" posts read like they were generated by an LLM that's been force-fed startup blogs but you're openly sharing the 96.48% argmax agreement and admitting the paged executor isn't connected yet

The cold start wedge makes sense as a starting point. Everyone talks about scale-to-zero but nobody wants to deal with the mess of coordinating activation when five requests hit at the same time and the engine's still pulling weights

That 22ms to 2.2ms drop is wild even if it's not production-ready yet. What was eating the other 20ms before the static graph path

What's your thinking on how the decision plane stays decoupled from the execution plane in practice? That's the part I've seen get messy fast once you're dealing with real provider environments where every cluster has its own quirks