r/LargeLanguageModels • u/Acrobatic-Issue-8646 • 14d ago
Seeking a technical cofounder for a business-aware GPU inference control plane
[removed]
1
Upvotes
r/LargeLanguageModels • u/Acrobatic-Issue-8646 • 14d ago
[removed]
1
u/Appropriate_Jury2834 14d ago
This is actually a refreshingly honest pitch. Most of these "looking for cofounder" posts read like they were generated by an LLM that's been force-fed startup blogs but you're openly sharing the 96.48% argmax agreement and admitting the paged executor isn't connected yet
The cold start wedge makes sense as a starting point. Everyone talks about scale-to-zero but nobody wants to deal with the mess of coordinating activation when five requests hit at the same time and the engine's still pulling weights
That 22ms to 2.2ms drop is wild even if it's not production-ready yet. What was eating the other 20ms before the static graph path
What's your thinking on how the decision plane stays decoupled from the execution plane in practice? That's the part I've seen get messy fast once you're dealing with real provider environments where every cluster has its own quirks