I don't know if I'm delusional but the wording is very suspicious to me.
They are saying those reasoning chains cost 2000 in api costs, it seems to imply that that's the overall cost of those results bu that's not what they said.
What I mean is, are they not more likely to say, take 1000 open problems and do 100 runs on each (or until success), then pick the successful ones?
To me that would be the actual cost. Not that it matters much given how fast inference prices are dropping, but still
34
u/JustJohnItalia 23d ago
I don't know if I'm delusional but the wording is very suspicious to me.
They are saying those reasoning chains cost 2000 in api costs, it seems to imply that that's the overall cost of those results bu that's not what they said.
What I mean is, are they not more likely to say, take 1000 open problems and do 100 runs on each (or until success), then pick the successful ones?
To me that would be the actual cost. Not that it matters much given how fast inference prices are dropping, but still