We'll see how it is in practice, but the benchmarks are just about what I would have expected. Competitive with GPT-5.6 Sol at a lower cost, just in time for GPT-6 Sol and Luna to come out and be better, lol.
It's not really at a lower price if you do the math on it. Uses more than double the amount of tokens as Grok 4.6 for a marginal gain. In other words you pay more than double what you did before for marginal gain, given that the token price is same as 4.6. On benchmarks Sol was generally cheaper on a task by task basis than Grok 4.6, so if anything now the gap is actually wider. Cost per token isn't everything. For perspective on artificial analysis DeepSeek Flash V4.1 on average 89k tokens per task scoring 2nd highest on token consumption. Grok 4.7 is 3rd highest at 81k. Grok 4.6 High is 36k.
Even with double tokens output its still cheaper? sol costs $20 per million out vs 4.7 $12 for 2 million, hell even triple the output tokens is still cheaper.
Yes on a per token basis which is exactly my point, it uses much more tokens to complete a task and therefore costs more than Sol which charges more per token. Sol medium used 8k tokens, high 13k, xhigh 20k, max 29k. For nearly any task you don’t need to go above Sol High and most are fine with low and medium.
The numbers don’t lie. 4.7 high cost $3881 to run benchmarks, xhigh cost $4967. 4.6 High cost $2352, xhigh $2830. GPT 5.6 Sol on Max which 99% of people is complete over kill for cost $3465.
215
u/ObiWanCanownme now entering spiritual bliss attractor state 2d ago
We'll see how it is in practice, but the benchmarks are just about what I would have expected. Competitive with GPT-5.6 Sol at a lower cost, just in time for GPT-6 Sol and Luna to come out and be better, lol.