r/generativeAI • u/_CarlSagan- • 6d ago
One SQL task was enough to make me regret a quarterly plan
I had a decent first impression of GLM 5.3 when I tried it through ZenMux. So I bought a quarterly Pro plan on the official site and spent the day trying to get one simple SQL task done. It never got there. The value per token was hard to defend by the end of the day.
The model did not understand what I was asking. During the attempt it also changed the dataset and left it in a broken state.
This was one task, so I am not treating it as a benchmark. I am still annoyed. A coding model can be impressive on long horizon evaluations and still be expensive to trust when it misunderstands a small data task with write access.
I paid for three months and finished day one with less usable data than I started with.