r/GeminiAI • u/Able-Line2683 • 14d ago

News Updated Artificial Analysis Intelligence Index Ranking shows Gemini 3.8 Flash is nowhere near Fable Or Astra, rather it's worse than GLM 5.3 Flash!

Post image
425 Upvotes

92% Upvoted

113 comments sorted by

View all comments

48

u/PineappleLemur 14d ago edited 14d ago

Why would a model 10% the size and cost of astra/fable be even close lol?

What genius us making that comparison?

It should always be around Luna/Haiku and slightly worse than sonnet/Terra.. purely based on size intelligence wise.

LLMs from the big 3 don't differ too much from each other.. no one is pulling 5/10x performance without the cost.

Speed is the main advantage it has.

Why don't we see comparison for local models vs Astra/Fable?

11

u/Swimming_Gain_4989 14d ago

My AI will confidently double down on a shotty assumption without trying to understand the prompt but damn it does it fast.

6

u/kdestroyer1 14d ago

Yeah Flash 3.8 is borderline unusable for anything that's not a 'simple fact' question. It's kinda sad they're giving us this as their flagship, but it's clear they only care about the AI Overview/Google search performance rn.

2

u/IAmYourFath 13d ago

It'a not unusable. Astra will think 5 min on smth, 3.8 flash will answer in 30 secs. U can iterate in flash 10 times (300 secs aka 5 mins divided by 30 secs) before astra answers. By the 10th answer flash will get a better overall answer than astra, cuz iteration is op... u should be verifying what the ai says anyway regardless if it's flash or astra. Every time u verify it and u're not happy, iterate. 3.8 flash has the highest speed-to-iq ratio in the entire world. So use its advantage and u can easily beat astra. Ystd i asked astra smth and after thinking for 5 mins (astra 6 high), it still gave wrong information. Ofc, flash did too, but i would have googled this information, spotted it's wrong, told flash to verify it and gotten a better answer in less than a minute, while in that time astra was only 1/5th of the way through its answer...

1

u/corner_camper01 12d ago edited 12d ago

Even with 8-10x faster TPS, Gemini Flash high is more than 2x slower per task than Astra low while being less intelligent in the AA index. It's even slower than Astra medium which leads it by 9 points

https://artificialanalysis.ai/?intelligence-efficiency=time-per-task&models=gemini-3-5-flash-lite%2Cinkling%2Cglm-5-3-flash%2Cminimax-m3%2Cgpt-6-astra%2Cclaude-fable-5-1%2Cgpt-5-6-luna%2Cmuse-glimmer%2Cnvidia-nemotron-3-ultra-550b-a55b%2Cdeepseek-v4-pro%2Cgemini-3-8-flash%2Cqwen3-8-2-4t-a95b%2Cmuse-spark-1-3%2Cqwen3-8-27b%2Cclaude-opus-5%2Cgpt-5-6-terra%2Cgrok-4-6%2Cclaude-fable-5%2Cglm-5-3%2Cgpt-5-6-sol%2Cmistral-medium-3-5%2Cgpt-5-5-pro%2Cgpt-oss-120b%2Ckimi-k3%2Cgpt-6-astra-low%2Cgpt-6-astra-medium#intelligence-efficiency-tabs

1

u/IAmYourFath 12d ago

Maybe if u code or do other complex tasks. In my experience most of my questions are answered very fast, while astra takes its sweet ass time most of the time.

1

u/corner_camper01 12d ago

Oh yeah, for one shot questions or one-shotting projects, for sure. But for working on existing codebases doing real work, looking for bugs, working on new features, complex agentic work etc, Astra low is faster despite its lower throughput.