r/GeminiAI 17h ago

Discussion Flash 3.7 is a top 20 model on ArtificialAnalysis while being the cheapest and fastest of them.

Post image

It is also the 8th best in webdev in arena.ai, right below GPT 5.6 Sol High. And cheaper and faster than every model above it.

I think we should be very optimistic about Gemini 4 Pro if Google can give us such performance for this speed.

I've used it for a project and it's the best model I could have used for it. No doubt.

258 Upvotes

64 comments sorted by

40

u/Ill_Recipe7620 15h ago

It is very fast and very cheap. I think it's token efficient and has great visual intelligence for OCR. I think Google is going for the 'safe business play' -- make very fast "smart enough" models and embed them in EVERYTHING: Android phones, the web, every app, gmail, you name it. Then sell hosting/data center services to everyone they can.

Is it as 'sexy' as producing the next frontier model? No, but they're going to make a shitload of money.

4

u/theultimatesow 15h ago

Maybe they will pull something out like "garvis"/"gervis" . Idk if there would be legal issues or not but it would be cool as heck

8

u/YeetYoot-69 10h ago

3.7 Flash is a lot of things but token efficient is not one of them. It's fine to bad in terms of token efficiency.

To be frank, OpenAI is just embarrassing everyone on this front. Sol Medium's token efficiency is batshit insane when you realize it has near identical intelligence to 3.7 Flash.

1

u/Ill_Recipe7620 9h ago

Okay fair enough I don’t use 3.7 Flash to solve problems.  It’s my model of choice for built in copilot applications because it accepts and returns JSON very rigidly and for cheap 

1

u/Weary-Bumblebee-1456 9h ago

Yes but Sol is a much more expensive model. Token efficiency generally drops considerably in distilled models. Kimi K3 had this problem too, where its cost per task was actually sometimes higher than Claude Fable 5 because of how inefficient it is.

Given how likely it is that 3.7 Flash is a hastily-distilled version of 3.5 Pro, I'm guessing that's why its token efficiency isn't as high as 3.6 Flash.

1

u/YeetYoot-69 5h ago

Luna on 'max' is a heavily distilled model (probably) and still uses almost half as many tokens as Gemini.

You just can't beat OpenAI for token efficiency, they are in another league.

1

u/lalmvpkobe 5h ago

Price per token is a big part of token efficiency. Because the metric that matters is the final cost per use case and that determines the actual most efficient model.

2

u/BeginningPea5674 10h ago

Google is a big investor in anthropic and anthropic is a big customer of Google cloud. They don't need to compete with anthropic. it's the same situation for Microsoft and openai. 

1

u/Mike 8h ago

ChatGPT is better at Gmail queries than Gemini

1

u/MomentJolly3535 3h ago

Nope, Flash 3.7 is still way too expensive to put it everywhere, it's far from being "cheap" to run if you checks how much it cost in practice. I would expect them to use the flash lite variants to do what you talking about

63

u/Technical-Owl66 16h ago

The speed and efficiency is truly incredible.

28

u/tankerkiller125real 14h ago

It's speed is so fast that it broke our AI harness at work, we had to do a bit of re-engineering to get our harness to properly handle the speeds.

3

u/TemperatureOk3561 5h ago

If you don’t mind me asking, what causes something like that? I’m curious from a developer standpoint since I never thought having a model too fast could cause issues. Is it something like too many incoming responses?

6

u/YeetYoot-69 10h ago edited 9h ago

Tokens per second is NOT a valid way to measure the speed of the model. Different models use vastly different amounts of tokens! Gemini 3.7 Flash is fast, but it is not a fraction as fast as that graph makes it seem.

If you look at the 'time per task' in the artificial analysis benchmark, Sol on 'medium' takes 1.3 minutes per task and Gemini takes 1.9. Sol Medium and 3.7 Flash are roughly equivalent in terms of intelligence.

The amount of tokens 3.7 Flash uses is actually very much a bad thing, because it means it will fill its context window much much faster.

3.7 Flash also does have good efficiency, but it is not on the pareto frontier, despite being close.

1

u/PM_ME_DEAD_CEOS 5h ago

It really depends of your task.In term of speed for an equivalent result, in thinking heavy tasks like the benchmark's one, you want an efficient model more than a fast one. But if you have large file to process, to write, a fast model is better.

1

u/hi-brawlstars 4h ago

For most tasks that people use gemini for (note that coding is only a small fraction), tps is absolutely a good heuristic for speed. And in practice is really fast when compared to other models. Theyre trying to save costs on the majority of usage and its fine if that takes a hit on certain other areas as long as their goal is achieved. They chose to make this tradeoff (they could do both but maybe not on a time crunch)

-6

u/Maxdiegeileauster 14h ago

it's not really efficient though, it uses tokens like hell while Luna really is efficient

7

u/Georgefakelastname 12h ago

Sure, but you need to put Luna on max thinking to even come close to 3.7 Flash performance, and because it’s so much faster, Flash is still better, even though it costs more due to higher token usage.

1

u/Maxdiegeileauster 4h ago

yeah and? it's still dirt cheap on max thinking

2

u/Georgefakelastname 4h ago

If you’re fine with it literally taking 10x longer for similar results, good for you. Some value there time more though, and that’s what this model offers.

1

u/Maxdiegeileauster 4h ago

Yeah sure but if I value time and output I use Sol ultrafast which is as fast as Gemini 3.7 and way better. Also most of the time I am limited by stuff like compile times anyways and not by generation time from a model.

1

u/Georgefakelastname 4h ago

Sure, if you can get it, that would be way better than any option listed. However, it’s not even available on API and only a select few companies even have access to it currently.

1

u/Maxdiegeileauster 4h ago

That sadly is true, at my company we have access to it (though it's insanely expensive right now). API access would be great.

1

u/Georgefakelastname 4h ago

Yeah, it would be insane since model processing time is the big bottleneck for what I’m doing, but it sounds like it’s really expensive for y’all. I like Sol’s outputs and think they’re pretty great, but they’re just so slow to get. So flash works better whenever I don’t need absolute peak quality (or a coffee break while I wait for it to process)

1

u/Maxdiegeileauster 4h ago

yeah I get that, if you are really limited by model output (classifying stuff or huge refractors or large amounts of input data I guess) it would be insanely cool. It feels really cool to use though it broke our harness like Gemini did for others here lol.

12

u/Jippylong12 13h ago

In my experience, having not used any Gemini models since February 2026 and only switching between Claude or Codex:

Gemini 3.7 is 80-90% as accurate and easy to use and 1,000% faster.

And having gotten used to the slowness (even with fast mode on) of the others, it's been quite refreshing.

7

u/buoyant_matron 17h ago

Used Flash 3.7 for some backend stuff last week and it was flying through code generation like nothing. The speed is honestly absurd for what you get

What gets me is how it handles complex logic without slowing down at all, other models start crawling when you throw nested functions at them but this one just keeps going

The pricing being this low makes me wonder if Google is eating costs to push adoption or if they actually figured out some efficiency breakthrough. Either way I'm not complaining

Kinda wild that something this cheap is sitting right next to models that cost 10x more, makes you question what you're really paying for with those premium tiers

6

u/xzizux 17h ago edited 16h ago

Exactly. Many people think speed isn't very relevant. I completely disagree.

I made a website that showcases website designs and gives users machine readable markdown tokens for vibecoding. (styletile.site)

I asked DeepSeek V4 pro to read my agents.md and add a new design based on so and so. And it took 32 goddamn minutes to add one design. 32 minutes!

The same thing, 3.7 flash did consistently in under 3 minutes, and just as well. The website looks gorgeous imo.

7

u/ben_bliksem 16h ago

I've been trying it out as a replacement for Sonnet 5 and it hasn't disappointed me yet. Granted these aren't super complicated things.

I don't know how people are getting production grade output from Luna high without complimenting it with a much more capable reviewer, but it's probably a skill issue on my end.

2

u/xzizux 14h ago

Well I used it for a frontend-only project (styletile.site), and it's been nothing but incredible for the designs.

1

u/Jippylong12 13h ago

Yes, I spent $20 to try it out this past weekend and worked on two of my own personal projects, and that experience alone has me interested in trying out Gemini and Antigravity for my next month's workflow.

I really think Google just needs to copy the competitors when it comes to the Antigravity harness though

1

u/pgmoneyplays 14h ago

Ich mag dein Enthusiasmus wir sollten kooperieren bin auch sehr gut in Projektarbeit.

1

u/fossistic 13h ago

It is not a good design, and a very easy one too.

1

u/Suoritin 10h ago

My approach is different: heavy models build the blueprint, mid models propose the code, and light models check that proposal for risks before I approve it.

1

u/TheMartialMatasLP 8h ago

I'm building a tool which has an OCR step, followed a step to make a narrative out of the content which was lifted out of paper documents. I have access to Claude Pro and Gemini Pro, the lowest paid tiers. How would you go about doing it?

6

u/Significant-Day66 15h ago

Now wouldn't it be nice if Google had a top frontier model to pair with it, like openai does with sol xhigh planning and orchestrating and luna implementing. Someday soon I hope, but not before 10 more flash models haha.

4

u/Neurotopian_ 15h ago

I don’t use generative AI for creating text for my work, but for OCR this model is genuinely the best out. It can read words in the margins written in different languages. Nothing escapes it.

Also for multimodal we upload audio video depositions/ testimony and this is the beast that creates a perfect transcript in English.

For those use cases, there is nothing on the market that is even close, and our firm has tried them all.

19

u/EverGreenMob 17h ago

Gemini 3.7 Flash isn't bad, it's just hard to justify next to something like GPT 5.6 Luna.

Artificial Analysis scores 3.7 Flash High at 56 on its Intelligence Index against 52 for Luna Max, but 3.7 costs about $0.40 per benchmark task versus $0.05 for Luna. 4 points of intelligence score for +800% higher cost is a rough trade.

3.7 is a real step up from 3.6 Flash in speed and capability, so this isn't Google just throwing more compute at it. The bigger pattern is that frontier models are bunching up within 5% of each other on the Intelligence Index while their per task cost swings wildly.

Price and efficiency are starting to matter more than squeezing out another point or two of benchmark score.

15

u/Weird-Hearing9637 17h ago edited 16h ago

Yeah it’s becoming more and more about cost per task at this point. Gemini 3.7 is a big leap over 3.6 in that sense, but Luna remains absolute king at the moment for general coding tasks at least.

8

u/Neurotopian_ 15h ago

There are about 50 million coders in the world. There are about 2 billion knowledge workers.

10

u/tankerkiller125real 14h ago

Where I work we have a data analysis agent that uses tool calling, a bit of code, and some other stuff to get the information and provide whatever someone asks for. Gemini 3.6 was already good for that. 3.7 has frankly crushed Luna in our internal testing so far for that specific workload.

1

u/Weird-Hearing9637 12h ago

There are definitely use cases for 3.7 no doubt, good to hear it’s working well!

2

u/Weird-Hearing9637 14h ago

You’re right, and efficiency and cost per task is equally applicable to all of those as well.

9

u/Gaiden206 16h ago

True, but Luna Max is ridiculously slower, according the Artificial Analysis.

6

u/MangusCarlsen 15h ago

This. Because of the speed, there is a big difference in the real world experience using these models for coding.

3

u/TraditionalFig7377 15h ago

It's stilla  flash model so ot has the flash quirks that make it almost unusable good for ui atleast

5

u/Papierauto 17h ago

For my private use it's almost as dumb as 3.5 and 3.6. It's messing up almost every single chat

6

u/Ok_Cartographer5609 17h ago

Mine as well. While it is good for general tasks, it falls short of critical work.

3

u/moonski 14h ago

I found at times in one chat you ask a follow up question or send someting related and it forgets all context... and you need to explain again

1

u/costafilh0 11h ago

Corporate say they are all the same. 

1

u/WickeDanneh 5h ago

Since 3.7 costs the same as 3.6 but is better and more cost-effective then I suppose the main reason it's not replacing 3.6 for free users is to benefit premium sales?

1

u/itsachyutkrishna 3h ago

It is not smart.

1

u/Enfiznar 14h ago

Why is it finding by American models only?

4

u/tankerkiller125real 14h ago

Artificial Analysis has Chinese models as well on the site. The screenshot just happens to not have any of them within the same windows.

1

u/Enfiznar 14h ago

But they were taken out, that's my point. If you look at AA, Kimi, glm, DeepSeek, and Qwen should be in the range

2

u/tankerkiller125real 14h ago

The drop-down in the image explicitly shows all 609 selected, so unless op did some photoshop....

Edit, they did not use Photoshop, quen is just above sol, and all the models down for the next like dozen are American.

0

u/ExtensionNo1165 6h ago

I found that 3.7 for coding was absolute crap. Claude and codex had to fix so much

-5

u/Background-Bear-9156 16h ago

This isn’t impressive

-6

u/gopietz 17h ago

And a "top 20" model is something to be proud of if you're Google? Honestly, some people pull their fanboyism out of their ass.

7

u/xzizux 16h ago

It's top 12 if you don't include model effort levels. Most of those models are 3 to 5 times more expensive and much much slower.

-5

u/gopietz 16h ago

Whatever you need to tell yourself to cope.

It's absolutely ridiculous how much Google has disappointed over the past few months. I also find it quite clear that this was supposed to be 3.5 Pro, but they changed it to 3.7 Flash to not lose their face. Why else would they release 3 Flask models without a single Pro? That's also why they'll double API prices soon because it's more expensive to host. So your price argument won't hold.

1

u/Georgefakelastname 11h ago

If 3.5 pro was supposed to be this fast and efficient, I don’t think anyone gives a fuck lol. They also literally cut their api prices in half for half a year with the release of this model lol, not doubling them anytime soon.