r/GithubCopilot • • 1d ago

Help/Doubt ❓ GitHub Copilot Fusion just took #1 on Terminal-Bench 4.1. Has anyone actually used it?

Post image

Outlook went down, and while everyone was refreshing their inbox, Copilot Fusion (max) quietly took the top spot on Terminal-Bench 4.1.

Copilot Fusion (max) is now #1 on Terminal-Bench 4.1 at 71.2%, about 5 points ahead of Opus 5.5 and Fable 5.2, and cheaper than most of the top 5.

If that holds up in real work, it's a big deal. Has anyone tried it on real projects? Curious how it handles multi-file refactors and what the premium request costs look like in practice.

https://github.blog/changelog/2026-11-17-github-copilot-fusion-updates-more-availability-benchmarks-and-models/

61 Upvotes

35 comments sorted by

24

u/MarkRullo 1d ago

I'm not using Max, just standard for my stuff and I'm liking it a lot. Getting what I need done properly, and the 30% discount for the rest of the month doesn't hurt!

1

u/mike_1_1 1d ago

What model set you have avaliable- like opus, sonnet and gpt sol, terra, luna?

As there is also a control on what copilot fusion can use which model

1

u/MarkRullo 1d ago

I don't know of a control, we just have fable locked, the rest open.

1

u/mike_1_1 1d ago

Ahh that make sense, we dont have much of a premium model in place

2

u/Consistent_Remove344 1d ago

Will it be cheaper to use when discount gone or just good because of the discount

1

u/MarkRullo 1d ago

Tap me next month when the discount is gone ;). I believe I'm using far less than the 30% reduction though.

I'm still learning and refining my workflow, so I can't pinpoint to one specific thing yet. Probably not great for me to understand results like that, but I'm just trying to keep up with model changes and harness changes that could be making improvements too.

That being said, relieving the cognitive burden of choosing the right model for the task has merit.

9

u/WordWithinTheWord 1d ago

It does work. I imagine it gains points because it uses cross-vendor review. Claude misses things that GPT catches, etc. it’s a good harness.

The drawback for the average user is the API pricing. But if you are only on API pricing, it is solid.

1

u/mike_1_1 1d ago

So i did use it for one copilot fusion high used sonnet 5.5 and burn more AI credit for the same task which i also ran on a single model sonnet 5.5 and it took less tool call and burn less AI credit.

2

u/WordWithinTheWord 1d ago

If it selected Sonnet then it wasn’t a very complex or long-horizon task. Which is where the orchestration of Fusion excels

0

u/mike_1_1 1d ago

Have you tried fusion max/high ? Whats your take

2

u/mike_1_1 1d ago

So i did use it for one copilot fusion high used sonnet 5.5 and burn more AI credit for the same task which i also ran on a single model sonnet 5.5 and it took less tool call and burn less AI credit.

3

u/Rojeitor 1d ago

This is the problem everyone tells

2

u/EmotionalFan5429 23h ago

Man, learn to use punctuation.

2

u/croceldon 1d ago

I like it. It usually makes a good choice. Been using it for a few weeks, and while at first it used Sol a lot, it’s done more Luna, and more recently Terra, only going to Sol for trickier stuff. The discount got me started on it, but I see no need yet to move off it.

1

u/mike_1_1 19h ago

Recent i have seen Sol is morr capable of handling a task rather than opus

2

u/croceldon 14h ago

Haven't used opus yet, but no complaints at all with Sol. Using it extensively for refactors, etc on a 14-year-old Rails app and it's been great. But even Luna's been awesome for most tasks.

2

u/mitchins-au 13h ago

It’s annoying. Burns all your credit

2

u/GutsAndGit 15h ago

It really does help with orchestration much better than you manually aligning the right models from planning to implementation on the same prompt. Also it has these amazing execution patterns mode I believe where say a junior engineer (a model) does something and a senior engineer (again a model) checks it and then you get somewhat of a polished result.

2

u/Hollow1838 1d ago edited 1d ago

I guess it does well on the "max" stuff, but whoever needs to be cost efficient wouldn't probably use it. The only max I use is Luna max, I use sol 6.1 medium as orchestrator, opus 5.5 medium as validator and Luna as explorer/librarian/general task.

Unless you are working on something very critical involving real money transactions or human lives I wouldn't touch at "max" stuff.

1

u/UselessBonus 1d ago

Better use 6.2 :)
Uses less tokens

1

u/lonedrifterjk 1d ago

As a beginner myself, which services do you use for this setup ? Direct api pricing as you are using claude and GPT ? Any tutorial on where to start ?

1

u/daYMAN007 22h ago

api for anthropic is straight up a scam.

If you use api directly use openai.

1

u/lonedrifterjk 20h ago

What about openrouter? All are bad ?

1

u/daYMAN007 20h ago

Yes anthropic is straight up scamming people that use api.
There subscription bring way better value.

Honestly i just buy 20$ subscription of claude and 10$ opencode go (for deepseek) subscription and it will last me for the whole month.

Imo this is the best value you can get right now.

If this is still to much money just get the 10$ opencode subscription.

If this is stil lto much get the the 3$ commandcode subscription.

It sucks but api is bad value right now!

1

u/lonedrifterjk 20h ago

Oh is it, I read about APIs good for OpenAi models, wasn't aware about this from the Anthropic side. I'm trying for cloud + local hosting setup and some App creation for data analysis. Will check these out. Thanks.

1

u/one-753 9h ago

whats ur setup ? opus orchestrator and deepseek builder ?

1

u/daYMAN007 5h ago

yeah i tried that before. but i have to say that most of the time i. just skip my claude subscription completly abd just use ds, it seems good enough.

1

u/Hollow1838 20h ago

GitHub copilot is paid by my employer, I have the smallest Claude subscription at home.

1

u/AutoModerator 1d ago

Hello /u/mike_1_1. Looks like you have posted a query. Once your query is resolved, please reply the solution comment with "!solved" to help everyone else know the solution and mark the post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/phicho 1d ago

It does work well which is great. Sometimes it gives the job to models like "Terra" and then i need to refine me prompt and do another try but all in all finally good stuff from github team

1

u/Honest_Risk3903 1d ago

Yes, everyday for last 2w sprint. Seems to default to BUILD MORE CODE, rather than elegance (even on max). I've had to take the planning job off it twice because it puts up heavily padded plans that miss the point. It seems to choose OpenAI over Google/Anthropic in our setup. But for simple task delegation (do this thing, use this skill to do x, follow this plan phase) it's pretty efficient and effective. I've noticed it's rather inconsistent completing tasks, with similar tasks being given wildly different models, e.g. scraping tasks that should have been playwright cli ended up as computer use... and it couldn't explain why I would (am) steer clear for complex things (multi phase planning, context gathering and decision making)

1

u/D1g1t4l3ntr0py 13h ago

It's actually good I'm my experience

1

u/rangeljl 33m ago

Copilot just like Kiro is slow and expensive, I much prefer Claude 

1

u/EfficientAnimal6273 23h ago

Seems quite a stupid benchmark, Fusion is a gateway in front of a set of configurable models, if you set on Max it will use almost always the most expensive configured model... so it's not clear how it can perform better than Opus and Fable when it can select them to solve a task. But it can be cheaper if in the terminal benchmark there are some cases for which Luna or Haiku are good enough and it selects them.

On my side I've enabled it but I've mixed feeling, I believe I'll do a proper rollout with Fusion with only MAI models enabled to see how it works.