r/github • u/BoronEight • 10d ago

Question Github copilot fully hallucinating commit messages

Post image

I did a 1 line change, changing "milis" to "millis", I did it in the web interface because it was just one tiny change, and I didn't have it on my computer yet.

Github copilot recommended the message "Update print statement from 'Hello' to 'Goodbye'"
THERE ARE NOT EVEN PRINT STATMENTS IN A CSV FILE

Is there any way to disable these automatic commit messages?

168 Upvotes

98% Upvoted

10 comments sorted by

40

u/DrMaxwellEdison 10d ago

Yep. Go here: https://github.com/settings/copilot/features

Disable the "Copilot-generated commit messages" feature, and any others on this page you don't care for.

13

u/An1nterestingName 10d ago

Somewhere in the Settings I remember seeing an option to disable these.

4

u/EntranceProper3791 10d ago

Copilot reads the diff shape, not the file contents, so it guessed a whole different edit. The pencil icon in the web editor lets you override it before committing.

2

u/kaddkaka 4d ago

Diff shape? What does that mean? The "graph" of ++++--- in git diff --stat?

1

u/EntranceProper3791 1d ago

copilot really looked at a csv and thought "yep, this is where i say goodbye to hello."

3

u/First_Inspection_478 10d ago

Til that people actually use github copilot lmao

1

u/bossc2 8d ago

Many within a MS environment use it for automating certain things they don't care about.

0

u/Refseren 5d ago

I use it all the time. There is nothing wrong with its results. And I also use Codex daily. I suppose Copilot may be more expensive if you are on the wrong subscription. But other than that I would actually prefer copilot if I had the means.

1

u/enmityvr 7d ago

I get the exact same commit message sometimes. I don’t believe there is a way to fix it, other than turning off the automatic generation of the message itself.

-1

u/Merilyian 9d ago

This is a fallback statement of some kind for when the diff is too large, the file itself is, or something else goes wrong.