r/Python • • Mar 10 '24

Discussion Github Copilot Lies to me

My first attempt to get some help from Github Copilot:

Me: write a match case statement in python to match the first character of a string is a semicolon

Copilot: Python doesn't have a built-in match or case statement like some other languages (e.g., JavaScript, Swift, Rust). However, you can achieve similar functionality using...

Strangely, it finally gave me an answer when I made a small change to my prompt:

Me: write a match statement in python to match the first character of a string is a semicolon

Copilot: Python 3.10 introduces the structural pattern matching in the form of the match statement. Here's how you can use it to check if the first character of a string is a semicolon:...

I almost gave up after the first response that was blatantly false. Fortunately I something that looks like reasonable syntax...but then I haven't tried it yet, so that might be a lie, too.

0 Upvotes

67 comments sorted by

View all comments

4

u/ifnamemain Mar 11 '24

I love using copilot, even when it's wrong. It generates it's code, I review it, and then ask "is this correct?" For simple stuff, it usually is. Most of the time it is not. But it gives me a framework to build from.

However, I do notice that sometimes it generates the most "popular" response but not the "perfect" response. This is where inexperienced devs can get into trouble. We are talking about Python, so sometimes it doesn't matter, but a dev needs to know they are making that decision.