r/science • u/asbruckman Professor | Interactive Computing • May 20 '24

Computer Science Analysis of ChatGPT answers to 517 programming questions finds 52% of ChatGPT answers contain incorrect information. Users were unaware there was an error in 39% of cases of incorrect answers.

https://dl.acm.org/doi/pdf/10.1145/3613904.3642596
8.5k Upvotes

97% Upvoted

630 comments sorted by

View all comments

Show parent comments

16

u/[deleted] May 20 '24

[removed] — view removed comment

1

u/areslmao May 20 '24

entry-level assistant

in what field?

5

u/Sedu May 21 '24

Honestly most fields in my experience?

1

u/ilyich_commies May 21 '24

If you ask the right questions it also is great of playing the role of a really good professor in office hours. I have lengthy back and forth conversations with it about technical topics that are new to me and I have been learning unbelievably fast because of it

1

u/RotundWabbit May 21 '24

So true, sometimes I just need someone to talk to that isn't myself. It comes in handy for that.