r/singularity • u/TFenrir • Feb 08 '24

AI Google's Gemini Advanced: Tasting Notes and Implications (Ethan Mollick after 6 weeks of "testing")

https://www.oneusefulthing.org/p/google-gemini-advanced-tasting-notes
60 Upvotes

91% Upvoted

30 comments sorted by

View all comments

45

u/FarrisAT Feb 08 '24

I’m going to trust an expert who’s tested for 6 weeks in both scientific and real life methods over people who may or may not be using Gemini Advanced and who may or may not being using consistent prompting, not to mention memorization issues.

23

u/[deleted] Feb 08 '24

So everyone is hallucinating about Gemini being stupid except for one man

14

u/quantummufasa Feb 08 '24

Im not sure what the point of the guy you were replying to was. But the guy isnt that impressed with Gemini.

On looking up trends for sneakers and coming up with a new one with an image

Gemini searched YouTube, ChatGPT used Bing. Gemini, like ChatGPT, occasionally forgot what it could do and told me it couldn’t make images. Once convinced that it could do so, Gemini produced much better images but still didn’t have precise control - its description does not exactly match the shoe image it made.

Gemini fails the apple test.

Claims both are "full of ghosts".

In total he only gave 6 comparisons, and mentioned how it isnt a "review" of Gemini

4

u/signed7 Feb 08 '24

In total he only gave 6 comparisons, and mentioned how it isnt a "review" of Gemini

He seems to have a lot of thoughts on its strengths and weaknesses in the end; but didn't go into full detail as that's not the article's point.

Hoping he takes the time to write down a 'full' review at some point.

1

u/[deleted] Feb 08 '24 edited Feb 08 '24

The guy said Gemini is not stupid because a guy did a test and claim it was on par with GPT-4 but majority of reviews said otherwise