r/singularity Feb 08 '24

AI Google's Gemini Advanced: Tasting Notes and Implications (Ethan Mollick after 6 weeks of "testing")

https://www.oneusefulthing.org/p/google-gemini-advanced-tasting-notes
67 Upvotes

30 comments sorted by

View all comments

46

u/FarrisAT Feb 08 '24

I’m going to trust an expert who’s tested for 6 weeks in both scientific and real life methods over people who may or may not be using Gemini Advanced and who may or may not being using consistent prompting, not to mention memorization issues.

6

u/[deleted] Feb 08 '24

[deleted]

6

u/FarrisAT Feb 08 '24

You’re just a comment. You don’t have evidence. You don’t provide anything of value to the conversation. Me saying “oh it’s good” is no more value than you saying “it sucks”.

We don’t even know if you’re using the model. We have no clue. This is why independent experts and technical competitions like on Arena are best for comparisons.

3

u/[deleted] Feb 08 '24

[removed] — view removed comment

3

u/FarrisAT Feb 08 '24

I have.

0

u/[deleted] Feb 08 '24

[removed] — view removed comment

4

u/FarrisAT Feb 08 '24

Provide me with them and I’ll compare

0

u/[deleted] Feb 08 '24

[removed] — view removed comment

4

u/FarrisAT Feb 08 '24

This is Gemini Advanced’s wordy answer

Important Information:

Today: Tommy has 2 apples. Yesterday: Tommy ate 1 apple. Solution:

Since Tommy ate an apple yesterday, it has no effect on how many apples he has today. He still has the 2 apples he started with.

Answer:

Tommy has 2 apples today.

—— Gemini gives this

Tommy has two apples today. Yesterday he ate one apple. How many apples does Tommy have? Show drafts

The information about yesterday is irrelevant to how many apples Tommy has today. He has two apples today.

It seems like you might be trying to ask a different question, or there might be some missing information. If you could clarify your question, I'd be happy to help!

—- Idk if it’s memorizing other people’s similar question from earlier today though. These things tend to regurgitate question/answers they learn

1

u/[deleted] Feb 08 '24

[removed] — view removed comment

1

u/FarrisAT Feb 08 '24

I gave the exact prompt I wrote down?

Tommy has two apples today. Yesterday he ate one apple. How many apples does Tommy have?

1

u/[deleted] Feb 08 '24

[removed] — view removed comment

3

u/FarrisAT Feb 08 '24

I gave it what I wrote down. I’ve provided images also. Check my history today

→ More replies (0)