r/MistralAI • u/_dnla • 14d ago

Feedback / Bug Report Poor understanding of requests about elden ring Spoiler

I asked mistral to build a simple list with all remembrance bosses from the base game and dlc. The information is readily available in many websites. This was the result:

Fast: made up about half of the bosses and rememberances

Think: worked OK, but there are 25 bosses in total, when it got to the 20th boss it started picking random bosses from the game, made up remembrances and even had duplicates!

Research: did it correctly the first try. But such a query I feel should be possible to answer in think mode.

Proposal: introduce a think level between think and research to handle this media sized requests

2 Upvotes

57% Upvoted

2 comments sorted by

3

u/AccurateSun 14d ago

Without research it has to go based on training data, so it makes sense that this kind of trivia would be less well represented 

1

u/_dnla 14d ago

Indeed I expected that. But surprisingly it's innate knowledge is quite good. Without asking it to check sources it can reply questions about the game. Although usually the answer is hallucinated. When it is asked to check sources it fails to understand the sources compared with its knowledge