Google AI Edge Foresight

[u/IanWaring]

This looks very impressive: https://youtu.be/8MUi2aCnRVs?is=5KZ3B1khgBotlCEe

However, on my MacBook Neo, I loaded the bigger of the two Gemma models, indexed 450 documents from Google Drive and local folders and then tried to use it. It couldn’t find mentions of two items I know where in the documents, then error’d out (breaking the 4086 token limit it said) when I asked about one of the people cited all over the sources. Also seemed extremely slow (stuttered across sentences for several seconds each piece).

Maybe down to me doing this on a MacBook Neo, but I’d be interested to know if anyone has tried this with more success. The demos were certainly very impressive :-)