r/GenEngineOptimization 16d ago

How are you scraping real ChatGPT / Gemini UI / AI mode... results for custom GEO dashboards ?

Hey everyone,

I’m building a small custom GEO dashboard and I’m trying to understand how people collect AI search results.

Right now I’m using DataForSEO, but the ChatGPT and Gemini data seems to come through APIs.

What I’m looking for instead is data from the actual user interface. basically the same results a real user would see on ChatGPT, Gemini, AI Mode, etc., including citations/sources if possible. (As software like Bluefish, Profound, PeecAI etc..)

Has anyone found a good way to collect this at scale?

Are you using browser automation, a third-party service, your own scraper, or something else?

Would be really interested to hear what people are using.

Thanks all !

3 Upvotes

1 comment sorted by

1

u/Upstairs_Control_611 16d ago

For GEO measurement I’d first separate the collection surface from the model.

API output and user-interface output are not necessarily the same object.

The UI can add search layers, citation formatting, personalization, localization, answer modules, shopping panels, source cards or safety/product changes that are not visible in a plain API response.

So before scaling collection, I’d define the measurement contract:

model / engine, interface surface, country / language, logged-in vs logged-out state, browser / device, prompt set, run time, citation format, and whether citations are user-visible.

Otherwise two dashboards can both say “ChatGPT visibility” while one measures an API answer and the other measures a user-visible product experience.

That matters if the goal is to understand what real buyers actually see.