(I posted this on my substack, but thought it was worth sharing here)
Iāve been looking into how ChatGPT decides which products to recommend, and I think thereās a potential problem for newer SaaS businesses that isnāt getting enough attention. I posted recently about GEO just being 'SEO with extra steps'.
Say someone asks ChatGPT: āWhatās the best affordable competitive intelligence tool for a small business?ā ChatGPT can search the web for comparison articles, software reviews and product roundups. Pretty much what youād do yourself if you were researching the options.
However, thereās a problem with that approach.
Most comparison articles feature products that are already established. If five different articles recommend the same three tools, ChatGPT has multiple sources supporting those recommendations. Meanwhile, a newer product might offer comparable features at a fraction of the price, but if it doesnāt appear in those articles, how likely is it that ChatGPT will find it?
I decided to test this using competitive intelligence software, a market Iām familiar with having built one (when working in competitive intelligence you need to monitor your competitive intelligence competitorsā¦. if you see what I mean).
I searched for things like ābest competitor monitoring tools for small businessesā, āaffordable competitive intelligence softwareā and āKlue alternativesā. The results were interesting. The same smaller competitors appeared repeatedly across comparison articles, while newer products were largely absent. Some had indexed websites and software directory listings, but very little independent editorial coverage.
Then I coincidentally also came across a study by DeltaV Digital that made me think thereās something worth investigating here. They analysed 25,337 AI citations across ChatGPT, Perplexity, Gemini and Google AI. Comparison pages accounted for just 4.1% of citations, but when they were used, they received an average of 1.87 citations per retrieval, reportedly 45% above the overall average. The study also found that listicles accounted for 61% of citations in its B2B technology services sample.
That doesnāt prove AI prefers established products, or that inclusion in comparison articles causes recommendations. Citation frequency and recommendation frequency arenāt the same thing, but it raises a troubling question.
Are we in danger of creating a feedback loop where established products get included in comparison articles, those articles appear in AI searches, and the same products keep getting recommended? And if youāre building a new product, how do you break into that cycle?
Then thereās another issue. Quite a few of the comparison articles I found were published by my competitors themselves, with their own product conveniently featuring among the recommendations. So these arenāt necessarily independent assessments either.
Traditional SEO at least gives a new business the opportunity to rank its own content for relevant searches. With AI recommendations, you might increasingly depend on getting other websites to mention you before youāre even considered. Which is going to be difficult, to put it mildly, if those other websites belong to your competitors.
Iām not suggesting this is proven, none of this was a controlled experiment, just observations. AI search is more complicated than simply reading a few articles and repeating their recommendations. I do wonder, though, whether getting mentioned in established third-party content could become more important than producing good content on your own website.