Answer Engine Optimization: Separating Hype from Reality

With the rise of large language models (LLMs) like ChatGPT, we've moved beyond traditional search engines to what some are dubbing 'answer engines.' These platforms are now sending noticeable referral traffic to various online domains. As a result, a trend similar to search engine optimization is emerging, aptly named Answer Engine Optimization (AEO).

The AEO Hype

Public success stories of AEO often boast impressive growth figures. However, if you've ever trained a model, you know that raw growth numbers can be misleading. A recent field study focused on a high-traffic domain, glasp.co, dug into this issue. They tested AEO interventions on a huge corpus of YouTube Q&A pages in January 2026.

Here's the thing. The test split the site into treated and untreated sections. This allowed researchers to control for natural platform growth, a key factor often ignored in those shiny success stories. It turns out, while ChatGPT referrals on treated pages grew 5.7 times, untreated pages still saw a 3.5 times increase, purely from the platform's own growth momentum.

Dissecting the Data

Using first-party analytics over third-party estimators, the study discovered that AEO interventions led to a 1.82 times increase in treated pages compared to controls. Yet, a conservative placebo test suggested the effect wasn't entirely conclusive due to a short, noisy pre-period.

Think of it this way: the real impact of AEO might be more modest than those large multiples suggest. The team also found that Google's organic clicks to treated pages didn't drop, which aligns with existing SEO practices. But are these interventions really worth the hype?

Why This Matters

Here's why this matters for everyone, not just researchers. This study's methodological approach, separating treatment from platform growth, is essential. It suggests that the headline grabbing AEO results might be overstating the causal effects. If you're banking on AEO as your next big move, it might be time to recalibrate expectations.

So, what's the takeaway? In the race to optimize for LLMs' answer engines, companies must tread carefully. Will AEO become the new SEO, or are we chasing a chimera?, but for now, it's wise to scrutinize those big growth claims.