On this page
- What it is
- SEO here covers three layers at once: classic SEO, semantic SEO and Supervised Search.
- The problem until now
- Ranking was treated as the finish line, so a page could hold position one and still be missing from the answers people read.
- What you can do from here
- You can see which layer your work sits in, and what to change so a page is found, used and named.
Contents 19
For twenty-five years, search engine optimization meant adjusting a page until a ranking system preferred it. Answer systems now read the page, answer on its behalf and send fewer people onward. The discipline moves with them.
Try this first
Three tests, about ten minutes. They show which of the three layers your pages are built for.
Tests on this page you have run: 0 of 3. The count stays in this browser only.
Test: SEO
- Search your main term on Google with Tools and Verbatim.
- Search the same need again as a full question in your own words.
- Think: does your page hold up in both searches?
Whether your page works for words and for meaning.
Test
- Search a question your page answers and read the answer on the result page itself.
- Note what you got, before you open anything else.
- Think: was your page needed for that answer?
Whether a ranking still produces a visit.
Test
- Open your three most important pages and write down the one fact each adds.
- Put them aside.
- Think: could a reader get that fact anywhere else?
What makes a page worth keeping.
Subjects under search engine optimization
The disciplines that grew out of SEO
What is the difference between user intent and search intent?
User intent is person-based. It is the whole field of thoughts, questions and wishes someone carries at the kitchen table, in the car on the way to work, in a waiting room or awake at night. Search intent is query-based. It is the small part of that field which reaches a search box, read by a search engine as a class such as informational, navigational or transactional.
The two form no yes-or-no pair. Search intent sits inside user intent, and user intent reaches far beyond it. A person wants to get rid of a headache and types headache tablet. The search intent is the tablet. The user intent is the end of the headache. She does not like pills and would prefer acupressure, and she does not yet know that acupressure exists.
Search engines read search intent from the SERP consensus, from what already ranks and from what people clicked on it. Clicks follow position, so each reading tends to confirm the result page it came from. Over decades, search intent has built a confirmation bias into the result page. Andrei Broder, who introduced the navigational, informational and transactional classes in 2002, called inferring the user intent from the query “at best an inexact science, but usually a wild guess”.
A page that answers the user intent also carries the search intent inside it. Whoever sells a book or a course on acupressure has to treat headache tablets too, with their advantages and disadvantages, and explain how headaches occur and why faster alternatives to the tablet often exist.

If the query revealed what a person wants, asking the person and reading the query would give the same shares. Reading the query put informational searches at 48 %. Asking people gave an estimated 39 %.
| Web searches | Asked from the searchers | Read from the queries |
|---|---|---|
| Navigational | 24.5 % | 20 % |
| Informational | estimated 39 % | 48 % |
| Transactional | more than 22 %, estimated 36 % | 30 % |
Andrei Broder, A taxonomy of web search, SIGIR Forum 36 (2), 2002. Survey of AltaVista users with 3,190 valid returns, and a reading of 400 logged queries, whose figures Broder himself calls very soft.
What did Classic SEO reward?
Classic SEO worked on a machine that counted words and links. Google itself started from links: in April 1998, Sergey Brin and Lawrence Page presented a search engine built on the link structure of the web, with PageRank as a measure of a page's citation importance.
The practices of that era followed from it. Keywords went into the title, the meta description, the headings and the first paragraph, often at a fixed density. Links were collected from directories, article sites and link exchanges, with anchor texts that repeated the keyword. Exact-match domains, doorway pages, hidden text and paid link networks were the black-hat end of the same logic.
The technical craft came with it: crawlable HTML, robots.txt, clean redirects and XML sitemaps. Google launched Google Sitemaps in June 2005, and Yahoo! and Microsoft joined the shared protocol in November 2006.
How did Google close the classic playbook?
Step by step, and in public. In January 2005, Google introduced rel="nofollow" so that links carrying it receive no ranking credit. In September 2009 it stated that its ranking does not use the keywords meta tag. The update against low-quality sites in February 2011 and the update against webspam in April 2012 took the ground from content farms and bought links.
What remains of Classic SEO is the technical floor. A page has to be crawlable, indexable, fast, usable on a phone and served over HTTPS. Google renamed its Webmaster Guidelines to Search Essentials in October 2022 and completed the move to mobile-first indexing in October 2023. The floor is required, and it wins nothing on its own.
If ranking had kept rewarding the classic playbook, Google's changes would have touched a few queries at the edge. One update alone noticeably changed 11.8 % of queries in the United States.
| Google ranking change | Announced | Queries affected at launch |
|---|---|---|
| Site speed as a ranking signal | April 2010 | fewer than 1 % |
| Update against low-quality sites, later called Panda | February 2011 | 11.8 % of US queries |
| Update against webspam, later called Penguin | April 2012 | about 3.1 % of English queries |
| HTTPS as a ranking signal | August 2014 | fewer than 1 % of global queries |
| BERT in ranking and featured snippets | October 2019 | one in 10 US English searches |
| Passage understanding in ranking | October 2020 | 7 % of queries in all languages |
Google Search Central Blog and Google, The Keyword: announcements of 9 April 2010, 24 February 2011, 24 April 2012, 7 August 2014, 25 October 2019 and 15 October 2020.
What is Semantic SEO?
Semantic SEO works on meaning, and meaning is carried by words. Search systems added models of things to the matching of words. In May 2012, Google introduced the Knowledge Graph with more than 500 million objects and more than 3.5 billion facts about them. Hummingbird followed in August 2013, RankBrain in 2015 as the first deep learning system in Search, neural matching in 2018, BERT in October 2019, passage understanding in October 2020 and MUM in May 2021.
Structured data gave pages a shared vocabulary for the same things. Google introduced Rich Snippets in May 2009, and Google, Bing and Yahoo! launched schema.org in June 2011.
Does Semantic SEO leave the lexical level behind?
No. The lexical level is where the knowledge of a field lives. Studies and books carry it as words: the terms a discipline has agreed on, its definitions, its names and the exact phrasing of its findings. A search system can only model the meaning of a subject from the words in which that subject has been written down.
Retrieval research still measures meaning-based search against keyword matching. In the study that introduced dense passage retrieval, keyword matching with BM25 already placed a passage containing the answer among the first 20 results for 59.1 % of Natural Questions and 66.9 % of TriviaQA questions, and the meaning-based model raised these shares to 78.4 % and 79.4 % (Vladimir Karpukhin and colleagues, EMNLP 2020).
Semantic SEO therefore works on both levels at once: the exact vocabulary of a field, taken from its studies and books, and the meaning that vocabulary builds.
What did Semantic SEO change in practice?
The entity and the topic joined the word as units of work. A page is expected to name the things it is about, relate them correctly and answer the questions that belong to them.
Quality became a written standard. In December 2022, Google added Experience to E-A-T in its search quality rater guidelines, which made it E-E-A-T. The helpful content system from August 2022 became part of the core ranking systems in March 2024, and Google reported 45 % less low-quality, unoriginal content in its results after that month's core update.
What did answer engines and generative engines change?
The answer moved above the list. OpenAI released ChatGPT on 30 November 2022. Microsoft launched an AI-powered Bing in February 2023, and Google opened its Search Generative Experience in May 2023. Google rolled out AI Overviews to everyone in the United States in May 2024 and reported more than 2 billion monthly users in July 2025. OpenAI introduced ChatGPT search in October 2024, Anthropic added web search to Claude in March 2025, and Google brought AI Mode to everyone in the United States in May 2025.
Two disciplines grew out of this. Answer engine optimization (AEO) works on being the source a direct answer is taken from: featured snippets, voice answers and answer boxes. Generative engine optimization (GEO) works on being named in an answer that a language model writes: citable passages, verifiable figures and entities a model can ground.
Both kinds of system learned from human judgement. Ranking models have learned from relevance labels since RankNet in 2005. InstructGPT and ChatGPT were trained on human rankings of model outputs. Google ran 719,326 search quality tests with external raters in 2023 and states that these ratings evaluate its systems without directly affecting the ranking of any page. The answer a person reads was shaped by judgements other people made before.
What is Supervised Search?
Supervised Search is search in which the publisher supervises the last stretch. The page asks where a visitor comes from and what they have already experienced, clarifies the user intent behind the visit in a short pre-loop, and routes the person to the answer that fits, on this site or beyond it. A static document becomes a user-triggered dialogue. The full definition and the research behind it: Supervised Search: when the publisher supervises the last stretch of a search.
Answer systems decide on the searcher's behalf. Supervised Search gives the part of that decision which only the person can make back to the person, at the place where they have already arrived.
What does a pre-loop look like?
A person arrives from a result list, an answer box or a chat. Before the page explains anything, it asks back, in the text itself: Have you experienced this before? Is this what brought you here, or was it something else? Each answer opens the passage that fits, or points to the page where that user intent is answered, including pages on other sites.
Search engines already ask such questions themselves. Bing's clarification pane asks a question back and offers answers to click. In a one-week test with 2.5 million users per group, it drew 48.57 % more clicks than the same pane with a static title (Hamed Zamani, Susan T. Dumais, Nick Craswell, Paul N. Bennett and Gord Lueck, WWW 2020). About 16 % of queries in a real search log are ambiguous (Ruihua Song and colleagues, Information Processing and Management, 2009). Supervised Search moves the question to the page the person has chosen, and it asks for the user intent.
If the user intent were clear from the query, one question back would change little. With one answered question, the share of relevant first results rose from 0.19 to 0.50.
| Retrieval quality | Query alone | Query plus one answered question |
|---|---|---|
| Mean reciprocal rank (MRR) | 0.2820 | 0.5677 |
| Precision of the first result (P@1) | 0.1933 | 0.4986 |
| nDCG of the first result (nDCG@1) | 0.1460 | 0.3988 |
Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani and W. Bruce Croft, Asking clarifying questions in open-domain information-seeking conversations, SIGIR 2019. Qulac, 198 topics with 762 distinct information needs behind them. The best question per need was selected with knowledge of its answer, so the figures are upper bounds.
Why does Supervised Search help search engines and language models?
Search systems never see what an individual visitor answers. They read what the page offers: the entry situations it names, the questions it asks back and the route from each situation to an answer. That is a readable map from search intent to user intent, written by the party that knows the subject. It gives a ranking system a precise reason to send a person to the page, and a language model a precise passage to cite.
Three rules keep it clean. The question sits in the content, and no dialog covers the page: Google states that intrusive interstitials and dialogs can lead to poor search performance, and since January 2017 pages whose content is hard to reach from mobile results may rank lower. The content stays readable for everyone who does not answer. Answers that are stored are personal data and need consent.
Why is the SERP consensus a red ocean?
W. Chan Kim and Renée Mauborgne describe red oceans as “all the industries in existence today – the known market space”, where “cut-throat competition in existing industries turns the ocean bloody red”. Their study of business launches in 108 companies shows what that competition returns.
In search, the red ocean is the SERP consensus: the settled core of a subject that every ranking page repeats. Search intent is read from this consensus and confirms it. Everyone can cover it, everyone does, and each further restatement is worth less. Answer systems compress exactly this part into one paragraph and hand it over without a visit.
If extending what a market already offers paid best, the 86 % of launches built that way would earn most of the profit. They earn 39 %.
| Share of | Line extensions (red ocean) | New markets and industries (blue ocean) |
|---|---|---|
| Launches | 86 % | 14 % |
| Total revenues | 62 % | 38 % |
| Total profits | 39 % | 61 % |
W. Chan Kim and Renée Mauborgne, Blue Ocean Strategy, Harvard Business Review, October 2004. Business launches in 108 companies.
How much money does the SERP consensus burn?
Three findings show where the spend on consensus pages goes. Almost all pages receive no search traffic at all. Most searches end without a click, and fewer end in one when an AI summary appears. Paying for a position on demand that would have arrived anyway returned a loss in the largest controlled experiment on paid search.
If publishing a page were enough to earn search visitors, most pages would receive some. 96.55 % receive none.
| Estimated monthly traffic from Google | Share of pages |
|---|---|
| None | 96.55 % |
| 1 to 10 visits | 1.94 % |
| Any traffic | 3.45 % |
Tim Soulo, Ahrefs, December 2023. About 14 billion pages in the Ahrefs index; traffic figures are estimates.
If a place on the first result page still delivered the audience, most searches would end in a click. In 2024, most of them ended without one.
| Google searches | Figure |
|---|---|
| US searches ending without a click, 2024 | 58.5 % |
| EU searches ending without a click, 2024 | 59.7 % |
| Clicks to the open web per 1,000 US searches, 2024 | 360 |
| US visits with a click on a result link, AI summary shown, March 2025 | 8 % |
| US visits with a click on a result link, no AI summary, March 2025 | 15 % |
| US visits with a click on a link inside the AI summary, March 2025 | 1 % |
Rand Fishkin, 2024 Zero-Click Search Study, SparkToro, July 2024, clickstream panel of Datos. Athena Chapekis and Anna Lieb, Google users are less likely to click on links when an AI summary appears in the results, Pew Research Center, July 2025. Browsing data of 900 US adults, 68,879 Google searches.
If buying ads for demand that already exists paid off, the controlled experiment would show a positive return. Its best estimate is minus 63 %.
| eBay paid search, United States | Return on investment |
|---|---|
| Conventional estimate, no controls | 4,173 % |
| Conventional estimate, with day and region controls | 1,632 % |
| Field experiment, non-brand keywords | −63 % |
| 95 % confidence interval of the experiment | −124 % to −3 % |
Tom Blake, Chris Nosko and Steven Tadelis, Consumer heterogeneity and paid search effectiveness: A large scale field experiment, Econometrica 83 (1), 2015. After eBay stopped its brand-keyword ads, 99.5 % of those clicks still arrived through unpaid results.
Who invented the blue ocean?
W. Chan Kim and Renée Mauborgne coined the terms red ocean and blue ocean. W. Chan Kim is Distinguished Professor of Strategy and International Management, Emeritus, at INSEAD. Renée Mauborgne is the INSEAD Distinguished Fellow and Affiliate Professor of Strategy. Together they direct the INSEAD Blue Ocean Strategy Institute in Fontainebleau, France. They introduced blue ocean strategy in Harvard Business Review in October 2004 and in the book Blue Ocean Strategy, published by Harvard Business School Press in 2005, in an expanded edition in 2015 and in an enhanced 20th anniversary edition in August 2026. The book is based on a study of 150 strategic moves spanning more than 100 years across 30 industries and has sold over 4 million copies in 49 languages. Blue Ocean Shift followed in 2017.
Their tools are theirs by name: value innovation, the simultaneous pursuit of differentiation and low cost, the strategy canvas, the Four Actions Framework and the Eliminate-Reduce-Raise-Create Grid. Thinkers50 named them the most influential management thinkers in the world in 2019, and Renée Mauborgne was the first woman to reach that position. In 2023, Harvard Business Review recognised them as two of the four leading thinkers in its 100-year history.
The transfer of their concept to search results is the work of this site. The concept, its terms and its tools belong to Kim and Mauborgne.
What is the blue ocean beyond the SERP consensus?
In the words of Kim and Mauborgne, blue oceans are “all the industries not in existence today – the unknown market space”. Beyond the SERP consensus, the blue ocean is made of the part of user intent that reaches beyond search intent: the questions and wishes that belong to a market, that people demonstrably carry, and that no first result page answers. Nobody competes there yet. There is no keyword price, no ranking to take from anyone and no summary an answer system could reuse.
If the first result pages already covered what people ask, new searches would be rare. Google reports that 15 % of the searches it sees every day are new.
| Search demand | Figure |
|---|---|
| Daily Google searches that are new | 15 % |
| Distinct AltaVista queries asked only once in 43 days | 63.7 % |
| Distinct AltaVista queries asked exactly twice in 43 days | 16.2 % |
| US keywords with fewer than 10 searches a month | almost 93 % |
Pandu Nayak, Understanding searches better than ever before, Google, October 2019. Craig Silverstein, Monika Henzinger, Hannes Marais and Michael Moricz, Analysis of a very large web search engine query log, ACM SIGIR Forum, 1999, about 1 billion requests. Tim Soulo, Long-tail keywords, Ahrefs, May 2026, US keyword database.
If the first result page answered what people want to know, open questions would be the exception. On 90 % of result pages, every top-3 page leaves at least one open.
| Google result pages | Share |
|---|---|
| Result pages where every top-3 page leaves at least one topic question unanswered | 90 % |
| Result pages leaving three or more topic questions unanswered | 60 % |
| Top-3 pages graded mostly shared content | 24 % |
| Pages at positions 4, 7 and 10 graded mostly shared content | 37 to 40 % |
Limor Barenholtz, You can rank on Google and be invisible in AI search, Similarweb, June 2026, reporting a study by On-Page.ai. 150 top-3 pages across 50 keywords in 10 verticals.
How is the blue ocean beyond the SERP consensus found?
Johannes Faupel finds it with the IgnoranceGraph Engine. The engine is available only in collaboration with him and a small number of partners. It is not sold as software, and there is no SaaS version and no public access.
A collaboration delivers the result: the subjects and questions a market is missing, named and ordered, ready to be written, and ready to be built into Supervised Search.
Next step in SEO
The next step is: Contact
The Relevance Package
Working in search and want to be found by the systems that write the answers? One hub page plus up to seven subject pages, ready to publish: the subjects that are missing from your market, each with sources you can check, tests your readers can run, and the structured data that carries them. From $7,500 plus VAT.
Part of the work stays with you, and it is the part nobody can copy: you are asked for hand-drawn sketches and tables from your own practice. Every file name is specified word by word, so each image says what it shows before anyone opens it. No picture, diagram or table in the delivered pages is machine generated.
For business customers. Offers are non-binding and take effect with a written agreement on scope and price. info@johannesfaupel.com
First published 2022-12-11. Last revised 2026-09-16.
