How ranking works, the AI-native way
Ranking is a three-stage pipeline — crawl, index, rank — and most "my SEO isn't working" problems start before ranking even begins. The AI-native move: you gather the two things AI can't see on its own (your index status and the live search results), and AI explains why the top results beat you.
The pipeline in 60 seconds
- Crawling — Googlebot discovers URLs from links, your sitemap, and backlinks, then queues them to visit.
- Indexing — the page's content, title, and key tags get stored (with 2026's AI-era twist: pages are also chunked into passages with embeddings for retrieval). Only indexed pages can rank.
- Ranking — hundreds of subsystems score indexed pages per query: relevance and intent match, E-E-A-T (experience, expertise, authority, trust), technical health (speed, mobile, crawlability), backlink authority, and real user behaviour (clicks, pogo-sticking back to search).
Fastest path: one prompt, end to end
Paste this into ChatGPT or Claude (browsing on) and fill in the brackets:
🤖 AI prompt — paste into ChatGPT / Claude
You are an SEO diagnostician for an e-commerce site.
My page: [URL]
Target keyword: [keyword]
1. Open Google (google.com), search "[keyword]", and list the top 3 organic results (skip ads and shopping units).
2. Open each of the 3 pages plus mine. For all 4 record: is the exact keyword in the title tag? What page type is it — product, collection, blog guide, comparison? That page type is the intent Google rewards for this query.
3. Open Ahrefs Free Backlink Checker (ahrefs.com/backlink-checker) for each of the 4 URLs and read the real referring-domains number it shows. Do NOT invent it.
4. Tell me bluntly if my page type doesn't match the winners — a product page can't outrank a results page full of guides, and vice versa. That mismatch outweighs everything else.
5. Return ONE markdown table — Rank | URL | Keyword in title? | Page type / intent | Referring domains (source) — with my page as the last row, then a 5-bullet diagnosis of why the top 3 outrank me and the single highest-impact fix.
Do not guess or estimate any number. Every figure must come from a tool you opened or a source you can cite — give the source next to it. If you cannot get a real number, leave it blank and ask me to fill it in. If you can't browse at all, leave those columns blank and tell me exactly what to copy from google.com and ahrefs.com/backlink-checker so you can finish the diagnosis.
Or do it in 5 steps
- Confirm the page is indexed. Search Console → Indexing → Pages, or search
site:yourstore.com/the-page on Google. Not indexed = stop and fix that first (see "Fix your technical SEO basics first").
- Google your target keyword in an incognito window. Copy the top 3 organic URLs and their titles into a note.
- Let AI compare. Paste the 3 results plus your URL into the prompt above, or simply ask: "what do these 3 share that my page lacks — intent, title, format, depth?"
- Read the backlink gap. Run all 4 domains through Ahrefs' free backlink checker (ahrefs.com/backlink-checker — the free view shows referring domains and the top 100 backlinks). If the winners have 500+ referring domains and you have 5, don't fight this keyword yet; pick a longer-tail one (see "Keyword research").
- Match the winning intent. Rebuild your page as the same type the results reward — guide, collection, or product. Done looks like: page indexed, same page type as the top 3, keyword in the title, and a backlink gap you can realistically close this quarter.
Worked example — what the top results for "best matcha whisk" share
A July 2026 search for best matcha whisk returned these among the top results:
| Result | "matcha whisk" in title? | Page type / intent |
|---|
| Kettl Tea — Matcha Whisks and Chasen (collection) | Yes | Collection — commercial |
| Tezumi — A Guide to Chasen, the Matcha Whisk | Yes | Blog guide — informational |
| Amazon — Best Sellers: Matcha Whisks | Yes | Category — transactional |
The pattern: every winner has the exact phrase in its title, and every page is built for choosing or buying — not a homepage, not a thin product page. The backlink column is the one you fill yourself: paste each domain into ahrefs.com/backlink-checker and read the real referring-domains number before deciding whether to compete.
My rule: fix crawl/index problems before touching a single ranking factor — you can't rank a page Google never stored. Re-run this diagnosis on any page that's been live 60+ days and still isn't on page 1.