Lesson 2 of 1916 minBeginner

How search engines work

Crawling: how Google finds your pages

Googlebot follows links and sitemaps to discover URLs. Anything only reachable through a form, a click handler or a login is effectively invisible, which is why internal linking and a clean sitemap matter more than most beginners expect.

Why this lesson matters

This lesson belongs to How search engines work, the part of SEO Foundations where the goal is: build the mental model everything else in seo sits on.

Read it once, then do it straight away on a real site inside RankAudit. Nothing here is theory for its own sake — every step produces something you can show a client.

Do it now

  1. 1Open RankAudit with sample data already loaded, so you are not stuck on setup.
  2. 2Crawl a site and triage the issue list.
  3. 3Open RankAudit, crawl your own domain and compare the discovered URL count with the URL count in your sitemap. Every gap is a discovery problem worth writing down.