--- title: "SEO Foundations: Crawl, Index and Rank | Agentic Organic" description: "How search engines crawl, index and rank a site, and what to fix at each step. A plain-language SEO foundations guide with a 30-day plan." url: https://agenticorganic.com/latent/seo/seo-foundations-guide/ last_updated: 2026-10-14 --- [Home](https://agenticorganic.com/) / [Latent](https://agenticorganic.com/latent/) / [SEO foundations](https://agenticorganic.com/latent/seo/) # Google reads you first. Before a customer sees your site, Google has to find it, read it and decide it deserves a spot. This guide shows that order and what to fix at each step. Updated Oct 14, 2026 · 9 min read · By Agentic Organic ## Key takeaways - SEO runs in a fixed order: crawl, index, rank. A problem at step one makes the rest pointless. - Most small sites don't have a ranking problem. They have pages Google can't reach, won't keep or can't tell apart. - One strong page per search topic beats ten thin pages chasing the same phrase. - Speed and links still matter. But they only boost pages people already need. ## Three steps, in order Every page goes through the same three steps before it can show up in Google. First Google finds it. Then Google decides to keep it. Only then does it compete for a spot. - **Crawl**: Google finds the page and fetches it · Fails when: robots.txt, a firewall or a login blocks it - **Index**: Google decides the page is worth keeping · Fails when: it looks like a duplicate or adds nothing new - **Rank**: The page competes for a spot on each search · Fails when: another page answers the question better - **Found**: Your page shows up when people search Every page passes three gates in order. A page stopped at one gate never reaches the next. Each step can fail on its own. If you skip ahead to rankings while step one is broken, nothing you do will show up. ## Step one: Google has to reach the page Google finds pages the way you find a new shop: someone points to it. Those pointers are links from other sites, links inside your own site and your sitemap. A sitemap is a file that lists the pages you want found. A page with no links pointing to it may never be found at all. When Google has a URL, it checks a file called `robots.txt`. That file says which pages bots may visit. If the answer is yes, Google requests the page. Anything that blocks that request blocks everything after it. These are the usual causes on small business sites: - **A leftover block from launch.** A `Disallow: /` line or a `noindex` tag copied from a test site. - **Links that aren't real links.** Menus built from buttons instead of normal links. Google follows links, not buttons. - **Pages behind a login.** If people must sign in to see your prices, Google can't see them either. - **A firewall that blocks Google.** Strict bot rules can turn Google away while the site looks fine to you. Big sites worry about how many pages Google will visit. A 40-page business site almost never needs to. If Google isn't reaching your pages, something is blocking it. Quick check Open Google Search Console. Paste a key URL into the search bar at the top and click "Test live URL." If it can't be crawled, you've found your first fix. ## Step two: Google has to keep it Reading a page and keeping it are two separate choices. After Google reads a page, it compares it with pages it already has. If the page adds nothing new, Google may drop it. The Page indexing report in Search Console shows which pages were left out and why. These four reasons come up most: | Status | What it means | What to do | | --- | --- | --- | | Discovered, not indexed | Google knows the page but hasn't visited it yet | Link to it from your stronger pages | | Crawled, not indexed | Google read it and decided not to keep it | Merge it with a similar page or make it more useful | | Duplicate | Two pages look the same, and Google picked the other one | Choose one main URL and point links at it | | Excluded by noindex | The page asks Google not to keep it | Remove the tag if the page should rank | Duplicates are a quiet problem. The same page might load at `/services`, `/services/` and `/services?ref=nav`. That asks Google to guess which one counts. Make the choice yourself. Pick one URL format. Add a canonical tag, which tells Google the main version. Redirect the others to it. Also check where your text loads. If it only appears after scripts run, Google may see it late. Most AI crawlers won't see it at all. Text in the page's HTML is the safe choice. ## Step three: earn the spot Once a page is kept, Google ranks it by asking four questions. The order matters. 1. **Is it relevant?** Does the page match what the person meant? A search for "emergency plumber" wants a phone number and an area, not plumbing history. 2. **Is it good?** Is it useful, correct and written by someone who knows the topic? Prices, steps, photos of real work and clear answers all help. 3. **Is it trusted?** Do other trusted sites link to it or mention you? Links are still one of Google's strongest signals. 4. **Is it easy to use?** Does it load fast, work on a phone and stay steady while loading? A fast page that answers the wrong question loses to a slower page that answers the right one. Fix the answer first. Then work on trust and speed. > A page earns its ranking by being the best answer to one question. ## Structured data: label the facts Structured data is a small block of code that labels facts on a page. It turns "Open 7am to 6pm" from text Google must interpret into a field it can read directly. It won't raise your rankings by itself. It can earn richer results, like review stars, prices and breadcrumbs. It also removes guesswork about who you are and what you sell. | Type | Use it on | Key facts | | --- | --- | --- | | LocalBusiness | Homepage, contact page | Name, address, phone, hours, social profiles | | Service or Product | Service and product pages | Name, description, area served, price | | BreadcrumbList | Every page below the homepage | The path from home to the page | | Article | Guides and blog posts | Headline, dates, publisher | | FAQPage | Pages with a visible FAQ | Each question and its answer | One rule matters most: the code must match what people see. If your code says one set of hours and the page says another, you can lose rich results. Test any change with Google's free Rich Results Test. ## Site structure: a clear path to every page Site structure is how your pages link together. Good structure helps people find things. It also tells Google which pages matter most. Take a landscaping company. A weak site has one "Services" page that lists everything. A strong site has a services hub that links to a page for each service. Services hub (/services/) - **Lawn care (/services/lawn-care/)** - **Irrigation (/services/irrigation/)** - **Tree trimming (/services/tree-trimming/)** - **Hardscaping (/services/hardscaping/)** A hub page links to every service, and every service links back. Google reads that as one clear topic with the hub at the center. Each service page links back to the hub and to one or two related services. Location pages sit under their own hub. - Every key page is three clicks or fewer from the homepage. - Link text says what's on the other side. "Irrigation repair" beats "click here." - URLs are short, lowercase and readable. They don't change after launch. - Breadcrumbs show where each page sits. ## Page speed, without the jargon Google measures how a page feels to use with three scores, called Core Web Vitals. They're measured on real visitors' phones, so a fast office computer tells you little. | Score | What it measures | Good | Common fix | | --- | --- | --- | --- | | LCP | How fast the main content shows | 2.5 seconds or less | Shrink the big top image and cut slow scripts | | INP | How fast the page reacts to a tap | 200 milliseconds or less | Remove heavy add-ons like chat widgets and extra tags | | CLS | How much the layout jumps while loading | 0.1 or less | Set image sizes and save space for banners | On most small sites, the biggest wins are the same three. Oversized images, too many tracking tags and page builders that load everything everywhere. Check your scores in Search Console or with PageSpeed Insights. Treat speed as a tiebreaker. Passing won't lift a weak page, but failing can hold a good page back. ## Keywords are questions with intent A keyword is a question someone typed into Google. The words around it show what they're ready to do. "How to fix a leaky faucet" is someone planning to do it themselves. "Plumber near me open now" is someone ready to pay. Both matter, but they need different pages. That's the main rule of SEO writing: **one page per intent**. Intent is the goal behind the search. Two pages chasing one intent compete with each other. One page chasing five intents wins none. ### How to plan your pages 1. List the questions customers ask before they buy. Your inbox and sales calls beat any keyword tool. 2. Group them by goal: learning, comparing, buying or finding someone nearby. 3. Give each group one page. Buying goals get service pages. Learning goals get guides like this one. 4. Put the answer near the top. People and AI tools both reward pages that get to the point. Thin pages are worth removing. A short page for every town you serve, with only the name swapped, rarely ranks. It can also drag down the rest of the site. Ten location pages with real local details will do far better. Think jobs done nearby, local rules and travel times. ## Local SEO: win the map Local searches often show a map with three businesses above the regular results. Those map spots get a large share of clicks, and they follow their own rules. 1. **Finish your Google Business Profile.** Pick the most specific category. Add services, hours, service areas and photos of real work. 2. **Keep your name, address and phone the same everywhere.** Your site, your profile and major directories should match exactly. 3. **Ask for reviews every time.** A steady flow of new reviews beats a burst of 50 in one month. Reply to them too. 4. **Build a real page for each main area.** Include details only that area has, like nearby jobs or local permits. 5. **Earn local links.** Your chamber of commerce, local news and community groups all count. You can't change how close you are to the searcher. Everything else on this list is in your control, and most competitors only do half of it. ## Links: what still counts Links from other sites act like votes. Google weighs each vote by how much it trusts the site giving it. One link from your local chamber of commerce beats a hundred from directories nobody visits. Start with links you control. Every new page should get links from at least two related pages on your own site. Then build outward: - **People you already work with.** Suppliers, partners and groups you belong to or sponsor. - **Things worth linking to.** Original data, a pricing guide or a useful free tool. - **Directory listings.** Your Google Business Profile and the main directories in your field. - **Press and podcasts.** Expert comments for local and trade outlets. Skip anything you'd be embarrassed to explain to a customer. Paid link packages and link networks can get you penalized. The gains rarely last. ## Measure what matters Search Console shows how Google sees your site, and it's free. Four numbers in its Performance report tell most of the story. | Number | What it tells you | If it's low | | --- | --- | --- | | Impressions | How often your pages show up in results | Check indexing and whether you have pages for key searches | | Clicks | How often people pick you | Improve titles and descriptions on pages that show but don't get clicks | | Average position | Roughly where you rank | Pages at spots 8 to 20 are your fastest wins | | Queries | The exact searches that found you | Spot topics you rank for by accident and give them a real page | Then check what those visitors do next: calls, forms and sales. Rankings are only the means. Leads and revenue are the goal. ## A 30-day starter plan If you do nothing else, work through this in order. Each week builds on the last. 1. **Week 1: access.** Set up Search Console and submit your sitemap. Check `robots.txt`, firewall rules and stray `noindex` tags. 2. **Week 2: indexing.** Work through the Page indexing report. Fix duplicates. Merge or remove thin pages. 3. **Week 3: pages.** Map one page per intent. Build hubs and rewrite the top of each key page so it answers fast. 4. **Week 4: speed and trust.** Fix the worst speed issues. Clean up listings and ask three partners for a link. After that, SEO becomes a habit. Add one useful page a month, update the pages that matter and watch what people search to find you. ## Frequently asked questions ### How long does SEO take to work? Fixes to crawling and indexing can show up in days or weeks. Gains from new pages and links usually take three to six months. Busy markets take longer. ### Do I need to submit a sitemap to Google? Not strictly, since Google can find pages through links. But it's free, helps new pages get found faster and gives you better reports. ### Does SEO still matter with AI search? Yes. AI tools that search the web use search rankings to choose which pages to read. A page that can't be found or doesn't rank is rarely the one AI quotes. ### Should I do SEO myself or hire someone? You can handle the basics in this guide with Search Console and a few hours a week. Get help when technical fixes go beyond your platform or you need content and links at scale. ## More from Latent [All categories](https://agenticorganic.com/latent/) ### [Be the answer AI gives.](https://agenticorganic.com/latent/geo/generative-engine-optimization-guide/) When a buyer asks ChatGPT for a recommendation, the answer names three or four businesses. 8 min read ### [Can a bot buy from you?](https://agenticorganic.com/latent/agentic-search/agentic-search-guide/) AI agents don't just answer questions anymore. 8 min read ### [Your first agent should be boring.](https://agenticorganic.com/latent/ai-agents/ai-agents-business-guide/) The AI agents that pay for themselves rarely make headlines. 8 min read ### [Rent the model or own it.](https://agenticorganic.com/latent/local-llms/local-llms-business-guide/) Every AI tool you use runs on a model someone hosts. 8 min read