Loading
Alkota Bikes — 3D WebGL Titanium Configurator
SELECTED WORKAVORRIA DIGITAL STUDIO · LONDON & GLOBAL
START SOMETHING WORTH BUILDINGSearch Engine Intelligence
Googlebot visiting your site is not the same as Google ranking it. The six technical failures that keep well-designed websites invisible in search results.
Editorial Analysis — Derived from patterns observed in Google Search Console diagnostics across 140+ website audits. Supplemented with official Google Search Central documentation on crawling and indexation.
Google Search Console shows Googlebot visiting your site regularly. Yet your service pages do not appear in search results. The problem is not a crawl problem — it is an indexation or quality problem. These are distinct failure modes requiring different fixes.
Crawling means Googlebot visited the URL and downloaded its content. Indexing means Google processed that content, judged it worthy of inclusion in the search index, and stored it for ranking. A page can be crawled thousands of times and never indexed. Google own documentation confirms that not all crawled pages are indexed — Google evaluates each crawled page against quality and relevance thresholds.
When a site is crawled but its commercial pages are not appearing in rankings, the investigation must focus on the indexation and quality signals, not the crawl frequency.
If page content — headings, body copy, product descriptions — is rendered exclusively by client-side JavaScript after the initial HTML loads, Googlebot may not process it. Googlebot does crawl JavaScript, but the rendering queue is separate from the initial crawl. Pages that depend on JavaScript to load their primary content may be crawled but indexed as near-empty.
The fix is server-side rendering or static generation: content must be present in the initial HTML response that Googlebot receives. Next.js App Router with React Server Components achieves this by default — all content is rendered server-side and delivered as HTML before any JavaScript executes.
Google quality systems assess whether a page provides genuine value relative to the query it is competing for. Service pages that consist primarily of a headline, three sentences, and a contact form — with no substantive information about the service, its scope, its process, or its commercial context — are frequently assessed as thin content.
The threshold for indexation on competitive commercial queries is higher than most agencies communicate. A bespoke web development service page competing against established agencies needs to demonstrate genuine depth: process documentation, case evidence, technical specification, and authoritative signals.
Canonical tags tell Google which URL is the authoritative version of a page. If canonical tags are absent, malformed, or point to the wrong URL, Google must infer the canonical version independently. This inference is sometimes incorrect, resulting in Google indexing a paginated or parameter variant instead of the intended page.
Check every commercial page for a canonical link tag pointing to its own absolute URL. This is the minimum canonical implementation required. For pages with URL parameters (filters, sorting, pagination), canonical tags are especially critical.
Google discovers and re-evaluates pages partly through internal links. A page that is not linked from any other page on the site — an orphan page — is crawled infrequently and receives no internal link equity. Service pages that only appear in the main navigation but have no internal links from editorial content, case studies, or other service pages are effectively isolated.
Building internal links from editorial content to commercial service pages and proof points — as implemented in our digital estate architecture for Entire Facilities Management — is one of the most structurally important technical SEO interventions available without external dependencies.
Google uses page experience signals — including LCP, INP, and CLS — as ranking factors. Pages that consistently fail Core Web Vitals thresholds on mobile are penalised in mobile rankings. This is particularly damaging for commercial service pages, which Google indexes and ranks from a mobile-first perspective.
For sites with hundreds or thousands of URLs, Google allocates a crawl budget: a limited number of pages it will crawl per day. If that budget is consumed by low-value pages — parameter URLs, empty filter pages, staging paths that were not properly blocked — the high-value commercial pages may be crawled infrequently.
Audit robots.txt and the sitemap to ensure crawl budget is directed exclusively at canonical, indexable pages. Avorria Scout engine identifies crawl budget misallocation as a standard output in its technical SEO audit.
“Crawling is the process by which Google discovers new and updated pages. Indexing is the process of storing and organising the content found during crawling. Not all crawled pages are indexed.”
Working with Avorria
We work with small businesses on websites, marketing systems, and digital infrastructure.