Free to explore: filter winning sites by DR, traffic and niche  ·  Try the live explorer →

Enterprise SEO: what changes at scale

A large office team working at screens

Enterprise SEO is usually sold as a separate discipline with its own platforms and its own ranking secrets. It isn’t. Search engines apply the same rules to a site with four hundred thousand URLs as to one with forty. What changes at scale is everything around those rules: the files you publish hit hard limits, the work is split across teams who don’t talk, and a fix that takes five minutes on a small site needs a ticket, a sprint and a sign-off.

The clearest way to see this is through one dull, concrete file: the XML sitemap. Its protocol has fixed limits, and a large site runs into every one of them. Once you see how sitemaps have to be organised at scale, the rest of the enterprise picture follows.

What enterprise SEO actually means

There is no official threshold. No source defines how many pages make a site “enterprise”, and the sitemap protocol certainly doesn’t. A working meaning: enterprise SEO is SEO on a site large enough that you can’t fix things by hand, and owned by an organisation large enough that you can’t fix things alone.

Both halves matter. The size half pushes you towards templates, rules and automated checks. The organisation half pushes you towards tickets, documentation and reporting that people outside SEO will read. An enterprise SEO strategy is mostly a plan for those two problems, with the ordinary ranking work sitting inside it.

An org chart on a whiteboard

The sitemap limits every large site hits

The sitemaps.org protocol sets the rules most search engines follow. Its footer reads “Last Updated: Monday, November 21, 2016”, so it is an old document, but the limits in it are the ones you design around. These are the numbers that matter at scale.

RuleLimit, as the protocol states itWhat it means at scale
URLs per sitemap fileNo more than 50,000Large sites need many files
Size per sitemap fileNo larger than 50MB (52,428,800 bytes), uncompressedGzip saves bandwidth, not the limit
Sitemaps per index fileNo more than 50,000You can have more than one index file
Size per index fileNo larger than 50MB (52,428,800 bytes)Index files can be compressed too
Length of a <loc> URLLess than 2,048 charactersWatch long faceted and tracking URLs
HostSame protocol and host as the sitemapEach subdomain needs its own sitemaps

The protocol is explicit about the split: “If you want to list more than 50,000 URLs, you must create multiple Sitemap files,” and “you should then list each Sitemap file in a Sitemap index file.” Files “must be UTF-8 encoded.” Our guide to XML sitemaps for SEO covers the basics; here the point is what the limits force you to build.

Analyst working on spreadsheet data

A worked hypothetical

Take an invented catalogue on example.com with 400,000 product URLs. That is eight sitemap files of 50,000 URLs each, listed in one index file. In practice you would split by section rather than by count, so that the product, category and editorial sitemaps can be checked separately and a problem in one section shows up as one bad file. Then one robots.txt line points to the index. The protocol says “If you have a Sitemap index file, you can include the location of just that file. You don’t need to list each individual Sitemap listed in the index file.”

A sitemap is a list, not a guarantee. The protocol doesn’t say listing a page gets it indexed, and it says nothing about crawl budget. For that side of large sites, read our posts on crawl budget and faceted navigation, which is where most runaway URL counts come from.

Hints, honesty and the same-host rule

Three sitemap fields cause most of the arguments on large sites, and the protocol settles them. <lastmod> “must be set to the date the linked page was last modified, not when the sitemap is generated.” A sitemap job that stamps today’s date on every URL every night is publishing false information. <changefreq> “is considered a hint and not a command.” And <priority> “is not likely to influence the position of your URLs in a search engine’s result pages”, while “assigning a high priority to all of the URLs on your site is not likely to help you.”

The same-host rule is where organisation meets plumbing. “All URLs listed in the Sitemap must use the same protocol … and reside on the same host as the Sitemap.” A sitemap at www.example.com can’t list URLs on a subdomain, and one at /catalog/sitemap.xml can only list URLs under /catalog/. The protocol “strongly” recommends the root, but notes you may need “different Sitemaps for different paths (e.g., if security permissions in your organization compartmentalize write access to different directories).”

A developer ticket board

That sentence describes most large companies. The blog runs on one system, the shop on another, the help centre on a subdomain owned by support. Each needs its own sitemaps, and someone needs a map of who owns which. You may list more than one sitemap in robots.txt, so the root file can point to each team’s index.

The organisational side of an enterprise SEO strategy

Most of the job is getting changes made. At scale you rarely edit a page; you change a template that renders fifty thousand of them. That raises the stakes of every change and is why tickets need to be precise: the template, the current output, the wanted output, a few example URLs and a way to check the fix.

An analytics dashboard

Reporting changes too. A single traffic line hides everything on a large site, so report by section, matching the way the sitemaps are split. A drop in one section’s indexed pages then points to one team’s change. Server logs show what crawlers actually request; our guide to log file analysis covers how to read them. Plan the work in a shared SEO roadmap so other teams can see it coming.

Big changes are where large sites lose the most. Before any replatform or domain move, work through our site migration checklist, and if you generate pages from data, read what still works in programmatic SEO.

A presentation in a meeting room

Platforms and tools: categories, not rankings

People search for the best enterprise SEO tools and for what an enterprise SEO platform is. The honest answer is a set of jobs rather than a product list. You need a crawler that can handle your URL count, log analysis to see real crawler behaviour, rank tracking by section, and somewhere to keep sitemap and indexing reports. Some vendors bundle these into one platform; others sell them separately. Choose by whether a tool fits your site’s size and your teams’ workflow, and test it on your own site before you sign.

Server racks

The limitation is worth stating plainly. The sitemap protocol is a technical specification from 2016. It tells you how to structure files, not how search engines treat them today, how quickly they read them, or whether your pages will rank. It describes an HTTP “ping” method too, but given the age of the page, don’t build a process on it. Everything beyond the file format in this post is judgement, and should be tested on your own site.

Frequently asked questions

What is enterprise SEO?

SEO on a site too large to fix by hand, run inside an organisation too large to fix things alone. The ranking rules are the same; the work shifts to templates, automation, tickets and reporting by section.

How many URLs can one sitemap hold?

The sitemaps.org protocol allows no more than 50,000 URLs and 50MB uncompressed per file. Above that you create multiple sitemaps and list them in a sitemap index file.

Does each subdomain need its own sitemap?

Yes. The protocol says URLs in a sitemap must use the same protocol and host as the sitemap, so a sitemap on www.example.com can’t list subdomain URLs.

Should I set a high priority on every page?

No. The protocol says priority “is not likely to influence the position of your URLs” and that a high priority on all URLs “is not likely to help you.”

The takeaway At scale, SEO becomes a systems job. Split sitemaps by section, keep lastmod honest, map which team owns which host and directory, and make every fix in the template.