Ahrefs Site Audit Sitemap Ultimate Guide to Keeping Crawlers in Line

on the web SEO In optimization, performing regular technical reviews (Site Audit) is an important step in maintaining the health of your website. Many webmasters want Site Audit to only crawl the Sitemap Pages inThis article will explain how to set the crawl scope in Ahrefs Site Audit so that it only crawls the pages in the Sitemap. In this article, we will introduce in detail how to set the crawling scope in Ahrefs Site Audit so that it only crawls the pages in the Sitemap. URL, covering both new and existing projects.

I. Setting up a new project to capture only Sitemap

Step 1: Create a new project and configure the URL source

• Create a new project in the Scope respond in singing Ownership Fill in the relevant information in the section.
• go into Site AuditFind URL Sources Tab.
• Check only Specific sitemaps Options.
• Enter the URL of the Sitemap in the input box below (you can enter more than one Sitemap address at the same time).

It must be ensured that in addition to Specific sitemaps All other options are unchecked so that the crawler will start crawling from the specified Sitemap.

Step 2: Set the crawl depth

1. Go to the next step Crawl settingsThe
2. locate Max depth level from the seedand set it to 0The

This setting tells the crawler not to crawl beyond the pages contained in the Sitemap, and to limit itself to the URLs within the Sitemap.

Step 3: Finish project configuration and start crawling

1. strike (on the keyboard) Continue, completing other configurations for new projects.
2. After waiting for the crawler to finish running, the Crawl log You can see the results of the crawl in the

Something to keep in mind:

• Known URLs(known URLs) will usually be better than the Crawled URLs（It is normal to have a higher number of crawled URLs.
• Crawled pages are limited to the project scope, while known URLs contain discarded links.

To make sure that the crawler only crawls the pages in the Sitemap, go to the Page explorerIf the filter condition is set to Is in sitemap = YesThe number of pages should be equal to the number of pages that have been crawled.

II. Modify the existing project to only capture Sitemap

Sometimes a project already exists, but you need to change the scope to Sitemap only, in which case you should be especially careful: changing the crawl scope will affect the overall Site Audit metrics. If you wish to keep the original data, you can delete the existing project and recreate it.

Step 1: Enter the existing project settings

• show (a ticket) Site Audit dashboardThe
• Click next to the item Vertical ellipsis (three-dot button)Selection SettingsThe

• In the right panel click on Site AuditIf you want to set up Site Audit, enter the Site Audit setting interface.
• Repeat the steps for new items: in the URL Sources Only check the box in the Specific sitemapsand enter the Sitemap URL.

Step 2: Run a new round of crawling

1. Go back to the Site Audit page and click Projects.
2. strike (on the keyboard) New crawl button to make the Ahrefs Recrawl the site.
3. Once the crawler is complete, it can be used in the Crawl log View the updated results in.

III. Summary

exist Ahrefs In Site Audit, if you want the crawler to crawl only the Pages in Sitemap, the following two steps need to be completed:

• Only check the box in the URL Sources Specific sitemapsIf you are interested in the site, please enter the Sitemap address;
• In Crawl settings, set the Max depth level from the seed set to 0The

For new projects, this can be set up in the creation process; in existing projects, you need to go to the setup page and run a new crawl. Once this is done, it can be set up in the Page explorer screening Is in sitemap = Yes, confirming that the number of pages matches the crawl results.

This method can help SEO Personnel monitor the health of core pages more accurately to avoid dispersing data, as well as saving crawler resources and analysis time.

Contact Us
Can't read the tutorial? Contact us for a free answer! Free help for personal, small business sites!	Customer Service
① Tel: 020-2206-9892
② QQ咨询：1025174874
(iii) E-mail: info@361sale.com
④ Working hours: Monday to Friday, 9:30-18:30, holidays off