Enterprise Site Intelligence Adds Crawler Profiles for AI Agents and Search Bots
New bot simulation capabilities let teams see their website exactly as AI models and search engines do. Without manual configuration.
March 31, 2026
As of today, we’ve expanded the scope of the Core Web Vitals report in Semrush to check vitals for up to 10 pages per audit.
As you can see above, the report will show a breakdown of how many out of these 10 pages are optimized according to Google’s Core Web Vitals guidelines.
Below the top area of the report, you’ll see a table with each page’s vitals and an indication of if this vital has improved or declined since the last audit.
You’ll be able to see the historical data for each page by expanding the table.
How to Set Your 10 Pages Checked
By default, Semrush will pick the 10 pages closest to the start of our crawl path, which generally begins at the homepage and follows hyperlinks.
However, this can be controlled by uploading a file with URLs listed in the Site Audit setup step. In your file, we will check Core Web Vitals for the first 10 rows.
In a few weeks, we’ll update this feature again so that Site Audit can allow you to customize your list of 10 URLs to check in this report. Until then you can control this step by setting your crawl scope to focus on a list of URLs.
If you have any questions or feedback about this report, please feel free to contact us at mail@semrush.com or site-audit-feedback@semrush.com.
