Rate limit on Site Audit
I get a lot of 430 errors from scanning shopify sites.
It looks like if you slow down the crawler to pause every 30 seconds you can fix some of these issues. Is there anyway to do that now, and if not, can you add that? I know that it has to respect the robots, but
19
votes
Chris Eckman
shared this idea
1 comment
-
Joseph Terzieva
commented
I'm excited to see that this is planned. This issue ultimately caused me to look for other options for SEO, but I came back because I couldn't find anything better. This is the single piece of SEMRush for Shopify users that hurts our ability to maximize site quality.