I suggest you ...

Rate limit on Site Audit

I get a lot of 430 errors from scanning shopify sites.

https://ecommerce.shopify.com/c/shopify-discussion/t/crawling-shopify-stores-returns-http-error-430-436862

It looks like if you slow down the crawler to pause every 30 seconds you can fix some of these issues. Is there anyway to do that now, and if not, can you add that? I know that it has to respect the robots, but

22 votes
Vote
Sign in
(thinking…)
Sign in with: Facebook Google
Signed in as (Sign out)
You have left! (?) (thinking…)
Chris Eckman shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

1 comment

Sign in
(thinking…)
Sign in with: Facebook Google
Signed in as (Sign out)
Submitting...
  • Joseph Terzieva commented  ·   ·  Flag as inappropriate

    I'm excited to see that this is planned. This issue ultimately caused me to look for other options for SEO, but I came back because I couldn't find anything better. This is the single piece of SEMRush for Shopify users that hurts our ability to maximize site quality.

Feedback and Knowledge Base