I suggest you ...

Rate limit on Site Audit

I get a lot of 430 errors from scanning shopify sites.

https://ecommerce.shopify.com/c/shopify-discussion/t/crawling-shopify-stores-returns-http-error-430-436862

It looks like if you slow down the crawler to pause every 30 seconds you can fix some of these issues. Is there anyway to do that now, and if not, can you add that? I know that it has to respect the robots, but

19 votes
Vote
Sign in
Check!
(thinking…)
Reset
or sign in with
  • facebook
  • google
    Password icon
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    Chris Eckman shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    1 comment

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      Submitting...
      • Joseph Terzieva commented  ·   ·  Flag as inappropriate

        I'm excited to see that this is planned. This issue ultimately caused me to look for other options for SEO, but I came back because I couldn't find anything better. This is the single piece of SEMRush for Shopify users that hurts our ability to maximize site quality.

      Feedback and Knowledge Base