Polite Scraping, robots.txt, Delays, Rate Limits

Is `robots.txt` legally enforceable?

• AYes, accessing Disallowed paths is illegal everywhere
• BGenerally no, it's advisory, not enforced by law in most jurisdictions, but ignoring it is poor practice and may strengthen a site's case against you
• CYes, but only for Googlebot
• DOnly in the EU