Rate limiting by
$remote_addr in Nginx behind Cloudflare will throttle Cloudflare's edge nodes instead of the actual scraper if you haven't configured real_ip_header CF-Connecting-IP with Cloudflare's IP ranges. Learned that the hard way once when a single bot briefly locked out an entire regional PoP.commit 5683b08