How to Stop AI Bots From Scraping Your Online Store
AI crawlers like OpenAI's GPTBot, ByteDance's Bytespider, and a dozen others now visit small online stores every single day. They copy your product photos, descriptions, and prices to train AI models — using your bandwidth, slowing your site, and sending you nothing in return. Here is how to tell if it is happening to you, and how to actually stop it.
How to check if AI bots are scraping your site
The signs show up in your server's access logs: repeated visits from user-agents such as GPTBot, Bytespider, CCBot, ClaudeBot, and Amazonbot. If you are not comfortable reading raw logs, the fastest way is a free scan: paste your store's URL into the free StopBotAPI scanner and it shows exactly which AI crawlers are hitting your site right now.
Why robots.txt is not enough
Adding User-agent: GPTBot / Disallow: / to your robots.txt is a good first step — but robots.txt is a polite request, not a lock. The well-behaved crawlers honor it; plenty of scrapers read your robots.txt, see what you are protecting, and grab it anyway. To truly stop them you need to block at the server or edge level, by the signature of the request itself — not just ask nicely.
Do not block the bots that bring you buyers
Not every bot is bad. There is a real difference between a training crawler (scraping your catalog to train a model, with nothing in it for you) and an AI shopping assistant (acting live for a real shopper who may buy from you). Block the first, welcome the second. A blunt block that turns away ChatGPT's shopping traffic can cost you sales — so the goal is a smart filter, not a wall.
How to actually block AI scrapers
Effective blocking looks at each request's user-agent and signature and turns away the known training crawlers at the door, before they ever reach your pages — while letting search engines, shopping assistants, and real customers straight through. StopBotAPI does this with one line of code you paste into your site, $1 for your first 3 months. It also keeps a live list of the latest scraper signatures so you are not chasing new bots by hand.
See which AI bots are on your site
Run a free scan — no signup needed — then block them in one line.