# Block AI crawlers User-agent: Google-Extended User-agent: GPTBot User-agent: CCBot User-agent: ChatGPT-User User-agent: anthropic-ai Disallow: / # All other users User-agent: * # Block API routes Disallow: /v1/ # Block login and registration auth pages Disallow: /login Disallow: /register # Block login protected pages Disallow: /notifications Disallow: /transactions Disallow: /classifieds/post/ Disallow: /classifieds/chats/ Disallow: /classifieds/favourites Disallow: /classifieds/user/ads/ Disallow: /classifieds/saved-searches Disallow: /classifieds/wallet Disallow: /classifieds/settings Disallow: /classifieds/dealership/ Disallow: /classifieds/bike-hub-pay/deals Disallow: /classifieds/ads/*/hold/ Disallow: /stolen-bikes/store Disallow: /stolen-bikes/manage