robots.txt for AI Crawlers: Which Bots to Allow and Block on a PBN

On a PBN, allow search engines and AI crawlers (Googlebot, Bingbot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot and friends) and block backlink crawlers like AhrefsBot, SemrushBot, MJ12bot, DotBot and BLEXBot. Blocking Google-Extended only opts you out of Gemini training; it does not affect Google Search or AI Overviews. Then check your CDN isn’t blocking AI bots

robots.txt for AI Crawlers: Which Bots to Allow and Block on a PBN Read More »

How to Get Your Brand Recommended by ChatGPT, Claude and Perplexity

You get recommended by ChatGPT, Claude and Perplexity by being easy to find, easy to quote and confirmed by sources you don’t control. In practice that means answer-first pages for the exact questions buyers ask, consistent facts about your brand everywhere, open crawler access, fresh content and genuine third-party mentions. Nobody can guarantee an AI

How to Get Your Brand Recommended by ChatGPT, Claude and Perplexity Read More »