Аудит доступности сайта для AI-краулеров

★ 7.4 · marketing

geo-crawlers is a Claude Code skill that analyzes a website's accessibility to AI crawlers by checking robots.txt rules, meta tags, and HTTP headers to map which bots can reach and index the site's content. It covers a full reference of crawlers — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, and more — grouped into priority tiers based on their impact on AI search visibility. According to an Originality.ai 2025 study, over 35% of the top 1,000 websites inadvertently block at least one major AI crawler due to legacy robots.txt configurations. The skill produces a complete access map along with actionable recommendations on what to allow or restrict, helping site owners stay visible in ChatGPT Search, Perplexity, and Claude responses without losing control over their content. It is aimed at SEO professionals and publishers focused on generative engine optimization (GEO).