# AI assistants and answer engines (GPTBot, OAI-SearchBot, ChatGPT-User, # ClaudeBot, anthropic-ai, Google-Extended, PerplexityBot, CCBot, etc.) are # welcome via the wildcard group below. See /llms.txt for what Lookalike is and # how to integrate it. Named per-bot groups are intentionally omitted: a named # group overrides "*", which would drop the Disallow rules and expose /embed/. User-agent: * Allow: / # App/utility routes with no SEO value. The create funnel sub-pages are NOT # listed here on purpose: they're linked from the indexable /create page, so # they must stay crawlable for Google to see their per-route `noindex` (a # Disallow would block the crawl and the noindex would never be read). Embed is # iframe-only with infinite token URLs — never user-navigated and never linked — # so a crawl block is the right tool there. Disallow: /dashboard Disallow: /embed/ Disallow: /api/auth/ Disallow: /logout Disallow: /ingest Sitemap: https://lookalike.com/sitemap.xml