User-agent: * Allow: / Allow: /shop Allow: /shop/ # Product pages are indexable for long-tail product SEO and tracked separately # in sitemap-products.xml through the sitemap index. Allow: /product/ Allow: /blog Allow: /blog/ Allow: /faq Allow: /sell Allow: /sourcing Allow: /appointment Allow: /contact Allow: /returns Allow: /terms # Internal tooling and APIs Disallow: /admin Disallow: /admin/ Disallow: /api/ Disallow: /email/ Disallow: /lovable/ # User-state and token-gated pages — no SEO value, often unique per visitor Disallow: /cart Disallow: /wishlist Disallow: /unsubscribe Disallow: /appointment/manage # Search & filter query strings on shop produce duplicate content Disallow: /shop?* Disallow: /shop/*?* # AI assistants & answer engines — explicitly welcome on public content # (named groups don't inherit the * rules, so private routes repeat here) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Bingbot Allow: / Disallow: /admin Disallow: /admin/ Disallow: /api/ Disallow: /email/ Disallow: /lovable/ Disallow: /cart Disallow: /wishlist Disallow: /unsubscribe Disallow: /appointment/manage Sitemap: https://www.oncelegosnyc.com/sitemap.xml