AeThex-Bot-Master/aethex-bot/public/robots.txt at 73ff5bcce3b69ca487225e93f26cc00a8ea6984c - AeThex-Labs/AeThex-Bot-Master - AeThex Forge: Beyond coding. We Forge.

AeThex-Labs/AeThex-Bot-Master

sirpiglr 52843c7577 Enhance website with SEO, metadata, and social sharing improvements

Add comprehensive SEO meta tags, Open Graph, Twitter Cards, JSON-LD, canonical URLs, keywords, robots.txt, and sitemap.xml to all public pages, and apply noindex to the dashboard.

Replit-Commit-Author: Agent
Replit-Commit-Session-Id: aed2e46d-25bb-4b73-81a1-bb9e8437c261
Replit-Commit-Checkpoint-Type: full_checkpoint
Replit-Commit-Event-Id: 2a2501fa-4c90-485b-838b-12edb74bf197
Replit-Commit-Screenshot-Url: https://storage.googleapis.com/screenshot-production-us-central1/3bdfff67-975a-46ad-9845-fbb6b4a4c4b5/aed2e46d-25bb-4b73-81a1-bb9e8437c261/2es2tYa
Replit-Helium-Checkpoint-Created: true

2025-12-13 01:26:40 +00:00

7 lines

122 B

Text

Raw Blame History

 User-agent: *
 Allow: /
 Disallow: /dashboard
 Disallow: /auth/
 Disallow: /api/
 Sitemap: https://bot.aethex.dev/sitemap.xml