f6d1d3705e
Fixes invalid robots.txt, updates sitemap.xml with full URLs, expands the title tag in index.html, and ensures canonical URLs are absolute in index.html. Replit-Commit-Author: Agent Replit-Commit-Session-Id: 9203795e-937a-4306-b81d-b4d5c78c240e Replit-Commit-Checkpoint-Type: full_checkpoint Replit-Commit-Event-Id: b8d81034-78c8-4b8e-91a7-ea448852570c Replit-Commit-Screenshot-Url: https://storage.googleapis.com/screenshot-production-us-central1/7c94b7a0-29c7-4f2e-94ef-44b2153872b7/9203795e-937a-4306-b81d-b4d5c78c240e/LFvmEVc Replit-Helium-Checkpoint-Created: true
16 lines
201 B
Text
16 lines
201 B
Text
User-agent: Googlebot
|
|
Allow: /
|
|
|
|
User-agent: Bingbot
|
|
Allow: /
|
|
|
|
User-agent: Twitterbot
|
|
Allow: /
|
|
|
|
User-agent: facebookexternalhit
|
|
Allow: /
|
|
|
|
User-agent: *
|
|
Allow: /
|
|
|
|
Sitemap: https://aethex.dev/sitemap.xml
|