🗂️ Sitemap.xml & Robots.txt Validator

A simple Python CLI tool that checks the availability and validity of sitemap.xml and robots.txt — two crucial files for search engine crawling and indexing.

---

✅ Features

• Automatically constructs URLs for:
  • sitemap.xml
  • robots.txt
• Checks if the files are present and accessible
• Displays:
  • HTTP status codes
  • Content-Type
  • Errors (if any)
• CLI-based: Paste any domain and get results in seconds!

---

🚀 How to Run

1. Clone the repository

git clone https://github.com/Aditi-Rani/sitemap_robots_validator

cd sitemap-robots-validator

2. Install dependencies

pip install -r requirements.txt

3. Run the script

python sitemap_robots_validator.py

4. Enter the URL when prompted

Enter the website URL (include https://): https://example.com