Custom Tools and Notes from my OSCP PWK experience
- Robots.txt.test.sh - This tool will grab the robots.txt file and run through each entry to display the HTTP status of the file.
- Run with
chmod +x robots.txt.test.sh && ./robots.txt.test.sh
- Run with