johndoex1 / robots.py Goto Github PK
View Code? Open in Web Editor NEWThis project forked from quitten/robots.py
robots.py is a script was designed to observe and analyze robots.txt of targeted website in order to ease information security experts work. developed by Barak Tawily.