RoboFinder is a tool designed to locate and analyze robots.txt files across websites, helping OSINT researchers and security analysts uncover potential clues for further investigation.
https://github.com/Spix0r/robofinder
#OSINT #Cybersecurity #Reconnaissance