RoboFinder
RoboFinder is a tool designed to locate and analyze robots.txt files across websites, helping OSINT researchers and security analysts uncover potential clues for further investigation. https://github.com/Spix0r/robofinder #OSINT #Cybersecurity #Reconnaissance