CRAWLING - SCRAPING Archivi - Mario Santella https://www.mariosantella.com/category/osint-resources/crawling-scraping/ Threat Researcher - Developer Thu, 15 May 2025 11:00:08 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.1 Uncomment https://www.mariosantella.com/uncomment-security-comment-extractor/ Mon, 28 Apr 2025 15:57:55 +0000 https://www.mariosantella.com/extract-all-html-comments-from-any-url-in-seconds/ Extract all HTML comments from any URL in seconds. Give it a list of URLs, and this tool will uncover all hidden HTML comments for deeper analysis. https://github.com/rohsec/Uncomment LinkedIn Post: https://www.linkedin.com/feed/update/urn%3Ali%3Ashare%3A7249312692144918529 #osint #cybersecurity #infosec

L'articolo Uncomment proviene da Mario Santella.

]]> Extract all HTML comments from any URL in seconds.
Give it a list of URLs, and this tool will uncover all hidden HTML comments for deeper analysis.

https://github.com/rohsec/Uncomment
LinkedIn Post: https://www.linkedin.com/feed/update/urn%3Ali%3Ashare%3A7249312692144918529

#osint #cybersecurity #infosec

L'articolo Uncomment proviene da Mario Santella.

]]> The Time Machine https://www.mariosantella.com/the-time-machine/ Mon, 28 Apr 2025 15:57:51 +0000 https://www.mariosantella.com/the-time-machine-wayback-url-analysis-for-effective-recon/ Use Wayback URL analysis for effective recon The Time Machine leverages Wayback Machine URLs to identify historical web endpoints, aiding bug hunters and OSINT professionals. With options for endpoint vulnerability checks, including XSS and SQLi, it provides a robust approach to discovering sensitive information across time. https://github.com/anmolksachan/TheTimeMachine #va #pentest #cybersecurity #infosec

L'articolo The Time Machine proviene da Mario Santella.

]]> Use Wayback URL analysis for effective recon

The Time Machine leverages Wayback Machine URLs to identify historical web endpoints, aiding bug hunters and OSINT professionals. With options for endpoint vulnerability checks, including XSS and SQLi, it provides a robust approach to discovering sensitive information across time.

https://github.com/anmolksachan/TheTimeMachine

#va #pentest #cybersecurity #infosec

L'articolo The Time Machine proviene da Mario Santella.

]]> Mantis https://www.mariosantella.com/mantis/ Mon, 28 Apr 2025 15:57:51 +0000 https://www.mariosantella.com/automate-asset-discovery/ Automate asset discovery. Mantis is a command-line framework designed to automate the workflow of asset discovery, reconnaissance, and scanning. It takes the top-level domains as input, then seamlessly progresses to discovering corresponding assets, including subdomains and certificates. The tool performs reconnaissance on active assets and concludes with a comprehensive scan for vulnerabilities, secrets, misconfigurations and...

L'articolo Mantis proviene da Mario Santella.

]]> Automate asset discovery.
Mantis is a command-line framework designed to automate the workflow of asset discovery, reconnaissance, and scanning. It takes the top-level domains as input, then seamlessly progresses to discovering corresponding assets, including subdomains and certificates. The tool performs reconnaissance on active assets and concludes with a comprehensive scan for vulnerabilities, secrets, misconfigurations and phishing domains – all powered by a blend of open-source and custom tools.

https://github.com/PhonePe/mantis

#osint #cybersecurity #infosec

L'articolo Mantis proviene da Mario Santella.

]]> ShodanSpider https://www.mariosantella.com/shodan-spider/ Mon, 28 Apr 2025 15:57:32 +0000 https://www.mariosantella.com/shodanspider-explore-devices-on-shodan-efficiently/ ShodanSpider automates the process of crawling Shodan results, helping OSINT researchers and security professionals gather detailed insights on exposed devices. https://github.com/shubhamrooter/ShodanSpider #OSINT #Cybersecurity #Shodan

L'articolo ShodanSpider proviene da Mario Santella.

]]> ShodanSpider automates the process of crawling Shodan results, helping OSINT researchers and security professionals gather detailed insights on exposed devices.

https://github.com/shubhamrooter/ShodanSpider

#OSINT #Cybersecurity #Shodan

L'articolo ShodanSpider proviene da Mario Santella.

]]> OSINT.SH Buckets https://www.mariosantella.com/osint-sh-buckets-search/ Mon, 28 Apr 2025 15:57:16 +0000 https://www.mariosantella.com/osint-sh-buckets-search-public-aws-s3-azure-blob-storage-by-keyword/ Search public AWS S3 & Azure Blob storage by keyword – Quickly uncover exposed cloud storage for OSINT investigations. https://osint.sh/buckets/ #OSINT #CloudSecurity #Cybersecurity #Reconnaissance

L'articolo OSINT.SH Buckets proviene da Mario Santella.

]]> Search public AWS S3 & Azure Blob storage by keyword – Quickly uncover exposed cloud storage for OSINT investigations.

https://osint.sh/buckets/

#OSINT #CloudSecurity #Cybersecurity #Reconnaissance

L'articolo OSINT.SH Buckets proviene da Mario Santella.

]]> GrayHatWarfare Buckets Search https://www.mariosantella.com/grayhatwarfare-buckets-search/ Mon, 28 Apr 2025 15:57:16 +0000 https://www.mariosantella.com/buckets-grayhatwarfare-maintains-a-searchable-database-of-open-amazon-s3-buckets-filtering-out-non-relevant-files-while-indexing-millions-of-exposed-documents-updated-daily/ Buckets GrayHatWarfare maintains a searchable database of open Amazon S3 buckets, filtering out non-relevant files while indexing millions of exposed documents, updated daily. https://buckets.grayhatwarfare.com/ #OSINT #CloudSecurity #Cybersecurity #Reconnaissance

L'articolo GrayHatWarfare Buckets Search proviene da Mario Santella.

]]> Buckets GrayHatWarfare maintains a searchable database of open Amazon S3 buckets, filtering out non-relevant files while indexing millions of exposed documents, updated daily.

https://buckets.grayhatwarfare.com/

#OSINT #CloudSecurity #Cybersecurity #Reconnaissance

L'articolo GrayHatWarfare Buckets Search proviene da Mario Santella.

]]> grep-backURLs https://www.mariosantella.com/grep-backurls/ Mon, 28 Apr 2025 15:57:16 +0000 https://www.mariosantella.com/grep-backurls-automate-credential-extraction-for-web-security-and-bug-hunting/ Automate credential extraction for web security and bug hunting: find subdomains, scrape archived URLs, and grep for sensitive data. https://github.com/gigachad80/grep-backURLs #OSINT #BugBounty #Cybersecurity #Reconnaissance

L'articolo grep-backURLs proviene da Mario Santella.

]]> Automate credential extraction for web security and bug hunting: find subdomains, scrape archived URLs, and grep for sensitive data.

https://github.com/gigachad80/grep-backURLs

#OSINT #BugBounty #Cybersecurity #Reconnaissance

L'articolo grep-backURLs proviene da Mario Santella.

]]> maxun https://www.mariosantella.com/maxun/ Mon, 28 Apr 2025 15:57:08 +0000 https://www.mariosantella.com/maxun/ Open-source no-code platform for automated web data extraction: train scraping workflows in minutes and collect data at scale—no coding needed. https://github.com/getmaxun/maxun #OSINT #WebScraping #Automation

L'articolo maxun proviene da Mario Santella.

]]> Open-source no-code platform for automated web data extraction: train scraping workflows in minutes and collect data at scale—no coding needed.

https://github.com/getmaxun/maxun

#OSINT #WebScraping #Automation

L'articolo maxun proviene da Mario Santella.

]]>