+- Hack Forums (https://hackforums.net)
+-- Forum: Hacks, Exploits, and Various Discussions (https://hackforums.net/forumdisplay.php?fid=45)
+--- Forum: Grayhat • Purple Team • Hybrid Security (https://hackforums.net/forumdisplay.php?fid=449)
+---- Forum: Website Hacking (https://hackforums.net/forumdisplay.php?fid=43)
+---- Thread: URL Exists Checker (/showthread.php?tid=5437195)
URL Exists Checker - TheDarkShadow - Oct 18, 2016
Hi,
i am looking for a tool that verify if a web page exists or not, i explain better what i need:
1) I have a base URL for example: mysite.com
2) I have a txt file that cointains a wordlist, for example:
- aaa
- bbb
- ccc
I need a tool that check every subdomain in the list, so:
- mysite.com/aaa
- mysite.com/bbb
- mysite.com/ccc
and tell me if exists or not.
I tried to develop an application that do that by myself, but it's too much slow, i need a faster tool that process a lot of tries at a second.
I'm not interested about the content or the page body, i just need a response code 200 or 404 or something similar.
Anyone know a tool that can do a similar work? And maybe some tutorial?
Thank you very much in advance.
* - Threebones - Oct 18, 2016
(Oct 18, 2016 09:17 AM)TheDarkShadow Wrote: Hi,
i am looking for a tool that verify if a web page exists or not, i explain better what i need:
1) I have a base URL for example: mysite.com
2) I have a txt file that cointains a wordlist, for example:
- aaa
- bbb
- ccc
I need a tool that check every subdomain in the list, so:
- mysite.com/aaa
- mysite.com/bbb
- mysite.com/ccc
and tell me if exists or not.
I tried to develop an application that do that by myself, but it's too much slow, i need a faster tool that process a lot of tries at a second.
I'm not interested about the content or the page body, i just need a response code 200 or 404 or something similar.
Anyone know a tool that can do a similar work? And maybe some tutorial?
Thank you very much in advance.
I think this is what you're looking for?
https://github.com/iluxonchik/blackhat-python-book/blob/master/Chapter_05/content_bruter.py
* - Abducted - Oct 18, 2016
Google up wfuzz. A very good tool for this I used some time ago.
Cheers,
Abducted 🤝
* - Lorenzon - Oct 18, 2016
You could use a admin page finder for this, would probably the easiest since there's plenty of them, and you could use your own textlist.
I could also recommend wget -r -nd --delete-after, it might be what you're looking for.
* - TheDarkShadow - Oct 18, 2016
wow, thank you very much for your quick answers! i will try these methods for sure, thank you again! :)
* - Colonel Panic - Oct 20, 2016
dirbuster will do this for you.
* - jembel - Oct 21, 2016
hey bro i can write the script url checker. can you send me your wordlist? so i could try my program..thanks
* - zuraelsTz - Oct 21, 2016
How this tool works? There is an explanation and guidance