Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

URL Exists Checker

Hi,
i am looking for a tool that verify if a web page exists or not, i explain better what i need:

1) I have a base URL for example: mysite.com
2) I have a txt file that cointains a wordlist, for example:
- aaa
- bbb
- ccc

I need a tool that check every subdomain in the list, so:
- mysite.com/aaa
- mysite.com/bbb
- mysite.com/ccc

and tell me if exists or not.

I tried to develop an application that do that by myself, but it's too much slow, i need a faster tool that process a lot of tries at a second.

I'm not interested about the content or the page body, i just need a response code 200 or 404 or something similar.

Anyone know a tool that can do a similar work? And maybe some tutorial?

Thank you very much in advance.
(Oct 18, 2016 09:17 AM)TheDarkShadow Wrote:  Hi,
i am looking for a tool that verify if a web page exists or not, i explain better what i need:

1) I have a base URL for example: mysite.com
2) I have a txt file that cointains a wordlist, for example:
- aaa
- bbb
- ccc

I need a tool that check every subdomain in the list, so:
- mysite.com/aaa
- mysite.com/bbb
- mysite.com/ccc

and tell me if exists or not.

I tried to develop an application that do that by myself, but it's too much slow, i need a faster tool that process a lot of tries at a second.

I'm not interested about the content or the page body, i just need a response code 200 or 404 or something similar.

Anyone know a tool that can do a similar work? And maybe some tutorial?

Thank you very much in advance.

I think this is what you're looking for?
https://github.com/iluxonchik/blackhat-p..._bruter.py
Google up wfuzz. A very good tool for this I used some time ago.

Cheers,
Abducted 🤝
You could use a admin page finder for this, would probably the easiest since there's plenty of them, and you could use your own textlist.
I could also recommend wget -r -nd --delete-after, it might be what you're looking for.
wow, thank you very much for your quick answers! i will try these methods for sure, thank you again! :)
dirbuster will do this for you.
hey bro i can write the script url checker. can you send me your wordlist? so i could try my program..thanks
How this tool works? There is an explanation and guidance


Possibly Related Threads...
Thread / Author Replies Views Last Post
by SMOKEDOUT69Jun 12, 2016 03:03 AM 0 142 Jun 12, 2016 03:03 AM
Last Post: SMOKEDOUT69
by livestreamApr 6, 2013 06:42 AM 2 92 Apr 6, 2013 06:42 AM
Last Post: Phizo
by CorruptedTNCMar 26, 2013 04:42 PM 3 139 Mar 26, 2013 04:42 PM
Last Post: ShadowRi5ing