[Dr.Hurlu]

Let's say I want to find out all pages from examplewebsite.com

Links like this: examplewebsite.com/login or examplewebsite.com/members/ or examplewebsite.com/2312831451410/

How do I go about that? especially if they're sort of hiding certain pages.

[The PC Guy]

https://pentest-tools.com/website-vulner...-and-files


Find different tools to explore the dir of websites

Correct term is a 'URL Fuzzer'

[linkinpork]

Let's say I want to find out all pages from examplewebsite.com

Links like this: examplewebsite.com/login or examplewebsite.com/members/ or examplewebsite.com/2312831451410/

How do I go about that? especially if they're sort of hiding certain pages.

Tried dirbuster yet? It has a built-in wordlist, also has bruteforcer mode. Mutli-threaded too in case you want it faster.
It's one of my faves:

Code

https://tools.kali.org/web-applications/dirbuster

If you want the Java version (to run it on Windows) here:
https://sourceforge.net/projects/dirbuster/
Screenshot:


Note: it's really fast so you have to tweak the threads and the request rate cos you might get blocked by the WAF, thinking you're doing a DDOS.


Kali also has dirb

Code

apt-get update
apt-get install dirb
dirb -h

There's also gobuster and wfuzz but I don't have a lot of experience in them (I'm pretty narrow-minded when it comes to using new tools lol)

I hope all goes well, mate

[Dr.Hurlu]

https://pentest-tools.com/website-vulner...-and-files


Find different tools to explore the dir of websites

Correct term is a 'URL Fuzzer'

Thanks a lot for the recommendation!

Tried dirbuster yet? It has a built-in wordlist, also has bruteforcer mode. Mutli-threaded too in case you want it faster.
It's one of my faves:

Code

https://tools.kali.org/web-applications/dirbuster

If you want the Java version (to run it on Windows) here:
https://sourceforge.net/projects/dirbuster/
Screenshot:


Note: it's really fast so you have to tweak the threads and the request rate cos you might get blocked by the WAF, thinking you're doing a DDOS.


Kali also has dirb

Code

apt-get update
apt-get install dirb
dirb -h

There's also gobuster and wfuzz but I don't have a lot of experience in them (I'm pretty narrow-minded when it comes to using new tools lol)

I hope all goes well, mate

Awesome, I'll give it a go on windows real quick. Thanks for the help mate!

[frank3nstien]

Before run any scanners just use few methods like
- Request robots file which extract links from it "example.com/robots.txt"
- Request site map same as above "example.com/sitemap.xml"
Above methods will work silently than network noise.

And the best one is use Burpsuite to crawl all pages.

[bdkalkun]

You can use screamingfrog for this

[00day]

there is only 2 ways to do this :

1-url fuzzing using many different tools like gobuster,dirbuster,wfuzz,ffuf etc ...
2- download the webapp source code (if its available online) locally to see the site structure and hidden files

[Cynaide]

You can use screamingfrog for this

Looks like you are from seo background..had used it some time ago to find wso download pages and it pretty much does its job in finding hidden pages 😁😁

[YETIII]

Posting to hold this thread so I can look at it again when I'm on PC!