How To Find All Pages within a website you don't own?

How To Find All Pages within a website you don't own? - Printable Version

+- Hack Forums (https://hackforums.net)
+-- Forum: Hacks, Exploits, and Various Discussions (https://hackforums.net/forumdisplay.php?fid=45)
+--- Forum: Grayhat • Purple Team • Hybrid Security (https://hackforums.net/forumdisplay.php?fid=449)
+---- Forum: Website Hacking (https://hackforums.net/forumdisplay.php?fid=43)
+---- Thread: How To Find All Pages within a website you don't own? (/showthread.php?tid=6091568)

How To Find All Pages within a website you don't own? - Dr.Hurlu - Jul 1, 2020

Let's say I want to find out all pages from examplewebsite.com

Links like this: examplewebsite.com/login or examplewebsite.com/members/ or examplewebsite.com/2312831451410/

How do I go about that? especially if they're sort of hiding certain pages.

RE: How To Find All Pages within a website you don't own? - The PC Guy - Jul 1, 2020

https://pentest-tools.com/website-vulnerability-scanning/discover-hidden-directories-and-files

Find different tools to explore the dir of websites

Correct term is a 'URL Fuzzer'

RE: How To Find All Pages within a website you don't own? - linkinpork - Jul 1, 2020

(Jul 1, 2020 03:00 AM)Dr.Hurlu Wrote: Let's say I want to find out all pages from examplewebsite.com

Links like this: examplewebsite.com/login or examplewebsite.com/members/ or examplewebsite.com/2312831451410/

How do I go about that? especially if they're sort of hiding certain pages.

Tried dirbuster yet? It has a built-in wordlist, also has bruteforcer mode. Mutli-threaded too in case you want it faster.
It's one of my faves:

Code 
https://tools.kali.org/web-applications/dirbuster

If you want the Java version (to run it on Windows) here:
https://sourceforge.net/projects/dirbuster/
Screenshot:
[Image: 1]

Note: it's really fast so you have to tweak the threads and the request rate cos you might get blocked by the WAF, thinking you're doing a DDOS.

Kali also has dirb

Code 
apt-get update

apt-get install dirb

dirb -h

There's also gobuster and wfuzz but I don't have a lot of experience in them (I'm pretty narrow-minded when it comes to using new tools lol)

I hope all goes well, mate

RE: How To Find All Pages within a website you don't own? - Dr.Hurlu - Jul 1, 2020

(Jul 1, 2020 03:07 AM)The PC Guy Wrote: https://pentest-tools.com/website-vulnerability-scanning/discover-hidden-directories-and-files

Find different tools to explore the dir of websites

Correct term is a 'URL Fuzzer'

Thanks a lot for the recommendation!

(Jul 1, 2020 03:22 AM)linkinpork Wrote: Tried dirbuster yet? It has a built-in wordlist, also has bruteforcer mode. Mutli-threaded too in case you want it faster.
It's one of my faves:

Code
https://tools.kali.org/web-applications/dirbuster

If you want the Java version (to run it on Windows) here:
https://sourceforge.net/projects/dirbuster/
Screenshot:

Note: it's really fast so you have to tweak the threads and the request rate cos you might get blocked by the WAF, thinking you're doing a DDOS.

Kali also has dirb

Code
apt-get update apt-get install dirb dirb -h

There's also gobuster and wfuzz but I don't have a lot of experience in them (I'm pretty narrow-minded when it comes to using new tools lol)

I hope all goes well, mate

Awesome, I'll give it a go on windows real quick. Thanks for the help mate!

RE: How To Find All Pages within a website you don't own? - frank3nstien - Jul 1, 2020

Before run any scanners just use few methods like
- Request robots file which extract links from it "example.com/robots.txt"
- Request site map same as above "example.com/sitemap.xml"
Above methods will work silently than network noise.

And the best one is use Burpsuite to crawl all pages.

RE: How To Find All Pages within a website you don't own? - bdkalkun - Jul 1, 2020

You can use screamingfrog for this

RE: How To Find All Pages within a website you don't own? - 00day - Jul 5, 2020

there is only 2 ways to do this :

1-url fuzzing using many different tools like gobuster,dirbuster,wfuzz,ffuf etc ...
2- download the webapp source code (if its available online) locally to see the site structure and hidden files

RE: How To Find All Pages within a website you don't own? - Cynaide - Aug 5, 2020

(Jul 1, 2020 10:03 AM)bdkalkun Wrote: You can use screamingfrog for this

Looks like you are from seo background..had used it some time ago to find wso download pages and it pretty much does its job in finding hidden pages 😁😁

RE: How To Find All Pages within a website you don't own? - YETIII - Aug 5, 2020

Posting to hold this thread so I can look at it again when I'm on PC!