Hack Forums
HOW TO GET LINK FOR ALL VALID PAGES ON A WEBSITE? - Printable Version

+- Hack Forums (https://hackforums.net)
+-- Forum: Hacks, Exploits, and Various Discussions (https://hackforums.net/forumdisplay.php?fid=45)
+--- Forum: Grayhat • Purple Team • Hybrid Security (https://hackforums.net/forumdisplay.php?fid=449)
+---- Forum: Website Hacking (https://hackforums.net/forumdisplay.php?fid=43)
+---- Thread: HOW TO GET LINK FOR ALL VALID PAGES ON A WEBSITE? (/showthread.php?tid=3414295)



HOW TO GET LINK FOR ALL VALID PAGES ON A WEBSITE? - TURKINATOR - Apr 16, 2013

lets say the website was hackforums.net , i want to find all the pages that would be hackforums.net/******.php etc etc , any tool to do this really quickly? thanks , help will be appreciated


* - Toasties - Apr 16, 2013

google site:hackforums.net/
look at results

acunetix web vulnerability scanner - note this is shit, just use for the dir


* - pr0xy122 - Apr 18, 2013

Learn 2 script, can easily be done with a bit of php


* - TURKINATOR - Apr 18, 2013

(Apr 18, 2013 07:20 PM)pr0xy122 Wrote:  Learn 2 script, can easily be done with a bit of php

im not going to try learn something when its a simple process that i need to use for a very short ammount of time. When there's already a program or something out there for this.


* - blue++ - Apr 18, 2013

You could create a sitemap, check this link: http://www.xml-sitemaps.com/


* - Toasties - Apr 18, 2013

(Apr 18, 2013 10:22 PM)Turk1sh-h4xx Wrote:  im not going to try learn something when its a simple process that i need to use for a very short ammount of time. When there's already a program or something out there for this.

well if you are not bothered to learn anything, i think you should not even try.... seriously. the more information you know the better.
knowledge is power.


* - -Root - Apr 18, 2013

(Apr 18, 2013 11:34 PM)Brentbmwh Wrote:  well if you are not bothered to learn anything, i think you should not even try.... seriously. the more information you know the better.
knowledge is power.

Knowledge is nothing without wisdom.

OP: What you're trying to do is called Crawling.
You could use Wget with this simple command:
Code
wget -mirror http://www.site.com/
You could of course use more variables, just look up the manual for Wget.