+- Hack Forums (https://hackforums.net)
+-- Forum: General Topics (https://hackforums.net/forumdisplay.php?fid=7)
+--- Forum: World (https://hackforums.net/forumdisplay.php?fid=445)
+---- Forum: The Lounge (https://hackforums.net/forumdisplay.php?fid=25)
+---- Thread: How do I crawl website for URLS? (/showthread.php?tid=5775202)
How do I crawl website for URLS? - ThePureAddiction - Dec 27, 2017
Say if a website was http://test.com/page/, how would I crawl that sub-url for more links connected to (page).
Thanks!
RE: How do I crawl website for URLS? - Major League - Dec 27, 2017
Try http://tools.seochat.com/tools/online-crawl-google-sitemap-generator/#sthash.JEVJUF6J.dpbs
I think that’s what you’re looking for.
RE: How do I crawl website for URLS? - ThePureAddiction - Dec 27, 2017
(Dec 27, 2017 09:49 AM)ßigg¥ Wrote: Try http://tools.seochat.com/tools/online-crawl-google-sitemap-generator/#sthash.JEVJUF6J.dpbs
I think that’s what you’re looking for.
Doesn't work, it's ineffective. Thanks for the attempt, though.