+- Hack Forums (https://hackforums.net)
+-- Forum: Hacks, Exploits, and Various Discussions (https://hackforums.net/forumdisplay.php?fid=45)
+--- Forum: Grayhat • Purple Team • Hybrid Security (https://hackforums.net/forumdisplay.php?fid=449)
+---- Forum: Beginner Hacking (https://hackforums.net/forumdisplay.php?fid=4)
+---- Thread: Leeching information from cloudflare protected website (/showthread.php?tid=5782394)
Leeching information from cloudflare protected website - Xeder - Jan 9, 2018
Hi there
I tried to leech a list of titles from a website, you can consider it similar to leeching usernames from forums (for example 25 names per page which I want to leech). Sadly, the website is protected by cloudflare (or something similar) so my leecher returns empty results.
Is there any way to do this? I've tried forum leecher and AIOHNB but all failed, and I'd rather not manually leech 130+ pages of 25 titles by hand.
Thanks.
RE: Leeching information from cloudflare protected website - Xeder - Jan 11, 2018
Is there really noone who knows how to handle this problem?
RE: Leeching information from cloudflare protected website - Phizo - Jan 12, 2018
CloudFlare is quite commonly misconfigured, causing the DNS to leak the real IP address of the webserver. See https://hackforums.net/showthread.php?tid=2660401. Most of the time, it works well out-of-the-box. However, you can easily extend it by adding more subdomains to the $subs array. You can attempt to find other subdomains by attempting a DNS zone transfer (by querying the DNS server for the AXFR record). It doesn't always work (only when the DNS server is (mis)configured to do so), but when it does, you will acquire a great topological overview of the DNS (as DNS zone transfers are a means of replicating DNS databases across sets of DNS servers). If DNS zone transfers are not permitted, you can simply crawl the site to acquire working subdomains.