Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

Leeching information from cloudflare protected website

Hi there
I tried to leech a list of titles from a website, you can consider it similar to leeching usernames from forums (for example 25 names per page which I want to leech). Sadly, the website is protected by cloudflare (or something similar) so my leecher returns empty results. 
Is there any way to do this? I've tried forum leecher and AIOHNB but all failed, and I'd rather not manually leech 130+ pages of 25 titles by hand.
Thanks.
Is there really noone who knows how to handle this problem?
CloudFlare is quite commonly misconfigured, causing the DNS to leak the real IP address of the webserver. See https://hackforums.net/showthread.php?tid=2660401. Most of the time, it works well out-of-the-box. However, you can easily extend it by adding more subdomains to the $subs array. You can attempt to find other subdomains by attempting a DNS zone transfer (by querying the DNS server for the AXFR record). It doesn't always work (only when the DNS server is (mis)configured to do so), but when it does, you will acquire a great topological overview of the DNS (as DNS zone transfers are a means of replicating DNS databases across sets of DNS servers). If DNS zone transfers are not permitted, you can simply crawl the site to acquire working subdomains.
[Image: 8Yoto.png]


Possibly Related Threads...
Thread / Author Replies Views Last Post
by DirtbagjohnnyApr 10, 2023 06:40 AM 0 108 Apr 10, 2023 06:40 AM
Last Post: Dirtbagjohnny
by giggioOct 2, 2022 04:44 AM 5 336 Oct 2, 2022 04:44 AM
Last Post: giggio
by fifalwt28Dec 8, 2019 08:21 PM 1 363 Dec 8, 2019 08:21 PM
Last Post: ideaatounotesutowan