Hack Forums
I want to download a full website with all files it hosts, Is there a way? - Printable Version

+- Hack Forums (https://hackforums.net)
+-- Forum: Hacks, Exploits, and Various Discussions (https://hackforums.net/forumdisplay.php?fid=45)
+--- Forum: Grayhat • Purple Team • Hybrid Security (https://hackforums.net/forumdisplay.php?fid=449)
+---- Forum: Beginner Hacking (https://hackforums.net/forumdisplay.php?fid=4)
+---- Thread: I want to download a full website with all files it hosts, Is there a way? (/showthread.php?tid=5971504)



I want to download a full website with all files it hosts, Is there a way? - Reporter - May 19, 2019

Hey HF

I want to download all files that a website hosts.

The website hosts over 40,000 songs x 7 different formats (280,000 files).

Each file has it's own download link with no verifications, Just a click and file is downloaded.

Example:

Websitex/ID/Songx

Is there a tool that let me download everything and rip an entire site to my Drive?


RE: I want to download a full website with all files it hosts, Is there a way? - tux1 - May 19, 2019

(May 19, 2019 06:43 AM)Reporter Wrote:  Hey HF

I want to download all files that a website hosts.

The website hosts over 40,000 songs x 7 different formats (280,000 files).

Each file has it's own download link with no verifications, Just a click and file is downloaded.

Example:

Websitex/ID/Songx

Is there a tool that let me download everything and rip an entire site to my Drive?

HTTrack I think would be a good bet, or just search for website rippers/copiers
https://www.httrack.com


RE: I want to download a full website with all files it hosts, Is there a way? - +mK - May 19, 2019

+1 to HTTrack. Put your source to the base of the domain and it'll dig through everything. It may take awhile, but it should do the trick.


RE: I want to download a full website with all files it hosts, Is there a way? - FSDSEEKERS - May 20, 2019

Use cyotek webcopy faster then Httrak


RE: I want to download a full website with all files it hosts, Is there a way? - Rezar - May 24, 2019

(May 19, 2019 07:41 AM)tux1 Wrote:  HTTrack I think would be a good bet, or just search for website rippers/copiers

httrack.com is a good one, it worked fine for me +1


RE: I want to download a full website with all files it hosts, Is there a way? - W32.DisTrack - May 24, 2019

If you don't mind the fact that httrack (or anyone who compromises them) could modify the page you get, then sure go ahead with that. But httrack also processes lots of these requests and will probably be slower than if you did it yourself. A command line utility like wget or curl would be better if your bandwidth is halfway decent.