Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

How can I download a whole forum?

Thread subject says it all. I'm user in a private forum and would like to leech the informations to have offline access.

Thanks in advance.
Have you considered typing the same into Google and clicking the first result?
Can you hear my voice
come thru the music?
(Aug 19, 2015 07:17 AM)Viktory Wrote:  Have you considered typing the same into Google and clicking the first result?

Yeah, but it doesn't work for private forums since HTTrack for example has no access to them.
(Aug 19, 2015 07:33 AM)KiNGTyreZe Wrote:  Yeah, but it doesn't work for private forums since HTTrack for example has no access to them.

If you don't have access to a forum, you can't download it. End of story.

The poor remain poor by acting rich.
(Aug 19, 2015 08:34 AM)XMR Wrote:  If you don't have access to a forum, you can't download it. End of story.

I think you misunderstood me. I have access to the forum.
However the tool isn't trying to download the website over my browser client.
In fact it's trying to download the private forum over a new instance.

My question is still: How can I download the whole forum?

I couldn't find something yet which could help me in my concern.
(Aug 19, 2015 09:22 AM)KiNGTyreZe Wrote:  I think you misunderstood me. I have access to the forum.
However the tool isn't trying to download the website over my browser client.
In fact it's trying to download the private forum over a new instance.

My question is still: How can I download the whole forum?

I couldn't find something yet which could help me in my concern.
What do you mean the database?
Accounts...
I don't get you here
Maybe it is a TOR website or a website with some kind of protection so HTTracker can't access it.
Python + Selenium is your answer
http://stackoverflow.com/questions/87925...ing-python
http://stackoverflow.com/questions/78617...tml-source

Do more research next time.
(Aug 19, 2015 09:33 AM)Maxi Wrote:  Maybe it is a TOR website or a website with some kind of protection so HTTracker can't access it.

This! I just want to download the pages inside there.


(Aug 19, 2015 09:33 AM)Nuclear3mbargo Wrote:  Python + Selenium is your answer

Doesn't it require login first before I can download it? It seems like it's also creating a new instance.
You can use an HTTP spider, but you can't really know if you have everything. Also, any server admin worth his weight in dog shit will prevent spiders like this.
SRPP Discord Server

I am a professional network/cloud security architect.
My Old Tutorials
(Aug 19, 2015 12:00 PM)Goodies Wrote:  You can use an HTTP spider, but you can't really know if you have everything. Also, any server admin worth his weight in dog shit will prevent spiders like this.

Does it work over my browser client instance? Remember a login is required to see the content.
(Aug 19, 2015 02:38 PM)KiNGTyreZe Wrote:  Does it work over my browser client instance? Remember a login is required to see the content.

There are spiders that support HTTP logins and cookies, absolutely.
SRPP Discord Server

I am a professional network/cloud security architect.
My Old Tutorials
(Aug 19, 2015 10:58 AM)KiNGTyreZe Wrote:  This! I just want to download the pages inside there.



Doesn't it require login first before I can download it? It seems like it's also creating a new instance.

Code
pip install selenium

Yes it creates new instance if you want to make it in the current instance in your browser your only choice is JS and i'm not sure if it's possible(to save page with javascript). However you can simulate every action with Selenium.
Thanks everybody. I appreciate the help.
you need a web crawler, try dcrawl.