Hack Forums
[.NET] (username scraper) where should I scrape from? - Printable Version

+- Hack Forums (https://hackforums.net)
+-- Forum: Tech (https://hackforums.net/forumdisplay.php?fid=444)
+--- Forum: Coding (https://hackforums.net/forumdisplay.php?fid=151)
+---- Forum: Software Development (https://hackforums.net/forumdisplay.php?fid=118)
+---- Thread: [.NET] (username scraper) where should I scrape from? (/showthread.php?tid=4752638)



(username scraper) where should I scrape from? - CC_AnoN - Mar 29, 2015

[Image: 43368ec8cb6dca388be77b91cd35559b.gif]

I am in the process of making a username scraper.
but where should i should from?


This is what I have now.
[Image: 24ac49cf24b11ab555263e704f0f6e82.png]

The last one "username" gets username from 5 large forums.




* - Odus - Mar 29, 2015

Xbox, PSN, Twitter, Instagram, Soundcloud, other big platforms. This should be in Hacking Tools and Programs rather than a coding sub forum.

P.S Owl.


* - Ninja - Mar 29, 2015

Xbox, PSN, Twitter, Instagram, Soundcloud, gaming forums. Or do it as I do it; import a list of firstnames (and lastnames) and make a username mapper.


* - Stаlkеr - Mar 29, 2015

Twitter, Random gaming forums..

OT: Nice Program so smooth and fast :)


* - NETExplorer - Mar 29, 2015

(Mar 29, 2015 07:33 AM)Tyranitar Wrote:  Xbox, PSN, Twitter, Instagram, Soundcloud, gaming forums. Or do it as I do it; import a list of firstnames (and lastnames) and make a username mapper.

Bro, like what are you doing with your life
Why do you feel the need to blatantly copy Odus's post


* - Ninja - Mar 29, 2015

(Mar 29, 2015 09:28 AM)PatPositron Wrote:  Bro, like what are you doing with your life
Why do you feel the need to blatantly copy Odus's post

I didn't copy his post. Well not intentionally. I read the posts and then made my post, and those names/services just came to my mind then. Maybe they did because I read his post, I dont know. And I just noticed because you posted this.


* - Brasil - Apr 10, 2015

HF, for example the users online list


* - Ninja - Apr 10, 2015

(Apr 10, 2015 04:06 PM)FOUSH Wrote:  HF, for example the users online list

Im not sure if that is allowed... And there are a TON of other stuff you can get usernames from. I got 2.5 million unique usernames from some ripped databases and such. Probably a few hundred 1000 is fake, but still.


* - Brasil - Apr 13, 2015

Why wouldn't it be allowed? You can view them in your browser...

If it isn't allowed then don't do it ;)


* - Ninja - Apr 14, 2015

(Apr 13, 2015 08:28 PM)FOUSH Wrote:  Why wouldn't it be allowed? You can view them in your browser...

If it isn't allowed then don't do it ;)

Well, first of all it wouldn't really work; HF has (d)dos protection, so it would have to use webbrowser instances (or you can run the JS in VB and use webrequests, but that is just not worth it), and also it detects the number of connections you make and automatically bans you if you exceed the limit. Using proxies would avoid that, but trigger the (d)dos protection. More info here:
https://hackforums.net/misc.php?action=help&hid=19
I couldn't find anything about scraping specifically, but I am %99 sure it is disallowed.


* - Ninja - Apr 14, 2015

(Apr 14, 2015 09:16 AM)Yani Wrote:  You can simulate the CF browser check if you know what you're doing.
That is what I said; you can simulate the JS in VB (using MSScriptControl).

(Apr 14, 2015 09:16 AM)Yani Wrote:  Problem is that the HF username list isn't a good one, and trying to get a CF bypass would be way too much work for a simple tool like this.

Amen. Too much work for a simple tool. You are better of finding some fresh databases and using regular expressions to capture the usernames (and optionally the passwords).