![[Image: 43368ec8cb6dca388be77b91cd35559b.gif]](https://i.gyazo.com/43368ec8cb6dca388be77b91cd35559b.gif)
I am in the process of making a username scraper.
but where should i should from?
This is what I have now.
![[Image: 24ac49cf24b11ab555263e704f0f6e82.png]](https://i.gyazo.com/24ac49cf24b11ab555263e704f0f6e82.png)
The last one "username" gets username from 5 large forums.
|
.NET
(username scraper) where should I scrape from? |
 
Mar 29, 2015 09:01 AM
(This post was last modified: Mar 29, 2015 09:01 AM by Stаlkеr.)
Twitter, Random gaming forums..
OT: Nice Program so smooth and fast :) ![[Image: GUsQZTN.gif]](https://i.imgur.com/GUsQZTN.gif) (Mar 29, 2015 07:33 AM)Ninja Wrote: Xbox, PSN, Twitter, Instagram, Soundcloud, gaming forums. Or do it as I do it; import a list of firstnames (and lastnames) and make a username mapper. Bro, like what are you doing with your life Why do you feel the need to blatantly copy Odus's post ![[Image: jlscvfi.png]](https://i.imgur.com/jlscvfi.png) (Mar 29, 2015 09:28 AM)NETExplorer Wrote: Bro, like what are you doing with your life I didn't copy his post. Well not intentionally. I read the posts and then made my post, and those names/services just came to my mind then. Maybe they did because I read his post, I dont know. And I just noticed because you posted this.  (Apr 10, 2015 04:06 PM)Brasil Wrote: HF, for example the users online list Im not sure if that is allowed... And there are a TON of other stuff you can get usernames from. I got 2.5 million unique usernames from some ripped databases and such. Probably a few hundred 1000 is fake, but still. (Apr 13, 2015 08:28 PM)Brasil Wrote: Why wouldn't it be allowed? You can view them in your browser... Well, first of all it wouldn't really work; HF has (d)dos protection, so it would have to use webbrowser instances (or you can run the JS in VB and use webrequests, but that is just not worth it), and also it detects the number of connections you make and automatically bans you if you exceed the limit. Using proxies would avoid that, but trigger the (d)dos protection. More info here: HF Site Access Problems and Loading Errors I couldn't find anything about scraping specifically, but I am %99 sure it is disallowed.
Apr 14, 2015 09:34 AM
(This post was last modified: Apr 14, 2015 09:34 AM by Ninja.)
(Apr 14, 2015 09:16 AM)Yani Wrote: You can simulate the CF browser check if you know what you're doing.That is what I said; you can simulate the JS in VB (using MSScriptControl). (Apr 14, 2015 09:16 AM)Yani Wrote: Problem is that the HF username list isn't a good one, and trying to get a CF bypass would be way too much work for a simple tool like this. Amen. Too much work for a simple tool. You are better of finding some fresh databases and using regular expressions to capture the usernames (and optionally the passwords). |
|
|
