+- Hack Forums (https://hackforums.net)
+-- Forum: Tech (https://hackforums.net/forumdisplay.php?fid=444)
+--- Forum: Coding (https://hackforums.net/forumdisplay.php?fid=151)
+---- Forum: Software Development (https://hackforums.net/forumdisplay.php?fid=118)
+---- Thread: [Python] ProxyScraper v2 (/showthread.php?tid=5676637)
ProxyScraper v2 - vorticalbox - Jul 23, 2017
Features:
- Scrapes proxies from https://www.us-proxy.org/ https://incloak.com/proxy-list/ http://free-proxy-list.net/anonymous-proxy.html and http://free-proxy-list.net/
- Custom target to check proxies work against it.
- Custom Thread count, put as many as your connection can handle.
- Module for easier imports into your projects
![[Image: Screenshotfrom2017-07-2319-36-53.png]](https://www.imageupload.co.uk/images/2017/07/23/Screenshotfrom2017-07-2319-36-53.png)
Requirements
- Python 3
- Beautifulsoup 4
- Requests
- tdqm
Download
Git hub
Zip
Changes:
- added tqdm for progress without slow printing
- reduced repetitive code as suggested
- custom URL for testing
- Changed asci art to match the forums (why not ^_^)
* - koolkid - Jul 23, 2017
I Like your focus dude and also i think you could have just updated your old thread to reflect this current improvement.
* - vorticalbox - Jul 23, 2017
(Jul 23, 2017 12:15 PM)koolkid Wrote: I Like your focus dude and also i think you could have just updated your old thread to reflect this current improvement.
Wouldn't let me, as I'm not upgrade and there is a time limit :(
* - TheMarkMan - Jul 23, 2017
This is looking clean, man. Could use this for a bunch of projects
* - vorticalbox - Jul 23, 2017
(Jul 23, 2017 12:53 PM)TheMarkMan Wrote: This is looking clean, man. Could use this for a bunch of projects
Feel free too, if you have any improvements send me a pull request on github.
I'm thinking i should add response time and keep only fast proxies.
* - lockhead - Jul 24, 2017
Thanks for sharing your work, keep it up.
But please don't post links to shitty url shorteners!
* - vorticalbox - Jul 24, 2017
(Jul 24, 2017 01:01 AM)lockhead Wrote: Thanks for sharing your work, keep it up.
But please don't post links to shitty url shorteners!
updated links ^_^
* - icmp - Jul 24, 2017
Don't push your pycache to your repo lmao, also placeholders can just be empty curly braces like {} instead of {:int} etc. As long as in the format method you list them in correct substitution order.
* - vorticalbox - Jul 24, 2017
(Jul 24, 2017 05:42 AM)icmp Wrote: Don't push your pycache to your repo lmao, also placeholders can just be empty curly braces like {} instead of {:int} etc. As long as in the format method you list them in correct substitution order.
added pychache to gitingore thanks for the heads up ^_^
* - idkausername1234 - Jul 30, 2017
Thanks for sharing, this is very useful :)