Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

[Need BETA Testers] Universal Scraper - Config based Scraper - Config Scripting

I have now finished the first build of my new product. It is an advanced Scraper which is nearly completely config based (like SentryMBA). I decided to create ir because I have seen a lot of overpriced scraper in the marketplace. That's also the reason why I will release a free and a premium version when the product is finished. But for now I am searching Beta testers. It has an extremely fast speed, is multi threaded and has a custom easy scripting language for creating configs. It has a clean newbie friendly clean gui. In the spoiler is a demo (gif) and the code for the example config which was used in this gif.

Spoiler (Click to View)

At first this scripting language looks a bit confusing, but if you take a closer look you can see that it is actually really simple.
In the first part
PHP Code

<?php 
author
=Weco
name
=MCScrap
version
=1.0.0
update
=http://example.com/update_mcscrap.html 
I entered informations like the author, version, name or the update url (for automatic updates of the config).
Then I set the increment type to given, so it will use the chars after given= (in this demo 0abcdefghijklmnopqrstuvwxyz_). You can also set "given" to numbers, letters and letters_numbers. But because the site required speical chars I used a custom charset. start=0 and end=26 are for the amount of chars it should use from the given charset.
Then there is url=https://minebook.me/c/directory/%weco_increment%. This means that my software will replace %weco_increment% with a char of the given charset. So it generates URLs like https://minebook.me/c/directory/0; https://minebook.me/c/directory/a; ...
Then my program reads the webpage line by line. If the trigger value is detected in one line (in this example: <a href="https://minebook.me/), then it will try to extract the text between targetLeft ( <a href="https://minebook.me/) and targetRight (">). The extraced value is the searched username.


here is the line with the required username extraced from the html code of the site:
targetLeft
targetRight
trigger
targeted text

Quote: <a href="https://minebook.me/username">


I am searching Beta Tester for this product. Every Beta tester will get all the configs I have created so far and two premium version serials when I start the sales. I will need about 3-6 Beta Testers. Requirements & Application format:
Spoiler (Click to View)
Interesting concept, although wouldn't regex be more suited? "GetBetween" functions do not work everywhere, perhaps add an option for 'regex' instead of targetLeft/right
[Image: PVoDiqS.png]
I'll be happy to become a beta tester of your new product
kik: spiderman
skype: scammed
twitter: 22i
soundcloud: uptime
snapchat: annulled

(Mar 3, 2016 06:29 AM)DarkSwag Wrote:  I'll be happy to become a beta tester of your new product

Ok, thanks for your interest, please add me on Skype:
weco.sell
Still searching people for this Beta!
Nice product, Can I be a beta tester ?
i lol'd when i saw i_want_yo_bacon but ye mate this is a good one.

if you can trump all existing ones there in terms of performance, compatibility and scalability, well you're amping up the market competition and would most likely land on your own next product line.

cheers.
Still searching BETA testers!
this is much like http://import.io/ if I am not mistaken, right?
(Mar 10, 2016 08:19 PM)Alskling Wrote:  this is much like http://import.io/ if I am not mistaken, right?

I hope it's not like import.io. I have a project that requires scraping thousands of pages for prices and it is a pain in the ass to stay on top of things. Import.io can only, if I recall correctly, import tables. If I wanted to only import tables, I would just use Excel External Data function. I need to grab specific prices and numbers from pages and they have to be filtered with specific attributes to stay in accordance to my project layout.

OP, I'll contact you later about this.


Possibly Related Threads...
Thread / Author Replies Views Last Post
[Beta Release] by ShadowCipherMar 26, 2025 09:48 PM 5 342 Mar 26, 2025 09:48 PM
Last Post: Deneme14
[Beta Release] by DrizJun 2, 2020 06:44 AM 0 149 Jun 2, 2020 06:44 AM
Last Post: Driz
[Beta Release] by BitCrashaApr 29, 2019 05:32 AM 4 219 Apr 29, 2019 05:32 AM
Last Post: CashoutArtist