Hack Forums
Google maps scrape - Printable Version

+- Hack Forums (https://hackforums.net)
+-- Forum: Tech (https://hackforums.net/forumdisplay.php?fid=444)
+--- Forum: Webmasters (https://hackforums.net/forumdisplay.php?fid=141)
+---- Forum: Website Construction (https://hackforums.net/forumdisplay.php?fid=50)
+---- Thread: Google maps scrape (/showthread.php?tid=5909606)



Google maps scrape - GLWS88 - Nov 19, 2018

Does anyone know how to scrape or take an embedded map on a website and add to your own. I looked at the source code in html but I think there's more to that.

https://coinatmradar.com trying to get the radar map



RE: Google maps scrape - TheGoldenRelik - Nov 20, 2018

You can generate your code easily from the site above, but you just have to remove the ad that's been added to the code.
https://embedgooglemaps.com/en/


RE: Google maps scrape - GLWS88 - Nov 20, 2018

What about all the locations they have on their maps


RE: Google maps scrape - Coftek - Nov 21, 2018

https://help.parsehub.com/hc/en-us/articles/221759968-Scrape-data-from-an-interactive-map

I believe this should help you out!


RE: Google maps scrape - sdk - Nov 21, 2018

Take a peek @ their network requests.

They are talking to the their API with
Code
POST /ajax/getlocdata/ HTTP/1.1
Host: coinatmradar.com
Connection: keep-alive
Content-Length: 319
Accept: */*
Origin: https://coinatmradar.com
X-Requested-With: XMLHttpRequest
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36
Content-Type: application/x-www-form-urlencoded; charset=UTF-8
Referer: https://coinatmradar.com/
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US,en;q=0.9
Cookie: _gcar_id=503e1e039ebff8b4f3383020277a3be9ce62d6c9; _ga=GA1.2.2023066381.1542818739; _gid=GA1.2.1231586504.1542818739

Body: is_bitcoin=1&is_bitcoincash=1&is_litecoin=1&is_dogecoin=1&is_ether=1&is_dash=1&is_zcash=1&is_monero=1&is_fiatcrypto=1&is_cryptofiat=1&is_atm=1&is_otc=1&is_cashserv=0&ne_lat=26.832649094634835&ne_lng=-81.67214855639575&sw_lat=26.095021607777472&sw_lng=-82.6691578337395&z=10&s_lat=&s_lng=&pagetype=main&pageid=null&coin=

And getting back
Code
{"error_code":"0","error_message":"Data provided","markers":[{"id":"4318","lat":"26.21080000","lng":"-81.79280000","type":"atm","is_status":"0","sprite_x":"6","sprite_y":"2"},{"id":"2561","lat":"26.63795700","lng":"-81.87747200","type":"atm","is_status":"0","sprite_x":"6","sprite_y":"2"}],"clusters":[],"bounds":{"search_sw_lat":-5.32759140000000019909975890186615288257598876953125,"search_sw_lng":-98.2529663999999911538907326757907867431640625,"search_ne_lat":33.03106668000000212259692489169538021087646484375,"search_ne_lng":19.650593279999998941320882295258343219757080078125}}


I see no session indicators, so you can have a field day with this endpoint and your own map.


RE: Google maps scrape - GLWS88 - Nov 21, 2018

(Nov 21, 2018 09:53 AM)sdk‎ Wrote:  Take a peek @ their network requests.

They are talking to the their API with
Code
POST /ajax/getlocdata/ HTTP/1.1
Host: coinatmradar.com
Connection: keep-alive
Content-Length: 319
Accept: */*
Origin: https://coinatmradar.com
X-Requested-With: XMLHttpRequest
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36
Content-Type: application/x-www-form-urlencoded; charset=UTF-8
Referer: https://coinatmradar.com/
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US,en;q=0.9
Cookie: _gcar_id=503e1e039ebff8b4f3383020277a3be9ce62d6c9; _ga=GA1.2.2023066381.1542818739; _gid=GA1.2.1231586504.1542818739

Body: is_bitcoin=1&is_bitcoincash=1&is_litecoin=1&is_dogecoin=1&is_ether=1&is_dash=1&is_zcash=1&is_monero=1&is_fiatcrypto=1&is_cryptofiat=1&is_atm=1&is_otc=1&is_cashserv=0&ne_lat=26.832649094634835&ne_lng=-81.67214855639575&sw_lat=26.095021607777472&sw_lng=-82.6691578337395&z=10&s_lat=&s_lng=&pagetype=main&pageid=null&coin=

And getting back
Code
{"error_code":"0","error_message":"Data provided","markers":[{"id":"4318","lat":"26.21080000","lng":"-81.79280000","type":"atm","is_status":"0","sprite_x":"6","sprite_y":"2"},{"id":"2561","lat":"26.63795700","lng":"-81.87747200","type":"atm","is_status":"0","sprite_x":"6","sprite_y":"2"}],"clusters":[],"bounds":{"search_sw_lat":-5.32759140000000019909975890186615288257598876953125,"search_sw_lng":-98.2529663999999911538907326757907867431640625,"search_ne_lat":33.03106668000000212259692489169538021087646484375,"search_ne_lng":19.650593279999998941320882295258343219757080078125}}


I see no session indicators, so you can have a field day with this endpoint and your own map.

So how do I apply this with my map. Thanks for the API dig btw


RE: Google maps scrape - sdk - Nov 21, 2018

(Nov 21, 2018 02:17 PM)GLWS88 Wrote:  So how do I apply this with my map. Thanks for the API dig btw

Scrape that API and use this API to add a map with said markers https://developers.google.com/maps/documentation/javascript/adding-a-google-map


RE: Google maps scrape - whit3 - Nov 22, 2018

Probably that won't work because in Google services you need to whitelist your IP or domain I guess, otherwise, you need to put access_key in the code which is private.


RE: Google maps scrape - S2K - Nov 27, 2018

(Nov 22, 2018 10:38 AM)whit3 Wrote:  Probably that won't work because in Google services you need to whitelist your IP or domain I guess, otherwise, you need to put access_key in the code which is private.

Yes, if there are specific options, features on the map on the website you can't code its code and run the same map on your website since it requires domain/IP whitelisting. But you can get any other embedded maps codes from websites just looking at the html source


RE: Google maps scrape - GLWS88 - Nov 27, 2018

(Nov 27, 2018 04:37 AM)ᴍs-ᴅᴏs Wrote:  Yes, if there are specific options, features on the map on the website you can't code its code and run the same map on your website since it requires domain/IP whitelisting. But you can get any other embedded maps codes from websites just looking at the html source

Thanks for the tip. Guess I just have to do it by hand