+- Hack Forums (https://hackforums.net)
+-- Forum: Tech (https://hackforums.net/forumdisplay.php?fid=444)
+--- Forum: Coding (https://hackforums.net/forumdisplay.php?fid=151)
+---- Forum: Software Development (https://hackforums.net/forumdisplay.php?fid=118)
+---- Thread: [.NET] Retrieving live text from website (/showthread.php?tid=5637147)
Retrieving live text from website - Johan Cruyff - Jun 1, 2017
Hi
Im building an application that must be able to receive a continuous stream of text from a webpage.
So the text is changing all the time and I want my application to keep it up to date.
Is there any easy way to accomplish this?
The website is quite big so it must be filtered out some how...
Let me know if you can help me out
* - Barret - Jun 1, 2017
(Jun 1, 2017 05:26 PM)Johan Cruyff Wrote: Hi
Im building an application that must be able to receive a continuous stream of text from a webpage.
So the text is changing all the time and I want my application to keep it up to date.
Is there any easy way to accomplish this?
The website is quite big so it must be filtered out some how...
Let me know if you can help me out
Your signature is just a sign of respect, join me on my discord and i will explain in native language ^^
* - Tkings9876 - Jun 2, 2017
Without looking at the website it's hard to recommend a method, however there are tons of guides around on how to "scrape" data/text from a website. I assume you're using vb.net, you can usually load the webpage into a web browser control then get the html out of the "tag" you require. See stackoverflow . Com/questions/20582241/scraping-specific-text-from-website-to-application-on-vb (I can't posts links yet so I've had to split the URL up)
If you need any help give me a PM and I'll see what I can do
* - Cairns - Jun 2, 2017
Yeah, you can use a httpwebrequest to send out a connection request to the website on a loop/repeat every few seconds and parse the text using substring function, regex, htmlagility, split, or whatever you prefer to parse with.
* - Barret - Jun 2, 2017
No no , we would go for a live feed, rss is one of those, but you also have html5 feeds and perhaps those with json libs
* - Malicious Intent - Jun 2, 2017
Im working on the application that do just that ... let me know if you need help. Is there any api you can access or do you want data scraped? Is api http or wss? wss is what you would want to use for continous stream and live data update but http can also be used if api allows enough connections.
* - The-Noob - Jun 2, 2017
HTMLAgilityPack will do just this. If you need any help with HTML-AO just send me a message and we can discuss.
* - Johan Cruyff - Jun 3, 2017
(Jun 2, 2017 06:55 AM)Malicious Intent Wrote: Im working on the application that do just that ... let me know if you need help. Is there any api you can access or do you want data scraped? Is api http or wss? wss is what you would want to use for continous stream and live data update but http can also be used if api allows enough connections.
It is WSS
* - Malicious Intent - Jun 3, 2017
(Jun 3, 2017 04:25 AM)Johan Cruyff Wrote: It is WSSPM me some details. It might be that we are working on the same api.