Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

.NET 

Retrieving live text from website

Hi
Im building an application that must be able to receive a continuous stream of text from a webpage.
So the text is changing all the time and I want my application to keep it up to date.

Is there any easy way to accomplish this?
The website is quite big so it must be filtered out some how...

Let me know if you can help me out
[Image: MbYfMNk.png]
(Jun 1, 2017 05:26 PM)Johan Cruyff Wrote:  Hi
Im building an application that must be able to receive a continuous stream of text from a webpage.
So the text is changing all the time and I want my application to keep it up to date.

Is there any easy way to accomplish this?
The website is quite big so it must be filtered out some how...

Let me know if you can help me out

Your signature is just a sign of respect, join me on my discord and i will explain in native language ^^
Without looking at the website it's hard to recommend a method, however there are tons of guides around on how to "scrape" data/text from a website. I assume you're using vb.net, you can usually load the webpage into a web browser control then get the html out of the "tag" you require. See stackoverflow . Com/questions/20582241/scraping-specific-text-from-website-to-application-on-vb (I can't posts links yet so I've had to split the URL up)

If you need any help give me a PM and I'll see what I can do
Yeah, you can use a httpwebrequest to send out a connection request to the website on a loop/repeat every few seconds and parse the text using substring function, regex, htmlagility, split, or whatever you prefer to parse with.
No no , we would go for a live feed, rss is one of those, but you also have html5 feeds and perhaps those with json libs
Im working on the application that do just that ... let me know if you need help. Is there any api you can access or do you want data scraped? Is api http or wss? wss is what you would want to use for continous stream and live data update but http can also be used if api allows enough connections.
[Image: V9Gredc.png]
HTMLAgilityPack will do just this. If you need any help with HTML-AO just send me a message and we can discuss.
(Jun 2, 2017 06:55 AM)Malicious Intent Wrote:  Im working on the application that do just that ... let me know if you need help. Is there any api you can access or do you want data scraped? Is api http or wss? wss is what you would want to use for continous stream and live data update but http can also be used if api allows enough connections.

It is WSS
[Image: MbYfMNk.png]
(Jun 3, 2017 04:25 AM)Johan Cruyff Wrote:  It is WSS
PM me some details. It might be that we are working on the same api.
[Image: V9Gredc.png]


Possibly Related Threads...
Thread / Author Replies Views Last Post
[C#] by ColdCypherDec 19, 2020 09:14 PM 0 140 Dec 19, 2020 09:14 PM
Last Post: ColdCypher
[Python] by SkidyApr 13, 2017 03:16 AM 2 135 Apr 13, 2017 03:16 AM
Last Post: Skidy
[Python] by IGotTheKeysAug 12, 2016 03:55 AM 5 154 Aug 12, 2016 03:55 AM
Last Post: IGotTheKeys