[Kallu609]

Made this while ago and decided to share because I don't really have need for this. Maybe this will help someone.
E: Updated multiple times. This post has most up-to-date version

[rabbi]

Made this while ago and decided to share because I don't really have need for this. Maybe this will help someone.

so it just goes through a textfile and checks to see if the account is banned or not? what was your reasoning for first starting out the project

[Kallu609]

so it just goes through a textfile and checks to see if the account is banned or not? what was your reasoning for first starting out the project

I got request from fellow HF user to make program for him to mass check his accounts. I wouldn't call this a "project", a snippet at most.

I struggled a lot on beginning of my Python career with multithreading, hopefully this will help someone. It really isn't as hard as it first seems.

[rabbi]

I got request from fellow HF user to make program for him to mass check his accounts. I wouldn't call this a "project", a snippet at most.

I struggled a lot on beginning of my Python career with multithreading, hopefully this will help someone. It really isn't as hard as it first seems.

ah i see, glad you could help someone out

[l0lwtf]

Code

with lock:
    print(username.ljust(26, " ") + status)

    if not is_banned:
        open(not_banned_file, 'a').write(item + '\n')

Does this close the file handle correctly? I don't think so? Maybe I'm mistaken due to the 'with'.

[Kallu609]

Code

with lock:
   print(username.ljust(26, " ") + status)

   if not is_banned:
       open(not_banned_file, 'a').write(item + '\n')

Does this close the file handle correctly? I don't think so? Maybe I'm mistaken due to the 'with'.

You're right. It doesn't close the file handle properly. I updated main post for better version.

[Scraping]

Thanks for this Kallu, I'm pretty new to python but this looks pretty handy. I never really thought about multithreading, I'm going to go through your code and comment some of the lines to try and better understand it.

[datguy.dev]

I like making Twitch related scripts too. You might want to add a 1 second delay between each request to avoid rate limit issues.

[Kallu609]

I like making Twitch related scripts too. You might want to add a 1 second delay between each request to avoid rate limit issues.

I don't know if there's any. I ran 100s of requests and it still gave the right response so I think you can abuse that API endpoint all you want.

[datguy.dev]

I don't know if there's any. I ran 100s of requests and it still gave the right response so I think you can abuse that API endpoint all you want.

They have never really posted an official API rate limit tat I've seen. But there is code there as I've been hit with the "Rate Limit Exceeded" response. If you to become a problem, I'm sure they would ban your client id or IP. It's just a good practice to not beat on APIs if you don't have to.

[vorticalbox]

r.text looks like a JSON response any reason you're not loading it into a dictionary?

[Kallu609]

r.text looks like a JSON response any reason you're not loading it into a dictionary?

It's more efficient to just read few characters from start of string than parsing JSON and checking it's value.

[vorticalbox]

It's more efficient to just read few characters from start of string than parsing JSON and checking it's value.

doesn't it all ready have it as json? which you can access via .json()

[Kallu609]

doesn't it all ready have it as json? which you can access via .json()

Yes, it does have it as JSON but JSON parsing is slow.

Here's example running 1000000 iterations:


Code that ran (Click to View)

[vorticalbox]

Yes, it does have it as JSON but JSON parsing is slow.

Here's example running 1000000 iterations:


Code that ran (Click to View)

fair enough I thought the request library already did the json.parse for you 👍