Addressing recent issues with the website and API

By the way, what are the repercussions for scraping? Do they just flat out permaban your account or is it a temporary ban or what? I might start scraping Czech Republic myself and give you the data, but it all depends...

admin

re: ban... they shut down the account for 48 hours, basically you just get 403's after you login

Expiring data for Australia looks to have updated in the last 8 hours and all looks correct. Also Brazil has a lot of titles listed now so that may be up to date.

Canada, Hong Kong, India, Japan, United States and United Kingdom expiring data is still missing, hopefully that just needs more time to cycle through for people in those countries.

Thanks!

@admin said in Addressing recent issues with the website and API:

re: ban... they shut down the account for 48 hours, basically you just get 403's after you login

Are you getting 403 error on login page load? This is not account issue. Change IP and try again.

admin

this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere

Can you scrape without account? For example, in Germany, you can still see https://www.netflix.com/de-en/title/81071573 while logged off.

admin

re scrape without an account: how would i find all the new titles?

@admin said in Addressing recent issues with the website and API:

this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere

Anyway it's easy to create another trial account (use Virtual CC).

@admin said in Addressing recent issues with the website and API:

re scrape without an account:

If it's possible, it means you can virtually scrape every country. Some countries would have new/expiring data (using the scraping method you've had so far), whereas others would just have availability (is it on Netflix: yes / no). That last data is what I pay the API for, as I'm sure many others are. The date data, in my view, is a nice to have. If I have to choose between having no data on so many countries or availability data on all of them, I'd definitely choose the latter.

And if your question is how to find completely new titles, you can use TMDb or OMDb to scrape against all titles.

admin

I suggest you give that a shot.. its more complicated than you think

which part? The tmdb integration?

or the matching?

admin

getting an accurate list of netflix titles by scraping their public site

Awesome US expiring back and complete. Thanks for your efforts

Did a quick check on Greece - unique items - lists a bunch of Superman movies, US Marshals, Lethal Weapon, but when searched - they are not on netflix greece as far as I can tell. making it harder and harder to tell what's valid.

Hey!. What happened with Argentina?. It will be no longer avalaible?

Y Argentina. Nos dejaron afuera :(

admin

re greece titles: what country are you coming from?

admin

@admin Greece is super weird.... when you search for 'superman' on Netflix it doesn't show up... but when you go directly to the movie it is..
https://www.netflix.com/title/60020039
I just checked a bunch of the unique titles... None of them come up in search... but you can play them by using the direct link on uNoGS...

so in this instance... uNoGS is actually more accurate than Netflix ;)