Addressing recent issues with the website and API
-
I don't know if Flixwatch has issues or if the developper is just a bit sloppy. If you look what he says on reddit, you'll see that the guy hasn't much ambition for that website, it's just a portfolio to get a job in SEO.
-
re Flixwatch, if they are actually updating 70 countries, I'm impressed...
but its hard to tell because the website is a bit of ad-laden dumpster fire IMHO -
That actually sounds plausible!
-
Rooting for czech republic to get back on track. Keep up the awesome work!
-
By the way, what are the repercussions for scraping? Do they just flat out permaban your account or is it a temporary ban or what? I might start scraping Czech Republic myself and give you the data, but it all depends...
-
re: ban... they shut down the account for 48 hours, basically you just get 403's after you login
-
Expiring data for Australia looks to have updated in the last 8 hours and all looks correct. Also Brazil has a lot of titles listed now so that may be up to date.
Canada, Hong Kong, India, Japan, United States and United Kingdom expiring data is still missing, hopefully that just needs more time to cycle through for people in those countries.
Thanks!
-
@admin said in Addressing recent issues with the website and API:
re: ban... they shut down the account for 48 hours, basically you just get 403's after you login
Are you getting 403 error on login page load? This is not account issue. Change IP and try again.
-
this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere
-
Can you scrape without account? For example, in Germany, you can still see https://www.netflix.com/de-en/title/81071573 while logged off.
-
re scrape without an account: how would i find all the new titles?
-
@admin said in Addressing recent issues with the website and API:
this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere
Anyway it's easy to create another trial account (use Virtual CC).
-
@admin said in Addressing recent issues with the website and API:
re scrape without an account:
If it's possible, it means you can virtually scrape every country. Some countries would have new/expiring data (using the scraping method you've had so far), whereas others would just have availability (is it on Netflix: yes / no). That last data is what I pay the API for, as I'm sure many others are. The date data, in my view, is a nice to have. If I have to choose between having no data on so many countries or availability data on all of them, I'd definitely choose the latter.
-
And if your question is how to find completely new titles, you can use TMDb or OMDb to scrape against all titles.
-
I suggest you give that a shot.. its more complicated than you think
-
which part? The tmdb integration?
-
or the matching?
-
getting an accurate list of netflix titles by scraping their public site
-
Awesome US expiring back and complete. Thanks for your efforts
-
Did a quick check on Greece - unique items - lists a bunch of Superman movies, US Marshals, Lethal Weapon, but when searched - they are not on netflix greece as far as I can tell. making it harder and harder to tell what's valid.