Addressing recent issues with the website and API
-
You're right, I don't know, I'm just guessing. The admin of UNOGs tried to get more Netflix IDs to solve the issue because IDs get banned for 2 days if they're overused. It's not the first time that UNOGs asks users for help in order to support more countries. On the other end, Flixwatch was able to handle twice more countries than UNOGs without ever asking for help. UNOGs didn't seem to know that it's very easy to get Netflix IDs, it costs only a few bucks. I may be wrong, but my assumption is that Flixwatch got Netflix IDs this way and that UNOGs could save its bussiness by doing the same. UNOGs could even expand beyond 35 countries!
-
regarding it being super easy to get Netflix ID's, I have yet to see evidence of this...
if you have some easy way to get additional ID's confirmed outside the EU please send us an email: admin@unogs.com
-
I don't know if Flixwatch has issues or if the developper is just a bit sloppy. If you look what he says on reddit, you'll see that the guy hasn't much ambition for that website, it's just a portfolio to get a job in SEO.
-
re Flixwatch, if they are actually updating 70 countries, I'm impressed...
but its hard to tell because the website is a bit of ad-laden dumpster fire IMHO -
That actually sounds plausible!
-
Rooting for czech republic to get back on track. Keep up the awesome work!
-
By the way, what are the repercussions for scraping? Do they just flat out permaban your account or is it a temporary ban or what? I might start scraping Czech Republic myself and give you the data, but it all depends...
-
re: ban... they shut down the account for 48 hours, basically you just get 403's after you login
-
Expiring data for Australia looks to have updated in the last 8 hours and all looks correct. Also Brazil has a lot of titles listed now so that may be up to date.
Canada, Hong Kong, India, Japan, United States and United Kingdom expiring data is still missing, hopefully that just needs more time to cycle through for people in those countries.
Thanks!
-
@admin said in Addressing recent issues with the website and API:
re: ban... they shut down the account for 48 hours, basically you just get 403's after you login
Are you getting 403 error on login page load? This is not account issue. Change IP and try again.
-
this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere
-
Can you scrape without account? For example, in Germany, you can still see https://www.netflix.com/de-en/title/81071573 while logged off.
-
re scrape without an account: how would i find all the new titles?
-
@admin said in Addressing recent issues with the website and API:
this is most definitely an account issue.... I have tried across a variety of IP's and devices... when its blocked its blocked everywhere
Anyway it's easy to create another trial account (use Virtual CC).
-
@admin said in Addressing recent issues with the website and API:
re scrape without an account:
If it's possible, it means you can virtually scrape every country. Some countries would have new/expiring data (using the scraping method you've had so far), whereas others would just have availability (is it on Netflix: yes / no). That last data is what I pay the API for, as I'm sure many others are. The date data, in my view, is a nice to have. If I have to choose between having no data on so many countries or availability data on all of them, I'd definitely choose the latter.
-
And if your question is how to find completely new titles, you can use TMDb or OMDb to scrape against all titles.
-
I suggest you give that a shot.. its more complicated than you think
-
which part? The tmdb integration?
-
or the matching?
-
getting an accurate list of netflix titles by scraping their public site
