Part 2: A simple script to pull information

spiffylogic

@admin When I use "availabilityEndDateNear" (for a title that I know is expiring soon) I get back something I don't understand:

u'availabilityEndDateNear': {u'$size': 16, u'$type': u'sentinel', u'size': 16}

What does this mean?

admin

@spiffylogic what title in what country?

spiffylogic

@admin That was "You Laugh But It's True" in Canada

admin

@spiffylogic It works fine for me, can you post the PATH JSON you are using?

spiffylogic

@admin Sorry it is actually working but I got lost in the sea of output. The data for that title indeed shows

u'availabilityEndDateNear': u'2017-10-05'

but for all other titles it has that sentinel blob (which is still curious to me...).

Thanks for your help and for this great forum!

admin

@spiffylogic Glad to hear it... https://jsonformatter.curiousconcept.com/ is your friend

@frankied said in Part 2: A simple script to pull information:

Requesting

When I try your code I get this response:
'''
{u'paths': [[u'shows'], [u'80113701'], [u'browse']],
u'value': {u'$size': 48,
u'80113701': {u'$size': 16, u'$type': u'sentinel', u'size': 16},
u'browse': {u'$size': 16, u'$type': u'sentinel', u'size': 16},
u'shows': {u'$size': 16, u'$type': u'sentinel', u'size': 16},
u'size': 48}}
'''

Do you guys know how I can get the titles actors, directors and creators?
Thanks in advance! :)

I'm trying to accomplish the same thing as this code sample in c#, I was able to get a working response in python but the rest of my project is in c#.

However when I use a HTTPWebRequest to get the response stream, the response looks like this:
"\u001f�\b\0\0\0\0\0\0\0ܖKo�F\fǿ�B�q�%�=�\u0015i\u000e)�&��T\u0004\u0006g�\u0013+Qv\u0017+��\u07fd#m��_M\u0011 \a�F��P\u007f�(��T�Ԟqu��k>\u0017C(i��^��\u0018�_m�ê�u߬��9hn3�ܔ\u0004��ݮ)'w��mL1�:��j��!�u&�\u0002\u001b��L�BP^��\u0018}d��LL9�(]&O�u\u0014Z9\u0017\u0010<\n\u001b2xͬ]\0��\u0010g2�Z��\u0010E��2uܽ.e��\u001d�@��\u0012XKgIHr |

(Shortened so not to overwhelm)

I'm at a loss as to why the response I'm getting in c# is a unicode mess but the python code gets a nice clean response.

Any ideas?

        string genres = "0,\"to\":1";
        string rmax = "5";
        string sbase = "[[\"newarrivals\",{\"from\":" + genres + "},{\"from\":0,\"to\":" + rmax + "},[\"title\",\"availability\"]],[\"newarrivals\",{\"from\":" + genres + "},{\"from\":0,\"to\":" + rmax + "},\"boxarts\",\"_342x192\",\"jpg\"]]";
        string data = "{\"paths\":" + sbase + ",\"authURL\":\"1516657903506.SW2aceZfllyxCd5V5TPHJdJiMxQ=\"}";

        byte[] byteArray = Encoding.UTF8.GetBytes(data);
        request.ContentLength = byteArray.Length;
        Stream dataStream = request.GetRequestStream();
        dataStream.Write(byteArray, 0, byteArray.Length);
        WebResponse response = request.GetResponse();
        dataStream = response.GetResponseStream();
        StreamReader reader = new StreamReader(dataStream);
        string responseFromServer = reader.ReadToEnd();

admin

unfortunately I have never played with C# so I can't be much help there...

@admin I've been trying to do a search call to pathevaluator, even copied exactly what is being sent on netflix's search page, but there must be some kind of sorting going on? For example when I search "shark" I'm getting little rascals at the top. Little rascals is also on the netflix page but down on around row 10.

Any idea if theres some relevancy value I need? Thanks in advance.

victorhupo

@admin I would like to download the boxart of this title "80101802" but in my language that is brazilian portuguese, I do not understand mto code but I tried it and I did not get it through your tutorial, it would have you help me or else add the function of being able to choose the parents that your site would take the image?

admin

@victorhupo what title is that? it doesn't look like it exists..

victorhupo

@admin Sorry, this is it. http://unogs.com/video/?v=80072207

admin

@victorhupo If its just for this one title click on 'show all images' , then right click on whatever image you want and save it

victorhupo

@admin but in the site only it shows images in EnglishI would like the images in Brazilian Portuguese.

admin

@victorhupo In that case you would need to use this tutorial and just change your language to whatever you want...

'Accept-Language':'en-GB,en;q=0.5',

needs to change to:

'Accept-Language':'pt',

or something equivalent.. have a look at your request headers like mentioned in the example above

Leuven

Am interested in understanding the geographical differences in Netflix offerings and particularly attempting to determine the hierarchies used to implement various aspects of subscriber based on location. Accordingly beginning to understand what the API can offer seems useful.

After using pip to install requests (which I also attempted for json as it's there in the script import statements), I created & did the updates to the script itself.

I copied the python script into a (.py) file, updated the cookie sections (containing components for memclid, nfvdid, SecureNetflixId, NetflixId, cL, clSharedContext, didUserInteractWithPage, dsca...).

Initially it seemed to give some sort of json error, but after updating the User-Agent details now gives me the following.

13:46:Drei $python netflix1.py
Traceback (most recent call last):
File "netflix1.py", line 29, in <module>
videos=rjson['value']['videos']
KeyError: 'value'
13:46:Drei $head -29 netflix1.py | tail -1
videos=rjson['value']['videos']

Ideas?
I also updated the User Agent value and pathevaluator value (URL) from a POST request.

Leuven

As the python response error is apparently with whatever the rjson is, how might I determine if it is being populated? Via inspect element in the browser I can see that videos contains the following attributes..summary, title, titleMaturity, userRating, boxarts, UserRatingRequestId.

I know that the browser response is separate from that of the python script response.

How to troubleshoot?

Leuven

Manually stepping through the steps of the script and using print to reveal variable values and responses shows me much.

response=requests.post(url,data=data,headers=headers)
print response
<Response [200]>

So I'm getting an "OK" response.

rjson=response.json()
print rjson
{u'paths': [[u'newarrivals', {u'to': 1, u'from': 0}, {u'to': 5, u'from': 0}, [u'title', u'availability']], [u'newarrivals', {u'to': 1, u'from': 0}, {u'to': 5, u'from': 0}, u'boxarts', u'_342x192', u'jpg']], u'jsonGraph': {u'newarrivals': {u'1': {u'$type': u'ref', u'value': [u'lists',...
...
.., {u'boxarts': {u'_342x192': {u'jpg': {u'$type': u'atom'}}}, u'availability': {u'$type': u'atom'}, u'title': {u'$type': u'atom'}}, u'5': {u'boxarts': {u'_342x192': {u'jpg': {u'$type': u'atom'}}}, u'availability': {u'$type': u'atom'}, u'title': {u'$type': u'atom'}}, u'4': {u'boxarts': {u'_342x192': {u'jpg': {u'$type': u'atom'}}}, u'availability': {u'$type': u'atom'}, u'title': {u'$type': u'atom'}}}}}}

And here's where it falls down.

videos=rjson['value']['videos']
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
KeyError: 'value'