Develop Reference

Extracting Multiple Fields from an Array of Dictionaries

I have an array of dictionaries that looks like this :
[{u'description': None, u'url': u'https://epi.testsite.net/index.php?/suites/view/196', u'is_completed': False, u'is_baseline': False, u'completed_on': None, u'is_master': False, u'project_id': 13, u'id': 196, u'name': u'Very Basic'}, {u'description': None, u'url': u'https://epi.testsite.net/index.php?/suites/view/200', u'is_completed': False, u'is_baseline': False, u'completed_on': None, u'is_master': False, u'project_id': 13, u'id': 200, u'name': u'Stress Testing'}]
and some Python code written to extract the 'id' field. Code is as follows :
suites_list = client.send_get ('get_suites/' + pid)
suites_list_ids = [item['id'] for item in suites_list]
return (suites_list_ids)
suites_list generates the data above; suite_list_ids generates a tidy output as follows :
[196, 200]
I would like to pull a second field 'name' and have that included in the output. The desired result like this :
[ {196,'Very Basic'}, {200, 'Stress Testing'} ]
I have been burning many cycles on this one and probably am overlooking something simple. Appreciate any advice.
Dan.

you can do something like this:
suites_list_vals = [(item['id'], item['name']) for item in suites_list]
output:
[(196, 'Very Basic'), (200, 'Stress Testing')]
That is a list of tuples. To iterate on the object you can do something like this:
for val in suites_list_vals:
print(val[0], ':', val[1])
output:
196 : Very Basic
200 : Stress Testing

Python - JSON results with nested for loops

Nested for loops alongside JSONresults can be mind bending.
With the code below I would like to fetch track names which belong to a specific playlist.
I create a series of empty lists:
#for 'search' endpoint results
owner_ids = []
playlist_query_names = []
playlist_query_ids = []
#for 'playlist' endpoint results
playlist_names = []
track_names = []
track_ids = []
then a function to perform a query:
def query_playlists(query):
#query 'search' endpoint(desired playlists),
#with no track_ids to be found
query_results = sp.search(q=query, type='playlist')
query_items = query_results['playlists']['items']
for item in query_items:
playlist_query_names.append(item['name'])
playlist_query_ids.append(item['id'])
owner = item['owner']
owner_ids.append(owner['id'])
however, one must access another endpoint in order to retrieve track names:
#lookup 'user_playlists' endpoint (all playlists),
#where track ids are to be found
playlist_results = [sp.user_playlists(owner) for owner in owner_ids]
playlist_items = playlist_results[0]['items']
for item in playlist_items:
playlist_name = item['name']
playlist_names.append(playlist_name)
username = item['owner']['id']
here is the method for the other endpoint
results = sp.user_playlist(username, item['id'], fields="tracks,next")
#intersect both endpoints
if playlist_name in playlist_query_names:
tracks = results['tracks']
#find desired tracks
for item in (tracks['items']):
track = item['track']
track_id = item['track']['uri']
#add tracks
track_names.append(track['name'])
track_ids.append(track_id)
return track_ids, track_names
somehow I'm not being able to narrow down track names results to playlists obtained via search endpoint
could please some rigorous mind point me out where my mistake is?
EDIT
JSONresults from playlists endpoint:
[{u'items': [{u'is_local': False, u'track': {u'album': {u'album_type': u'album', u'name': u'At Last!', u'external_urls': {u'spotify': u'https://open.spotify.com/album/2pBhXw3Hi1hBf8FpAtE101'}, u'uri': u'spotify:album:2pBhXw3Hi1hBf8FpAtE101', u'href': u'https://api.spotify.com/v1/albums/2pBhXw3Hi1hBf8FpAtE101', u'images': [{u'url': u'https://i.scdn.co/image/6387bb37eb021db9f3c9da7173fd093f5ded2429', u'width': 640, u'height': 637}, {u'url': u'https://i.scdn.co/image/55d6dc87cf5f29485c251cf672a0896bd87cc2b9', u'width': 300, u'height': 299}, {u'url': u'https://i.scdn.co/image/8bcfde39549a94c46e9cf51e653572a71aaf1f0d', u'width': 64, u'height': 64}], u'type': u'album', u'id': u'2pBhXw3Hi1hBf8FpAtE101', u'available_markets': [u'AD'..., u'UY']}, u'name': u'At Last - Single Version', u'uri': u'spotify:track:0CmIALzGn4vHIHJG4n3Q4z', u'external_urls': {u'spotify': u'https://open.spotify.com/track/0CmIALzGn4vHIHJG4n3Q4z'}, u'popularity': 65, u'explicit': False, u'preview_url': u'https://p.scdn.co/mp3-preview/a8fc45fd24d3f6aaaa33262cba0d5c91b37d56fd', u'track_number': 7, u'disc_number': 1, u'href': u'https://api.spotify.com/v1/tracks/0CmIALzGn4vHIHJG4n3Q4z', u'artists': [{u'name': u'Etta James', u'external_urls': {u'spotify': u'https://open.spotify.com/artist/0iOVhN3tnSvgDbcg25JoJb'}, u'uri': u'spotify:artist:0iOVhN3tnSvgDbcg25JoJb', u'href': u'https://api.spotify.com/v1/artists/0iOVhN3tnSvgDbcg25JoJb', u'type': u'artist', u'id': u'0iOVhN3tnSvgDbcg25JoJb'}], u'duration_ms': 182400, u'external_ids': {u'isrc': u'USMC16046323'}, u'type': u'track', u'id': u'0CmIALzGn4vHIHJG4n3Q4z', u'available_markets': [u'AD',...u'UY']}, u'added_by': None, u'added_at': u'2012-01-06T10:47:09Z'}, {u'is_local': False...]

How do I merge and sort two json lists using key value

I can get a JSON list of groups and devices from an API, but the key values don't allow me to do a merge without manipulating the returned lists. Unfortunately, the group info and devices info have to be retrieved using separate http requests.
The code for getting the group info looks like this:
#Python Code
import requests
import simplejson as json
import datetime
import pprintpp
print datetime.datetime.now().time()
url = 'https://www.somecompany.com/api/v2/groups/?fields=id,name'
s = requests.Session()
## Ver2 API Authenticaion ##
headers = {
'X-ABC-API-ID': 'nnnn-nnnn-nnnn-nnnn-nnnn',
'X-ABC-API-KEY': 'nnnnnnnn',
'X-DE-API-ID': 'nnnnnnnn',
'X-DE-API-KEY': 'nnnnnnnn'
}
r = json.loads(s.get((url), headers=headers).text)
print "Working...Groups extracted"
groups = r["data"]
print "*** Ver2 API Groups Information ***"
pprintpp.pprint (groups)
The printed output of groups looks like this:
#Groups
[
{u'id': u'0001', u'name': u'GroupA'},
{u'id': u'0002', u'name': u'GroupB'},
]
The code for getting the devices info looks like this:
url = 'https://www.somecompany.com/api/v2/devicess/?limit=500&fields=description,group,id,name'
r = json.loads(s.get((url), headers=headers).text)
print "Working...Devices extracted"
devices = r["data"]
print "*** Ver2 API Devices Information ***"
pprintpp.pprint (devices)
The devices output looks like this:
#Devices
[
{
u'description': u'GroupB 100 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0002/',
u'id': u'90001',
u'name': u'ABC550-3e9',
},
{
u'description': u'GroupA 101 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0001/',
u'id': u'90002',
u'name': u'ABC500-3e8',
}
]
What I would like to do is to be able to merge and sort the two JSON lists into an output that looks like this:
#Desired Output
#Seperated List of GroupA & GroupB Devices
[
{u'id': u'0001', u'name': u'GroupA'},
{
u'description': u'GroupA 101 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0001/',
u'id': u'90002',
u'name': u'ABC500-3e8',
},
{u'id': u'0002', u'name': u'GroupB'},
{
u'description': u'GroupB 100 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0002/',
u'id': u'90001',
u'name': u'ABC550-3e9',
}
]
A couple of problems I am having is that the key names for groups and devices output are not unique. The key named 'id' in groups is actually the same value as the last 4 digits of the key named 'group' in devices, and is the value I wish to use for the sort. Also, 'id' and 'name' in groups is different than 'id' and 'name' in devices. My extremely limited skill with Python is making this quite the challenge. Any help with pointing me in the correct direction for a solution will be greatly appreciated.

This program produces your desired output:
import pprintpp
groups = [
{u'id': u'0001', u'name': u'GroupA'},
{u'id': u'0002', u'name': u'GroupB'},
]
devices = [
{
u'description': u'GroupB 100 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0002/',
u'id': u'90001',
u'name': u'ABC550-3e9',
},
{
u'description': u'GroupA 101 (City State)',
u'group': u'https://www.somecompany.com/api/v2/groups/0001/',
u'id': u'90002',
u'name': u'ABC500-3e8',
}
]
desired = sorted(
groups + devices,
key = lambda x: x.get('group', x.get('id')+'/')[-5:-1])
pprintpp.pprint(desired)
Or, if that lambda does not seem self-documenting:
def key(x):
'''Sort on either the last few digits of x['group'], if that exists,
or the entirety of x['id'], if x['group'] does not exist.
'''
if 'group' in x:
return x['group'][-5:-1]
return x['id']
desired = sorted(groups + devices, key=key)

Can't get dictionary value from key in unicode dictionary

The following code stores a unicode dictionary in the variable webproperties_list:
webproperties_list = service.management().webproperties().list(
accountId='~all').execute()
profile_id = webproperties_list.get(u'defaultProfileId')
print profile_id
For some reason the .get() on the key of u'defaultProfileId' is giving me None, even though I know it is in the response. I also tried the get without the u and I still get a None response:
profile_id = webproperties_list.get('defaultProfileId')
Do I need to do something to the dict before I get the value from the key, or am I doing something else wrong entirely?
UPDATE:
Here is the response I get:
{u'username': u'removed', u'kind': u'analytics#webproperties', u'items': [{u'profileCount': 1, u'kind': u'analytics#webproperty', u'name': u'removed', u'level': u'STANDARD', u'defaultProfileId': u'removed'.....
I need to retrieve the value of u'defaultProfileId'
Not really sure how to get a value from a key that is in a dict within a list within a dict...

To figure out how to access it, it sometimes helps to go step by step:
>>> d
{u'username': u'removed', u'items': [{u'profileCount': 1, u'defaultProfileId': u'removed', u'kind': u'analytics#webproperty', u'name': u'removed', u'level': u'STANDARD'}], u'kind': u'analytics#webproperties'}
>>> d['items']
[{u'profileCount': 1, u'defaultProfileId': u'removed', u'kind': u'analytics#webproperty', u'name': u'removed', u'level': u'STANDARD'}]
>>> d['items'][0]
{u'profileCount': 1, u'defaultProfileId': u'removed', u'kind': u'analytics#webproperty', u'name': u'removed', u'level': u'STANDARD'}
>>> d['items'][0]['defaultProfileId']
u'removed'

Using the data for 'requests' module in python

I am able to load in some weather data from the requests module for python with the following code:
from pprint import pprint
import requests
r = requests.get('http://api.openweathermap.org/data/2.5/weather?q=London')
pprint(r.json())
But how do I actually use the data it produces? I cannot for the life of me find the relevant documentation or tutorial on how to do this. this is the output of the pprint:
{u'base': u'cmc stations',
u'clouds': {u'all': 0},
u'cod': 200,
u'coord': {u'lat': 42.98, u'lon': -81.23},
u'dt': 1397676977,
u'id': 6058560,
u'main': {u'humidity': 25,
u'pressure': 1024,
u'temp': 278,
u'temp_max': 283.15,
u'temp_min': 275.37},
u'name': u'London',
u'rain': {u'1h': 0.25},
u'snow': {u'3h': 0},
u'sys': {u'country': u'CA',
u'message': 0.0467,
u'sunrise': 1397644810,
u'sunset': 1397693338},
u'weather': [{u'description': u'light rain'
u'icon': u'10d',
u'id': 500,
u'main': u'Rain'}],
u'wind': {u'deg': 168.001, u'speed': 3.52}}
How could I address an item within the list? For example to print just the temp on it's own and maybe to use it as a variable. E.g.:
temp = *not sure what to put here*
print temp

Now that you have the results:
results = r.json()
just access it like any other Python dict:
main = results['main'] # Get the 'main' key's value out of results
temp = main['temp'] # Get the 'temp' key's value out of main
print temp
or more tersely (and the way you'd almost always write this in real life):
print results['main']['temp']