I have JSON files of size data_large(150.1mb). The content inside the file is of type [{score: 68},{score: 78}]. I need to find the list of unique scores from each file. This is what I'm doing:import ijson  # since JSON file is large, hence making use of ijsonf = open ('data_large')content = ijson.items(f, 'item') # json loads quickly here as compared to when json.load(f) is used.print set(i['score'] for i in content) #this line is actually taking a long time to get processed.Can I make the last line more efficient?  It's currently taking 201 secs to execute.
How to find the unique values from the JSON file?
python;performance;json