sridatta / huhjfr Goto Github PK

hey @sridatta , my script ran fine for the most part but it stopped halfway cuz internet dropped. I have been trying to do it again, but it keeps timing out on me. Can you run it in the morning? 'Why do it work now?', you might be asking. Well, the answer is black magic.

One thing though. You asked me to makes the checks to see if the artist is in the allowed_artist lists. Well some of them are there but are differently spelled. Like Jay Z is jay-z. or run-dmc is run-D.M.C or something. I made a new file called allowed_artists_expanded.json which is same file as before but takes care of a few of those misspelling differences -- DEFO NOT ALL of them.

For now, I put a boolean flag at the top of the script to see if you want to do the allowed_artists checking or not. Also, you can change the name of the output file at the top if you want to see the differences between the two.

Thanks Sri

@jerryl the sample data from echonest is currently blank. Can you push one with data? @abhikalakuntla needs an example of the format to expect.

Few (small) things:

1. I didn't really know how the links to the whosampled website is given so i just made a "sample_links" at the top of "whosampled_scraper.py". Just tell me how it will look later and I can change it.
2. The output of the file will look something like the "whosampled_data_example_output.json". Yeah, I added " +=+=+ " in the key just to split the song name and song artist, lol.
3. Presently, I don't look through the "allowed_artists.json" and cross reference over there. I assume that the links will given such that they already leave unimportant artists out. Moreover, I wasn't too sure on how you wanted that done, so just msg me when you can and I'll fix it. Should be a 5 line fix.

Thanks for being pm on this sri.
Abhi