mrhohn / movierecommend Goto Github PK

I tried a few approaches to retrieve the full imdb title for all movies but encounterred many issues and none of my approaches guarantee I would gain correct imdb titles for all movies, hence raised errors while combining with the UI.

I still think returning imdb ids is a good way to handle this, Since in the UI, we are also using OMDB api for retrieving the infomation of movies instead of our local database. Hence it doesn't matter whether we have the imdb ids locally or not. And the unique imdb id would guarantee we got the right one.

The username is actually not passed into the function. When I try to print the username directly, I got empty string.

Some movies do not have available URL, and I encounterred this error:
λ python main.py
[mongo] Initializing database: [imdb]
[MovieRecommend] Target user screen_name: BrunoMars
[MovieRecommend] Profile retrieved.
[MovieRecommend] Built up actors pool, size: 55741
[MovieRecommend] Found 27 actors from profile.
[MovieRecommend] Built up tags pool, size: 1128
[MovieRecommend] Found 59 tags from hashtags.
[MovieRecommend] Found 8876 candidate movies.
[MovieRecommend] Earned recommendations for Twitter.
Exception in thread Thread-3:
Traceback (most recent call last):
File "C:\Python34\lib\threading.py", line 921, in _bootstrap_inner
self.run()
File "C:\Python34\lib\threading.py", line 869, in run
self._target(_self._args, *_self._kwargs)
File "main.py", line 466, in download_coverart
coverart = urllib.request.urlretrieve(result["Poster"], localpath)
File "C:\Python34\lib\urllib\request.py", line 178, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File "C:\Python34\lib\urllib\request.py", line 153, in urlopen
return opener.open(url, data, timeout)
File "C:\Python34\lib\urllib\request.py", line 440, in open
req = Request(fullurl, data)
File "C:\Python34\lib\urllib\request.py", line 258, in init
self.full_url = url
File "C:\Python34\lib\urllib\request.py", line 284, in full_url
self._parse()
File "C:\Python34\lib\urllib\request.py", line 313, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'N/A'

• When I did:
  python imdbParser.py
• I got:
  [mongo] Initializing database: [imdb]
  === Starting Parse of movies.list ===
  Traceback (most recent call last):
  File "imdbParser.py", line 23, in
  imdbMovies.parse(mongo, collectionName)
  File "C:\Users\Think\Documents\GitHub\MovieRecommend\imdbMovies.py", line 27, in parse
  with open("imdbdata/movies.list", encoding="latin1") as tsv:
  TypeError: 'encoding' is an invalid keyword argument for this function
  [mongo] Closing all connections

I already put the necessary lists into imdbdata folder. Would it be something wrong with my python library?

Keyword uniqueness is not being enforced in the imdb.keywords collection, so multiple documents are getting added for the same keywords.