Coder Social home page Coder Social logo

ambalytics / amba-analysis-worker-pubfinder Goto Github PK

View Code? Open in Web Editor NEW
0.0 1.0 0.0 2.2 MB

Retrieves publication metadata from other web services.

Home Page: https://ambalytics.github.io/amba-analysis-worker-pubfinder/

License: MIT License

Dockerfile 0.38% Python 91.83% Shell 7.79%
analysis-services

amba-analysis-worker-pubfinder's People

Contributors

e3dmc2 avatar lukasjesche avatar xlrx avatar

Watchers

 avatar

amba-analysis-worker-pubfinder's Issues

Error on run

worker-pubfinder      | Exception in thread Thread-18:
worker-pubfinder      | Traceback (most recent call last):
worker-pubfinder      |   File "/usr/local/lib/python3.6/threading.py", line 916, in _bootstrap_inner
worker-pubfinder      |     self.run()
worker-pubfinder      |   File "/usr/local/lib/python3.6/threading.py", line 864, in run
worker-pubfinder      |     self._target(*self._args, **self._kwargs)
worker-pubfinder      |   File "/usr/local/lib/python3.6/multiprocessing/pool.py", line 103, in worker
worker-pubfinder      |     initializer(*initargs)
worker-pubfinder      |   File "/src/src/meta_source.py", line 118, in worker
worker-pubfinder      |     self.pubfinder.finish_work(item, self.tag)
worker-pubfinder      |   File "./src/pubfinder_worker.py", line 208, in finish_work
worker-pubfinder      |     self.save_to_mongo(publication)
worker-pubfinder      |   File "./src/pubfinder_worker.py", line 268, in save_to_mongo
worker-pubfinder      |     pub = self.dao.save_publication(publication)
worker-pubfinder      |   File "/usr/local/lib/python3.6/site-packages/event_stream/dao.py", line 111, in save_publication
worker-pubfinder      |     fos = FieldOfStudy(name=fos_data['name'], normalizedName=fos_data['normalizedName'])
worker-pubfinder      | TypeError: string indices must be integers

Crossref parse error

worker-pubfinder      | 2021-09-03 15:06:22,846.846 Thread-4:MongoDB, not found event
worker-pubfinder      | 2021-09-03 15:06:22,854.854 Thread-9:SourceCrossref work on item 10.15366/tp2021.38
worker-pubfinder      | Exception in thread Thread-9:
worker-pubfinder      | Traceback (most recent call last):
worker-pubfinder      |   File "/usr/local/lib/python3.6/threading.py", line 916, in _bootstrap_inner
worker-pubfinder      |     self.run()
worker-pubfinder      |   File "/usr/local/lib/python3.6/threading.py", line 864, in run
worker-pubfinder      |     self._target(*self._args, **self._kwargs)
worker-pubfinder      |   File "/usr/local/lib/python3.6/multiprocessing/pool.py", line 103, in worker
worker-pubfinder      |     initializer(*initargs)
worker-pubfinder      |   File "/src/src/crossref_source.py", line 110, in worker
worker-pubfinder      |     publication_temp = self.add_data_to_publication(publication)
worker-pubfinder      |   File "/src/src/crossref_source.py", line 129, in add_data_to_publication
worker-pubfinder      |     return self.map(response, publication)
worker-pubfinder      |   File "/src/src/crossref_source.py", line 156, in map
worker-pubfinder      |     publication['title'] = response_data['title'][0]
worker-pubfinder      | IndexError: list index out of range
worker-pubfinder      | 
worker-pubfinder      | 2021-09-03 15:06:24,934.934 Thr

Error Crossref Source

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.6/multiprocessing/pool.py", line 103, in worker
    initializer(*initargs)
  File "./src/pubfinder_worker.py", line 145, in worker_results
    self.finish_work(result['item'], result['tag'])
  File "./src/pubfinder_worker.py", line 182, in finish_work
    self.dao.save_publication(publication)
  File "/usr/local/lib/python3.6/site-packages/event_stream/dao.py", line 150, in save_publication
    fos = FieldOfStudy(name=fos_data['name'], normalizedName=fos_data['normalizedName'])
TypeError: string indices must be integers

updated for correct error

Known Bugs

  • empty author
  • connection error domain to many retries -> limit per domain? (see sentry)
  • key error (see sentry)
  • type error (see sentry)
  • meta (?) clean abstract better

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.