Coder Social home page Coder Social logo

scraper-lobbyliste's Issues

PDF-Link broken & Dependency Error?

Leider scheint der Parser aufgrund einer geänderten URL auf Seiten des Bundestages nicht mehr zu funktionieren:

DEBUG=scraper node ./scraper.js dump
  scraper outdir is /home/user/Dokumente/scraper-lobbyliste/dump +0ms
(node:14036) [DEP0022] DeprecationWarning: os.tmpDir() is deprecated. Use os.tmpdir() instead.
Error: Unable to locate PDF link
    at /home/user/Dokumente/scraper-lobbyliste/scraper.js:224:80
    at /home/user/Dokumente/scraper-lobbyliste/node_modules/scrapyard/lib/scrapyard.js:110:22
    at Object.callback (/home/user/Dokumente/scraper-lobbyliste/node_modules/scrapyard/lib/scrapyard.js:123:4)
    at /home/user/Dokumente/scraper-lobbyliste/node_modules/async/dist/async.js:1311:26
    at /home/user/Dokumente/scraper-lobbyliste/node_modules/async/dist/async.js:321:20
    at /home/user/Dokumente/scraper-lobbyliste/node_modules/scrapyard/lib/scrapyard.js:55:4
    at /home/user/Dokumente/scraper-lobbyliste/node_modules/scrapyard/lib/scrapyard.js:160:4
    at Request._callback (/home/user/Dokumente/scraper-lobbyliste/node_modules/scrapyard/lib/scrapyard.js:193:7)
    at Request.self.callback (/home/user/Dokumente/scraper-lobbyliste/node_modules/request/request.js:185:22)

Wenn ich die BASEURL auf das aktuelle PDF ändere erhalte ich ebenfalls einen Error:

  scraper outdir is /home/user/Dokumente/scraper-lobbyliste/dump +0ms
(node:14735) [DEP0022] DeprecationWarning: os.tmpDir() is deprecated. Use os.tmpdir() instead.
/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:87
		if(test(elems[i])) result.push(elems[i]);
		   ^

RangeError: Maximum call stack size exceeded
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:87:6)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)
    at findAll (/home/user/Dokumente/scraper-lobbyliste/node_modules/domutils/lib/querying.js:90:27)

Vielleicht liegt dies an #19? Leider habe ich keine JavaScript-Kenntnisse, könnte mir aber vorstellen, dass ein Problem bei den Dependencies vorliegt.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.