reyesgeorge / tarantula Goto Github PK
View Code? Open in Web Editor NEWa Scrapy spider that utilizes Postgres as a DB, Squid as a proxy server, Redis for de-duplication and Splash to render JavaScript. All in a microservices architecture utilizing Docker and Docker Compose
License: MIT License