simfin / pdf-crawler Goto Github PK

Exception has occurred: TypeError
WebDriver.init() got an unexpected keyword argument 'executable_path'
File "/home/dongwook/Project/pdf-crawler/crawler/crawl_methods.py", line 119, in load_driver
self.driver = webdriver.Firefox(executable_path=self.executable_path, options=driver_options)
File "/home/dongwook/Project/pdf-crawler/crawler/crawl_methods.py", line 196, in get_hrefs_js_complex
self.load_driver()
File "/home/dongwook/Project/pdf-crawler/crawler/crawler.py", line 82, in get_urls
urls = click_crawler.get_hrefs_js_complex()
File "/home/dongwook/Project/pdf-crawler/crawler/crawler.py", line 69, in crawl
urls = self.get_urls(response)
File "/home/dongwook/Project/pdf-crawler/crawler/init.py", line 57, in crawl
crawler.crawl(url, depth)
File "/home/dongwook/Project/pdf-crawler/tax.py", line 3, in
crawler.crawl(url="https://www.irs.gov/instructions",output_dir="crawling_test",method="rendered-all")
TypeError: WebDriver.init() got an unexpected keyword argument 'executable_path'

do I have to install a driver for this problem? Using Linux Ubuntu

Hi Thomas Flassbeck ,

Could please help me to resolve this issue.
I'm unable to install crawler.helper package in pdf cawler.

Thanks
Chinna R

Traceback (most recent call last):
File "", line 1, in
File "/home/xxxx/Documents/Github/wordbank/pdf-crawler/crawler/init.py", line 7, in
from crawler.handlers import (
File "/home/xxxx/Documents/Github/wordbank/pdf-crawler/crawler/handlers.py", line 5, in
import psutil
ModuleNotFoundError: No module named 'psutil'

Cases:

http://investors.3m.com/
http://www.aes.com/investors/investors-overview/default.aspx
http://ir.tesla.com/investor-relations

As per the title, will this support sites that require a login?

https://www.adidas-group.com/en/investors/overview/

https://www.investor.bayer.de/en/reports/annual-reports/overview/