The magic-formula-scraper's discuss from ginglis13

ginglis13 / magic-formula-scraper Goto Github PK

View Code? Open in Web Editor NEW

scrapes names and tickers from magicformulainvesting.com every quarter, adds info to a google sheet which includes stock prices and a link to the first result of a google search of the company name

License: MIT License

Python 100.00%

magic-formula-scraper's Issues

Chromedriver needs to be manually updated frequently

Chromedriver updates a lot, and it would be nice to manually download and update the latest version of chromedriver each time the scraper is run. I'll see if I can figure it out too.

Scraper Paste Offset

The scraper pastes the data offset by a few columns in Google Sheets when run.

Chromedriver/Chrome Browser version mismatch

The code chunk below downloads the latest chromedriver and extracts it which is great, but if the user's chrome browser is at a lower version the code will fail.

# Get latest chromedriver zip file for mac, extract into same folder
try:
    version = requests.get('https://chromedriver.storage.googleapis.com/LATEST_RELEASE').text
    url = 'https://chromedriver.storage.googleapis.com/{0}/{1}'.format(version, 'chromedriver_mac64.zip')
    r = requests.get(url, allow_redirects=True)
    open('chromedriver.zip', 'wb').write(r.content)
    with zipfile.ZipFile("chromedriver.zip", "r") as zip_ref:
        zip_ref.extractall()
except:
    pass

Error text:

selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 111 Current browser version is 110.0.5481.77 with binary path C:\xxxxx

Proposed solutions: checking if the chromedriver download is necessary before executing the try/except block.

Recommend Projects