abki12c / skroutz-best_price_scraper

A cli app for scraping data from Skroutz and Best Price

Skroutz-Best_Price_Scraper

A cli application that scrapes data from the two biggest price comparison websites in Greece : BestPrice and Skroutz. There's some shops on Best Price that don't exist on Skroutz, so this app provides a quick way to automate comparison between the two sites.

The available functionalities are:

• Find the cheapest product on Skroutz
• Find the cheapest product on Best Price
• Compare Skroutz and Best Price Prices
• Show reviews from Skroutz and Best Price # TODO
• Monitor the price of a certain product # TODO

The data are scaped using the json data sent to the website server and using Beautiful Soup for Best Price specifically

Installation

Use the package manager pip to install the requirements

pip install -r requirements.txt

Run

python main_program.py

skroutz-best_price_scraper's Issues

Error when searching general terms in greek for Skroutz

When searching general terms in greek for the Skroutz marketplace, an json decoding error appears. For example for the search term γυαλια, the program tries to get json data from this website. The website doesnt show any products and requires to select a product category.

This problem may also appear on general search terms in english