Coder Social home page Coder Social logo

petersid2022 / skroutz-prosfores-scraper-go Goto Github PK

View Code? Open in Web Editor NEW
1.0 2.0 1.0 15.36 MB

CLI based web scraper written in Go, that looks for any deals on skroutz.gr.

License: MIT License

Go 99.06% Makefile 0.94%
go golang goroutines http scraper skroutz skroutz-analytics tui

skroutz-prosfores-scraper-go's Introduction

skroutz-prosfores-scraper-go

CLI based web scraper written in Go, that scrapes www.skroutz.gr/price-drops for any new deals.

image

Gif made using vhs

Installation using Make

Make sure you are running go version 1.20.x

git clone https://github.com/petersid2022/skroutz-prosfores-scraper-go.git
cd skroutz-prosfores-scraper-go
make

Pro Tip: Place the binary in the ~/.local/bin directory. This enables you to run the command from the terminal regardless of your location!

CLI Usage

skroutz [Options]

Options:

-h, --help      Output usage information
-f, [String]    Set filtering options: [Recommended], [price_asc], [price_desc], [newest]
-p, [Number]    Set the number of pages to scrape (default: 5)
-n, [Number]    Set the number of products to print when filtering_option=Recommended (default: 5)
-w, [Number]    Set the number of workers (default: 10)

Things I am working on

  • Command-Line flags (change category, add filters, prices ascending/descending etc.) f155812

  • Use a different TUI Library

  • Use goroutines (Concurrency)

License

This project is licensed under the MIT License. Please see the LICENSE file for more details.

skroutz-prosfores-scraper-go's People

Contributors

petersid2022 avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Forkers

gkarmas

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.