exemuel / indiegogo-scrapper

Indiegogo Scraper is a tool for scraping the Indiegogo web. This tool uses project datasets on Indiegogo by Web Robots, namely Indiegogo Datasets as input to scrape text data on the Story, FAQ, Updates, and Discussion menus. As well as data on the Basic Section.

Indiegogo Scrapper

Indiegogo Scraper is a tool for scraping the Indiegogo web. This tool uses project datasets on Indiegogo by Web Robots, namely Indiegogo Datasets as input to scrape text data on the Story, FAQ, Updates, and Discussion menus. As well as data on the Basic Section.

Usage

To scrape based on project's url in Indiegogo Datasets, provided by Web Robots, and store the results in a json file:

$ python src\main.py indiegogo-corpus.json

indiegogo-scrapper's Issues

UnicodeDecodeError: 'utf-8' codec can't decode byte 0x87 in position 23

Hi everyone,

thanks for the awesome package! I followed all instructions to get the script running, but I am having issues when reading the csv file. I am getting the following error:

UnicodeDecodeError: 'utf-8' codec can't decode byte 0x87 in position 23

I have tried different encodings for the read_csv function (line 31, main.py), but nothing worked. Does anyone can help me?

I am using a Macbook Pro with M1 Pro, MacOS Venture (Version 13.0.1 (22A400)); Chrome Version (Version 107.0.5304.110).

Thanks for your help!