cam-cambridge / thingiscrape

A python based Thingiverse.com object scraper and downloader

Thingiscrape

Thingiverse REST API python wrapper

About

A python based Thingiverse.com object scraper and downloader. The program can search of objects using keywords, licenses, users, categories and then sort the results, for example returning the most popular or newest uploads.

Getting Started

First you need to install the requirements - there are not that many 😊.

pip install -r requirements.txt

You need to add an environment variable containing the Thingiscrape applications API token. Contact @dougbrion [email protected] to get the token or create your own Thingiverse application by visiting the following site: https://www.thingiverse.com/apps

export API_TOKEN "<your-api-token>"

Usage

To see the various options available to you type the following into your terminal.

python thingiscrape.py --help

Example usage:

python thingiscrape.py --search "yoda" --popular 1 --pages 2 --license "cc"

STL 3D model files will be downloaded to ./downloads/stls/ along with a json file containing the results from the request in ./downloads/json/.

thingiscrape's Issues

keep getting this error

i get the hole time this error:

Traceback (most recent call last):
File "C:\Users\larss\Downloads\thingiscrape-master\thingiscrape-master\thingiscrape.py", line 324, in
popular(args.popular_true)
File "C:\Users\larss\Downloads\thingiscrape-master\thingiscrape-master\thingiscrape.py", line 94, in popular
generic_search(sort_type="popular", n_pages=n_pages)
File "C:\Users\larss\Downloads\thingiscrape-master\thingiscrape-master\thingiscrape.py", line 76, in generic_search
rest_url += access_keyword + api_token + rest_keywords["pages"] + str(idx + 1)
TypeError: can only concatenate str (not "NoneType") to str

Conflicting requirements

When performing a fresh installation via pip install -r requirements.txt, i get the following error:

The conflict is caused by:
    The user requested urllib3==1.26.5
    requests 2.23.0 depends on urllib3!=1.25.0, !=1.25.1, <1.26 and >=1.21.1

I was able to complete the installation by modifying the requirements to

certifi==2020.4.5.2
chardet==3.0.4
idna==2.9
requests>=2.23.0
urllib3==1.26.5

Pip installed requests-2.28.1.

Expected behavior:
Running the command pip install -r requirements.txt will perform a complete installation with no conflicting libraries

Actual behavior:
Module requests 2.23.0 depends on urllib3!=1.25.0, !=1.25.1, <1.26 and >=1.21.1, while the original requirements is urllib3==1.26.5