Coder Social home page Coder Social logo

Comments (4)

harveycastree avatar harveycastree commented on August 18, 2024

The tool seems to not be pulling sizes on 'PURCHASED' or 'MARKED AS SOLD' items also, I am not sure if this is something that can be fixed also? Thank you

from vinted-scraper.

Gertje823 avatar Gertje823 commented on August 18, 2024

First of all, thank you for opening this issue.
I am unable to reproduce the timeouts you are getting. Is it possible you already send a lot of requests to depop and are therefore being rate limited?

Great idea to add the option to scrape the data only whithout downloading the files. I will implement it soon 😄

About the issue with not pulling the sizes for sold items. I think depop removes the size from the product when it is marked as sold. I looked at a couple sold products, but none of them had the size available. The size is also not displayed on the webpage. If there is a sold product with size, and it is not getting parsed by the tool, could you please send me the url?

from vinted-scraper.

harveycastree avatar harveycastree commented on August 18, 2024

Hi, thanks for getting back to me so soon!

That's fine, I seem to have it working again now from downloading a fresh Python file, I didn't think I changed anything but it seems I have haha.

And yes, you are right, my mistake, I wasn't aware Depop removes the the sizes after an item is sold.

So I guess this has turned into an enhancement request now... 😄

It would be great to be able to pull some of the more readily available data from the api such as "address", "discountedPriceAmount", "dateUpdated" as well as potentially using "group" and "productType" instead of "categoryId" for categorising the items?

This should enable some good trend analysis of items with location and calendar data.

I have had a go at trying to implement some of these myself but as mentioned before, I am pretty limited when it comes to Python and there's some mistakes I'm making that are not letting me make somewhat seemingly simple changes.

Many thanks!

from vinted-scraper.

Gertje823 avatar Gertje823 commented on August 18, 2024

You can now disable file download using -n.
I also added the address, discountedPriceAmount and dateUpdated fields to the database.
And changed categoryId to group and subcatagory to productType

from vinted-scraper.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.