Comments (4)
The tool seems to not be pulling sizes on 'PURCHASED' or 'MARKED AS SOLD' items also, I am not sure if this is something that can be fixed also? Thank you
from vinted-scraper.
First of all, thank you for opening this issue.
I am unable to reproduce the timeouts you are getting. Is it possible you already send a lot of requests to depop and are therefore being rate limited?
Great idea to add the option to scrape the data only whithout downloading the files. I will implement it soon 😄
About the issue with not pulling the sizes for sold items. I think depop removes the size from the product when it is marked as sold. I looked at a couple sold products, but none of them had the size available. The size is also not displayed on the webpage. If there is a sold product with size, and it is not getting parsed by the tool, could you please send me the url?
from vinted-scraper.
Hi, thanks for getting back to me so soon!
That's fine, I seem to have it working again now from downloading a fresh Python file, I didn't think I changed anything but it seems I have haha.
And yes, you are right, my mistake, I wasn't aware Depop removes the the sizes after an item is sold.
So I guess this has turned into an enhancement request now... 😄
It would be great to be able to pull some of the more readily available data from the api such as "address", "discountedPriceAmount", "dateUpdated" as well as potentially using "group" and "productType" instead of "categoryId" for categorising the items?
This should enable some good trend analysis of items with location and calendar data.
I have had a go at trying to implement some of these myself but as mentioned before, I am pretty limited when it comes to Python and there's some mistakes I'm making that are not letting me make somewhat seemingly simple changes.
Many thanks!
from vinted-scraper.
You can now disable file download using -n
.
I also added the address
, discountedPriceAmount
and dateUpdated
fields to the database.
And changed categoryId
to group
and subcatagory
to productType
from vinted-scraper.
Related Issues (20)
- Question - Please answer asap HOT 3
- Vinted scraper stops early HOT 3
- Item Category Label Needed HOT 3
- [Feature Request] Extract multiple items from different profiles HOT 1
- Vinted MSG Crawl does not work anymore HOT 1
- [feature request] Scrape my own favorites HOT 2
- error running code HOT 3
- not clear how to use HOT 8
- purchases scrapper HOT 1
- [Feature Request] auto get vinted session with login token HOT 5
- Scraper not working anymore? HOT 1
- [Feature Request] Scrape the number of like HOT 1
- [Feature request] Post products HOT 1
- Depop 403 HOT 11
- Vinted Download stops working
- Is there any way to save as PNG as opposed to jpeg? HOT 1
- depop SSL: CERTIFICATE_VERIFY_FAILED HOT 1
- Scraper not working since yesterday HOT 2
- Depop 'products' issue HOT 7
- Depop issues.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vinted-scraper.