Comments (4)
Ugh they totally changed their UI...
Thanks for reporting. Will fix this soon. I haven't refreshed my folder for a few weeks, otherwise I would have normally caught this sooner.
from pixivmediascraper.
Looks like it wasn't just their UI. They're relying a lot AJAJ now, and the initially loaded page data has almost no information. They did a similar shift in December 2016 with asynchronous image loading, but this is way worse.
The nice thing is that they're using their own API now. Will see what the rules of ~this~ game are regarding limits/throttling. At least the API links weren't too bad to find and the data returned seems reasonable at first glance.
from pixivmediascraper.
The new format is now supported. It will work whether your account is on the old or the new format.
I tested it successfully in a few handpicked cases and I also tested it successfully with my personal folder. Please try it yourself and let me know if everything's working for you as well.
from pixivmediascraper.
Oh thank you, for some reason I was not getting told I got responded to. I'm sorry about being 20 days later. I was actually coming over to post that I was able to use wget
when I added:
--referer='https://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=ID_HERE&page=0'
to it.
I'm running the script right now and it appears to be working. I have a pretty big backlog here lol, but it's working just fine:
541 directories, 166943 files
541 directories, 167548 files
from pixivmediascraper.
Related Issues (20)
- cURL doesn't have native support for Windows HOT 2
- Not downloading everything HOT 2
- Not viable with 46 artists HOT 1
- Sometimes Images Get An Incorrect 404 HOT 2
- Artist changed their name, script redownloaded everything from them HOT 1
- Even faster would be nice HOT 3
- Supported platforms? HOT 1
- Recommended way to stop script, along with all threads
- Performance Improvement Suggestion HOT 1
- threads cap out for some reason [2046 max per run] HOT 6
- Since yesterday, script runs extremely slowly and caps out at 100% CPU HOT 1
- pixiv must have changed their layout again HOT 1
- Fight with python to spawn >2046 threads HOT 1
- Suggestion : stop script earlier HOT 1
- ampersand showing as HTML
- [21 Oct 2018] Batch HOT 3
- Breakage - Sign In Failure [29 Jun 2019] HOT 2
- Pixiv needlessly changing once more HOT 2
- Broken because pixiv is now requiring User-Agent HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pixivmediascraper.