klaster1 / crunchydump Goto Github PK

Downloading only free chapters avaliable for limited time isn't cool enough, crynchydump should be able to:

• Set API host URL.
• Dump everything into local DB.
• Expose API mirror using data from DB.
• Start API automatically when there's a DB path in params. No need to run two instances for that.

If any page fails to download (for example, when API returns error 500), crunchydump should just skip it, notify user and then save everything else.

It was implemented in the old private version before, now I have to add the same into this one as well.

Turns out some series don't have locale, which causes crash on title search with -s option.

Since there are three possible URLs, let's try all three if any fails to download. The order should be:

1. page.locale.enUS.encrypted_composed_image_url
2. page.image_url
3. page.locale.enUS.encrypted_composed_image_url

If there's no page.locale, default image url access throws and nothign catches access from undefined error.

Page download messages are too verbose, these should show only vital information useful for debugging.

Colon in manga title causes invalid file name on Windows.

Unhandled rejection TypeError: Cannot read property 'value' of undefined
at APIClient.updateSessionID (C:\Users\Owner\AppData\Roaming\npm\node_module
s\crunchydump\lib\Client.js:17:81)
at APIClient. (C:\Users\Owner\AppData\Roaming\npm\node_modules\cr
unchydump\lib\Client.js:63:8)
at tryCatcher (C:\Users\Owner\AppData\Roaming\npm\node_modules\crunchydump\n
ode_modules\bluebird\js\main\util.js:26:23)
at Promise._settlePromiseFromHandler (C:\Users\Owner\AppData\Roaming\npm\nod
e_modules\crunchydump\node_modules\bluebird\js\main\promise.js:510:31)
at Promise._settlePromiseAt (C:\Users\Owner\AppData\Roaming\npm\node_modules
\crunchydump\node_modules\bluebird\js\main\promise.js:584:18)
at Promise._settlePromises (C:\Users\Owner\AppData\Roaming\npm\node_modules
crunchydump\node_modules\bluebird\js\main\promise.js:700:14)
at Async._drainQueue (C:\Users\Owner\AppData\Roaming\npm\node_modules\crunch
ydump\node_modules\bluebird\js\main\async.js:123:16)
at Async._drainQueues (C:\Users\Owner\AppData\Roaming\npm\node_modules\crunc
hydump\node_modules\bluebird\js\main\async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (C:\Users\Owner\AppData\Roa
ming\npm\node_modules\crunchydump\node_modules\bluebird\js\main\async.js:15:14)
at runCallback (timers.js:756:18)
at tryOnImmediate (timers.js:717:5)
at processImmediate [as _immediateCallback] (timers.js:697:5)