devsnek / webtoondl

Download Webtoon comics quickly and nicely

webtoondl

npm i -g webtoondl

$ webtoondl --comic=1022 --out=lumine/ --pdf
Comic Selected: LUMINE (Drama) by Emma Krogell
Indexing Episodes [========================================] 100% | ETA: 0s | Episode 35/35
Downloading to /home/snek/documents/comics/lumine
Downloading Episode 1 [========================================] 100% | ETA: 0s | Panel 42/42
Downloading Episode 2 [========================================] 100% | ETA: 1s | Panel 36/36
Downloading Episode 3 [========================================] 100% | ETA: 1s | Panel 48/48
Downloading Episode 4 [==============================----------] 75% | ETA: 0s | Panel 33/45

Options

• --comic comic id from webtoons
  • in http://www.webtoons.com/en/drama/lumine/list?title_no=1022 the comic id is 1022
• --out: defaults to cwd
• --pdf: output pdfs of the episodes instead of folders with images

webtoondl's Issues

Socket hang up, 0 episodes found.

I’m don’t know much nodejs so just wanted to ask first before I dug in myself: is the application out of sync with the current website (since it’s parsing DOM and all rather than using an API), or do you think this is only an issue on my end?

$ webtoondl --comic=93 --out=gotw/
Comic Selected: Girls of the Wild'sGirls of  (Action) by HUN
Indexing Episodes [----------------------------------------] 0% | ETA: 0s | Episode 0/264
socket hang up
$

I have not tried other downloaders yet (maybe my IP is blocked or similar), but I will amend the issue with my findings.

Does'nt download webtoons with a lot of episodes

When downloading large webtoons, it keeps throwing an error.

./webtoondl --comic 1049
Comic Selected: Lookism (Drama) by Taejoon Park
Indexing Episodes [==============================----------] 75% | ETA: 33s | Episode 156/207
<--- Last few GCs --->

[13769:0x55e4a9dcf1a0]    62119 ms: Scavenge 1385.8 (1424.4) -> 1385.4 (1424.9) MB, 5.0 / 0.0 ms  (average mu = 0.131, current mu = 0.049) allocation failure 
[13769:0x55e4a9dcf1a0]    62853 ms: Mark-sweep 1385.9 (1424.9) -> 1385.1 (1425.4) MB, 729.7 / 0.0 ms  (average mu = 0.087, current mu = 0.039) allocation failure scavenge might not succeed


<--- JS stacktrace --->

==== JS stack trace =========================================

    0: ExitFrame [pc: 0x1f309b2cfb5d]
    1: StubFrame [pc: 0x1f309b2d107d]
Security context: 0x162cf68c5379 <JSObject>
    2: attributeValueDoubleQuotedState [0x1c47d02b8f89] [/home/username/Projects/Test/web/webtoondl/node_modules/parse5/lib/tokenizer/index.js:~1462] [pc=0x1f309b2e8fe8](this=0x39118ec13369 <JSObject>,46)
    3: /* anonymous */ [0x1c47d02b7e49] [/home/username/Projects/Test/web/webtoondl/node_modules/parse5/lib/tokenizer/index...

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x55e4a8ce76d1 node::Abort() [node]
 2: 0x55e4a8ce85ff node::OnFatalError(char const*, char const*) [node]
 3: 0x55e4a8e680c2 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [node]
 4: 0x55e4a8e6831b v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [node]
 5: 0x55e4a91fde33  [node]
 6: 0x55e4a91fdf74  [node]
 7: 0x55e4a920db26 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [node]
 8: 0x55e4a920e4ce v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node]
 9: 0x55e4a92106cd v8::internal::Heap::AllocateRawWithLightRetry(int, v8::internal::AllocationSpace, v8::internal::AllocationAlignment) [node]
10: 0x55e4a9210722 v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationSpace, v8::internal::AllocationAlignment) [node]
11: 0x55e4a91df065 v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationSpace) [node]
12: 0x55e4a944d4bf v8::internal::Runtime_AllocateInNewSpace(int, v8::internal::Object**, v8::internal::Isolate*) [node]
13: 0x1f309b2cfb5d 
[1]    13769 abort (core dumped)  ./webtoondl --comic 1049

Any idea how to fix it?

Errors Out If Artist Skips/Deletes/Hides An Episode

Looking at an example of this occurrence: Fluffy Boyfriend (1164), the episode numbers skip over 46 (jumping from 45 to 47). The indexer fails because it gets a 404 Not Found on episode 46.

Indexer should handle this situation gracefully.