jules-winnfieldx / cyberdropdownloader

Bulk Gallery Downloader for Cyberdrop.me and Other Sites

cyberdrop-dl

Bulk downloader for multiple file hosts

Brand new and improved! Cyberdrop-DL now has an updated paint job, fantastic new look. It's now easier to use than ever before!

Supported Sites

bunkr, bunkrr, celebforum, coomer, cyberdrop, cyberfile, e-hentai, erome, fapello, f95zone, gofile, hotpic, ibb.co, imageban, imgbox, imgur, img.kiwi, jpg.church, jpg.homes, jpg.fish, jpg.fishing, jpg.pet, jpeg.pet, jpg1.su, jpg2.su, jpg3.su, jpg4.su, host.church, kemono, leakedmodels, mediafire, nudostar.com, nudostar.tv, omegascans, pimpandhost, pixeldrain, postimg, realbooru, reddit, redd.it, redgifs, rule34.xxx, rule34.xyz, rule34vault, saint, scrolller, simpcity, socialmediagirls, toonily, xbunker, xbunkr

Installation and More Information

Read the Wiki!

You can find how to install the program and how to use it there. You can also find a list of supported hosts, and frequently asked questions.

cyberdropdownloader's Issues

[FEATURE] wirking wuth putmega/sub albums

this program don't work with subfolder from putmega.

example: only +18 years old
redacted

Can't find pictures on putmega file

I tried downloading from the following URL: https://putme.ga/album/example
However the link is locked by a password which is why I fear it cannot find any files. Not sure. But everytime I try, it closes immediately. When I try an older version I can see this error "https://putme.ga/album/example Couldn't find pictures."
Are password protected links supported?

Idea / Feature: Add cyberdrop album ID to downloaded folder name

This is helpful for if more than one folder / album link has the same name.

Confirmation when rip is done.

Please add a confirmation at the end of the ripping process so that we know what we ripped is done.

[FEATURE] Error checking (File Size Comparison)

Is it possible to implement any error checking into the program?
Often from CyberDrop half the files will fail to properly download.
I know gallery-dl compares file sizes to make sure they match, can something like this be added?

About link which has the password

Hey,
I just wanted to ask how do you download files from PutMega or from other sites which are supported, but have password?

Need some clarification on how to run the file on Mac?

Sorry, I've never really used something like this before. I've put the links in URLs.txt but nothing seems to happen when I then double click Start.sh. I've tried doing the chmod +x but I think I'm doing something wrong as the file just seems to open as a text file.

Thanks

run script not compatible with multiple python installations

The script

start cmd.exe /c "pip install -r requirements.txt"
cmd.exe /k "py downloader.py"

Might not run downloader and pip with the same python, see my (messy) setup:

>py --version
Python 3.8.1

>pip --version
pip 9.0.1 from c:\python27\lib\site-packages (python 2.7)

In order to run pip correctly, ignore the command line script and invoke the module directly:

>py -m pip --version
pip 19.2.3 from C:\Python38\lib\site-packages\pip (python 3.8)

Adding a download speed limiter to settings.py

Downloading multiple small files is not a problem, but when it's set to download large files, it tends to hog all the bandwidth and slowing my internet to a crawl.

Failed Attempt

Can someone point out the problem with the error that I keep on getting?

Also, is there a way to skip the current file that's being downloaded or configure a setup where it skips the file after x attempts?

The tool is super useful and I really appreciate the devs for working on this one.

Cant download with the command line

Hello I have tried to download the cyberdrop downloader in py but when I copy and paste the line: paru -Sy cyberdropdownloader-bin then py say Syntax Error and I dont know how to fix that. Can anybody say to me whats the issue?
To me: I am not a every day python user so it can be that its a error from my side

502 Bad Gateway and 'content-length' Exception

502 Bad Gateway

I often get files with the data as shown below
I guess this is CyberDrop's issue? but still, I'd wish it could be handled better by the Downloader when issues like this occure :)

<!-- randomvideofromalbum.mp4 -->
<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx</center>
</body>
</html>

I assume you can check the request.get response header 'Content-Type'; it always is 'text/html' when there is a html error and then inform the user that the file is "temporarily unavailable".

'content-length'

'content-length' 
[WinError 2] The system cannot find the file specified. './Downloads/album/pathtofile' 
Failed to Download

I just assume the WinError happens bc the file can't be created due to the exception(s).

OS: Windows 10
Python: 3.7.4

Downloader has trouble with hyphens in URL

When an album uses hyphens, it is ignored when added to URL.txt.
Example: https://www.putme.ga/album/testing-hyphen-usage.rY6gJ

Command Line Message:
URLs.txt exists
Traceback (most recent call last):
File "D:\OFFLOAD\Downloads\CyberDropDownloader-2.1.3\main.py", line 74, in
asyncio.get_event_loop().run_until_complete(main())
File "C:\Users[USER]\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 642, in run_until_complete
return future.result()
File "D:\OFFLOAD\Downloads\CyberDropDownloader-2.1.3\main.py", line 63, in main
raise ValueError('No links found, check the URL.txt')
ValueError: No links found, check the URL.txt

D:\OFFLOAD\Downloads\CyberDropDownloader-2.1.3>pause
Press any key to continue . .
URLs.txt
.

cmd turns off after few seconds after start

So I start downloading, cmd appears and it seems like it will start downloading now, but it just closes and nothing happens after that. Win 10, idk what's wrong

The number of simultaneous downloads.

Is it possible to somehow reduce the number of simultaneous downloads? For example, up to 2 or up to 3. If it is possible, then how to do it

.

Sfhkch

[BUG] The app closes itself after some time

Describe the bug
After some time, the app closes itself. It will download for about half an hour or maybe more, I haven't exactly counted.

To Help Reproduce
Steps to help reproduce the behavior:

1. For example, I have started downloading a video album of 30 GB. I kept it on and after 20-30 mins, I noticed that the app wasn't on the taskbar nor was it running in the background and I didn't close it either, it closed itself!
2. Can't actually provide a screenshot of this as it literally closes itself.
3. Using the latest version 2.3.0

Setup Information

• OS: [Windows 10 Pro 64 bit, 20H2, OS Build 19042.1526]
• 2.3.0

**Additional Information
I was downloading from Bunkr.is

[BUG] 2.3.5 doesn't works while 2.3.4 still does

\Python\Python310\site-packages\twisted\internet\main.py", line 32, in installReactor
raise error.ReactorAlreadyInstalledError("reactor already installed")
twisted.internet.error.ReactorAlreadyInstalledError: reactor already installed

^ Something like that, anyway thank you for your contribution, nice downloader.

Rename the folder

Greetings.
I would like to know if in this latest version (currently 2.3.2) it is possible to change the name of the folder that is created when saving the gallery, let me explain.

Currently the gallery folder is left with the name of the gallery (example: "my gallery") and in previous versions it was left with the following syntax my gallery 40 files __ 34.38 MB _ CyberDro

I clarify, I have tried to do it by editing the file utils/downloaders.py but unfortunately I don't know how to program in python and I couldn't.

I really appreciate the reply.

PDTA: I hope you understand, my English is not very good and it works with google translator.

[FEATURE] Add Gofile support

Quite a few posts use Gofile album links, which contain files that must be downloaded individually. Would be a nice addition to have Gofile support added

Downloader has problem with too long folder names?..

Link Redacted
Failed to download the 5-th (or 4-th, I don't remember) file from there: just hang. I closed the window after approx. 2 minutes of waiting. The folder "Lera Himera Lara Croft in cosplay + swimsuit + robe + nude 1..." is unresponsive now (and why does it have "..." in its name in the first place?), I can't either access or delete it:

At the same time, the script itself apparently can access the folder - I started it again and was able to finish downloading, however afterwards I received the same problem - the folder is unresponsive.

Downloader repeatedly hangs at random files.

It seems to hang at random files throughout the process. It will be stuck on the previous message for hours.

Unable to Scrap - No links found

Tried scrapping a link and it works in browser but isn't working on the app.

Bunkr.is no longer works

Bunkr are now blocking direct access to the videos: "Due to constant abuse, direct access to videos have been disabled. You can still stream it through stream.bunkr.is, and also download them without any issues by clicking on the "Download media" button."

My guess is that they are using the valid_referers parameter in nginx for the videos to be played on their site only. Possible to set a referer (stream.bunkr.is) to see if this does the trick? Because the videos play and download fine from their site, so they must be allowing only from their site (referer)

Stuck at "Failed to Download"

Hello, I was using this downloader for a long time and it worked perfectly, then suddenly one day it stopped working. Now it always returns "Failed to Download" on every image. I've tried with different albums (which I know they all exist and work) to no avail. I downloaded the latest version but that didn't change anything.

ConnectionResetError

i keep getting this kind of error. please set limit on how many thread per file to prevent this issue

[SSL: CERTIFICATE_VERIFY_FAILED]

Is putme.ga still supported?

Download to a particular folder

Currently, it downloads all the galleries to the root folder of the program. I created a folder inside it with the name "Downloads" and want all the albums to be downloaded to it. How can I do that?

Thanks

Downloader has trouble with folder/file names that contain unallowed characters.

Link: https://cyberdrop.me/a/Rv3DUQx4

The set title "Balloon Birthday (?)" has a question mark which Windows does not allow when naming folders/files. For instance, the characters that aren't allowed are: \ / : * ? " < > |

"We've stored the partial result and will retry"

When trying to download multiple folders, the download hangs and then everything stops with this error that I have attached in the file.
Error.txt

[BUG] FileExistsError: [WinError 183]

FileExistsError: [WinError 183] Cannot create a file when that file already exists: "1855.download" -> "1855.jpg"

[bunkr.to] fails to download

This is what I get when I run the script on a Mac

 
Downloading 44 files...
'content-length'
        Failed attempt 1 for Nirvana-Issue-12---BTS-vLog!-Turks-&-Caicos-IDPX1Lxa.mov
        Retrying Nirvana-Issue-12---BTS-vLog!-Turks-&-Caicos-IDPX1Lxa.mov...
        Downloading Nirvana-Issue-10---Cabo-BTS-Vlog-Part-1-FfDBrPOD.mp4...

An existing connection was forcibly closed by the remote host

("Connection broken: ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)", ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))

Any Idea why this could be happening ?

bunkr video http error 429 too many request

bunkr album id: dmbW3gZR

429 Client Error: Too Many Requests for url: the file url
Failed attempt 1 for the file name

btw i think u forgot to update the version number in the python file.

[BUG] OSError: [Errno 24] Too many open files:

Current version has problems downloading (from cyberdrop.me)

Starts downloading and after a short time it stops with the error message from above

Persistent Incomplete Download

Describe the bug
The app downloads few megabytes and then show all downloads completed even if they aren't. Rerunning the app multiple times doesn't do anything to fix it. All incomplete downloads are shown as mp4 files with few byte size. There are no ".download" files.

To Help Reproduce

1. I am not sure if this is exclusive to bunkr.is files or not but it happened a day or two ago too but I didn't notice that and all the links were from bunkr.is I think and since the app showed the downloads as completed so didn't bother and removed the links from URL.txt but later found out those were actually incomplete downloads. Furthermore, today the same thing occurred.
2. Just downloaded and tried 2.3.4 and still nothing.

Screenshots

Setup Information

• OS: [Windows 10, 64-bit, 20H2 OS Build 19042.1526]
• Cyberdrop Downloader Version 2.3.4

Additional context
logs.log

downloader.py — No such file or directory

Getting this error
./downloader.py': [Errno 2] No such file or directory

Can't see. this file in releases

[FEATURE] add possibilities for parsing links from the URLs.txt

Sometimes I want copy/paste text from a forum, but it has a "trash", and I must clean links with REGX or something as that.
I think will be fine if your program will be it by itself.

Python int too large to convert to C long

Got this error while downloading on windows.
Here's the link:
/a/gd9riZ62
Python int too large to convert to C long

possibility to download folders in putmega

When I want to download an putmega account and it has folders inside I'd like the program to download all those folders, it seems now it doesnt do that

[PREPOSITION] add support downloads free books

e.g. (https://kp.rusneb.ru/ or https://polona.pl/

The site has a many old books.
https://kp.rusneb.ru/item/reader/rossiyskaya-grammatika-mihayla-lomonosova-2

let tmp = Array .from(document.querySelector("div.previews.panel.open").querySelectorAll("img")) .map(e=>"https://kp.rusneb.ru"+e.getAttribute("data-src").replace(/thumb/g, 'preview'))

result:
...
https://kp.rusneb.ru/attachments/attachment/preview/5fd/3fc/d8d/5fd3fcd8dc63cb9f6aa02f01-preview.jpg
https://kp.rusneb.ru/attachments/attachment/preview/5fd/3fc/d8d/5fd3fcd8dc63cb9f6aa02f04-preview.jpg
...

[FEATURE] Add pyproject.toml

Is your feature request related to a problem? Please describe.
Installation using requirements.txt is unorthodox way in Python. It leads to ugly solutions like cyberdropdownloader-bin in AUR which keeps all dependencies in user's dir and do not update them when system package updates.

Describe the solution you'd like
pyproject.toml and probably setup.cfg/setup.py is preferred way for building and installation Python packages (wheels).

[FEATURE] arm64-v8a/armeabi-v7a library support

During the installation with termux for the phone, requirements.txt libraries have installation problems for arm CPUs.
Maybe I didn't install properly, but I still wanted to ask.

An ability to choose which file server to download from / exclude a particular file server

In my experience, Cyberdrop has at least three file servers that provide content: 01, 02, 03.

During normal usage I've noticed that file server 02 gets called first by a handful of direct links, which would be fine if fs-02 wasn't the slowest server available to me. I am able to remedy this on my preferred web browser by editing the address on the address bar (and skip the "broken" images in the Downloader), but it would be nice to see a functionality like this built into the Downloader.

[BUG] Bunkr download video doesn't works [2.4.0]

Describe the bug
A clear and concise description of what the bug is. INCLUDE THE FULL STACK TRACE.
Did the usual thing but this time 2 bunkr links i wanted to download didn't worked

To Help Reproduce
Steps to help reproduce the behavior:

1. Describe the bug accurately.
   Dunno if i'm allowed to post nsfw links from bunkr so if you need them just tell me and i will post them

2. Provide an example album that showcases it (only containing non-copyright SFW images).

3. Make sure you are updated to the latest version to see if it's already fixed.
   I'm on the latest version to date [2.4.0]

Screenshots
If applicable, add screenshots to help explain your problem.
https://i.imgur.com/JiC6Q3P.png

Setup Information

• OS: Win10
• Cyberdrop Downloader Version #2.4.0

Additional context
Add any other context about the problem here. Bonus points for uploading your logs.log file.
https://i.imgur.com/iEsesQy.png sorry, i don't have a paste bin for the logs

[BUG] I can't update to the latest version

Does anyone know the command to update?

[Errno 2]: No such file or directory: 'requirements.txt' . On Mac OSx

I keep getting this same error but i do not know how to fix it. Can you help me? My system is macOS Catalina version 10.15.7

bunkr.is: Videos/mp4 files with Unicode symbols in the filename fail to download

Issue description

When downloading videos/mp4 files with Unicode symbols in the filename, it fails with a conversion error:
'latin-1' codec can't encode character '\u2019' in position 87: ordinal not in range(256)
Failed attempt 1 for Its-getting-warmer-outside,-so-it’s-a-perfect-time-to-remind-you-of-all-the-super-hot-summertime-fun-I-enjoy!-pVMg1JUh.mp4
Its not a filename issue, because the same filename with a .jpg extension downloads just fine. It also seems to be independent from the file size.

Steps to reproduce the issue

1. Add the following Test Link to the URL.txt file: https://bunkr.is/a/zkGCNfxs .
2. Run the start.bat.
3. The jpgs download without any problem, but the mp4 fails.

What's the expected result?

• All files should download correctly.

What's the actual result?

• The mp4 file fails to download with the above error message.

Additional details

Windows 10 21H1
Python 3.9.7
CyberDropDownloader 1.5.1

Guhh

[BUG]

hi i keep getting this error I checked url it start with https://www.
URLs.txt exists
Traceback (most recent call last):
File "C:\Users\Pakun\OneDrive\Desktop\CyberDropDownloader-2.1.5\main.py", line 74, in
asyncio.get_event_loop().run_until_complete(main())
File "C:\Users\Pakun\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 642, in run_until_complete
return future.result()
File "C:\Users\Pakun\OneDrive\Desktop\CyberDropDownloader-2.1.5\main.py", line 63, in main
raise ValueError('No links found, check the URL.txt\nNote: This utility only supports album links, not direct links to pictures or videos.')
ValueError: No links found, check the URL.txt
Note: This utility only supports album links, not direct links to pictures or videos.