blackjack4494 / yt-dlc Goto Github PK
View Code? Open in Web Editor NEWmedia downloader and library for various sites.
License: The Unlicense
media downloader and library for various sites.
License: The Unlicense
PASTE VERBOSE LOG HERE
Error loading Python DLL 'C:\DOCUME1\Owner\LOCALS1\Temp_MEI33442\python35.dll'.
LoadLibrary: This application has failed to start because the application configuration is incorrect. Reinstalling the application may fix this problem.
WRITE DESCRIPTION HERE
I know I'm the exception rather than the rule, but I tried to run YouTube-DLC_x86 on my Windows XP system and got the above error. The original YouTube-DL works fine for me, but YouTube-DLC_x86 won't even run because it's looking for a python36.dll, which I don't have.
ytdlc -v -F https://youtu.be/-gJaYKwreEc?list=RD-gJaYKwreEc
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://youtu.be/-gJaYKwreEc?list=RD-gJaYKwreEc']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.09.20
[debug] Python version 2.7.16 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[youtube:playlist] Downloading playlist RD-gJaYKwreEc - add --no-playlist to just download video -gJaYKwreEc
[youtube:playlist] RD-gJaYKwreEc: Downloading page 1 of Youtube mix
[download] Downloading playlist: RD-gJaYKwreEc
[youtube:playlist] playlist RD-gJaYKwreEc: Collected 0 video ids (downloading 0 of them)
[download] Finished downloading playlist: RD-gJaYKwreEc
test links:
https://www.youtube.com/watch?v=-gJaYKwreEc&feature=youtu.be&list=RD-gJaYKwreEc
https://youtu.be/-gJaYKwreEc?list=RD-gJaYKwreEc
Tried some other playlists and they seem to be fine.
Assume this could be a formatting problem of the initial link.
Opened that channel, navigated to playlists and took this link for that very same playlist wanted initially:
https://www.youtube.com/watch?v=-gJaYKwreEc&list=PLF-k_OIEn_PMQ4bYJGD1Jx1OUAM7zwaEH
It works.
Please take a look and in case this is just a link formatting problem, just close this issue.
$ youtube-dlc --ignore-config --verbose 'https://www.nicovideo.jp/watch/sm29303999'
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--ignore-config', u'--verbose', u'https://www.nicovideo.jp/watch/sm29303999']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 2.7.18 (CPython) - Linux-5.4.0-52-generic-x86_64-with-Ubuntu-20.04-focal
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[niconico] sm29303999: Downloading webpage
[niconico] sm29303999: Downloading JSON metadata for h264_360p-aac_64kbps
[niconico] sm29303999: Downloading JSON metadata for h264_360p_low-aac_64kbps
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://pe03821af87.dmc.nico/vod/ht2_nicovideo/nicovideo-sm29303999_d12af73024e45c5410966649f9601391bdf4129f978a797c374c3bb3ce252d22?ht2_nicovideo=6-N0wawdNOqC_1604121810978.4nohp4qioy_qj1wb7_20e41xpuox7ii'
[download] Destination: 【東方】幻想万華鏡 第7話・巨大妖怪伝説の章【二次創作アニメ】-sm29303999.mp4
[download] 23.8% of 58.16MiB at 120.34KiB/s ETA 06:17[download] Got server HTTP error: Downloaded 14524539 bytes, expected 60982677 bytes. Retrying (attempt 1 of 10)...
ERROR: unable to download video data: HTTP Error 403: Forbidden
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dlc/YoutubeDL.py", line 2003, in process_info
success = dl(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dlc/YoutubeDL.py", line 1861, in dl
return fd.download(name, info)
File "/usr/local/bin/youtube-dl/youtube_dlc/downloader/common.py", line 366, in download
return self.real_download(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dlc/downloader/http.py", line 349, in real_download
establish_connection()
File "/usr/local/bin/youtube-dl/youtube_dlc/downloader/http.py", line 114, in establish_connection
raise err
HTTPError: HTTP Error 403: Forbidden
Downloading long videos requires heartbeat signals. Here's the description found in the original issue on youtube-dl's repo:
As of today, Nicovideo's seem to implemented a new session system. After every few minutes, the url of the video changes. This causes a 403 Forbidden error on the old url, Causing the Downloader to fail.
A screenshot of part of a video session:
chrome 2017-10-25 10 43 35 396Resuming the download works just for a few minutes before the session is dropped.
Note: I have only tested on a non-premium account. Im not sure if it applies to the permium accounts or not.
URL example: https://www.nicovideo.jp/watch/sm29303999
FAQ, etc. down due to suppression of FOSS.
Is this report from VirusTotal accurate (https://www.virustotal.com/gui/file/763744714819c4a63ecda89e869eab4767e8d4304d544ff000298d267d198646/detection)
? The previous release did not have this issue.
Release scanned: youtube-dlc 2020.10.26 (youtube-dlc.exe). It looks like a false positive to me, but surprised to see it.
For example, when program fails to extract rating, it returns:
WARNING: unable to extract rating; please report this issue on https://yt-dl.org/bug .
Link points to youtube-dl bug tracker, not youtube-dlc one.
That may confuse some people.
youtube-dlc -v https://artikalmusic.bandcamp.com/album/far-north-dubs-ep
[debug] System config: []
[debug] User config: ['-o', '/dev/shm/%(title)s.%(ext)s', '-f', 'bestvideo[height<=1080][ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', '--no-mtime', '--add-metadata', '--embed-thumbnail']
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://artikalmusic.bandcamp.com/album/far-north-dubs-ep']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.25
[debug] Python version 3.6.9 (CPython) - Linux-4.15.0-122-generic-x86_64-with-LinuxMint-19.3-tricia
[debug] exe versions: ffmpeg N-99430-g9d8f9b2-Nico_20201001, ffprobe N-99430-g9d8f9b2-Nico_20201001
[debug] Proxy map: {}
[Bandcamp:album] far-north-dubs-ep: Downloading webpage
ERROR: The page doesn't contain any tracks; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/bandcamp.py", line 311, in _real_extract
raise ExtractorError('The page doesn\'t contain any tracks')
youtube_dlc.utils.ExtractorError: The page doesn't contain any tracks; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
As a user on Reddit experienced, Bandcamp stopped working again.
Doesn't matter what album.
[debug] System config: []
[debug] User config: []
[debug] Custom config: [u'-f', u'bestvideo[ext=webm]+bestaudio[ext=webm]/bestvideo+bestaudio', u'-i', u'-o', u'%(uploader)s (%(uploader_id)s)/%(upload_date)s - %(title)s - [%(resolution)s] [%(id)s].%(ext)s', u'--ffmpeg-location', u'./ffmpeg', u'--download-archive', u'youtube-dl-archive.txt', u'-a', u'youtube-dl-channels.txt', u'--prefer-ffmpeg', u'--merge-output-format', u'mkv', u'--write-sub', u'--all-subs', u'--convert-subs', u'srt', u'--add-metadata', u'--write-description', u'--write-thumbnail', u'-v']
[debug] Command-line args: [u'--config-location', u'./youtube-dl.conf']
[debug] Batch file urls: [u'https://www.youtube.com/channel/UCxLYtICsUCWdr1YPrj5DtwA']
[debug] Loading archive file u'youtube-dl-archive.txt'
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 2.7.16 (CPython) - Linux-5.6.0-0.bpo.2-amd64-x86_64-with-debian-10.6
[debug] exe versions: ffmpeg N-45774-g223f3dff8-static
[debug] Proxy map: {}
[youtube:playlist] UUxLYtICsUCWdr1YPrj5DtwA: Downloading webpage
[download] Downloading playlist: Uploads from Ordinary Things
[youtube:playlist] playlist Uploads from Ordinary Things: Downloading 36 videos
[download] Downloading video 1 of 36
[download] The Evil Economics of Tinder has already been recorded in archive
[download] Downloading video 2 of 36
[download] Handshakes Deserve to Die, Here's Why has already been recorded in archive
[download] Downloading video 3 of 36
[download] Why the Internet Hates Nestlé has already been recorded in archive
[download] Downloading video 4 of 36
[download] How to WIN an Election | An Ordinary Guide has already been recorded in archive
[download] Downloading video 5 of 36
[download] The Bloody Business of the British Flag has already been recorded in archive
[download] Downloading video 6 of 36
[download] The Tasteless History of Ronald McDonald has already been recorded in archive
[download] Downloading video 7 of 36
[download] How Nintendo Killed the GameCube has already been recorded in archive
[download] Downloading video 8 of 36
[download] The Great Egg Industry InfoWar has already been recorded in archive
[download] Downloading video 9 of 36
[download] How the USSR Collapsed on Soviet TV has already been recorded in archive
[download] Downloading video 10 of 36
[download] The Billion-Dollar Bitcoin Scam has already been recorded in archive
[download] Downloading video 11 of 36
[download] The Bizarre Business of Trading Cards has already been recorded in archive
[download] Downloading video 12 of 36
[download] The Rise & Fall of American Malls has already been recorded in archive
[download] Downloading video 13 of 36
[download] Unmasking The History of Masks has already been recorded in archive
[download] Downloading video 14 of 36
[download] The Toxic Business of Cruise Ships has already been recorded in archive
[download] Downloading video 15 of 36
[info] Writing video description to: Ordinary Things (UCxLYtICsUCWdr1YPrj5DtwA)/20200320 - The Desperate History of Panic Buying - [1920x1080] [ZX4vseaNJKY].description
[info] Writing video subtitles to: Ordinary Things (UCxLYtICsUCWdr1YPrj5DtwA)/20200320 - The Desperate History of Panic Buying - [1920x1080] [ZX4vseaNJKY].live_chat.json
ERROR: u'url'
Traceback (most recent call last):
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 841, in extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 896, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 1691, in process_video_result
self.process_info(new_info)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 1893, in process_info
sub_info['url'], info_dict['id'], note=False).read()
KeyError: u'url'
[download] Downloading video 16 of 36
[youtube] 9k6sbhyOD5o: Downloading webpage
[youtube] 9k6sbhyOD5o: Downloading embed webpage
[youtube] 9k6sbhyOD5o: Refetching age-gated info webpage
[info] Writing video description to: Ordinary Things (UCxLYtICsUCWdr1YPrj5DtwA)/20200306 - The (Ob)Noxious Rise of Vapes - [1920x1080] [9k6sbhyOD5o].description
[info] Writing video subtitles to: Ordinary Things (UCxLYtICsUCWdr1YPrj5DtwA)/20200306 - The (Ob)Noxious Rise of Vapes - [1920x1080] [9k6sbhyOD5o].live_chat.json
ERROR: u'url'
Traceback (most recent call last):
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 841, in extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 896, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 1691, in process_video_result
self.process_info(new_info)
File "/home/user/.local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 1893, in process_info
sub_info['url'], info_dict['id'], note=False).read()
KeyError: u'url'
^C
ERROR: Interrupted by user
youtube-dlc seems to fail grabbing subtitles for videos, even if there aren't any, and is instead grabbing live_chat.json files, which don't exist for these videos.
This in turn crashes the video ID grab process, which skips grabbing the video all together.
If I comment out these subs lines in my .conf, it grabs video and description without issue. It of course does not grab subs.
# Get All Subs to SRT
--write-sub
--all-subs
--convert-subs srt
youtube-dl 2020.09.20 fails to parse or even download the videos.
Thanks!
[debug] System config: []
[debug] User config: ['-f', 'best', '--merge-output-format', 'mkv']
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://iview.abc.net.au/show/bluey/series/0/video/CH1903Q042S00']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.09.20
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17763
[debug] exe versions: ffmpeg 2020-10-21-git-289e964873-full_build-www.gyan.dev, ffprobe 2020-10-21-git-289e964873-full_build-www.gyan.dev
[debug] Proxy map: {}
[debug] Using fake IP 1.152.104.99 (AU) as X-Forwarded-For.
[abc.net.au:iview] CH1903Q042S00: Downloading JSON metadata
[abc.net.au:iview] CH1903Q042S00: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 401: Unauthorized (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpksi3o1r1\build\youtube_dl\extractor\common.py", line 632, in _request_webpage
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpksi3o1r1\build\youtube_dl\YoutubeDL.py", line 2238, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
All attempts to download content from ABC iview fail with the above error. This was working yesterday, but is failing today. I can confirm that videos are still playable in the browser (using an Australian-based VPN server).
I'm afraid of projects like these being taken down again, so I suggest this project be either mirrored or moved to another site such as NotABug
https://notabug.org/
The readme states
DO NOT UPDATE using -U ! instead download binaries again or when installed with pip use a described above when installing.
I will add some memorable short links to the binaries so you can download them easier.
So what about removing the -U flag completely? Or change to print the update information.
If you want this done I can make a PR this.
:\>c:\support\youtube-dlc.exe --list-subs https://www.pbs.org/video/worlds-fastest-animal-8w5tdp/ --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--list-subs', 'https://www.pbs.org/video/worlds-fastest-animal-8w5tdp/', '--verbose']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.24-6
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: ffmpeg N-92986-gaceb9131c1, ffprobe N-92986-gaceb9131c1, rtmpdump 2.4
[debug] Proxy map: {}
[debug] Using fake IP 6.56.221.25 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] worlds-fastest-animal-8w5tdp: Downloading webpage
[pbs] worlds-fastest-animal-8w5tdp: Downloading widget/partnerplayer page
[pbs] worlds-fastest-animal-8w5tdp: Downloading portalplayer page
[pbs] worlds-fastest-animal-8w5tdp: Downloading 0 video url info
[pbs] worlds-fastest-animal-8w5tdp: Downloading m3u8 information
[pbs] worlds-fastest-animal-8w5tdp: Downloading 1 video url info
[pbs] worlds-fastest-animal-8w5tdp: Checking http-2000k video URL
[pbs] worlds-fastest-animal-8w5tdp: http-2000k video URL is invalid, skipping
[pbs] worlds-fastest-animal-8w5tdp: Checking http-6500k video URL
[pbs] worlds-fastest-animal-8w5tdp: http-6500k video URL is invalid, skipping
[pbs] worlds-fastest-animal-8w5tdp: Checking http-4500k video URL
[pbs] worlds-fastest-animal-8w5tdp: http-4500k video URL is invalid, skipping
[pbs] worlds-fastest-animal-8w5tdp: Checking http-3000k video URL
[pbs] worlds-fastest-animal-8w5tdp: Checking http-1100k video URL
[pbs] worlds-fastest-animal-8w5tdp: http-1100k video URL is invalid, skipping
[pbs] worlds-fastest-animal-8w5tdp: Checking http-730k video URL
[pbs] worlds-fastest-animal-8w5tdp: http-730k video URL is invalid, skipping
3018507559 has no subtitles
Some videos are not picking up VTT subtitles.
Video URL: https://www.pbs.org/video/worlds-fastest-animal-8w5tdp
Subtitle URL: https://ga.video.cdn.pbs.org/captions/nova/ed371369-2d0a-4442-9f64-700ed52cdc9e/captions/yFtOv5_caption.vtt
D:\`user`\Documents\Youtube-DL>youtube-dlc https://www.newgrounds.com/portal/view/769705 -v
[debug] System config: []
[debug] User config: ['-o', 'F:/Videos/Downloaded/%(title)s.%(ext)s', '--write-sub', '--write-auto-sub']
[debug] Custom config: []
[debug] Command-line args: ['https://www.newgrounds.com/portal/view/769705', '-v']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg git-2020-04-03-52523b6, ffprobe git-2020-04-03-52523b6
[debug] Proxy map: {}
[Newgrounds] 769705: Downloading webpage
ERROR: Unable to extract ; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\newgrounds.py", line 64, in _real_extract
File "youtube_dlc\extractor\common.py", line 1010, in _search_regex
youtube_dlc.utils.RegexNotFoundError: Unable to extract ; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
fails to download from newgrounds. using a random video for this example but have tried on multiple.
Hi, it's sad what's happened with both dl & dlc. Is it possible to release on telegram & other similar sites, like deemix/freezer?
The issue is that if you are an Xfinity customer and you try to use youtube-dl while on your home Xfinity connection (in other words you are not trying to log in through some other ISP) it will not allow you to login unless it completes its auto-login sequence. This 8 line fix allows that and has worked fine for a year and a half now, it was originally posted in a comment on a related issue on the other site, but for some inexplicable reason was never added to the main program. This is the output of the diff command comparing the original adobepass.py to the patched one, as you can see there are only 8 lines to be added (6 if you don't count the comments):
$ diff -u adobepass.py.original adobepass.py.patched
--- adobepass.py.original 2018-10-17 01:22:56.000000000 -0400
+++ adobepass.py.patched 2019-04-23 08:53:36.000000000 -0400
@@ -1433,6 +1433,14 @@
provider_redirect_page, 'oauth redirect')
self._download_webpage(
oauth_redirect_url, video_id, 'Confirming auto login')
+ elif 'automatically signed in with' in provider_redirect_page:
+ # Seems like comcast is rolling up new way of automatically signing customers
+ oauth_redirect_url = self._html_search_regex(
+ r'continue:\s*"(https://oauth.xfinity.com/oauth/authorize\?.+)"',
+ provider_redirect_page, 'oauth redirect (signed)')
+ # Just need to process the request. No useful data comes back
+ self._download_webpage(
+ oauth_redirect_url, video_id, 'Confirming auto login')
else:
if '<form name="signin"' in provider_redirect_page:
provider_login_page_res = provider_redirect_page_res
I should clarify that I did not write this patch, just copied it from a comment/submission on the original project.
ytdlc -v https://www.tiktok.com/@charlidamelio/video/6854565358808993029
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.tiktok.com/@charlidamelio/video/6854565358808993029']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.24-5
[debug] Python version 2.7.16 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[TikTok] 6854565358808993029: Downloading video webpage
Traceback (most recent call last):
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "./ytdlc/__main__.py", line 19, in <module>
File "./ytdlc/youtube_dlc/__init__.py", line 487, in main
File "./ytdlc/youtube_dlc/__init__.py", line 477, in _real_main
File "./ytdlc/youtube_dlc/YoutubeDL.py", line 2096, in download
File "./ytdlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info
File "./ytdlc/youtube_dlc/extractor/common.py", line 532, in extract
File "./ytdlc/youtube_dlc/extractor/tiktok.py", line 137, in _real_extract
File "./ytdlc/youtube_dlc/extractor/tiktok.py", line 22, in _extract_aweme
AttributeError: 'NoneType' object has no attribute 'get'
https://www.tiktok.com/@charlidamelio/video/6854565358808993029
I had posted this in the discussion area of the other project just a few days ago and wanted to get it here while I still had it in TextArea Cache (a Firefox addon that comes in REALLY handy at times). Please note that I am NOT the author of the patch discussed below so I can't really answer any questions about it:
I am waiting for blackjack4494/youtube-dlc#124 to be resolved before I install youtube-dlc but in the meantime I wanted to refer you to the patches in https://github.com/ytdl-org/youtube-dl/pull/26826/files although they do not fully fix the issue. The patches are as follows (these are to the original, not necessarily your fork, and they are not mine, I am just referencing them):
In youtube_dl/extractor/extractors.py:
Remove the line from .fxnetworks import FXNetworksIE
at or near line 397.
Remove the file youtube_dl/extractor/fxnetworks.py completely.
And in the file youtube_dl/extractor/go.py:
@@ -38,13 +38,17 @@ class GoIE(AdobePassIE):
'disneynow': {
'brand': '011',
'resource_id': 'Disney',
- }
+ },
+ 'fxnow.fxnetworks': {
+ 'brand': '025',
+ 'requestor_id': 'dtci',
+ },
}
_VALID_URL = r'''(?x)
https?://
(?:
(?:(?P<sub_domain>%s)\.)?go|
- (?P<sub_domain_2>abc|freeform|disneynow)
+ (?P<sub_domain_2>abc|freeform|disneynow|fxnow\.fxnetworks)
)\.com/
(?:
(?:[^/]+/)*(?P<id>[Vv][Dd][Kk][Aa]\w+)|
@@ -99,6 +103,19 @@ class GoIE(AdobePassIE):
# m3u8 download
'skip_download': True,
},
+ }, {
+ 'url': 'https://fxnow.fxnetworks.com/shows/better-things/video/vdka12782841',
+ 'info_dict': {
+ 'id': 'VDKA12782841',
+ 'ext': 'mp4',
+ 'title': 'First Look: Better Things - Season 2',
+ 'description': 'md5:fa73584a95761c605d9d54904e35b407',
+ },
+ 'params': {
+ 'geo_bypass_ip_block': '3.244.239.0/24',
+ # m3u8 download
+ 'skip_download': True,
+ },
}, {
'url': 'http://abc.go.com/shows/the-catch/episode-guide/season-01/10-the-wedding',
'only_matching': True,
I apologize that this is not proper patch file format, I don't know how you get one from github so I had to manually type the + and - symbols at the start of the lines. Anyway this all came from ytdl-org/youtube-dl#26826 but the problem is that it doesn't work on things that require a login. As I said there,
I very much appreciate the effort here, and using your example URL it does work, but I find that with these patches installed I still get an error on other types of URL's: ERROR: Unable to download webpage: HTTP Error 401: Unauthorized (caused by <HTTPError 401: 'Unauthorized'>); please report this issue on https://yt-dl.org/bug ... It seems to affect episodes picked from the page at https://www.fxnetworks.com/ that include season and episode numbers in the URL. For example the first episode on that page tonight was https://fxnow.fxnetworks.com/shows/a-wilderness-of-error/episode-guide/season-01/episode-05-a-wilderness-of-error/vdka20447879 and that doesn't work. Your example in your code follows the format:
https://fxnow.fxnetworks.com/shows/show-name/video/vdka########
What doesn't work is
(the #'s represent digits)
The guy that wrote the patch said the issue was that I was not supplying credentials, but in fact I was, and other Go services that require credentials work fine. My guess is it just isn't parsing the second form of the URL correctly but I don't know for sure. If there is some way you can figure out why his patch only works for videos that don't require a provider login it would be much appreciated, but also I have a feeling that even his original patches will not make it into the main distribution any time soon, so it would be helpful if you could get them into yours if there's not some reason not to.
[youtube] P5ZJui3aPoQ: Downloading webpage
Track: None
Artist: None
When using the YoutubeDL.extract_info, that returns None to both track and artist (it returns None to more things like album, release_date, release_year, etc).
As described in the solution here, apparently changing the User-Agent to the Facebook's one fixed the problems, but, for me, even changing stills returning None.
I believe it's a regex problem while scrapping the metadata, but don't have a clue how/where to fix.
Even videos that have this information given in the description, as Carry on Wayward Son - https://imgur.com/55N5k4l, it stills returning None to the YoutubeDL.extract_info.
Python Example for Carry on Wayward Son
YTDL_OPTIONS = {
'ignoreerrors': False,
'logtostderr': False,
'quiet': False,
'no_warnings': False,
}
ytdl = ytb.YoutubeDL(YTDL_OPTIONS)
example_url = "https://www.youtube.com/watch?v=P5ZJui3aPoQ"
video = ytdl.extract_info(example_url, download=False)
print('Track: ' + video['track'])
print('Artist: ' + video['artist'])
Output
[youtube] P5ZJui3aPoQ: Downloading webpage
Track: None
Artist: None
Anyway, it seems to works well with videos that have the description generated by the Youtube, like this one
Python Example for the link above
YTDL_OPTIONS = {
'ignoreerrors': False,
'logtostderr': False,
'quiet': False,
'no_warnings': False,
}
ytdl = ytb.YoutubeDL(YTDL_OPTIONS)
example_url = "https://www.youtube.com/watch?v=QBxSQXbj6Go"
video = ytdl.extract_info(example_url, download=False)
print('Track: ' + video['track'])
print('Artist: ' + video['artist'])
Output
[youtube] QBxSQXbj6Go: Downloading webpage
Track: Keep Pushin'
Artist: REO Speedwagon
Does this fork have ability to download HQ tracks from SoundCloud with Go+ subscription using just login and password?
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.cbs.com/shows/bob-the-builder/video/9AF4F96F-6B2A-A0FF-F4A7-208A3B6154F1/bob-the-builder-pilchard-and-the-bear/']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.7.3 (CPython) - Linux-4.14.182-bbrplus-x86_64-with-debian-10.0
[debug] exe versions: ffmpeg 4.1.6-1, ffprobe 4.1.6-1
[debug] Proxy map: {}
[CBS] 9AF4F96F-6B2A-A0FF-F4A7-208A3B6154F1: Downloading XML
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
download for this specific episode not working
https://www.cbs.com/shows/bob-the-builder/video/9AF4F96F-6B2A-A0FF-F4A7-208A3B6154F1/bob-the-builder-pilchard-and-the-bear/
however the other works just fine.
e.g https://www.cbs.com/shows/bob-the-builder/video/38CC8BCF-E327-4B42-8F0C-208A3B593ABB/bob-the-builder-drive-thru-disaster/ this ok.
Checklist
I have put together a guide on how to host yt-dlc offshore using companies that have a track record of being very resilient to DMCA takedowns: https://old.reddit.com/r/youtubedl/comments/jktx5b/how_to_anonymously_host_the_continued_development/
I won't copy paste the whole guide onto this issue ticket since it might be better to just link to it off-site and have further away from the development of the software.
$ youtube-dlc --verbose --extract-audio --audio-format mp3 --audio-quality 0 "https://www.youtube.com/watch?v=I8k4jk2ParA"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--extract-audio', '--audio-format', 'mp3', '--audio-quality', '0', 'https://www.youtube.com/watch?v=I8k4jk2ParA']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out cp1252, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: none
[debug] Proxy map: {}
[youtube] I8k4jk2ParA: Downloading webpage
ERROR: Unable to download webpage: <urlopen error EOF occurred in violation of protocol (_ssl.c:1124)> (caused by URLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1124)')))
File "youtube_dlc\extractor\common.py", line 632, in _request_webpage
File "youtube_dlc\YoutubeDL.py", line 2308, in urlopen
File "urllib\request.py", line 525, in open
File "urllib\request.py", line 542, in _open
File "urllib\request.py", line 502, in _call_chain
File "youtube_dlc\utils.py", line 2736, in https_open
File "urllib\request.py", line 1353, in do_open
WRITE DESCRIPTION HERE
Getting error when try to download
ERROR: Unable to download webpage: <urlopen error EOF occurred in violation of protocol (_ssl.c:1124)> (caused by URLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1124)')))
File "youtube_dlc\extractor\common.py", line 632, in _request_webpage
File "youtube_dlc\YoutubeDL.py", line 2308, in urlopen
File "urllib\request.py", line 525, in open
File "urllib\request.py", line 542, in _open
File "urllib\request.py", line 502, in _call_chain
File "youtube_dlc\utils.py", line 2736, in https_open
File "urllib\request.py", line 1353, in do_open
While code signing is not a panacea, it would reduce the possibility of maliciously modified copies of the binaries, as well as reduce the probability for anti-malware utilities reporting a false positive.
$ youtube-dlc -g -v https://youtu.be/QpQvJExilsk
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-g', '-v', 'https://youtu.be/QpQvJExilsk']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.5 (CPython) - Windows-10-10.0.17763-SP0
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1
[debug] Proxy map: {}
ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "c:\python38\lib\site-packages\youtube_dlc\YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "c:\python38\lib\site-packages\youtube_dlc\extractor\common.py", line 532, in extract
ie_result = self._real_extract(url)
File "c:\python38\lib\site-packages\youtube_dlc\extractor\youtube.py", line 2065, in _real_extract
jsplayer_url_json = self._search_regex(
File "c:\python38\lib\site-packages\youtube_dlc\extractor\common.py", line 1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dlc.utils.RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
This started occurring about two days ago and happens the majority of the time when trying to get the URL for a video.
./testdlc -v -F https://www.facebook.com/100002659934141/videos/3355692847862680/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://www.facebook.com/100002659934141/videos/3355692847862680/']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.25
[debug] Python version 2.7.16 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[facebook] 3355692847862680: Downloading webpage
[facebook] 3355692847862680: Downloading webpage
[facebook] 3355692847862680: Downloading webpage
ERROR: Cannot parse data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "./testdlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "./testdlc/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "./testdlc/youtube_dlc/extractor/facebook.py", line 484, in _real_extract
video_id, fatal_if_no_video=True)
File "./testdlc/youtube_dlc/extractor/facebook.py", line 380, in _extract_from_url
raise ExtractorError('Cannot parse data')
ExtractorError: Cannot parse data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Private videos used to work fine until lately. I assume the server response from FB changed or something. As a result, ytdlc does not how to handle it and ask for cookies or login, for example.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--no-warnings', u'--dump-json', u'--verbose', u'--id', u'--', u'6-8E4Nirh9s']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs UTF-8, out None, pref UTF-8
[debug] youtube-dlc version 2020.10.25 [debug] Python version 2.7.16 (CPython) - Linux-4.19.0-10-amd64-x86_64-with-debian-10.6
[debug] exe versions: ffmpeg 4.1.6-1, ffprobe 4.1.6-1
[debug] Proxy map: {} ERROR: 6-8E4Nirh9s: YouTube said: Unable to extract video data
Traceback (most recent call last):
File "./youtube-dlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info ie_result = ie.extract(url)
File "./youtube-dlc/youtube_dlc/extractor/common.py", line 532, in extract ie_result = self._real_extract(url)
File "./youtube-dlc/youtube_dlc/extractor/youtube.py", line 1866, in _real_extract 'YouTube said: %s' % unavailable_message, expected=True, video_id=video_id)
ExtractorError: 6-8E4Nirh9s: YouTube said: Unable to extract video data
Currently, about 3% of video analysis for youtube fails with "Unable to extract video data", even when always using the same URL. The problem ist that sometimes Youtube delivers a player page which does not contain the expected "args": "player_response" object (see youtube.py - _real_extract()).
I did not have time to investigate further today, therefore I open this issue for others to investigate. I will update this if I find out more, if someone else finds something, please add to this issue :)
I attached a working and a non-working reponse to this issue for further investigation.
responses.zip
youtube-dlc --version
2020.10.26
config in use:
--cookies=~/.config/youtube-dl/cookies-youtube-com.txt
--no-check-certificate
--ignore-errors
--format best[ext=mp4]
--no-overwrites
--add-metadata
--output 's1e%(playlist_index)s %(title)s.%(ext)s'
--download-archive ~/.config/youtube-dl/archive.txt
Do I need a new cookie file?
snip
>youtube-dlc --verbose https://7plus.com.au/housos?episode-id=HOUS03-001
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://7plus.com.au/housos?episode-id=HOUS03-001']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: ffmpeg git-2020-06-28-4cfcfb3, ffprobe git-2020-06-28-4cfcfb3
[debug] Proxy map: {}
[7plus] HOUS03-001: Downloading JSON metadata
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\sevenplus.py", line 61, in _real_extract
File "youtube_dlc\extractor\brightcove.py", line 551, in _parse_brightcove_metadata
File "youtube_dlc\extractor\common.py", line 1359, in _sort_formats
youtube_dlc.utils.ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
7plus downloader no longer working for some episodes in particular the latest episode of Housos found here: https://7plus.com.au/housos?episode-id=HOUS03-001
Thanks :)
I think that This project can be migrated to https://codeberg.org or other Open Source friendly Git hosting service.
I'd recommend renaming the project to media-dl. That will avoid any trademark issues with YouTube and is a more accurate description of youtube-dlc anyway since YouTube is just one of many sites it can rip from.
Need to check it again.
File is needed for next releases to check for updates.
I normally would update via Homebrew and would install using these instructions: https://formulae.brew.sh/formula/youtube-dl
Is the new fork will homebrew accessible? is there a formulae for yt-dlc available?
Hi, I just installed youtube-dlc
on my MacBook using cURL
but for all the commands I made, I ended up with syntax error near unexpected token 'newline'
as shown in screenshot below
Is this a bug or anything I did wrong?
When downloading the video getting this error,
ERROR: C0DPdy98e4c: YouTube said: Unable to extract video data
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python3.8/site-packages/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.8/site-packages/youtube_dlc/extractor/youtube.py", line 1865, in _real_extract
raise ExtractorError(
youtube_dlc.utils.ExtractorError: C0DPdy98e4c: YouTube said: Unable to extract video data
After retry..no error.
This issue happening randomly.
@bq:03:11:27:/tmp/dl$ youtube-dlc --verbose -F https://www.youtube.com/watch?v=hKAB91trmbg
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'-F', u'https://www.youtube.com/watch?v=hKAB91trmbg']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 2.7.18 (CPython) - Linux-5.8.0-3-amd64-x86_64-with-debian-bullseye-sid
[debug] exe versions: avconv 4.3.1-3, avprobe 4.3.1-3, ffmpeg 4.3.1-3, ffprobe 4.3.1-3, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] hKAB91trmbg: Downloading webpage
[youtube] hKAB91trmbg: Downloading embed webpage
ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/youtube.py", line 1966, in _real_extract
yt_initial_data['contents']['twoColumnWatchNextResults']['conversationBar']['liveChatRenderer']['continuations'][0]['reloadContinuationData']['continuation']
KeyError: u'conversationBar'
Traceback (most recent call last):
File "/usr/local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/youtube.py", line 2066, in _real_extract
ASSETS_RE, embed_webpage, 'JS player URL')
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/common.py", line 1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Y:\YouTube Channels\NonCompete>youtube-dl --cookies "Y:\cookies.txt" --add-metadata --write-description --write-info-json --write-thumbnail --download-archive "Y:\ytdl_archive.txt" --all-subs --sleep-interval 1 -ciw -o "%(title)s.%(ext)s" -v https://www.youtube.com/channel/UCkZFKKK-0YB0FvwoS8P7nHg
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--cookies', 'Y:\\cookies.txt', '--add-metadata', '--write-description', '--write-info-json', '--write-thumbnail', '--download-archive', 'Y:\\ytdl_archive.txt', '--all-subs', '--sleep-interval', '1', '-ciw', '-o', '%(title)s.%(ext)s', '-v', 'https://www.youtube.com/channel/UCkZFKKK-0YB0FvwoS8P7nHg']
[debug] Loading archive file 'Y:\\ytdl_archive.txt'
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg git-2020-04-15-51db0a4, ffprobe 4.3.1-2020-10-01-full_build-www.gyan.dev
[debug] Proxy map: {}
[youtube:channel] UCkZFKKK-0YB0FvwoS8P7nHg: Downloading channel page
[youtube:playlist] UUkZFKKK-0YB0FvwoS8P7nHg: Downloading webpage
[download] Downloading playlist: Uploads from NonCompete
[youtube:playlist] UUkZFKKK-0YB0FvwoS8P7nHg: Downloading page #1
[youtube:playlist] playlist Uploads from NonCompete: Downloading 159 videos
[download] Downloading video 1 of 159
[youtube] T78IcPvnBtQ: Downloading webpage
[debug] Default format spec: bestvideo+bestaudio/best
[info] Video description is already present
[info] Writing video subtitles to: Viva South America! El Breadcast!.live_chat.json
ERROR: 'url'
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 841, in extract_info
File "youtube_dlc\YoutubeDL.py", line 896, in process_ie_result
File "youtube_dlc\YoutubeDL.py", line 1691, in process_video_result
File "youtube_dlc\YoutubeDL.py", line 1893, in process_info
KeyError: 'url'
For some videos, I'm seeing failures with KeyError: 'url'
(and this time I've actually confirmed the videos work on the site). This is with the latest release version.
Have you considered migrating from GitHub to prevent this entire situation from happening again?
A mirror is now available at https://git.kavin.rocks/kavin/yt-dlc
Tweet regarding the CEO trying to bring back youtube-dl: https://nitter.kavin.rocks/t3rr4dice/status/1320660235363749888
While testing code changes, I noticed many of the unit tests are failing either due to unsupported URLs, timeouts or extractor errors. These are things we should be correcting, right? I didn't want to start down the path of looking at them if we don't intend on fixing them :-)
A Chocolatey package would be useful, it would make it easier to update
$ youtube-dlc https://www.vlive.tv/post/0-19646784 -s -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.vlive.tv/post/0-19646784', '-s', '-v']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg N-99793-gae9a1a9698, ffprobe N-99793-gae9a1a9698
[debug] Proxy map: {}
[generic] 0-19646784: Requesting header
WARNING: Falling back on generic information extractor.
[generic] 0-19646784: Downloading webpage
[generic] 0-19646784: Extracting information
ERROR: Unsupported URL: https://www.vlive.tv/post/0-19646784
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\generic.py", line 3382, in _real_extract
youtube_dlc.utils.UnsupportedError: Unsupported URL: https://www.vlive.tv/post/0-19646784
Vlive now change their URL format (the old format is http://www.vlive.tv/video/0000000 or https://channels.vlive.tv/xxxx/video)
New format:
Single video: https://www.vlive.tv/post/1-19369327
Channel: https://www.vlive.tv/channel/FE619/board/3498
youtube-dlc -x --audio-format mp3 https://www.youtube.com/watch?v=0Qd_k0hv3Nw -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-x', '--audio-format', 'mp3', 'https://www.youtube.com/watch?v=0Qd_k0hv3Nw', '-v']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.9.0 (CPython) - macOS-10.13.6-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg present, ffprobe present, rtmpdump Reason
[debug] Proxy map: {}
[youtube] 0Qd_k0hv3Nw: Downloading webpage
[youtube] 0Qd_k0hv3Nw: Downloading embed webpage
ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python3.9/site-packages/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.9/site-packages/youtube_dlc/extractor/youtube.py", line 2065, in _real_extract
jsplayer_url_json = self._search_regex(
File "/usr/local/lib/python3.9/site-packages/youtube_dlc/extractor/common.py", line 1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dlc.utils.RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
As of yesterday downloading anything from Youtube seems to fail.
C:\youtube-dlc>youtube-dlc -v --cookies cookies.txt https://www.youtube.com/watch?v=JR4KHfqw-oE
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--cookies', 'cookies.txt', 'https://www.youtube.com/watch?v=JR4KHfqw-oE']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg 4.3.1-2020-10-01-full_build-www.gyan.dev, ffprobe 4.3.1-2020-10-01-full_build-www.gyan.dev
[debug] Proxy map: {}
[youtube] JR4KHfqw-oE: Downloading webpage
ERROR: JR4KHfqw-oE: YouTube said: Unable to extract video data
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\youtube.py", line 1865, in _real_extract
youtube_dlc.utils.ExtractorError: JR4KHfqw-oE: YouTube said: Unable to extract video data
As of October 20th, using --cookies
no longer works correctly with my YouTube account. No matter if the video is public or members-only, I still get the same error. While I can just omit this option to download public videos, this becomes a problem when I want to download members-only videos. Between the time of it working and not working, nothing with my setup was changed in any way which leads me to believe this is something YouTube changed on the back-end.
I have signed out and back in to YouTube multiple times, have generated new cookies files multiple times, even tried on another machine but still receive the same error. There was another user who submitted this exact issue back on the old repository but unfortunately I didn't think to make an archive to use for reference.
What adds to the frustration is that this only seems to be happening selectively. When asked, most have reported no recent problems while a few users I've found online seem to have the exact issue as described here.
WRITE DESCRIPTION HERE
GAnarchy is a project I started about when the Mastodon developers refused to add a privacy-protecting feature I requested. it was originally created with the long-term goal of taking over the Mastodon project.
I kinda grew tired of Mastodon but I still stand behind GAnarchy. I think it's an useful project. I think forks of projects such as OpenWRT/LEDE, OpenSSL/LibreSSL, DooM/Sonic Robo Blast 2, and yt-dl/yt-dlc would all benefit from it in different ways. In particular for yt-dl/yt-dlc, I believe it can speed up development efforts even further (by completely decentralizing them), as well as provide strong censorship resistance (because it's so decentralized).
You can learn more about GAnarchy by checking out the subreddit at https://reddit.com/r/GAnarchy or one of the various instances such as https://ganarchy.github.io/ or https://ganarchy.autistic.space/. I've yet to do a proper write-up of it tho.
All it needs is a project maintainer to create a "project commit". They're formatted like so:
[Project] GAnarchy
A Project Page Generator written in Python, focused on giving forks of a
project the same visibility as the original repo.
youtube-dlc -v https://www.youtube.com/watch?v=rNlhTKTHgpo
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.youtube.com/watch?v=rNlhTKTHgpo']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.10.26
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: ffmpeg 4.2.1, ffprobe 4.2.1
[debug] Proxy map: {}
[youtube] rNlhTKTHgpo: Downloading webpage
[youtube] rNlhTKTHgpo: Downloading embed webpage
ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\youtube.py", line 2065, in _real_extract
File "youtube_dlc\extractor\common.py", line 1010, in _search_regex
youtube_dlc.utils.RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Unable to extract JS player URL error
[Download] Debug: [youtube] dX3k_QDnzHE: Downloading webpage
[Download] Debug: [youtube] dX3k_QDnzHE: Downloading embed webpage
[Download] Error: ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
[Download] Error: Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python3.6/dist-packages/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.6/dist-packages/youtube_dlc/extractor/youtube.py", line 2050, in _real_extract
ASSETS_RE, embed_webpage, 'JS player URL')
File "/usr/local/lib/python3.6/dist-packages/youtube_dlc/extractor/common.py", line 1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dlc.utils.RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
This issue is happening around 2-3% of the time when downloading some Videos. This is one of the Videos (https://youtu.be/dX3k_QDnzHE), I am using yt-dlc in python embedded and not as a command line tool. I tried to make it as verbose as possible. If you need more info, just let me know.
As this issue is only happening sometimes, I know this is extremely hard to reproduce and fix, but maybe other people are experiencing this issue too and can share their experience with said issue.
If you need any more info, let me know
I want to download a video and give the user the option to keep the video for later, but for further processing i need to somehow store the output file name as a variable, i cant find any way to do so, and i dont want to make a big workaround by using os
to check the file manually
EDIT: I am aware of the extract_info
option, but this wont give me the literal file name, as it ommits e.g. :
and turns it into -
[youtube] 1234567890: Downloading webpage
[youtube] 1234567890: Downloading embed webpage
[youtube] 1234567890: Refetching age-gated info webpage
Traceback (most recent call last):
File "youtube_dlc\__main__.py", line 19, in <module>
File "youtube_dlc\__init__.py", line 487, in main
File "youtube_dlc\__init__.py", line 477, in _real_main
File "youtube_dlc\YoutubeDL.py", line 2095, in download
File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
File "youtube_dlc\extractor\common.py", line 532, in extract
File "youtube_dlc\extractor\youtube.py", line 2068, in _real_extract
File "json\__init__.py", line 341, in loads
TypeError: the JSON object must be str, bytes or bytearray, not NoneType
[22460] Failed to execute script __main__
Using Windows version, I get this error while trying to download age restricted videos. It used to download properly till 2 days ago.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=HRHVJPFKCqE']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.10.26
[debug] Python version 2.7.18 (CPython) - Linux-5.4.0-52-generic-x86_64-with-Ubuntu-20.04-focal
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[youtube] HRHVJPFKCqE: Downloading webpage
[youtube] HRHVJPFKCqE: Downloading embed webpage
ERROR: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/youtube.py", line 1966, in _real_extract
yt_initial_data['contents']['twoColumnWatchNextResults']['conversationBar']['liveChatRenderer']['continuations'][0]['reloadContinuationData']['continuation']
KeyError: u'conversationBar'
Traceback (most recent call last):
File "/usr/local/bin/youtube-dlc/youtube_dlc/YoutubeDL.py", line 830, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/common.py", line 532, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/youtube.py", line 2066, in _real_extract
ASSETS_RE, embed_webpage, 'JS player URL')
File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/common.py", line 1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract JS player URL; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dlc -U to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
Im simply trying to download a youtube video. Every video that I try including the one mentioned above returns with the stated error. Some other options work like --write-sub or --list-formats but download of the video fails. I had youtube-dl previously installed. Is there some cache I need to clear or is the issue something else? Thank you very much for your help!
I used youtube-dl many years and it automatically made it possible to download age restricted videos.
But if I use youtube-dlc, it tells me:
ERROR: Video is age restricted and only playable on Youtube. Requires cookies!
How do I get the same automatically "cookie creation"?
Thanks in advance
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.