Comments (8)
deldesir
commented on July 17, 2024
1
I reproduced the error. Working on it now...
from calibre-web.
holta
commented on July 17, 2024
@EMG70 can you include both?
- The complete yt-dlp command you used to download the video
- The exact filename of the video (on your local machine) resulting from above
Errors from pastebin Lines 1016-1290 below:
COMMAND: /usr/bin/journalctl -u calibre-web | tail -100 # Calibre-Web systemd log
Jul 06 04:02:52 box python3[691]: self._context.run(self._callback, *self._args)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/wsgi.py", line 156, in handle_request
Jul 06 04:02:52 box python3[691]: app_response = await loop.run_in_executor(
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/platform/asyncio.py", line 266, in run_in_executor
Jul 06 04:02:52 box python3[691]: return self.asyncio_loop.run_in_executor(executor, func, *args)
Jul 06 04:02:52 box python3[691]: File "/usr/lib/python3.12/asyncio/base_events.py", line 863, in run_in_executor
Jul 06 04:02:52 box python3[691]: executor.submit(func, *args), loop=self)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/concurrent.py", line 62, in submit
Jul 06 04:02:52 box python3[691]: future_set_result_unless_cancelled(future, fn(*args, **kwargs))
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 2213, in __call__
Jul 06 04:02:52 box python3[691]: return self.wsgi_app(environ, start_response)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/reverseproxy.py", line 79, in __call__
Jul 06 04:02:52 box python3[691]: return self.app(environ, start_response)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 2190, in wsgi_app
Jul 06 04:02:52 box python3[691]: response = self.full_dispatch_request()
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1484, in full_dispatch_request
Jul 06 04:02:52 box python3[691]: rv = self.dispatch_request()
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1469, in dispatch_request
Jul 06 04:02:52 box python3[691]: return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/usermanagement.py", line 34, in decorated_view
Jul 06 04:02:52 box python3[691]: return func(*args, **kwargs)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/editbooks.py", line 60, in inner
Jul 06 04:02:52 box python3[691]: return f(*args, **kwargs)
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/editbooks.py", line 272, in upload
Jul 06 04:02:52 box python3[691]: error = helper.update_dir_structure(book_id,
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 736, in update_dir_structure
Jul 06 04:02:52 box python3[691]: return update_dir_structure_file(book_id,
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 486, in update_dir_structure_file
Jul 06 04:02:52 box python3[691]: error = move_files_on_change(calibre_path,
Jul 06 04:02:52 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 561, in move_files_on_change
Jul 06 04:02:52 box python3[691]: log.debug("Moving title: %s to %s/%s", original_filepath, new_path)
Jul 06 04:02:52 box python3[691]: Message: 'Moving title: %s to %s/%s'
Jul 06 04:02:52 box python3[691]: Arguments: ('/tmp/calibre_web/0e698f63138363d99a2e257b6cf59380', '/library/calibre-web/Unknown/Days of the Week Sing-along Song _[spi77By9-iA] (14)')
Jul 06 04:09:02 box python3[691]: --- Logging error ---
Jul 06 04:09:02 box python3[691]: Traceback (most recent call last):
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/logging/handlers.py", line 73, in emit
Jul 06 04:09:02 box python3[691]: if self.shouldRollover(record):
Jul 06 04:09:02 box python3[691]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/logging/handlers.py", line 196, in shouldRollover
Jul 06 04:09:02 box python3[691]: msg = "%s\n" % self.format(record)
Jul 06 04:09:02 box python3[691]: ^^^^^^^^^^^^^^^^^^^
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/logging/__init__.py", line 999, in format
Jul 06 04:09:02 box python3[691]: return fmt.format(record)
Jul 06 04:09:02 box python3[691]: ^^^^^^^^^^^^^^^^^^
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/logging/__init__.py", line 703, in format
Jul 06 04:09:02 box python3[691]: record.message = record.getMessage()
Jul 06 04:09:02 box python3[691]: ^^^^^^^^^^^^^^^^^^^
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/logging/__init__.py", line 392, in getMessage
Jul 06 04:09:02 box python3[691]: msg = msg % self.args
Jul 06 04:09:02 box python3[691]: ~~~~^~~~~~~~~~~
Jul 06 04:09:02 box python3[691]: TypeError: not enough arguments for format string
Jul 06 04:09:02 box python3[691]: Call stack:
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps.py", line 51, in <module>
Jul 06 04:09:02 box python3[691]: main()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/main.py", line 83, in main
Jul 06 04:09:02 box python3[691]: success = web_server.start()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/server.py", line 286, in start
Jul 06 04:09:02 box python3[691]: self._start_tornado()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/server.py", line 272, in _start_tornado
Jul 06 04:09:02 box python3[691]: self.wsgiserver.start()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/platform/asyncio.py", line 205, in start
Jul 06 04:09:02 box python3[691]: self.asyncio_loop.run_forever()
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/asyncio/base_events.py", line 641, in run_forever
Jul 06 04:09:02 box python3[691]: self._run_once()
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/asyncio/base_events.py", line 1987, in _run_once
Jul 06 04:09:02 box python3[691]: handle._run()
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/asyncio/events.py", line 88, in _run
Jul 06 04:09:02 box python3[691]: self._context.run(self._callback, *self._args)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/wsgi.py", line 156, in handle_request
Jul 06 04:09:02 box python3[691]: app_response = await loop.run_in_executor(
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/platform/asyncio.py", line 266, in run_in_executor
Jul 06 04:09:02 box python3[691]: return self.asyncio_loop.run_in_executor(executor, func, *args)
Jul 06 04:09:02 box python3[691]: File "/usr/lib/python3.12/asyncio/base_events.py", line 863, in run_in_executor
Jul 06 04:09:02 box python3[691]: executor.submit(func, *args), loop=self)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/tornado/concurrent.py", line 62, in submit
Jul 06 04:09:02 box python3[691]: future_set_result_unless_cancelled(future, fn(*args, **kwargs))
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 2213, in __call__
Jul 06 04:09:02 box python3[691]: return self.wsgi_app(environ, start_response)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/reverseproxy.py", line 79, in __call__
Jul 06 04:09:02 box python3[691]: return self.app(environ, start_response)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 2190, in wsgi_app
Jul 06 04:09:02 box python3[691]: response = self.full_dispatch_request()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1484, in full_dispatch_request
Jul 06 04:09:02 box python3[691]: rv = self.dispatch_request()
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1469, in dispatch_request
Jul 06 04:09:02 box python3[691]: return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/usermanagement.py", line 34, in decorated_view
Jul 06 04:09:02 box python3[691]: return func(*args, **kwargs)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/editbooks.py", line 60, in inner
Jul 06 04:09:02 box python3[691]: return f(*args, **kwargs)
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/editbooks.py", line 272, in upload
Jul 06 04:09:02 box python3[691]: error = helper.update_dir_structure(book_id,
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 736, in update_dir_structure
Jul 06 04:09:02 box python3[691]: return update_dir_structure_file(book_id,
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 486, in update_dir_structure_file
Jul 06 04:09:02 box python3[691]: error = move_files_on_change(calibre_path,
Jul 06 04:09:02 box python3[691]: File "/usr/local/calibre-web-py3/cps/helper.py", line 561, in move_files_on_change
Jul 06 04:09:02 box python3[691]: log.debug("Moving title: %s to %s/%s", original_filepath, new_path)
Jul 06 04:09:02 box python3[691]: Message: 'Moving title: %s to %s/%s'
Jul 06 04:09:02 box python3[691]: Arguments: ('/tmp/calibre_web/b5f691dbdc6ef1ffe71a22e26192f9d5', '/library/calibre-web/Unknown/Numbers in the Teens They start with a 1!!!! song clipnabber com [RMM5N63d2DI] (15)')
=IIAB==========================================================================
-rw-r--r-- 1 root root 70766 Jul 6 04:10 /var/log/calibre-web.log
...ITS LAST 100 LINES FOLLOW...
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1486, in full_dispatch_request
rv = self.handle_user_exception(e)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1484, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1469, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/usermanagement.py", line 34, in decorated_view
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 60, in inner
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 250, in upload
meta, error = file_handling_on_upload(requested_file)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 930, in file_handling_on_upload
meta = uploader.upload(requested_file, config.config_rarfile_location)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/uploader.py", line 378, in upload
return process(tmp_file_path, filename_root, file_extension, rar_excecutable)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/uploader.py", line 102, in process
if not meta.title.strip():
^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'title'
[2024-07-06 03:51:57,474] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/9f07d45ce89b01e5b63b6fc1ebe819c8
[2024-07-06 03:51:57,570] WARN {cps.uploader:309} Cannot find the xklb database, using default metadata
[2024-07-06 03:51:57,570] ERROR {cps:1414} Exception on /upload [POST]
Traceback (most recent call last):
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 2190, in wsgi_app
response = self.full_dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1486, in full_dispatch_request
rv = self.handle_user_exception(e)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1484, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/lib/python3.12/site-packages/flask/app.py", line 1469, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/usermanagement.py", line 34, in decorated_view
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 60, in inner
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 250, in upload
meta, error = file_handling_on_upload(requested_file)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/editbooks.py", line 930, in file_handling_on_upload
meta = uploader.upload(requested_file, config.config_rarfile_location)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/uploader.py", line 378, in upload
return process(tmp_file_path, filename_root, file_extension, rar_excecutable)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/calibre-web-py3/cps/uploader.py", line 102, in process
if not meta.title.strip():
^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'title'
[2024-07-06 03:52:49,413] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/b557a6499854dfbf8f01400895076d78
[2024-07-06 03:52:55,029] DEBUG {cps.uploader:336} ffmpeg output: b''
[2024-07-06 03:52:55,057] DEBUG {cps.services.worker:91} Add Task for user: Admin - Upload Counting Songs Collection KasD52z9dB4
[2024-07-06 03:54:43,286] DEBUG {cps.services.worker:91} Add Task for user: Admin - Metadata fetch task for https://www.youtube.com/watch?v=e0dJWfQHF8Y
[2024-07-06 03:54:43,570] INFO {cps.tasks.metadata_extract:153} Starting to fetch metadata for URL: https://www.youtube.com/watch?v=e0dJWfQHF8Y
[2024-07-06 03:54:49,755] DEBUG {cps.services.worker:91} Add Task for user: Admin - Download task for https://www.youtube.com/watch?v=e0dJWfQHF8Y
[2024-07-06 03:54:49,755] INFO {cps.tasks.download:43} Subprocess args: ['lb-wrapper', 'dl', 'https://www.youtube.com/watch?v=e0dJWfQHF8Y']
[2024-07-06 03:54:56,712] INFO {cps.editbooks:369} Received metadata request: ImmutableMultiDict([('requested_file', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4'), ('current_user_name', 'Admin')])
[2024-07-06 03:54:56,712] INFO {cps.editbooks:371} Requested file: /library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4
[2024-07-06 03:54:56,712] INFO {cps.editbooks:376} Processing file: <_io.BufferedReader name='/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4'>
[2024-07-06 03:54:56,715] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/a0915b5af8cb41be4655de64c5b109bb
[2024-07-06 03:54:56,749] WARN {py.warnings:112} /usr/local/calibre-web-py3/cps/editbooks.py:1531: SAWarning: Object of type <Books> not in session, add operation along 'Authors.books' won't proceed (This warning originated from the Session 'autoflush' process, which was invoked automatically in response to a user-initiated operation.)
db_element = db_session.query(db_object).filter((func.lower(db_filter).ilike(add_element))).first()
[2024-07-06 03:54:56,796] INFO {cps.tasks.download:116} Successfully sent the requested file to http://10.123.144.182/books/meta
[2024-07-06 03:54:56,808] INFO {cps.tasks.download:139} Download task for https://www.youtube.com/watch?v=e0dJWfQHF8Y completed successfully
[2024-07-06 04:00:00,001] INFO {apscheduler.executors.default:123} Running job "delete temp (trigger: cron[hour='4'], next run at: 2024-07-07 04:00:00 BST)" (scheduled at 2024-07-06 04:00:00+01:00)
[2024-07-06 04:00:00,002] DEBUG {cps.services.worker:91} Add Task for user: System - Delete Temp Folder
[2024-07-06 04:00:00,002] INFO {apscheduler.executors.default:144} Job "delete temp (trigger: cron[hour='4'], next run at: 2024-07-07 04:00:00 BST)" executed successfully
[2024-07-06 04:00:36,144] DEBUG {cps.updater:331} Stable version: {'version': '0.6.22b'}
[2024-07-06 04:00:50,607] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/d17b7ed1d10f2fef5bb27dfaac22379e
[2024-07-06 04:00:53,150] DEBUG {cps.uploader:336} ffmpeg output: b''
[2024-07-06 04:00:53,168] ERROR {cps.editbooks:952} Failed to move cover file /library/calibre-web/Unknown/Numbers in the Teens They start with a 1!!!! song clipnabber com RMM5N63d2DI (12): [Errno 2] No such file or directory: '/tmp/calibre_web/d17b7ed1d10f2fef5bb27dfaac22379e.cover.jpg'
[2024-07-06 04:00:53,176] DEBUG {cps.services.worker:91} Add Task for user: Admin - Upload Numbers in the Teens They start with a 1!!!! song clipnabber com RMM5N63d2DI
[2024-07-06 04:01:27,229] DEBUG {cps.updater:331} Stable version: {'version': '0.6.22b'}
[2024-07-06 04:01:54,564] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/688aa21412e359bdca96ba16cc489ff5
[2024-07-06 04:01:58,725] DEBUG {cps.uploader:336} ffmpeg output: b''
[2024-07-06 04:01:58,749] DEBUG {cps.services.worker:91} Add Task for user: Admin - Upload Climbing Up This Mountain (Counting by 10s up to 100) yQSdKlNvrmw
[2024-07-06 04:02:41,571] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/0e698f63138363d99a2e257b6cf59380
[2024-07-06 04:02:52,359] DEBUG {cps.uploader:336} ffmpeg output: b''
[2024-07-06 04:02:52,385] DEBUG {cps.services.worker:91} Add Task for user: Admin - Upload Days of the Week Sing-along Song *[spi77By9-iA]
[2024-07-06 04:08:59,834] DEBUG {cps.uploader:376} Temporary file: /tmp/calibre_web/b5f691dbdc6ef1ffe71a22e26192f9d5
[2024-07-06 04:09:02,861] DEBUG {cps.uploader:336} ffmpeg output: b''
[2024-07-06 04:09:02,874] ERROR {cps.editbooks:952} Failed to move cover file /library/calibre-web/Unknown/Numbers in the Teens They start with a 1!!!! song clipnabber com [RMM5N63d2DI] (15): [Errno 2] No such file or directory: '/tmp/calibre_web/b5f691dbdc6ef1ffe71a22e26192f9d5.cover.jpg'
[2024-07-06 04:09:02,884] DEBUG {cps.services.worker:91} Add Task for user: Admin - Upload Numbers in the Teens They start with a 1!!!! song clipnabber com [RMM5N63d2DI]
[2024-07-06 04:10:00,000] INFO {apscheduler.executors.default:123} Running job "end scheduled task (trigger: cron[hour='4', minute='10'], next run at: 2024-07-07 04:10:00 BST)" (scheduled at 2024-07-06 04:10:00+01:00)
[2024-07-06 04:10:00,001] INFO {apscheduler.executors.default:144} Job "end scheduled task (trigger: cron[hour='4', minute='10'], next run at: 2024-07-07 04:10:00 BST)" executed successfully
=IIAB==========================================================================
-rw-r--r-- 1 root root 9619 Jul 6 03:54 /var/log/xklb.log
...ITS LAST 300 LINES FOLLOW...
2024-07-06 03:54:44 - [Info] Using yt-dlp 2024.07.02
2024-07-06 03:54:44 - [Info] Running xklb command: lb tubeadd '/library/calibre-web/xklb-metadata.db' 'https://www.youtube.com/watch?v=e0dJWfQHF8Y' --force -vv
2024-07-06 03:54:46 - [Debug] library v2.8.066
2024-07-06 03:54:46 - [Debug] ['/usr/local/bin/lb', 'tubeadd', '/library/calibre-web/xklb-metadata.db', 'https://www.youtube.com/watch?v=e0dJWfQHF8Y', '--force', '-vv']
2024-07-06 03:54:46 - [Debug] {'force': True, 'paths': ['https://www.youtube.com/watch?v=e0dJWfQHF8Y']}
2024-07-06 03:54:46 - [Debug] {'noprogress': True, 'skip_download': True, 'lazy_playlist': True, 'extract_flat': True, 'no_check_certificate': True, 'ignore_no_formats_error': True, 'skip_playlist_after_errors': 21, 'playlistend': 20000, 'force': True}
2024-07-06 03:54:47 - [Debug] yt-dlp initialized 0.2149
2024-07-06 03:54:47 - [Info] [youtube] Extracting URL: https://www.youtube.com/watch?v=e0dJWfQHF8Y
2024-07-06 03:54:47 - [Info] [youtube] e0dJWfQHF8Y: Downloading webpage
2024-07-06 03:54:47 - [Info] [youtube] e0dJWfQHF8Y: Downloading ios player API JSON
2024-07-06 03:54:47 - [Info] [youtube] e0dJWfQHF8Y: Downloading player 5352eb4f
2024-07-06 03:54:49 - [Debug] no such table: media
2024-07-06 03:54:49 - [Debug] Importing playlist-less media https://www.youtube.com/watch?v=e0dJWfQHF8Y
2024-07-06 03:54:49 - [Debug] media.playlist_media_add 2.2274
2024-07-06 03:54:49 - [Debug] ydl.extract_info done 0.0115
2024-07-06 03:54:49 - [Debug]
2024-07-06 03:54:49 - [Debug] Optimizing database
2024-07-06 03:54:49 - [Debug] Processing table: media
2024-07-06 03:54:49 - [Debug] Transforming column order: ['id', 'size', 'duration', 'time_uploaded', 'time_created', 'time_modified', 'time_deleted', 'time_downloaded', 'fps', 'view_count', 'path', 'webpath', 'extractor_id']
2024-07-06 03:54:49 - [Debug] Creating index: id
2024-07-06 03:54:49 - [Debug] Creating index: size
2024-07-06 03:54:49 - [Debug] Creating index: duration
2024-07-06 03:54:49 - [Debug] Creating index: time_uploaded
2024-07-06 03:54:49 - [Debug] Creating index: time_created
2024-07-06 03:54:49 - [Debug] Creating index: time_modified
2024-07-06 03:54:49 - [Debug] Creating index: time_deleted
2024-07-06 03:54:49 - [Debug] Creating index: time_downloaded
2024-07-06 03:54:49 - [Debug] Creating index: fps
2024-07-06 03:54:49 - [Debug] Creating index: view_count
2024-07-06 03:54:49 - [Debug] Creating index: live_status
2024-07-06 03:54:49 - [Debug] Creating index: path
2024-07-06 03:54:49 - [Debug] Creating index: uploader
2024-07-06 03:54:49 - [Debug] Creating fts index: ['path', 'webpath', 'title']
2024-07-06 03:54:49 - [Debug] Processing table: captions
2024-07-06 03:54:49 - [Debug] Creating index: media_id
2024-07-06 03:54:49 - [Debug] Creating index: time
2024-07-06 03:54:49 - [Debug] Creating fts index: ['text']
2024-07-06 03:54:49 - [Debug] Running VACUUM
2024-07-06 03:54:49 - [Debug] Running ANALYZE
2024-07-06 03:54:49 - [Info]
2024-07-06 03:54:49 - [Info] lb-wrapper's xklb command (tubeadd) completed successfully.
2024-07-06 03:54:50 - [Info] Using yt-dlp 2024.07.02
2024-07-06 03:54:50 - [Info] Running xklb command: lb dl '/library/calibre-web/xklb-metadata.db' --video --search 'https://www.youtube.com/watch?v=e0dJWfQHF8Y' --format best --format-sort 'tbr~1000' --write-thumbnail --subs --live --live-from-start -o '/library/downloads/calibre-web/%(extractor_key,extractor)s/%(uploader,uploader_id)s/%(title).170B_%(view_count)3.2D_[%(id).64B].%(ext)s' -vv
2024-07-06 03:54:50 - [Debug] library v2.8.066
2024-07-06 03:54:50 - [Debug] ['/usr/local/bin/lb', 'dl', '/library/calibre-web/xklb-metadata.db', '--video', '--search', 'https://www.youtube.com/watch?v=e0dJWfQHF8Y', '--format', 'best', '--format-sort', 'tbr~1000', '--write-thumbnail', '--subs', '--live', '--live-from-start', '-o', '/library/downloads/calibre-web/%(extractor_key,extractor)s/%(uploader,uploader_id)s/%(title).170B_%(view_count)3.2D_[%(id).64B].%(ext)s', '-vv']
2024-07-06 03:54:50 - [Debug] {'include': ['https://www.youtube.com/watch?v=e0dJWfQHF8Y'], 'subs': True, 'profile': 'video', 'live': True, 'paths': []}
2024-07-06 03:54:50 - [Debug] None
2024-07-06 03:54:50 - [Debug] {'path': 'https://www.youtube.com/watch?v=e0dJWfQHF8Y', 'title': 'The Big Numbers Song', 'duration': 194, 'time_created': 1720234489, 'size': 0, 'time_modified': 0, 'time_downloaded': 0, 'time_deleted': 0, 'extractor_key': 'Playlist-less media'}
2024-07-06 03:54:51 - [Debug] {'noprogress': True, 'lazy_playlist': True, 'noplaylist': True, 'no_check_certificate': True, 'ignore_no_formats_error': True, 'skip_playlist_after_errors': 21, 'playlistend': 20000, 'extractor_args': {'youtube': {'skip': ['authcheck']}}, 'logger': <xklb.createdb.tube_backend.download.<locals>.DictLogger object at 0x783504892870>, 'postprocessors': [{'key': 'FFmpegMetadata'}, {'key': 'FFmpegEmbedSubtitle'}], 'playlist_items': '1', 'extractor_retries': 3, 'retries': 12, 'retry_sleep_functions': {'extractor': <function download.<locals>.<lambda> at 0x783504005620>, 'http': <function download.<locals>.<lambda> at 0x7835040056c0>, 'fragment': <function download.<locals>.<lambda> at 0x783504005760>}, 'outtmpl': {'default': '/library/downloads/calibre-web/%(extractor_key,extractor)s/%(uploader,uploader_id)s/%(title).170B_%(view_count)3.2D_[%(id).64B].%(ext)s'}, 'progress_hooks': [<function download.<locals>.<lambda> at 0x783504005800>], 'subtitlesformat': 'srt/best', 'writesubtitles': True, 'writeautomaticsub': True, 'format': 'best', 'format_sort': ['tbr~1000'], 'writethumbnail': True, 'live_from_start': True, '_warnings': ['"-f best" selects the best pre-merged format which is often not the best option.\n To let yt-dlp download and merge the best available formats, simply do not pass any format selection.\n If you know what you are doing and want only the best pre-merged format, use "-f b" instead to suppress this warning'], 'include': ['https://www.youtube.com/watch?v=e0dJWfQHF8Y'], 'subs': True, 'profile': 'video', 'live': True}
2024-07-06 03:54:55 - [Debug] [https://www.youtube.com/watch?v=e0dJWfQHF8Y]: Downloaded to /library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '0.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '63.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '42.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '21.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '105.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '84.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '126.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:55 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '147.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:56 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '168.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:56 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '189.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:56 - [Debug] ('ffmpeg', '-nostdin', '-hide_banner', '-nostats', '-xerror', '-v', '16', '-err_detect', 'explode', '-ss', '193.00', '-i', '/library/downloads/calibre-web/Youtube/KidsTV123/The Big Numbers Song_281.01M_[e0dJWfQHF8Y].mp4', '-t', '1', '-f', 'null', '/dev/null')
2024-07-06 03:54:56 - [Debug] Extra media data {'time_modified': 0, 'time_downloaded': 0, 'time_deleted': 0, 'corruption': 0}
2024-07-06 03:54:56 - [Info] lb-wrapper's xklb command (dl) completed successfully.
Related:
from calibre-web.
holta
commented on July 17, 2024
I've abbreviated @EMG70's answers above, to simplify testing:
- The complete yt-dlp command you used to download the video
yt-dlp https://youtu.be/RMM5N63d2DI
- The exact filename of the video (on your local machine) resulting from above
Numbers in the Teens They start with a 1!!!! song clipnabber com [RMM5N63d2DI].mp4 (4,347,392 bytes)
from calibre-web.
holta
commented on July 17, 2024
Which other kinds of upload testing are most important?
from calibre-web.
deldesir
commented on July 17, 2024
Cannot reproduce the issue downloading the single video
from calibre-web.
deldesir
commented on July 17, 2024
@EMG70, I successfully downloaded this video in my new VM. Does it work for you now?
from calibre-web.
holta
commented on July 17, 2024
@EMG70, I successfully downloaded this video in my new VM. Does it work for you now?
@deldesir do you mean "successfully uploaded" ?
(This issue is not about downloading.)
from calibre-web.
deldesir
commented on July 17, 2024
Ah I see. I will do upload check then, sorry.
from calibre-web.
Related Issues (20)
- Clarify actions on Book Details overlay HOT 4
- @EMG70's YouTube playlist downloading problems 2024-06-10: (1) (This is taking longer than expected) (2) Metadata Fetch: [YouTube video URL] failed: 'NoneType' object cannot be interpreted as an integer [@avni results: (3) failed to download: None (4) it keeps trying to redownload failed videos] HOT 20
- The "Download to IIAB" overlay has the prior URL populated in the text when downloading additional videos HOT 2
- (1) download.py: "sqlite3.OperationalError: no such column: error" after "TypeError: 'NoneType' object is not subscriptable" (2) editbooks.py: SAWarning: Object of type <Books> not in session, add operation along 'Authors.books' won't proceed HOT 10
- metadata_extract.py ... Unavailable Video ... SyntaxError: f-string: unterminated string [and "502 Bad Gateway" on RPi 4 & RPi 400] HOT 9
- Formerly live videos fail to download: "failed to download [download] ... does not pass filter (live_status=?not_live); skipping" HOT 49
- Why ~100 minute ETA to complete "Metadata Fetch" stage (seems very slow) for a playlist of 35 short videos? [Metadata Fetch: ... failed: unsupported operand type(s) for /: 'NoneType' and 'int'] [hundreds of videos stuck in xklb-metadata.db, painstakingly processed every time, but never downloading?] HOT 10
- Overall "Download to IIAB" workflow
- Search videos by subtitles/captions/transcripts [AND video title AND video description AND video author AND video publisher?] HOT 2
- "Upcoming live" and "Actually live" videos are caught in subsequent downloads [need to clearly explain errors, e.g. in "Tasks" view] HOT 5
- Uploading videos via Calibre-Web fails - 500 Internal Server Error [if filename contains square brackets] HOT 17
- Should "Delete this Shelf" allow you to auto-delete all its "books" too? HOT 1
- Shouldn't "Metadata Fetch" show Progress 100% ? HOT 3
- Preserve "Tasks" view history of uploads/downloads/errors across reboots? (and "systemctl restart calibre-web") HOT 2
- ValueError: not enough values to unpack (expected 4, got 3) [Regression in file uploading mechanism, "500 INTERNAL ERROR"] HOT 1
- Formerly live https://youtu.be/4BL65HElOPg fails to download [same "no such column: error" issue as #186 ?] HOT 7
- failed to download: 500 INTERNAL SERVER ERROR after ~15-20 seconds on a couple of videos — "name 'move' is not defined" — "Failed to send the requested file to http://box/books/meta"
- All videos failed to download: "'NoneType' object is not subscriptable" — "Some formats may be missing" HOT 3
- Previously stuck video returns nothing at all
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from calibre-web.