akshitireddy / ai-powered-video-tutorial-generator

Create AI-Generated Video Tutorials with Character Animation and Slides!

Hi, I'm Akshit - a budding AI enthusiast with skills in prompt engineering, generative AI, deep learning, MLOps, full-stack development. When I'm not working on fun projects like CupcakeAGI, GPT-4 Controlled God Of War, I enjoy sharing my knowledge through my silly and fun-filled ML blogs. Excited to collaborate and learn from fellow AI enthusiasts to keep pushing the boundaries of what's possible in this exciting field!

💡 LinkedIn: https://www.linkedin.com/in/akshit-ireddy

✍️ Medium: https://medium.com/@akshit.r.ireddy

🐦 Twitter: https://twitter.com/Akshit2089

ai-powered-video-tutorial-generator's Issues

FileNotFoundError: [WinError 2] The system cannot find the file specified: '2024_01_17_15_55_17/video_temp/2024_01_17_15.56.20/Benjamin##0_enhanced.mp4' -> '2024_01_17_15_55_17/video/0.mp4'

i am facing the error of file not found of the result generated by sadtalker as i have tried generating sadtalker output manually it is generating properly but with this project it is acting abnormally am not able to identify that is it error with my installation or something else ....
just faced this errors along with it
WARNING: The new version of the model will be updated by safetensor, you may need to download it mannully. We run the old version of the checkpoint this time!
Traceback (most recent call last):
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\inference.py", line 154, in
main(args)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\inference.py", line 38, in main
preprocess_model = CropAndExtract(sadtalker_paths, device)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\src\utils\preprocess.py", line 56, in init
checkpoint = torch.load(sadtalker_path['path_of_net_recon_model'], map_location=torch.device(device))
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\venv\lib\site-packages\torch\serialization.py", line 699, in load
with _open_file_like(f, 'rb') as opened_file:
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\venv\lib\site-packages\torch\serialization.py", line 230, in _open_file_like
return _open_file(name_or_buffer, mode)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\SadTalker\venv\lib\site-packages\torch\serialization.py", line 211, in init
super(_open_file, self).init(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: './checkpoints\epoch_20.pth'
INFO: 127.0.0.1:56034 - "POST /videoCreate HTTP/1.1" 500 Internal Server Error
ERROR: Exception in ASGI application
Traceback (most recent call last):
File "C:\Users\AppData\Local\Programs\Python\Python310\lib\shutil.py", line 815, in move
os.rename(src, real_dst)
FileNotFoundError: [WinError 2] The system cannot find the file specified: '2024_01_17_15_55_17/video_temp/2024_01_17_15.56.20/Benjamin##0_enhanced.mp4' -> '2024_01_17_15_55_17/video/0.mp4'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\uvicorn\protocols\http\httptools_impl.py", line 435, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 78, in call
return await self.app(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\fastapi\applications.py", line 276, in call
await super().call(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\applications.py", line 122, in call
await self.middleware_stack(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\errors.py", line 184, in call
raise exc
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\errors.py", line 162, in call
await self.app(scope, receive, _send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\cors.py", line 91, in call
await self.simple_response(scope, receive, send, request_headers=headers)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\cors.py", line 146, in simple_response
await self.app(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\exceptions.py", line 79, in call
raise exc
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\middleware\exceptions.py", line 68, in call
await self.app(scope, receive, sender)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in call
raise e
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in call
await self.app(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\routing.py", line 718, in call
await route.handle(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\routing.py", line 276, in handle
await self.app(scope, receive, send)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\starlette\routing.py", line 66, in app
response = await func(request)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\fastapi\routing.py", line 237, in app
raw_response = await run_endpoint_function(
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend.venv\lib\site-packages\fastapi\routing.py", line 163, in run_endpoint_function
return await dependant.call(**values)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\main.py", line 30, in create_insights
path = video_main(message, level, age, creative, humour, characterName)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\functions\video_main_function.py", line 23, in video_main
create_video_from_audio(timestamp, character_name)
File "C:\Users\Desktop\project\AI-Powered-Video-Tutorial-Generator\backend\functions\create_video_from_audio_function.py", line 29, in create_video_from_audio
shutil.move(video_path, video_output_path)
File "C:\Users\AppData\Local\Programs\Python\Python310\lib\shutil.py", line 835, in move
copy_function(src, real_dst)
File "C:\Users\AppData\Local\Programs\Python\Python310\lib\shutil.py", line 434, in copy2
copyfile(src, dst, follow_symlinks=follow_symlinks)
File "C:\Users\AppData\Local\Programs\Python\Python310\lib\shutil.py", line 254, in copyfile
with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '2024_01_17_15_55_17/video_temp/2024_01_17_15.56.20/Benjamin##0_enhanced.mp4'

Api calls

hey akshit, can you help me find the snippet of code where you have decided number of api calls of cohere as cohere has limited free api key toh 5 calls/per minute so am facing error through it

Cohere model not found

recently saw your project and i am pretty intrested in that, i tried running it i successfully ran the webui for sadtalker and the frontend part for this project is running good i am facing some issues running the backend

i got my trial_api keys and i added it into the apikeys.json file

{
    "api_keys": [
        "XXXXXXXXXXXXXXXX"
     ]
}

i am facing this error while running the backend saying that:

cohere.error.CohereAPIError: model not found, make sure the correct model ID was used and that you have access to the model.

please guide me through this as i am a pretty newbie to this field.

Thanks!!

error NameError: name 'video_main_function' is not defined

I am a beginner to python and NodeJS

when I am running this app. I am getting this error

NameError: name 'video_main_function' is not defined

on a backend terminal, I am getting this

INFO: Started server process [9272]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
INFO: 127.0.0.1:52834 - "GET /videoCreate HTTP/1.1" 405 Method Not Allowed

Any idea why I am getting these error

ERRORS in statement: <pip install -r requirements.txt>

I am a beginner of AI and python, and I meet a error in "pip" step, can any guru help me with that?
I think the error statements are so long but they have some kinds of familiar type, so I think maybe it's a share problem? (maybe)

ERROR: Exception:
Traceback (most recent call last):
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\cli\base_command.py", line 173, in _main
status = self.run(options, args)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\cli\req_command.py", line 203, in wrapper
return func(self, options, args)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\commands\install.py", line 315, in run
requirement_set = resolver.resolve(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\resolution\resolvelib\resolver.py", line 94, in resolve
result = self._result = resolver.resolve(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\resolvelib\resolvers.py", line 472, in resolve
state = resolution.resolve(requirements, max_rounds=max_rounds)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\resolvelib\resolvers.py", line 341, in resolve
self._add_to_criteria(self.state.criteria, r, parent=None)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\resolvelib\resolvers.py", line 172, in _add_to_criteria
if not criterion.candidates:
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\resolvelib\structs.py", line 151, in bool
return bool(self._sequence)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\resolution\resolvelib\found_candidates.py", line 140, in bool
return any(self)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\resolution\resolvelib\found_candidates.py", line 128, in
return (c for c in iterator if id(c) not in self._incompatible_ids)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\resolution\resolvelib\found_candidates.py", line 29, in _iter_built
for version, func in infos:
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\resolution\resolvelib\factory.py", line 272, in iter_index_candidate_infos
result = self._finder.find_best_candidate(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\package_finder.py", line 851, in find_best_candidate
candidates = self.find_all_candidates(project_name)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\package_finder.py", line 798, in find_all_candidates
page_candidates = list(page_candidates_it)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\sources.py", line 134, in page_candidates
yield from self._candidates_from_page(self._link)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\package_finder.py", line 758, in process_project_url
html_page = self._link_collector.fetch_page(project_url)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\collector.py", line 490, in fetch_page
return _get_html_page(location, session=self.session)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\collector.py", line 400, in _get_html_page
resp = _get_html_response(url, session=session)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\index\collector.py", line 115, in _get_html_response
resp = session.get(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\requests\sessions.py", line 555, in get
return self.request('GET', url, **kwargs)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_internal\network\session.py", line 454, in request
return super().request(method, url, *args, **kwargs)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\requests\sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\requests\sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\cachecontrol\adapter.py", line 53, in send
resp = super(CacheControlAdapter, self).send(request, **kw)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\requests\adapters.py", line 439, in send
resp = conn.urlopen(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\connectionpool.py", line 696, in urlopen
self._prepare_proxy(conn)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\connectionpool.py", line 964, in _prepare_proxy
conn.connect()
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\connection.py", line 359, in connect
conn = self._connect_tls_proxy(hostname, conn)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\connection.py", line 500, in connect_tls_proxy
return ssl_wrap_socket(
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\util\ssl.py", line 453, in ssl_wrap_socket
ssl_sock = ssl_wrap_socket_impl(sock, context, tls_in_tls)
File "C:\Project\AI-Powered-Video-Tutorial-Generator-main\backend.venv\lib\site-packages\pip_vendor\urllib3\util\ssl.py", line 495, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock)
File "C:\Python\Python39\lib\ssl.py", line 500, in wrap_socket
return self.sslsocket_class._create(
File "C:\Python\Python39\lib\ssl.py", line 997, in _create
raise ValueError("check_hostname requires server_hostname")
ValueError: check_hostname requires server_hostname

SadTalker installation

For the SadTalker installation do we have to install everything and run everything from the SadTalker conda environment?

Or can we just clone SadTalker and then run from the venv we made earlier?

Thanks in advance