almostengr / videoprocessor

Application that renders videos using FFMPEG for my content platforms

Video Processor

Purpose

Ask any content creator and they will tell you that creating videos is a time consuming process. For me, the most mundane and worse part of the process is waiting on the videos to render and uploading them to YouTube.

Some video editors, have a version of their software that can be ran on the server to render the video files created. By offloading the video rendering to another machine, you can edit more videos in less time.

Purpose of this application is to automate the video creation process. Videos that I post on both of my YouTube channels have a predefined structure for each video. Thus they are easy to automate. When additional content or on screen text needs to be displayed, the automation for that particular channel is modified accordingly.

My YouTube Channels

• Dash Cam Channel
• Home Improvement Channel
• Technology Channel

Video Schedule By Channel

• Kenny Ram Dash Cam - Videos released weekly on Sundays
• Robinson Handy and Technology Services - Videos released on Saturdays
• Tech Talk with RHT Services - released on Tuesdays

References

• https://www.youtube.com/watch?v=mp3mDT_x6ho
• https://filme.imyfone.com/video-editing-tips/how-to-merge-or-combine-videos-using-ffmpeg/
• https://stackoverflow.com/questions/44280903/ffmpeg-vaapi-and-drawtext
• https://trac.ffmpeg.org/wiki/Hardware/VAAPI
• https://stackoverflow.com/questions/7333232/how-to-concatenate-two-mp4-files-using-ffmpeg

Additional FFMPEG Commands

Occasionally, there are some additional FFMPEG commands that I need to run to create the videos that I desire to have. Since the commands are rarely used, I chose to not add the functionality that uses these commands into the application, but instead note them here for future reference.

Timelapse Video Without Audio

ffmpeg -i FILE0710.MOV -filter:v "setpts=0.5*PTS" -an FILE0710.timelapse.MOV

Create Video without Audio

ffmpeg -i out165.mov -an -c:v copy uncut165.mp4

Scale Video Resolution

ffmpeg -i out165.mov -an -vf scale=1920:1080 scaled165.mov

Concat Video Timelapse Files

for file in *MP4
do
echo "file $file" >> input.txt
done

ffmpeg -f concat -i input.txt -c:v copy output.mp4

Create Video With Image Files

ffmpeg -framerate 1/3 -pattern_type glob -i '*.jpg' -c:v libx264 -r 30 -pix_fmt yuv420p output.mp4

Add Music To Video

fmpeg -i 20230401_110000.mp4 -i ../../../ytvideostructure/07music/mix03.mp3 -shortest -c:v copy -c:a copy -map 0:v:0 -map 1:a:0 output.mp4

Convert Variable Rate Video To Constant Rate Video

ffmpeg -i input.mp4 -vf "setpts=1.0*PTS" -r 30 -c:v libx264 -crf 18 -c:a aac -b:a 192k output.mp4

videoprocessor's Issues

Worker service to generate video file from project

Create timelapse service for dash cam videos

Dash cam videos need to also be created as timelapse videos. Service methods need to be created for them. In addition consider worker service for these as well.

Create logging class

Need class for logging output instead of the static method in the UI class. Currently violates SRP

Also need to set the log format

update project to .NET 6

generate thumbnails

After rendering each video, a thumbnail of each video should be created so that it can be uploaded with the video.
The thumbnail should have the title of the video in it.

Call api for transcriptions

Google has api that will transcribe a audio file to text. Will leverage this to transcribe the video and to provide captions

Included images convert to video clips

video object

create Dto for videos that has the following properties

• archive file name
• video title based on file name
• channel properties to be used
• video description
• video keywords
• video location

scale dash cam video to 1080

https://www.youtube.com/watch?v=QQ-djYYpKFo

exit gracefully when tarballs are not present

videoprocessor/src/Almostengr.VideoProcessor.Infrastructure/FileSystem/FileSystem.cs

Line 52 in 19101e3

public string GetRandomTarballFromDirectory(string directory)

When there are not files waiting to be processed, the application should exit the respective ExecuteAsync method in the Service class gracefully instead of throwing error exceptions.

Add Readme

Readme file for how to use the automation, purpose,

Update Readme with channel URL

Readme needs to include URL to YouTube channel

Post transcriptions to website

Transcriptions from the videos will need to be posted to the website as new content. The content that is posted, will need to be in draft so that final edits can be done on the post.

Additional fields may need to be added to the content type to track the response received from the transcription service.

Video walkthough of code

Create time-lapse from full video

When generating a full video, time-lapse also needs to be created. In particular for dash cam videos

process video files in directories

worker service to upload video file

Rename project

Project name needs to be updated so that it better describes the project

clean render folder after processing file

the render folder needs to be Cleaned up as part of the archiving process.

Disk space is being taken up even thought the files are no longer needed.

filters file for blurring

Add logic for additional filters file to be read for video filters. This will allow for additional filters to be dynamically added so that additional video edits and rendering does not have to be done

Check disk space before rendering

A lot of disk space can be used when generating videos.

Automation needs to check the disk space before rendering a video to prevent running out of space and the program crashing.

add audio to silent video

For RHT Services videos, need to check each video file to see if it has audio. If it does not then audio from the music library should be added to the video.

https://stackoverflow.com/questions/21446804/find-if-video-file-has-audio-present-in-it

configure for Linux system service

Create Java doc

Error when attempting to move file

Exception message being thrown. Looks like the wrong version of Files is being called.

Exception in thread "main" java.lang.NoClassDefFoundError: com/google/common/io/Files
at com.thealmostengineer.kdenlivetoyoutube.App.archiveProject(App.java:141)
at com.thealmostengineer.kdenlivetoyoutube.App.main(App.java:256)
Caused by: java.lang.ClassNotFoundException: com.google.common.io.Files
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 2 more

Create credits clip

Have application to create credits clip when credits.txr file is present.

get resolution, add scale

videoprocessor/Almostengr.VideoProcessor.Api/Services/Video/HandyTechVideoService.cs

Line 218 in b13a1eb

var result = await _externalProcess.RunCommandAsync(

Get the resolution of the video using ffprobe. If the resolution is not 1920x1080, then add the scale attribute to make it adjust to that size

filter for flipping video

Some video footage is recorded with the camera upside down. Condition needs to be added to the file so that it can determine and add this filter when rendering the output

Read configuration from properties file

Configuration values need to be saved into a configuration file and be loaded on startup

Replace spaces with underscores in file names

Replacing spaces with underscores will reduce the errors that occur when processing files

update render video

when creating video with multiple MP4 files with different encodings, it is advised to convert them to TS format first. Then merge them into a single MP4 file that is the same.

https://stackoverflow.com/questions/7333232/how-to-concatenate-two-mp4-files-using-ffmpeg

for MP4 files:
If they are not exactly same (100% same codec, same resolution, same type) MP4 files, then you have to trans-code them into intermediate streams at first:

ffmpeg -i myfile1.mp4 -c copy -bsf:v h264_mp4toannexb -f mpegts temp1.ts
ffmpeg -i myfile2.mp4 -c copy -bsf:v h264_mp4toannexb -f mpegts temp2.ts
// now join
ffmpeg -i "concat:temp1.ts|temp2.ts" -c copy -bsf:a aac_adtstoasc output.mp4

https://www.jeffgeerling.com/blog/2021/how-join-multiple-mp4-files-gopro-ffmpeg
https://superuser.com/questions/1059245/ffmpeg-join-two-mp4-files-with-ffmpeg-on-command-line/1059261#1059261

ffmpeg -i input1.mp4 -c copy -bsf:v h264_mp4toannexb -f mpegts intermediate1.ts
ffmpeg -i input2.mp4 -c copy -bsf:v h264_mp4toannexb -f mpegts intermediate2.ts
ffmpeg -i "concat:intermediate1.ts|intermediate2.ts" -c copy -bsf:a aac_adtstoasc output.mp4

Video of setting up cron job automation

Tutorial of how to set up the automation with a cron job needs to be created.

Be able to open kdenlive on computer

Automation needs to be able to open kdenlive app image.

transcript - sentence case

For the blog post, split the entire string into an array, using period followed by space as the separator.

Then uppercase the first letter in each array string

Then merge the individual strings to a single variable and continue with generating the final output.

Similar would need to be done for question marks followed by space

Upload final file to YouTube

Output file needs to be automatically uploaded to the website once the rendering process has completed

Create audio file output

Audio file output is needed for transcription of video to be used for creating blog posts.

Create properties file

Have the application prompt in a what that the properties file can be created

determine video project type

Determine the video project type, dash cam or tutorial. Based on this, then perform the additional steps for publishing the post, in addition to generating the video for it.

check for large video files before uncompressing

Some archives contain the final output videos. These archives need to have the final video remove before processing and repackaging.

https://askubuntu.com/questions/907608/how-do-i-get-a-file-sizeoriginal-file-size-within-tar-gz-without-uncompress-i

color schemes

Color schemes for the different video types are

• handyman - yellow text, black background
• technology - white text, green background; Christmas light show, white text, red (maroon) background
• dash cam - white text, black background; night videos, orange text, black background
• Toastmasters - blue background, white text

Lower thirds are to use the same backgrounds unless otherwise specified.

Read kdenlive archive

Need to be able to read the archive file for kdenlive

update repository structure

Update the project to the below folder structure. This will assist in better organizing the project and making future updates to the code.

• documentation
• source
• tests

Use java logger

Use native java logging.
Remove current function that does logging.

night text for "fireworks"

Dash cam video titles that contain the word "fireworks" need to display titles in night mode (orange) color.

Get transcriptions

Some time needs to pass to allow for the a transcriptions to be generated by youtube. Process needs to wait after uploading before pushing the text to the website

automatic thumbnails

https://www.youtube.com/watch?v=qF-edetkYIg

update to domain driven design

Timeout being reached, resulting in failure

Null pointer exception is being thrown for the project file name not being found.

Check for duplicate processes

Check to see if a previous instance of the process is already running. That will prevent the same file from being processed twice or causing unexpected exceptions.

add on screen graphics at beginning of clip

For Videos, there should be a check to include a video filter for lower third overlay. This filter will show for the first 5 to 10 seconds of the clip. Will then disappear. The overlay will need to be predefined and hard coded, so that it is consistent throughout the video.