Comments (4)
Very interesting approach. Have you given some thought to benchmarking it versus Albanie's shot detection benchmarks to see how it performs?
It would be quite interesting to have some additional detection techniques in PySceneDetect for sure. I haven't had much time to keep up with the project lately, but I'm always open to pull requests!
from pyscenedetect.
Also @r1b, this definitely does seem to be a sound approach - there is plenty of literature referencing this method.
I will have to do some more research into your work, but definitely plan to get started on something like this in the future. I have added this to the backlog of issues, indicating it will be worked on for the next major release of PySceneDetect following v0.5 (the project is almost done a heavy refactor which should make developing detectors much easier).
Also just curious, what is your development environment like? I'm not too familiar with Python notebooks, but some of the analysis (esp. with regards to the graphs) would be immensely useful. Just curious what you're using, if it's an interactive environment.
from pyscenedetect.
Wonderful! When I have some free time I will play with it some more. I am using Jupyter as a development environment to take advantage of the inline plotting & exploratory workflow. Usually I use matplotlib
for plots but here I use Seaborn mostly just to use distplot
(but I also think they look nicer).
from pyscenedetect.
Thank you for the references @r1b , will definitely be checking out Jupyter. Thank you also for the proof of concept, had some time to look into it briefly and will be following up on this after v0.5 is released. One thing I'm experimenting with is automatic threshold detection for the content/threshold detectors, and had a few high-level questions if you don't mind me picking your brain.
I noticed in your notebook that you're using the equation for threshold T = μ + ασ, where μ is the mean, σ is the standard deviation, and α is a constant set to 5.
Just curious, how did you arrive at a value of α = 5? Does it need to be adjusted for different types of source material?
For the histogram itself, have you experimented at all with changing the number of frequency bins in the histograms, or generating the colour code in HSV space instead of RGB? Just trying to flesh out the design by trying to get a feel for what options need to be presented to the user when calling detect-histogram
, and what the exact equations/algorithms need to be in place.
I'm trying to use the same equation to automatically generate T for the ContentDetector algorithm, but I can't seem to find a good value for α that works across a good number of source material - specifically when dealing with shorter clips. I was also wondering if you had any ideas for approaching computing a good value for α (or if another equation would be better in this case) for the ContentDetector, which computes a single HSV-based frame score.
Also, feel to check out the upcoming API if you have a minute, any feedback you might have is most welcome.
from pyscenedetect.
Related Issues (20)
- Incorrect warning in `detect_scenes` when `end_time` is not a `FrameTimecode`
- load-scenes: make faster and clearer HOT 2
- can`t save_images in scenedetect HOT 7
- Comma-separated frame list HOT 2
- Setting up development environment results in circular import errors HOT 2
- Avisynth input? HOT 7
- Cannot find reference 'open_video' in 'scenedetect.py' on Windows 10 HOT 1
- Incorrect FrameTimecode conversion to string HOT 1
- webm files don't work correctly HOT 4
- `list-scenes` option `-q`/`--quiet` does not suppress all output HOT 3
- Output File Name Change HOT 2
- Extraction half of frames HOT 5
- split_video_ffmpeg error HOT 1
- split_video_ffmpeg lib function update HOT 1
- Update issue creation templates to use new forms feature
- Fix Github license detection
- How run it with asyncio and fastapi
- The performance of detecting shot changes is poor HOT 5
- Change `list-scenes` defaults: don't output file, skip cuts
- [Bug] memory leak HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyscenedetect.