Comments (2)
Adding optical flow would be a great contribution if you're willing to put it together!
It is possible to compute the optical flow for the last frame because each batch
includes a look-ahead region (of equal size). That, for example, is how we are able
to do difference annotations. It is also possible to carry-over the key points to the
next batch using the cache attribute of the annotator. It doesn't seem like there would
be much wasted computation because even at a very high cut rate, cuts should only
be happen <5% of the time.
You are entirely correct that sometimes it is best to do a first past to get, e.g., cuts and
then run a second pass after having detected those cuts. This is entirely possible within
DVT. For example, you could
- run one pass with a cut annotator
- aggregate the cuts to get the shot breaks
- feed the shot breaks to initiate a new frame annotator
- re-run the pipeline
What's nice about that structure is that it is even possible to use a different program to
detect or manually specify the shot breaks before doing the optical flow.
from dvt.
I didn't notice the look-ahead region, that's a clever solution! I'll have a go at adding optical flow then, as the structure definitely sounds flexible enough to make it work in a nice way, thanks!
from dvt.
Related Issues (20)
- Question regarding JOSS paper authorship HOT 2
- Documented vs. actual license mismatch HOT 1
- Comments on the documentation HOT 1
- State of the field HOT 1
- Please provide instructions on how to run the tests HOT 1
- Improve documentation for layperson and Mac users HOT 1
- Demo web app not usable under Mac OS HOT 1
- Improve consistency of documentation HOT 2
- Make Anaconda a strict requirement in the documentation HOT 2
- DiffAnnotator/CutAggregator Not Functional for Black and White Films HOT 4
- Performance Issue with custom annotator
- `freq` does not work consistently across the whole video file
- AttributeError: 'Node' object has no attribute 'output_masks' HOT 2
- install into new 3.7 environment, Keras requires TensorFlow 2.2 or higher HOT 3
- colab notebook - more examples working from video HOT 2
- Colab notebook demo does not exist
- legacy setup.py deprecation warning
- Error running example face annotation code HOT 2
- Downloading dvt_detect_shots.pt error HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dvt.