Comments (3)
One possibility discussed, but without consensus from editors present, was to define metrics such that they could be implemented, but whenever not implemented for a particular source, you'd just return empty dictionary (somewhat related issue about feature detection: #101)
from mediacapture-extensions.
An implementation update here on the Chromium side:
While all types of tracks share the same stats logic for delivered and discarded frames (which happen in the renderer), and the same logic for drops triggered around the VideoTrackAdapter parts of the code, there is one kind of frame drop that needs additional implementation effort on a per-source basis.
And that is if the frame was dropped by the source prior to reaching the renderer process. For example if the capturer process runs out of buffers, that's a dropped frame that needs to be signalled. E.g. it's one of those rare circumstances that totalFrames increments but neither deliveredFrames or discardedFrames do.
So it's not true that there is no additional implementation effort in supporting new sources, but it is only needed in cases where drops can happen by the source.
from mediacapture-extensions.
I'm not convinced that sources that are not backed by a real-time device is able to drop frames. For example a canvas based track would only generate frames in a pace that it is able to achieve, so there would be no need to drop the frame before delivery, and thus no extra implementation effort regarding keeping track of dropped frames for these types of sources.
That's just a theory though
from mediacapture-extensions.
Related Issues (20)
- [Track Stats API] Rename deliveredFrames to deliverableFrames HOT 2
- [Track Stats API] SameObject is a confusing API shape HOT 23
- [Track Stats API] When to initialize frame counting HOT 3
- Should web applications be aware of reaction effects added by OS to camera feeds? HOT 17
- [Audio Stats] Add current latency HOT 2
- Background Blur: Unprocessed video should be mandatory to support HOT 8
- [Track Stats API] Make stats attribute nullable instead of throwing when unsupported HOT 2
- [Stats] Example uses ratio, not percentage
- [Audio Stats] Add average, min and max latency HOT 5
- [Audio Stats] Disagreement about audio dropped counters HOT 19
- volume is not working HOT 1
- Move MediaStreamTrack stats in its own spec? HOT 10
- Clarify how `track.stats.resetLatency()` relates to run-to-completion semantics HOT 1
- https://w3c.github.io/mediacapture-extensions/#transferable-mediastreamtrack should talk about the MediaStreamTrack's application-set content hint
- Moving the source of a track HOT 1
- Should we add reasons to MediaStreamTrack.onended HOT 4
- Add a blackFrames counter to MediaStreamTrackVideoStats HOT 7
- Consider adding onVoiceActivity event on MediaStreamTrack for audio HOT 3
- How to select camera presets that have better power efficiency at the expense of quality? HOT 2
- Clarifying Transferable MediaStreamTrack Types HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mediacapture-extensions.