Comments (5)
I'd also like to know! Is there an "easy" way to take the tracked points and re-train/re-fine the model?
from co-tracker.
Hi @jdyjjj, @horsto, I think the easiest way to train on a custom dataset right now is to adapt this class to your use case:
I'm not sure if this is considered an easy way, though :)
from co-tracker.
Hi @nikitakaraevv, I adapted the KubrikMovifDataset to a local dataset. In my case, I have 180 points to track per video. However, when sampling data with augmentations, I sometimes end up with fewer points. I these cases, the getitem_helper function return gotit=False. Is that a wished behaviour?
Thanks for your answers!
from co-tracker.
Hi @Anderstask1, some points don't satisfy the sampling criteria: being visible in the first frame or the middle frame of the sequence. That's why we sometimes end up with fewer points, especially if we don't have additional points to sample from. I think you can modify the sampling criteria to make it less strict:
from co-tracker.
Hi again @nikitakaraevv, I modified the sampling criteria to make it less strict. However, during training, it seems like several points are sampled mid-sequence in the provided prediction videos (even though the ground truth video don't sample points mid-sequence). Do you know the reason for this?
from co-tracker.
Related Issues (20)
- Inference with sequence of multiple images for a particular single pixel using co-tracker2 HOT 3
- cannot backward tracking in online model with specific queries in middle frame HOT 2
- About the training window size of stride 8 model. HOT 1
- About reproduction of training. HOT 1
- Tracking errors with cotracker2 HOT 2
- Question About GPU Memory Requirements for Model Training HOT 2
- question about backward_tracking HOT 1
- Efficency of V2 and adding more points? HOT 1
- Can not reproduce table3 with the provided checkpoint. HOT 2
- Code for Training and Testing on PointOdyssey HOT 2
- Is it possible to track specified point in the video from the webcam? HOT 8
- track fast moving objects HOT 1
- thx
- question about windowed inference HOT 3
- how to track a specified x-y point? HOT 2
- Add points as they get visible throughout the video HOT 5
- Sample occluded points during training HOT 3
- where can I find the confidence value of prediction?
- huggingface space down?
- ValueError: mutable default <class 'hydra.conf.JobConf.JobConfig.OverrideDirname'> for field override_dirname is not allowed: use default_factory HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from co-tracker.