Comments (10)
@nikitakaraevv here is a case where your method works nicely š„
Each runner is initialized with a local grid [10,5]
Note that one corridor 9 runner is lost just at finish lane. Conventional trackers loose runners in corridor 5 and 6 when they pass the olympic rings
Tokyo_final_tracks_filt.mp4
from co-tracker.
Hi,
I face a similar problem with a video of one person running seen from the side.
If left leg is in the front, points on the right leg stay still after they have been occluded by left leg. All points stay still if they are occluded by a vertical stick for a short time
from co-tracker.
Hi @learnuser1, @fenaux,
Could you send me an example of such a video with estimated tracks? How many points are you tracking and what grid_size
/ local_grid_size
do you use?
Also, have you tried other CoTracker configurations, such as stride_4_wind_12
?
In my experience, tracking is always better with a non-zero grid_size
because the model can identify similarly moving points and pay attention to background points to compensate for camera motion. A grid_size
of 4/5/6 works best for a small number of points (less than 50). When tracking a handful of points, local_grid_size
can also improve tracking performance.
from co-tracker.
Thanks, I will try local_grid_size anyway here are two sample. Queries are the keypoints as obtained by a top down human pose
queries_run_pred_track.mp4
query_run_backward_pred_track.mp4
from co-tracker.
Thanks @fenaux, could you also send the original video with queried points? I'll try to make it work better
from co-tracker.
@nikitakaraevv Many thanks for the interest you deserve to my questions
Here is the video (I do not know if it uploaded correctly !)
1_crop.mp4
queries from frame number 2
tensor([[ 2., 127., 124.],
[ 2., 127., 124.],
[ 2., 96., 141.],
[ 2., 156., 163.],
[ 2., 86., 180.],
[ 2., 195., 167.],
[ 2., 66., 186.],
[ 2., 219., 179.],
[ 2., 87., 185.],
[ 2., 199., 164.]])
queries from last frame
tensor([[229., 99., 112.],
[229., 99., 112.],
[229., 57., 122.],
[229., 120., 154.],
[229., 51., 172.],
[229., 151., 156.],
[229., 35., 186.],
[229., 163., 158.],
[229., 54., 164.],
[229., 158., 174.]])
from co-tracker.
Hi @fenaux, thank you for sending me these videos! I've tried different things but unfortunately wasn't able to significantly improve the result with simple tricks. I'll keep working on CoTracker, so stay tuned!
If you find other examples where the model doesn't work well, please let me know!
I'm closing the issue for now.
from co-tracker.
@fenaux I'm working on a similar problem, to track athletes' body joints and use the tracks for motion kinematics analysis. Can I hit you up and discuss more about it?
from co-tracker.
@zhuolisam yes provide me a mail for instance
from co-tracker.
@fenaux here this is my email [email protected]
from co-tracker.
Related Issues (20)
- Regarding the Application of the generic features HOT 3
- Inference time Multi GPUs for long video out of memory issue. HOT 2
- Chinese newbie seeking help! Encountering issues while trying to install libraries using pip!
- question about v2 HOT 8
- How to run the online tracker for every frame? HOT 4
- Solve camera poses? HOT 3
- Inference with sequence of multiple images for a particular single pixel using co-tracker2 HOT 3
- cannot backward tracking in online model with specific queries in middle frame HOT 2
- About the training window size of stride 8 model. HOT 1
- About reproduction of training. HOT 1
- Tracking errors with cotracker2 HOT 2
- Question About GPU Memory Requirements for Model Training HOT 2
- question about backward_tracking HOT 1
- Efficency of V2 and adding more points? HOT 1
- Can not reproduce table3 with the provided checkpoint. HOT 2
- Code for Training and Testing on PointOdyssey HOT 2
- Is it possible to track specified point in the video from the webcam? HOT 8
- track fast moving objects HOT 1
- thx
- question about windowed inference HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
š Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ššš
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ā¤ļø Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from co-tracker.