Comments (10)
Hi, for online recognition, we need to use a uni-directional TSM, but we have not included the code. But it would be easy to modify by yourself (just change the activation shift part to shift in one side). The other training is just the same as the offline part.
After training, you may need to unroll the model to take one image as input. Now I do it manually, but I will try to provide an automated script if i have time (it would still be easy though).
from temporal-shift-module.
@Nauman007 I do. But I observed significant accuracy drop. I took the mobilenetv2 implementation from the online-demo/ folder and made a new training script with the same parameters as the offline training. I observed a 15% accuracy drop and very poor demo results. I suspect the number of segment to be very important for good accuracy (I used only 1 segment)
from temporal-shift-module.
hi, Does the training of uni-directional TSM needs the mutli rgb frames as input, and use the segemental consensus to deal with it? Or use a single frame as input of model?
from temporal-shift-module.
For uni-directional TSM, we used multiple frames as input during training, while only one frame as input during testing.
from temporal-shift-module.
@tonylins
Hi Author, Thanks for the impressive work with publicly accessible source code here.
I am trying to train another application for online TSM with different datasets. Could you provide the training script of Online model and how to modify the code to Online uni-directional TSM? Looking forward your reply! Thank you very much!
from temporal-shift-module.
Hi,
Firstly, thank you for this repo, it's really an impressive work. I have a request related to the subject of this issue so I will post it here.
I was trying to tune the online model downloaded in the online demo code. I saw that some changes needed to be made in order to make online training work, but I don't really see where and how. So if I can get a hint on what to modify I'd appreciate that.
Thanks in advance!
from temporal-shift-module.
Hi!
Thanks for the impressive work with publicly accessible source code here :)
I am trying to train another application for online TSM with different datasets and adding a few adjustments. The repo currently only has the offline version of training script. Is it possible for you also providing the training script for the online TSM?
Thank you very much!
Hi have u solved it?
from temporal-shift-module.
has anyone trained online TSM ? which files are needed to be modified ?
from temporal-shift-module.
For uni-directional TSM, we used multiple frames as input during training, while only one frame as input during testing.
Hi, should the sampling strategy of training be consistent with testing, when training the online model? Because the online model considers the continuous frames as the input clip when processing the frame stream.
from temporal-shift-module.
Hi, for online recognition, we need to use a uni-directional TSM, but we have not included the code. But it would be easy to modify by yourself (just change the activation shift part to shift in one side). The other training is just the same as the offline part.
After training, you may need to unroll the model to take one image as input. Now I do it manually, but I will try to provide an automated script if i have time (it would still be easy though).
Hi,thanks your reply.
The online training method is equal to 'online_demo/main.py' where has shift buffer?
from temporal-shift-module.
Related Issues (20)
- Question on online google maps HOT 1
- Unable to understand average_duration > 0 and record.num_frames > self.num_segments: HOT 1
- nvidia
- Excuse me, the parameters controlling the time shift are false. Where can I call them
- Acc1 about training HMDB51 pretrained on Imagenet HOT 5
- Rebuild DPU kernel
- Trying to understand fold_div
- Can not download the pretrained models HOT 3
- How to set up the correct combination of shift_div and frame_count? HOT 1
- the pretrained model link is broken. It shows as text but not downloading HOT 2
- How to extract my own dataset and where is the pre-trained model?
- Question about online demo
- On the precision of something-something-v1
- Confusion about the parameter.
- nll_loss_forward_reduce_cuda_kernel_2d: block: [0,0,0], thread: [0,0,0] Assertion `t >= 0 && t < n_classes` failed.
- questions about raspberrypi
- TSM model checkpoint download links not working HOT 2
- Which parameter in the code corresponds to the channel shift ratio? Is it 'shift_div'?
- How to train pretrain model with Kinetics dataset? About choosing parameters
- TypeError: 'IntImm' object cannot be interpreted as an integer
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from temporal-shift-module.