a4bio / simvp Goto Github PK
View Code? Open in Web Editor NEWThe official implementation of the CVPR'22 paper SimVP: Simpler Yet Better Video Prediction.
The official implementation of the CVPR'22 paper SimVP: Simpler Yet Better Video Prediction.
Hi, thank you very much for releasing code for this inspiring work. Regarding the prediction length, say we input 10 previous frames and output 10 future frames, if our final goal is to predict 1 future frame at evaluation time, do we also calculate and backpropagate the loss on the 2nd to the 9th future frames or just on the 1st future frame during training?
Thank you very much for your time and help!
Hi,
May I know whether you can share how you did the pre-processing and the post-processing of the TaxiBJ frames? It's stated int he paper " Following [69], we transform the data into [0, 1] via max-min normalization. Since the origi- nal data is between -1 and 1, the reported MSE and MAE are 1/4 and 1/2 of the original ones, consistent with previous lit- erature ". It would be helpful if you can guide me.
Thank you!
Can you give me instructions on how to train the network on a custom dataset? It contains 512x512 RGB images with labels in the form of timestamps of when they were taken, in differences of minutes. I'm trying to predict what the next images in the sequence will look like in the next timestamps.
作者你好,想请问一下是怎么把视频帧转成数据集中的npz格式的呢。因为github上的数据集格式都是npy的,数据集的结构看着不是很直观。我这里有一段连续的视频帧,想放进去train一下,但是都是jpg格式的。想问一下这个视频帧是按照什么格式准备成npy格式的,您那里有准备数据集的train和test部分相关的代码吗,能否共享一下呀。我的邮箱是[email protected]
The SimVP is set to produce a fixed-length sequence prediction whose length is the same as the input sequence's.
I trained using the Kitti dataset, and the input image size is 128 * 416, how can I solve the problem of blurring the generated image?
Thank you for sharing the code of this interesting paper. I notice you have shown the evaluation on the Caltech dataset, I am wondering if it is possible to also share your preprocessed KITTI-Caltech dataset? I assume you use the KITTI training set from directly from PredNet, whose resolution is 128 X 160, if that is the case, then only the Caltech test set will be enough.
Since I am trying to replicate the experiment for SimVP on the KITTI-Caltech setting, some training details of your experiment would also be very helpful, e.g. learning rate, learning scheduler, and batch size.
Thank you so much for your time!
I want to know if you have any plans to release the pretraining model for each datasets
Can you give me instructions on how to train the network on a custom dataset? It contains 512x512 RGB images with labels in the form of timestamps of when they were taken, in differences of minutes. I'm trying to predict what the next images in the sequence will look like in the next timestamps.
Hi, Gao
I find the input size is almost smaller than 128 in the paper. So, I take a training on my own dataset which are same expect for different input size (128, and 512), leading to different performance:
What causes this situation? Can you help me with the questions or give me some suggestions?
Thanks
when I run dataloader_kth.py, something is wrong :
`Cannot open file. This file was likely created with Python 2 and an old hickle version.’
can you share the new hickle file (from Python 3)?
Thanks for your interesting work
Hi, thank you for your works.
Is it possible to give out Human3.6 dataset or code that you tested on your experiments? Thanks.
Hello,
Is there any way to parallelize this code across multiple GPUs??
Thanks,
Sam
Hi author, I'd like to ask about specific experimental setup parameters such as batchsize, lr, NS, NT, Hs, Ht, etc., as I can't seem to fully reproduce the effects in the paper,I hope you can be patient with them,I'd appreciate it.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.