dlpbc / keras-kinetics-i3d Goto Github PK

In your opinion, how sensitive is the model to the flow method?

I've tried it with some other flow methods on cuda (for speed) and it gives me absurd results. I also can't seem to re-train it on other flow methods. So I"m wondering if the model is very sensitive to the optical flow method and how would you deal with it if you needed something faster?

Hello,

Great work, thanks!
I was just curious about how you converted the tf models and weights to Keras. Is there a simple way to do that?

Best,
Florian

/v_CricketShot_g04_c01_rgb.npy /v_CricketShot_g04_c01_flow.npy is missing

Hello @dlpbc ,

I just wanted to thank you for porting the I3D network to Keras. I used it to build a Sign Language Recognition prototype: https://github.com/FrederikSchorr/sign-language

Kind regards, Frederik

PS: In https://github.com/FrederikSchorr/sign-language/blob/master/model_i3d.py I added a function add_i3d_top that creates new top layers depending on the number of output classes.

Hi dlpbc, your i3d keras model is awesome!

I am working on sign language recognition for deaf-mute-people, and need to finetune the provided model/weights on another video-dataset.

In case you have also trained/finetuned with I3D - Could you share a training/finetuning script? I am in particular interested in data_generator needed for fitting with data augmentation.

Thank you! br Frederik

Have you experimented with the separable version of i3d?

Hi, love this work! Just wondering if you're planning to support any models on the updated kinetics 600 dataset?

I was trying to train on the UCF101 dataset as toy example. Fail to build model.
Following minimalist code snippet fails.

from keras_kinetics_i3d.i3d_inception import Inception_Inflated3d
i3d_model = Inception_Inflated3d(weights='rgb_imagenet_and_kinetics', endpoint_logit=False, classes=102, include_top=False)

Error given

  File "/home/hollowgalaxy/Github/experiments/video_extraction_experiments.py", line 76, in <module>
    i3d_test()
  File "/home/hollowgalaxy/Github/experiments/video_extraction_experiments.py", line 74, in i3d_test
    i3d_model = Inception_Inflated3d(weights='rgb_imagenet_and_kinetics', classes=102, include_top=False)
  File "/home/hollowgalaxy/Github/keras_kinetics_i3d/i3d_inception.py", line 515, in Inception_Inflated3d
    h = int(x.shape[2])
TypeError: __int__ returned non-int (type NoneType)

Hi dears,
sorry for send email directly,

I'm interested in I3D method for action recognition and i cloned the github project "https://github.com/deepmind/kinetics-i3d"
i want to test the model with my sample recorded video but don't know how to convert my *.mp4 video file (25fps rgb) to *rgb.npz and *flow.npz

could it possible to help or share me a reprocessing script file

best regards.