Error in conversion from Tensorflow Model to CNTK Model about mmdnn

[kitstar]

Hi @coolrishi2005,
Thanks for helping test the converter. Tensorflow converter is in very initial state, any question and issue is welcome.

Fix some bugs and seems it works. Tensorflow -> IR command (step 1) is

python -m mmdnn.conversion._script.convertToIR -node add -f tensorflow -d IRModel_3_5 -n /tmp/model.ckpt.meta -w /tmp/model.ckpt

Note: Please specify the output node of tensorflow model, which can help the converter trims useless nodes. like -node add in above command.

For this model, we can get the output node from codes:

or from tensorboard

Thanks.

[coolrishi2005]

Thanks kitstar for the response.
The model has been converted successfully now from tf -> cntk.
The issue was due to those useless nodes only, which got trimmed while generating IR Code from tf.

[mhajiaghayi]

hi there, i'm trying to convert a transformer model that is trained with tf to cntk model. I get the following error.

[mhajiaghayi]

it seems it's not recognizing the attention layer. is there any way to get around that?

[namizzz]

Hi @mhajiaghayi , could you please provide your model files?

[mhajiaghayi]

hi namizz, how would you like me to send it to you? it's 800meg.

[namizzz]

Hi @mhajiaghayi , any free cloud storage is ok.

[mhajiaghayi]

hi @namizzz , you can find the model here https://1drv.ms/f/s!AqysHcfYW1hSgc57psU_Bh8MDND74A and I used the following script to convert it

mmconvert -sf tensorflow -in checkpoints\model-0.meta -iw checkpoints\model-0 --dstNodeName output/fwside1/fwside1/fully_connected/Relu -df cntk -om cntk-model

[namizzz]

Hi @mhajiaghayi , MMdnn doesn't support RNN network now. Sorry,thanks!

[mhajiaghayi]

hi @namizzz, would you please look at this model located in https://1drv.ms/f/s!AqysHcfYW1hSgc8KG_BnQRrwT7vCJA? . This model doesn't use any RNN or attention layer.
mmconvert -sf tensorflow -in checkpoints\model-0.meta -iw checkpoints\model-0 --dstNodeName output/fwside1/fwside1/fully_connected/Relu -df cntk -om cntk-model