Inference Time about cdistnet

[simplify23]

Compared with the parallel attention mechanism, our method has no advantage in inference speed, but it is not far behind the traditional encoder-decoder method. If speed of reasoning is required, try decoding 2-3 characters at one timestep, or distil a CTC student network. We plan to design a rapid inference version of CDistNet V2 later.

[bharatsubedi]

changed the network structure and got faster inferencing time now.
Thank you very much.

[WongVi]

Compared with the parallel attention mechanism, our method has no advantage in inference speed, but it is not far behind the traditional encoder-decoder method. If speed of reasoning is required, try decoding 2-3 characters at one timestep, or distil a CTC student network. We plan to design a rapid inference version of CDistNet V2 later.

waiting rapid version