omerferhatt / torch2tflite

PyTorch to TensorFlow Lite converter

💫 About Me:

🔭 I’m currently working on Nerveblox
💬 Ask me about PyTorch, Tensorflow, Linux

🌐 Socials:

💻 Tech Stack:

📊 GitHub Stats:

🏆 GitHub Trophies

✍️ Random Dev Quote

torch2tflite's Issues

No module named 'models'

I tried this code to convert my custom trained YOLOv5 model (.pt)
It returns this message

2021-05-31 10:26:03.181164: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcudart.so.11.0
No module named 'models'

How can I fix this?

OSError: SavedModel file does not exist at: ./converter/tf_model/{saved_model.pbtxt|saved_model.pb}

Hi,

Thank you very much for sharing this code. I have tried applying it to my torch model, the conversion steps from torch to ONNX and ONNX to TF work fine, but it fails at the last step (TF to TFlite) with the following message:

Traceback (most recent call last):
File "converter.py", line 58, in
main()
File "converter.py", line 22, in main
convert(torch_model_path=args.torch_model_path,
File "/home/A49175/torch2tflite-master/converter/torch_to_tflite.py", line 157, in convert
tf_to_tf_lite(tf_path=TF_PATH, tf_lite_path=tf_lite_model_path)
File "/home/A49175/torch2tflite-master/converter/torch_to_tflite.py", line 74, in tf_to_tf_lite
converter = tf.lite.TFLiteConverter.from_saved_model(tf_path) # Path to the SavedModel directory
File "/home/A49175/.conda/envs/tflite-converter/lib/python3.8/site-packages/tensorflow/lite/python/lite.py", line 399, in from_saved_model
saved_model = _load(saved_model_dir, tags)
File "/home/A49175/.conda/envs/tflite-converter/lib/python3.8/site-packages/tensorflow/python/saved_model/load.py", line 578, in load
return load_internal(export_dir, tags)
File "/home/A49175/.conda/envs/tflite-converter/lib/python3.8/site-packages/tensorflow/python/saved_model/load.py", line 588, in load_internal
loader_impl.parse_saved_model_with_debug_info(export_dir))
File "/home/A49175/.conda/envs/tflite-converter/lib/python3.8/site-packages/tensorflow/python/saved_model/loader_impl.py", line 56, in parse_saved_model_with_debug_info
saved_model = _parse_saved_model(export_dir)
File "/home/A49175/.conda/envs/tflite-converter/lib/python3.8/site-packages/tensorflow/python/saved_model/loader_impl.py", line 110, in parse_saved_model
raise IOError("SavedModel file does not exist at: %s/{%s|%s}" %
OSError: SavedModel file does not exist at: ./converter/tf_model/{saved_model.pbtxt|saved_model.pb}

Do you have any idea of the origin of this problem ? I am using the packages versions specified in the requirements.txt.

Thank you!

TypeError: 'tuple' object cannot be interpreted as an integer

I created below colab and getting below "TypeError: 'tuple' object cannot be interpreted as an integer" error.
Could you please help me on this ?
https://colab.research.google.com/drive/19JeOkrxlGP6KtkfGbrkO87COc4pvSZSE?usp=sharing#scrollTo=vdeytDxjFdZ3

Traceback (most recent call last):
File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/usr/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/content/torch2tflite/torch2tflite/converter.py", line 187, in
args.seed
File "/content/torch2tflite/torch2tflite/converter.py", line 40, in init
self.sample_data = self.load_sample_input(sample_file_path, target_shape, seed, normalize)
File "/content/torch2tflite/torch2tflite/converter.py", line 121, in load_sample_input
data = np.random.random(target_shape).astype(np.float32)
File "mtrand.pyx", line 434, in numpy.random.mtrand.RandomState.random
File "mtrand.pyx", line 425, in numpy.random.mtrand.RandomState.random_sample
File "_common.pyx", line 291, in numpy.random._common.double_fill
TypeError: 'tuple' object cannot be interpreted as an integer

Runtime Errori mportError: dlopen

When I have ran:
python -m torch2tflite.converter --torch-path converted.pt --tflite-path siggraph17.tflite --targeet-shape 225 225 3 --seed 10

I have the following error:

  File "/usr/local/Cellar/[email protected]/3.8.12_1/Frameworks/Python.framework/Versions/3.8/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/Cellar/[email protected]/3.8.12_1/Frameworks/Python.framework/Versions/3.8/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/XXX/torch2tflite/torch2tflite/converter.py", line 12, in <module>
    import onnx
  File "/XXX/torch2tflite/venv38/lib/python3.8/site-packages/onnx-1.11.0-py3.8-macosx-12-x86_64.egg/onnx/__init__.py", line 10, in <module>
    from .onnx_cpp2py_export import ONNX_ML
ImportError: dlopen(/XXX/torch2tflite/venv38/lib/python3.8/site-packages/onnx-1.11.0-py3.8-macosx-12-x86_64.egg/onnx/onnx_cpp2py_export.cpython-38-darwin.so, 0x0002): symbol not found in flat namespace '__ZN6google8protobuf11MessageLite20ParseFromCodedStreamEPNS0_2io16CodedInputStreamE'```


ANY SUGGESTION, SOLUTION?

Under what license is your code?

Hi,

under what license is the code in your repository? I've found the overview at https://choosealicense.com/ useful to choose a license. It would be great if you could add a license file to the repository, because otherwise it can't be used.

ERROR:root:Can not load PyTorch model. Please make surethat model saved like `torch.save(model, PATH)`

I'm trying to convert a YOLOv5 best.pt weights file to a .tflite file so we can deploy the model on a flutter app.

This is the code:

`import torch
weights_path = '/content/drive/MyDrive/Weights/best.pt'
yolo_path = '/content/yolov5'

model = torch.hub.load(yolo_path, 'custom', weights_path, source='local') # local repo
torch.save(model, '/content/pipeline.pt' )`

You can also go straight to the colab for all the colde.
https://colab.research.google.com/drive/19JeOkrxlGP6KtkfGbrkO87COc4pvSZSE?usp=sharing

I assume I'm not saving the model how the converter wants it, but I can't figure it out.
Can you please explain exactly how the file needs to be saved so the code will work ?

Thanks a lot in advance!

Issue in the model converting

Hi, I had an error below when the code is in torch.onnx.export. I doubt the problem is the model isn't loaded completely but I'm not sure. Is it possible to provide any model sample to verify my code environment. Thanks!
'dict' object has no attribute 'training'

Fails to create .tflite

ValueError: Could not open './converter/tf_lite_model.tflite'.

I've loaded my .pt file and a sample test image....but looks like the conversion is not working.
Can you rectify this?

Thanks

Not found: 'python/cv2/gapi/.*\.py'

python install running to this error:
Not found: 'python/cv2/gapi/.*.py'

Installation issue

Dear Authors, Could you please verify the dependencies. It seems tflite-runtime~=2.5 is not available now.

No local packages or working download links found for tflite-runtime~=2.5
error: Could not find suitable distribution for Requirement.parse('tflite-runtime~=2.5')

Thanks
Maulik

error: (-215:Assertion failed) !_src.empty() in function 'cvtColor'

I tried this code to convert my custom trained YOLOv5 model (.pt)
It returns this bug:
cv2.error: OpenCV(4.1.2) /io/opencv/modules/imgproc/src/color.cpp:182: error: (-215:Assertion failed) !_src.empty() in function 'cvtColor'

2021-06-02 03:17:26.651552: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
Showing result!

Traceback (most recent call last):
File "converter.py", line 59, in
main()
File "converter.py", line 30, in main
original_image, tf_lite_image, torch_image = get_example_input(args.test_im_path)
File "/content/drive/My Drive/Univoice/yolov5/torch2tflite/converter/torch_to_tflite.py", line 28, in get_example_input
image = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)
cv2.error: OpenCV(4.1.2) /io/opencv/modules/imgproc/src/color.cpp:182: error: (-215:Assertion failed) !_src.empty() in function 'cvtColor'

How can I fix this?