pinto0309 / tflite2json2tflite

Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.

tflite2json2tflite

Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.

Usage sample

1. Docker run

docker run --rm -it -v `pwd`:/home/user/workdir ghcr.io/pinto0309/tflite2json2tflite:latest

2. tflite to JSON

./flatc -t \
--strict-json \
--defaults-json \
-o workdir \
./schema.fbs -- workdir/model_float32.tflite

3. JSON edit

sed -i -e 's/Placeholder/input/g' workdir/model_float32.json
sed -i -e 's/fusion\/fusion_3\/BiasAdd/output/g' workdir/model_float32.json

4. JSON to tflite

./flatc \
-o workdir \
-b ./schema.fbs workdir/model_float32.json

rm workdir/model_float32.json

5. flatbuffers (flatc)

I have made my own modifications to the official flatbuffers(flatc) to preserve the accuracy of the quantization parameters output to JSON. For more information, please see this issue. tflite to JSON to tflite quantization error #1

https://github.com/google/flatbuffers

• flatbuffers/include/flatbuffers/util.h

  • From:

    template<> inline std::string NumToString<double>(double t) {
      return FloatToString(t, 12);
    }
    template<> inline std::string NumToString<float>(float t) {
      return FloatToString(t, 6);
    }

  • To:

    template<> inline std::string NumToString<double>(double t) {
      return FloatToString(t, 12);
    }
    template<> inline std::string NumToString<float>(float t) {
      return FloatToString(t, 17);
    }

• build

  cd flatbuffers && mkdir build && cd build
  cmake -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release ..
  make -j$(nproc)

tflite2json2tflite's Issues

tflite to JSON to tflite quantization error

Hi!

When I convert my int8 quantized tflite model to JSON and back the quantization scale parameters are different (they are correct up to ~4 decimals).

This makes the edgetpu compiler return an error when I try to convert it

edgetpu_compiler -m 13 -sa model_unroll.tflite
Edge TPU Compiler version 16.0.384591198
Started a compilation timeout timer of 180 seconds.
ERROR: :514 output->params.scale == 1. / 256 was not true.
ERROR: Node number 6 (LOGISTIC) failed to prepare.

Compilation failed: Model failed in Tflite interpreter. Please ensure model can be loaded/run in Tflite interpreter.
Compilation child process completed within timeout period.
Compilation failed! 

Any idea of how to fix this?

Inputs and outputs of the model before conversion

Inputs and outputs of the model after conversion