Comments (7)
Hi, @zingo
Thank your for your support. We don't have anything to follow up with currently, please close this ticket.
Best Regards,
Rahn
from ethos-n-driver-stack.
Hi,
reason: Convolution: Overall scale (of the input* weights/ output) should be in range [2.328306e-10, 1)
Please note that the quantization scale of input, weights, and output need to satisfy the above equation
Best Regards,
Mohamed
from ethos-n-driver-stack.
Hi,
Since the int8 tflite model is converted based on (TensorFlow2 int8 calibration)[https://www.tensorflow.org/lite/performance/post_training_quantization#integer_only], and the model could successfully executed in both CpuAcc and GpuAcc backend. Is there any other step needed to be included to allow the weight values in the converted int8 tflite model satisfy the requirement of NPU?
Best Regard,
Rahn
from ethos-n-driver-stack.
Hi,
You mentioned your model is based on BiSeNetv2 architecture. I would like to produce the error on my environment. It would be helpful if you let me know your reproduce steps, the environment used, and if there's any model I can use that produce the same error.
Looking forward to hear from you
Best Regards,
Mohamed
from ethos-n-driver-stack.
Hi,
The attachment is the BiSeNetv2 model we used in our experiment, and the following is the information about our environment.
AMR_20211018_office1_2_3_exp7Ext1_nosoftmax_int8.tflite.tar.gz
- The model is tested on a ZEBU simulator with a cortex A55 CPU and a mounted ethos N78 device
- The version of ArmNN, Compute Library, and ethos-n driver is 21.08.
- Since our model contains a argmax layer which is not supported in NPU, we apply the "hint" mechanism to execute the layer on CpuACC mode, and the other layers executed on EthosACC mode.
Best Regard,
Rahn
from ethos-n-driver-stack.
Hi,
Please note that this is currently not supported. We are evaluating adding support for this in a future release. My colleague is looking to provide more details on the corresponding ticket opened in the support channel.
Best Regards,
Mohamed
from ethos-n-driver-stack.
Hi @Rahn80643 thanks for checking and helping out with our code!
I just want to check if you are you happy with this info for now or do you have anything you want to follow up with?
(I'm wondering if we can close this ticket for now?)
Best Regards,
Zingo
from ethos-n-driver-stack.
Related Issues (17)
- [BUG]Unable to build tvm with ethos-n-driver-stack support HOT 2
- Conv2D could not be estimated HOT 2
- Best practise to create a quantized tflite model HOT 1
- The converged pad and convolution NPU are not supported HOT 16
- An exception occurred using the cache network function HOT 2
- Error message while executing inference with NPU HOT 2
- Ethos-N driver + simulated Ethos-N NPU? HOT 1
- Kernel support HOT 1
- Orange Pi 5B no driver file created after initializing the kernel module HOT 4
- Support for Raspberry or jetson nano ? HOT 1
- Build fails on Centos7/manylinux2014 and Ubuntu:latest HOT 5
- compilation error with scons HOT 5
- Which type of quantization does ARM NPU support? HOT 1
- Support of elementwise mulitiplication HOT 2
- SPA test generates warning "Layer of type is not supported" HOT 5
- Inference result of int8 model on NPU HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ethos-n-driver-stack.