quic / ai-hub-models Goto Github PK

I was trying to run the Whisper ASR example.
However, I encountered some issues which I would like to point out.

1. After running the following lines:

   pip install "qai_hub_models[whisper_asr]"
   python -m qai_hub_models.models.whisper_asr.demo
   

   an exception is raised as reported in #15.
2. Solving that as reported in the same issue and proceeding with the export commands python -m qai_hub_models.models.whisper_asr.export raises another exception which is equivalent to the one before and that can be fixed in a similar manner inside the source code.
3. Then, trying to execute the command again gives another exception during the profiling step:

    qai_hub/client.py", line 1097, in _determine_model_type
    raise UserError(qai_hub.client.UserError: Unsupported model type. The following types are supported
        - TorchScript: Extension .pt or .pth
        - Core ML Model: Extension .mlmodel
        - Compiled Core ML Model: Extension .mlmodelc or .mlmodelc.zip
        - Tensorflow Lite: Extension .tflite
        - ONNX: Extension .onnx
        - ONNX (ORT model format): Extension .ort
        - QNN Binary: Extension .bin
        - AIMET Model: Directory ending with .aimet
   

4. Trying to skip the profiling operation ( python -m qai_hub_models.models.whisper_asr.export --skip-profiling) can of course avoid that the previous exception is encountered, but gives another exception similar to the first one:

   qai_hub_models/utils/base_model.py", line 187, in sample_inputs
    inputs_dict[input_name] = [inputs_list[i].numpy()]
   TypeError: can't convert cuda:0 device type tensor to numpy. Use Tensor.cpu() to copy the tensor to host memory first.
   

Why is it not possible to proceed with the profiling operation? The same issue is also encountered when trying to run the inference step, but I guess that these two problems are due to the same reason.
I hope that the information I reported can be helpful.

This bug is being filed in conjunction with the discussion on slack between Adam and Kory. https://qualcomm-ai-hub.slack.com/archives/C06KMD15QH4/p1709746420588749?thread_ts=1709570637.688689&cid=C06KMD15QH4

Compile job on hub for quantized model failed with the following error message "Failure occurred in the Torch to ONNX export: Exporting the operator 'quantized::relu6' to ONNX opset version 17 is not supported.". How can I get rid of it?

https://app.aihub.qualcomm.com/jobs/jn5qww457/

An update will be shared here once available

Are these models applicable to older Snapdragon processors (Snapdragon 7xx)?

I believe that this repo is the source for the models under the Qualcomm huggingface account? If not feel free to close this issue as it does not pertain

I was going through some models and noticed that although the file extension is .tflite some files are actually of the ELF format

❯ head -c 20 ResNet50.tflite
ELF�%                

Repos that are fine:

• VIT

Repos where i noticed the tflite files are actually ELF:

• ResNet50
• ResNext
• Real-ESRGAN-x4plus
• FFNet-40S

Describe the bug
Follow the instruction in "apps/android/ImageClassification" and classification-debug.apk is built successfully.
Installed the apk on Samsung Galaxy S21 Ultra.
Sample image can be selected and it will be displayed on UI.
After selecting CPU or NPU runtime, Image_Classification app is crashed.

Question
I only have Samsung Galaxy S21 Ultra now and I can't test this apk on others phone.
Is this example app only limited to certain chipsets?
I saw GPU is used not NPU with python -m qai_hub_models.models.mobilenet_v3_small.export --device "Samsung Galaxy S21 Ultra".
Any changes need to be done for this case?
Thank you.

Do you intend to experiment with modes like rtmpose, rtmo for real time pose estimation?

Details of model being requested

• Model name: RTMpose, rtmo
• Source repo link: https://github.com/open-mmlab/mmpose
• Research paper link [If applicable]:https://arxiv.org/abs/2303.07399
• Model use case: SimCC

Additional context for requested model
Add any other context or screenshots about the feature request here.

The LLama 7B repo is currently empty, I can't find the conversion scripts or find converted .so files on the hugging face page. Is there an ETA for those to be uploaded?

https://github.com/quic/ai-hub-models/tree/main/qai_hub_models/models/llama_v2_7b_chat_quantized

Hello, thank you for all your hard work. Some time back, Qualcomm announced a model called X-Distill, but it has yet to be published. ( paper talking about it )

Hi all, I have an AI-BOX with Ubuntu 20.04 from a Qualcomm OEM/ODM with the QCS6490 chipset.

I used the AI Hub website to quantize a YoloV7 model to .tflite model and I'd like to perform the model inference on the QCS6490 device mentioned above.

This is the code that I'm using for:

import numpy as np
import tensorflow as tf

# Load your TFLite model
# Replace 'model.tflite' with the path to your actual model
tflite_model_path = 'yolov7.tflite'
tflite_model = open(tflite_model_path, 'rb').read()

# Set up the TFLite interpreter
# To use the Hexagon DSP with TensorFlow Lite, you would typically need to
# build the TensorFlow Lite Hexagon delegate. However, this script assumes
# that the delegate is already available and part of the TFLite runtime.
interpreter = tf.lite.Interpreter(
    model_content=tflite_model,
    experimental_delegates=[tf.lite.experimental.load_delegate('libhexagon_delegate.so')]
)
interpreter.allocate_tensors()

# Get input and output tensors.
input_details = interpreter.get_input_details()
output_details = interpreter.get_output_details()

# Test the model on random input data.
input_shape = input_details[0]['shape']

print(f"[INFO] Input Shape = {input_shape}")

input_data = np.array(np.random.random_sample(input_shape), dtype=np.float32)
interpreter.set_tensor(input_details[0]['index'], input_data)
interpreter.invoke()

# Get the output of the model
output_data = interpreter.get_tensor(output_details[0]['index'])
print(output_data)

And my question is where can I find, or where do I download the libhexagon_delegate.so library.

Describe the bug
I have a model with only layers like Conv2d, LeakyReLU, Sigmoids and element-wise multiplications. The model converts successfully, here is an example job: https://app.aihub.qualcomm.com/jobs/jegn9nk5o/
However, running the model on device (Vivo X90 Pro+ with 8550 chipset) through qnn-net-run gets stuck.
If I run the model through the qnn-pytorch-converter it converts successfully and I can run it on device.

TorchScript can be downloaded here: https://drive.google.com/file/d/19Y2H8TyqEsJ_QbNISDBA98b_6RCYa38k/view?usp=share_link

To Reproduce

• Download model from link above.
• Run code to convert:

compile_job = qai_hub.submit_compile_job(
    model="checkpoints/Mock.pt",
    device=qai_hub.Device("Samsung Galaxy S23+"),
    options="--target_runtime qnn_lib_aarch64_android",
    input_specs=dict(image=x.shape),
)
compile_job.download_target_model("checkpoints/")

• Create demo input with np.random.rand(256,256,1).astype(np.float32).tofile("input.raw") and a input list with echo input.raw > input.txt
• Copy the model, demo input and input list to device
• Run the model with qnn-net-run --backend libQnnHtp.so --model job_jegn9nk5o_optimized_so_m7n1evpm5.so --input_list input.txt

Expected behavior
The qnn-net-run command should exit after a few seconds, generating an output/Result_0 folder.

Stack trace
Stack trace with cancellation after a minute:

./qnn-net-run --backend libQnnHtp.so --model res/job_jegn9nk5o_optimized_so_m7n1evpm5.so --input_list res/input.txt                                  
qnn-net-run pid:11906
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
^C

Host configuration:

• QAI-Hub client version: '0.9.0'

This bug is being filed based on the discussion with Manuel Kolmet in AI Hub Models slack community. https://qualcomm-ai-hub.slack.com/archives/C06LT6T3REY/p1709827335261829

Bug report: A fairly simply model (3x Conv-3 layers) runs out of memory when converted through the model hub but works fine out of the qnn-pytorch-converter.
The model was created as below, TorchScript is attached.
model = nn.Sequential(
nn.Conv2d(1, 64, kernel_size=3, padding=1),
nn.ReLU(),
nn.Conv2d(64, 64, kernel_size=3, padding=1),
nn.ReLU(),
nn.Conv2d(64, 1, kernel_size=3, padding=1),
)
When running the model with qnn-net-run I get
qnn-net-run pid:22832
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
Graph Finalize failure
Our own runner tool which prints all debug output shows
2022-06-12 21:52:57.097 - E/QNN-RUNNER-CALLBACK: fa_alloc.cc:3747:ERROR:graph requires estimated allocation of 4176043 KB, limit is 2097152 KB

2022-06-12 21:52:57.098 - E/QNN-RUNNER-CALLBACK: graph_prepare.cc:638:ERROR:error during serialize: memory usage too large

2022-06-12 21:52:57.098 - E/QNN-RUNNER-CALLBACK: graph_prepare.cc:5512:ERROR:Serialize error: memory usage too large

2022-06-12 21:52:57.098 - E/QNN-RUNNER-CALLBACK: Weight Offset (0) + Weight data (0) sizes != total pickle size (712704) !!

2022-06-12 21:52:57.098 - E/QNN-RUNNER-CALLBACK: Error getting size and offsets of weights

2022-06-12 21:52:57.491 - E/QNN-RUNNER-CALLBACK: Failed to initialize graph memory

2022-06-12 21:52:57.491 - E/QNN-RUNNER-CALLBACK: Failed to finalize graph input_model with err: 6020

2022-06-12 21:52:57.491 - E/QNN-RUNNER-CALLBACK: Failed to finalize graph (id: 1) with err 6020

2022-06-12 21:52:57.491 - E/QNN-RUNNER: Graph Finalize failure
The job I've used to convert the model is here: https://app.aihub.qualcomm.com/jobs/jz5763ng3/

I would like to use the controlnet(https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/controlnet_quantized/README.md) model pipeline with a 16:9 resolution input image, but currently the image resolution of this pipeline is fixed to 512x512

Describe the solution you'd like
Either having a variable input/output image WxH would be the best solution, but a fixed resolution model would make it also, for example 960x540

Describe alternatives you've considered
I considered resizing the input 16:9 image, but that distorts the image unfortunately.

How do you run this and the other QualComm Hub models on the S23 Ultra please?

I would like to run the controlnet(https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/controlnet_quantized/README.md) models on the HTP on snapdragon with windows. Is it possible to run the exported binary cache files of the controlnet models on snapdragon with windows?

In the docs I saw that the only support runtime is qnn_lib_aarch64_android for job compilation.

Is your feature request related to a problem? Please describe.
In the application I am considering, the recognition of technical terms is fundamental to guarantee the release of a successful solution.
However, ASR models in general have difficulties in recognizing very specific terms.

OpenAI Whisper allows to feed a prompt to the decoder which makes use of a simple language model. The prompt can be used to help stitch together multiple audio segments or as a spelling guide to improve the recognition of specific terms, and it proved to be very useful.

Reference: https://cookbook.openai.com/examples/whisper_prompting_guide

Describe the solution you'd like
It would be very useful to update the Whisper model to accept another input which is a set of decoder_input_ids representing the prompt.
An image of the idea behind this can be found at the following link: openai/whisper#117

Describe alternatives you've considered
The recognition of specific terms can be improved using other strategies such as fine-tuning, but prompting is a much easier and faster alternative in many cases.

Additional context
This feature is already supported in HuggingFace Transformers (huggingface/transformers#22395)

Other useful links:

• https://platform.openai.com/docs/guides/speech-to-text/prompting
• openai/whisper#963

Hello, when I utilize NPU(HTP aka. cDSP) on Snapdragon 8 gen3, I meet some performance problems.
Here is the details.
When we use qhblas_hvx_ah_matrix_vector_mpy_ab in Hexagon SDK qhl_hvx library, we find that it is much slower than directly computing with CPU Arm Neon. The result is shown as below.
cDSP(NPU) [13008, 5120] * [5120, 1] 45ms
CPU [13008, 5120] * [5120, 1] 10ms
After that, we set the power mode to performance mode, the cDSP execution time is a little faster, but still slower than CPU.
cDSP(NPU) [13008, 5120] * [5120, 1] 36ms
CPU [13008, 5120] * [5120, 1] 10ms
I want to know if the result is correct and is compatible with your tests? Looking forward to get your response.

Hi, I'd like to know if there are any benchmarks done on QCS610 and QCS6490. Those chipsets are available on some Qualcomm OEM/ODM vendors.

import com.qualcomm.qti.QnnDelegate file is not found

Metrics on LLama2 7B is confusing. Can you provide clarification on what the metrics represent.
For example if I am interested in these metrics:

1. Time to first token (for input of a given token length)
2. Token per second (same input length)
   How do I extrapolate that from the metrics on that page?

Does this mean the input prompt was maxed out and it corresponds to 8.48 token/sec:

• Max context length:1024
• Prompt processor input:1024 tokens
• Llama-TokenGenerator-KVCache-Quantized: 8.48 token/s

What does this mean, the output is 1 token?

• Prompt processor output:1 output token + KVCache for token generator

Also, are there the memory metrics for this model?

Thanks you!

Details of model being requested

• Model name: Depth-Anything
• Source repo link: https://github.com/LiheYoung/Depth-Anything
• Research paper link [If applicable]: https://arxiv.org/abs/2401.10891
• Model use case: depth-estimation

Additional context for requested model
Real-time depth estimation on live camera video streams holds immense potential for various industries, offering immersive experiences and enabling innovative applications, from augmented reality to autonomous navigation.

Describe the bug
If a model contains the QNN ElementWiseSelect operation, equivalent to torch.where(), it converts successfully but the graph fails to finalize on device or in the emulator.

To Reproduce
Steps to reproduce the behavior:

• Compile job is here: https://app.aihub.qualcomm.com/jobs/j0pxk1885/
• You can create an equivalent model in Pytorch with

class Where(nn.Module):
    def __init__(self):
        super(Where, self).__init__()
        self.conv1 = nn.Conv2d(3, 3, kernel_size=3, padding=1)

    def forward(self, x):
        mask = x > 0.5
        y = x - 1.0
        x = torch.where(mask, x, y)
        x = self.conv1(x)
        return x

x = torch.rand(1, 3, 16, 16)
y = Where()(x)

Expected behavior
After conversion, the model should run on the emulator and device as expected.

Stack trace
Output from qnn-net-run:

qnn-net-run pid:21299
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
WARNING: linker: Warning: unable to normalize "$/data/local/tmp/QNN-2.19" (ignoring)
Graph Finalize failure

Host configuration:

• QAI-Hub-Models version: aihub-2024.03.07.0
• QAI-Hub client version: 0.9.0

Additional context
As a heads-up: The operation also fails to finalize when converting through the qnn-pytorch-converter or going creating the model "manually" in C++.

ai-hub-models-main\apps\android\ImageClassification\classification

Traceback (most recent call last):
File "build_apk.py", line 119, in
shutil.copy(aarfile, destaar)
File "/usr/lib/python3.8/shutil.py", line 418, in copy
copyfile(src, dst, follow_symlinks=follow_symlinks)
File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/opt/qcom/aistack/qairt/2.21.0.240401/lib/android/qtld-release.aar'

To Reproduce
Steps to reproduce the behavior:

1. Go to : ai-hub-models-main\apps\android\ImageClassification\classification
2. ' python build_apk.py -q $QNN_SDK_PATH -m mobilenet_v3_large'
3. Do you want us to download the model from AI hub (y/n)n
4. Click on 'N'
   5.Give model File as input./mobilenet_v3.tflite
5. Traceback (most recent call last):
   File "build_apk.py", line 119, in
   shutil.copy(aarfile, destaar)
   File "/usr/lib/python3.8/shutil.py", line 418, in copy
   copyfile(src, dst, follow_symlinks=follow_symlinks)
   File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
   with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
   FileNotFoundError: [Errno 2] No such file or directory: '/opt/qcom/aistack/qairt/2.21.0.240401/lib/android/qtld-release.aar'

Host configuration:

• OS and version: [Ubuntu20.04_WindowsWSL2, ]
• qairt: 2.21.0.24040

Describe the bug
I followed the guidance in the following document , installed: pip install "qai_hub_models[whisper_asr]", and after running the CLI demo: python -m qai_hub_models.models.whisper_asr.demo, I encountered an error：

RuntimeError: Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same or input should be a MKLDNN tensor and weight is a dense tensor

To Reproduce
Steps to reproduce the behavior:

1. pip install "qai_hub_models[whisper_asr]
2. python -m qai_hub_models.models.whisper_asr.demo

Context

We want to run the ControlNet model on Android devices.

Problem

It is not clear what condition was used for ControlNet. It would be very kind of you if you could specify what type of condition was used (Canny Edge, M-LSD Lines, Scribbles, etc.)

Proposed Solution

Make a catalog of quantized ControlNet models for each type of condition with the corresponding description.

On AI Hub Models Slack, Hu Eric shared that openAI-Clip demo failed for him. https://qualcomm-ai-hub.slack.com/archives/C06LT6T3REY/p1709470194079099

Kory initially took a look. It seems like this has something to do with CUDA availability. This bug is being filed to look into the initially reported bug.

(qai_hub) a19284@njai-ubuntu:~/workspace/qai-hub-clip$ python -m qai_hub_models.models.openai_clip.demo
Traceback (most recent call last):
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/qai_hub_models/models/openai_clip/demo.py", line 98, in
main()
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/qai_hub_models/models/openai_clip/demo.py", line 72, in main
predictions = app.predict_similarity(images, text).flatten()
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/qai_hub_models/models/openai_clip/app.py", line 64, in predict_similarity
image_features = self.image_encoder(image)
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/qai_hub_models/models/openai_clip/model.py", line 134, in forward
image_features = self.net.encode_image(image)
File "/home/a19284/.qaihm/models/openai_clip/v1/openai_CLIP_git/clip/model.py", line 341, in encode_image
return self.visual(image.type(self.dtype))
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(input, **kwargs)
File "/home/a19284/.qaihm/models/openai_clip/v1/openai_CLIP_git/clip/model.py", line 224, in forward
x = self.conv1(x) # shape = [, width, grid, grid]
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 463, in forward
return self._conv_forward(input, self.weight, self.bias)
File "/home/a19284/mambaforge/envs/qai_hub/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 459, in _conv_forward
return F.conv2d(input, weight, bias, self.stride,
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument weight in method wrapper___slow_conv2d_forward)

I want to quantize my llama-finetuned model to INT4 and deploy it on my 8 gen3 device. But I don't know how to do it. So when will we have a tutorial?

Is this samples can be executed on Volterra?

Context

We want to run the ControlNet model on Android devices.

Problem

Currently, users interested in utilizing the [TextEncoder, Unet, ControlNet, VAEDecoder] models as a pipeline need to download each model separately and manually connect them later. This process can be cumbersome and inefficient, especially for users unfamiliar with model integration.

Proposed Solution

It would be beneficial to provide a bundled option where users can download all the necessary models as one package and easily integrate them into their workflow without the need for manual connections. Also, a comprehensive notebook with demos would be highly appreciated! Of course, it would be best if we could use StableDiffusionControlNetPipeline.

i try to use ai-hub on midas ( a very populare model to do image to depth map ) but from what i understand it doesn't support to be trace
here the code i use

import torch
import urllib.request

# Load MiDaS model
model_type = "DPT_Large"     # MiDaS v3 - Large     (highest accuracy, slowest inference speed)
#model_type = "DPT_Hybrid"   # MiDaS v3 - Hybrid    (medium accuracy, medium inference speed)
#model_type = "MiDaS_small"  # MiDaS v2.1 - Small   (lowest accuracy, highest inference speed)
midas = torch.hub.load("intel-isl/MiDaS", model_type)

# Trace MiDaS model
input_shape = (1, 3, 384, 384)  # Adjust input shape as needed
example_input = torch.rand(input_shape)
traced_midas = torch.jit.trace(midas, example_input)

# Optimize model for the chosen device
device = hub.Device("Samsung Galaxy S23 Ultra")
compile_job = hub.submit_compile_job(
    model=traced_midas,
    name="MyMiDaSModel",
    device=device,
    input_specs=dict(image=input_shape),
)

# Run the model on a hosted device
profile_job = hub.submit_profile_job(
    model=compile_job.get_target_model(),
    device=device,
)

here the log of the execution :

C:\Users\iphone/.cache\torch\hub\intel-isl_MiDaS_master\midas\backbones\vit.py:22: TracerWarning: Using len to get tensor shape might cause the trace to be incorrect. Recommended usage would be tensor.shape[0]. Passing a tensor of different shape might lead to errors or silently give incorrect results.
  gs_old = int(math.sqrt(len(posemb_grid)))
Traceback (most recent call last):
  File "C:\Users\iphone\midas_qualcomm\test.py", line 14, in <module>
    traced_midas = torch.jit.trace(midas, example_input)
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\jit\_trace.py", line 794, in trace
    return trace_module(
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\jit\_trace.py", line 1056, in trace_module
    module._c._create_method_from_trace(
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1488, in _slow_forward
    result = self.forward(*input, **kwargs)
  File "C:\Users\iphone/.cache\torch\hub\intel-isl_MiDaS_master\midas\dpt_depth.py", line 166, in forward
    return super().forward(x).squeeze(dim=1)
  File "C:\Users\iphone/.cache\torch\hub\intel-isl_MiDaS_master\midas\dpt_depth.py", line 114, in forward
    layers = self.forward_transformer(self.pretrained, x)
  File "C:\Users\iphone/.cache\torch\hub\intel-isl_MiDaS_master\midas\backbones\vit.py", line 13, in forward_vit
    return forward_adapted_unflatten(pretrained, x, "forward_flex")
  File "C:\Users\iphone/.cache\torch\hub\intel-isl_MiDaS_master\midas\backbones\utils.py", line 99, in forward_adapted_unflatten
    nn.Unflatten(
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\nn\modules\flatten.py", line 110, in __init__
    self._require_tuple_int(unflattened_size)
  File "C:\Users\iphone\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\nn\modules\flatten.py", line 133, in _require_tuple_int
    raise TypeError("unflattened_size must be tuple of ints, " +
TypeError: unflattened_size must be tuple of ints, but found element of type Tensor at pos 0

did i do something wrong ?

The whole android folder and the apks are missing from the repository