steb6 / isbfsar Goto Github PK
View Code? Open in Web Editor NEWInteractive Skeleton Based Few Shot Action Recognition
Interactive Skeleton Based Few Shot Action Recognition
when i change the test type with RealSense_pipeline by device name to test mp4 with opencv, the input frame size to h.estimate() is 640*480,
but when i run hpe.py , it show me :
Traceback (most recent call last):
File "D:/ISBFSAR/modules/hpe/demo.py", line 259, in <module>
res = h.estimate(img)
File "D:/ISBFSAR/modules/hpe/demo.py", line 109, in estimate
bbone_in = self.image_transformation([frame.astype(int), H.astype(np.float32)])
File "D:\ISBFSAR\utils\tensorrt_runner.py", line 60, in __call__
np.copyto(inp.host, elem)
File "<__array_function__ internals>", line 180, in copyto
ValueError: could not broadcast input array from shape (9,) into shape (45,)
why ?
i have run it with only hpe.py, and i notice the smpl in the code ,
so,
Q1: the results in hpe.py are 3d keypoints and the skeleton length and human box ?
Q2: i want to get the smpl pose for the results , how to do ? i find it shows smpl image in project metrabs .
I'm checking the project metrabs code ,
and can you give me some advices or some python module to get it ?
Hi @StefanoBerti ,I noticed that your repo was updated, I tested, but the following errors occurred:
File "D:\python\scripts\AR-main3\modules\hpe\metrabs_trt\utils\extract_onnxs
_from_metrabs.py", line 122, in metr_head *
pred2d, pred3d = model.crop_model.heatmap_heads.conv_final(tf.cast(my_pr
ediction_inputs, tf.float16), training=False)
ValueError: Found zero restored functions for caller function.
File "D:\python\scripts\AR-main3\modules\hpe\metrabs_trt\utils\from_pytorch_to
_onnx.py", line 5, in <module>
torch_out = model(x)
TypeError: 'collections.OrderedDict' object is not callable
'modules/hpe/metrabs_trt/models/numpy/heads_weight.npy'
'modules/hpe/metrabs_trt/models/numpy/heads_bias.npy'
'modules/ar/trx/checkpoints/debug.pth'
How do I get or create these files, Can you send these files to me for testing?
What are the functions of the new TRX and LSTM?
Do you have a gtx1060 or gtx1080 graphics card? Can you test its compatibility with your program?
@StefanoBerti @andrearosasco I've used this command "docker run -it --rm --gpus=all -v "D:/amnt/Quidich_pose_estimation_poc/ISBFSAR":/home/ecub ecub:latest python modules/hpe/hpe.py"
and getting below error. Help me with this.
==========
== CUDA ==
==========
CUDA Version 11.3.1
Container image Copyright (c) 2016-2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.
Ubuntu: True
2023-03-27 07:23:06.763 | INFO | utils.tensorrt_runner:__init__:22 - Loading yolo engine...
[03/27/2023-07:23:07] [TRT] [E] 1: [stdArchiveReader.cpp::StdArchiveReader::42] Error Code 1: Serialization (Serialization assertion stdVersionRead == serializationVersion failed.Version tag does not match. Note: Current Version: 232, Serialized Engine Version: 213)
[03/27/2023-07:23:07] [TRT] [E] 4: [runtime.cpp::deserializeCudaEngine::66] Error Code 4: Internal Error (Engine deserialization failed.)
Traceback (most recent call last):
File "modules/hpe/hpe.py", line 181, in <module>
h = HumanPoseEstimator(MetrabsTRTConfig(), RealSenseIntrinsics())
File "modules/hpe/hpe.py", line 42, in __init__
self.yolo = Runner(model_config.yolo_engine_path) # model_config.yolo_engine_path
File "/home/ecub/utils/tensorrt_runner.py", line 36, in __init__
for binding in engine:
TypeError: 'NoneType' object is not iterable
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.