Coder Social home page Coder Social logo

niki's People

Contributors

biansy000 avatar jeff-sjtu avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

niki's Issues

Size mismatch

When I tried to run the demo.py, this error occured. The input model is from "checkpoint_49_cocoeft.pth".
Any method to solve this?
'''
RuntimeError: Error(s) in loading state_dict for HRNetSMPLCam:
size mismatch for smpl.shapedirs: copying a param with shape torch.Size([6890, 3, 10]) from checkpoint, the shape in current model is torch.Size([6890, 3, 300]).
'''

Not so effective

I used the model mentioned in the readme to test, and found that the effect did not seem to be as good as in the video. The effect is as follows. Is this result normal, or did I make an error during runtime?
企业微信截图_16939051089595
企业微信截图_16939050538673

3dpw-occ

Hi, I have a question about the 3DPW-OCC test.

The results that you've reported in the table and the results from PARE's paper are different each other.

For example, in 3DPW-OCC set,

PARE's result

Methods PA-MPJPE MPJPE PVE
SPIN 60.8 95.6 121.6
HMR-EFT 60.9 94.4 111.3
PARE (Res-50) 56.6 90.5 107.9

Your result

Methods PA-MPJPE MPJPE PVE
SPIN 62.5 98.4 135.1
HMR-EFT 62.0 95.8 120.5
PARE 57.4 91.4 115.3

I think there are some differences in the evaluation code (e.g., setting bounding boxes), could you share how you evaluated each model? Thank you so much for your help in advance!

Script for AGORA

Can you share the script you used to generate AGORA .pkl files so I can reproduce the results for the AGORA dataset? Thank you.

fps ?

if not vis, what is the fps with GPU ?

Checkpoint file used for AGORA dataset

Could you please also provide the pre-trained model that was used with AGORA? The current pre-trained model performs significantly worse than reported in the paper. These are the results I'm getting right now:

INFO:root:{'precision': 0.89, 'recall': 0.52, 'f1': 0.65, 'kid_precision': 'nan', 'kid_recall': 'nan', 'kid_f1': 'nan', 'body-MPJPE': 115.0, 'kid-body-MPJPE': nan, 'body-NMJE': 176.9, 'kid-body-NMJE': 'nan', 'body-MVE': 263.3, 'kid-body-MVE': nan, 'body-NMVE': 405.1, 'kid-body-NMVE': 'nan'}

3D 渲染

Hello~ 请问有没有类似 HybrIK 的 Blender 插件代码能渲染生成的 pt 文件

Missing function `calc_cam_scale_trans_const_scale`

Thanks for sharing such fantastic works.

When I was trying to run the train/validate/demo according to README.md, I got the following error:

Traceback (most recent call last):
  File "scripts/train.py", line 8, in <module>
    from niki.datasets.naive_dataset_temporal import (
  File "/home/ubuntu/NIKI/niki/datasets/naive_dataset_temporal.py", line 22, in <module>
    from .hp3d_dataset_temporal import hp3d_dataset_temporal
  File "/home/ubuntu/NIKI/niki/datasets/hp3d_dataset_temporal.py", line 16, in <module>
    from niki.utils.pose_utils import (calc_cam_scale_trans_const_scale,
ImportError: cannot import name 'calc_cam_scale_trans_const_scale' from 'niki.utils.pose_utils' (/home/ubuntu/NIKI/niki/utils/pose_utils.py)

After digging into niki/utils/pose_utils, I was unable to find the function calc_cam_scale_trans_const_scale .

Is this a bug?

Mixed results

Tested on some images from Yoga-82 dataset with the default demo.py script. The model seems too constrained by IK on this dataset, and sometimes it incorrectly detects a person.

What is the easiest way to improve results for this kind of pictures? Does it require fine-tuning the IK network, or can the IK constraints be adjusted in some config?

Bad results:

image-000001 image-000003 image-000006 image-000008
image-000010 image-000016



Ok results:

image-000002 image-000004 image-000005 image-000007
image-000009 image-000011 image-000012 image-000013
image-000014 image-000015

SMPLX

Hello!
Is it possible to apply SMPL-X with this model?
Thanks for the help

run demo

FileNotFoundError: [Errno 2] No such file or directory: './model_files/basicModel_neutral_lbs_10_207_0_v1.0.0.pkl'

Trainning data

Thanks for your great work! Could you provide the trainning data so we can reproduce the results?
- './data/annot/h36m_train_25fps_occ_smpl_db_xyz17new_add_cam_bbox_hrnetw48_pred_amb_sigma.pt'
- './data/annot/3dpw_train_occ_db_xyz17_uv24new_addcam_bbox_hrnetw48_pred_amb_sigma_adduv.pt'
- './data/annot/mpii3d_train_scale12_occ_db_add_cam_bbox_hrnetw48_pred_amb_sigma_adduv.pt'

demo code

Hello, very impressive work and I am wondering if you are going to release the demo code for external videos. Thanks!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.