Coder Social home page Coder Social logo

shaohua-pan / robustcap Goto Github PK

View Code? Open in Web Editor NEW
122.0 7.0 10.0 93.95 MB

Code for our SIGGRAPH ASIA 2023 paper "Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture".

Home Page: https://shaohua-pan.github.io/robustcap-page/

License: MIT License

Python 100.00%
pose-estimation human-pose-estimation motion-capture

robustcap's People

Contributors

shaohua-pan avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

robustcap's Issues

How to enter a video

hi, I want to input video path, output a result video. What should I do? Thank you

optimize reprojection error

if self.use_reproj_opt and c > self.conf_range[0]:
p = j2dc[:, 2]#获取置信度
# optimize x, y
ax = (p / j[:, 2].pow(2)).sum() + self.smooth
bx = (p * (- j[:, 0] / j[:, 2].pow(2) + j2dc[:, 0] / j[:, 2])).sum()
ay = (p / j[:, 2].pow(2)).sum() + self.smooth
by = (p * (- j[:, 1] / j[:, 2].pow(2) + j2dc[:, 1] / j[:, 2])).sum()
d_tran = torch.tensor([bx / ax, by / ay, 0]).to(device)
tran = tran + d_tran
# optimize z
j = j + d_tran#这里已经更新了bx和by
az = (p * (j[:, 0].pow(2) + j[:, 1].pow(2)) / j[:, 2].pow(4)).sum() + self.smooth
bz = (p * ((j[:, 0] / j[:, 2] - j2dc[:, 0]) * j[:, 0] / j[:, 2].pow(2) + (
j[:, 1] / j[:, 2] - j2dc[:, 1]) * j[:, 1] / j[:, 2].pow(2))).sum()
d_tran = torch.tensor([0, 0, bz / az]).to(device)
请问在上述代码中az和bz的计算依据是什么
image
我的式子是正确的嘛,我无法推导出az和bz

请教关于unity3d问题

您好,我目前有个问题,就是在unity3d渲染,我在跑live_server这个时候,显示无法连接unity3d,是否是缺少unity客户端代码,还是我做的有问题,拜托,请您回复一下,谢谢

Questions about the acceleration

Hi,

Thanks for sharing the code of the awesome project!

I have some questions about the acceleration from the IMUs.

First, what is the unit of the acceleration? Is it SI (m/s^2) or G (g)?

Second, is the gravity cancelled out from the acceleration? I suppose the synthetic acc generated from the AIST++ dataset does not consider the gravity, but the readings from IMUs contain the gravity.

Thanks.

训练数据集

请问训练数据是否包含amass数据集中的toctalcapture合成数据

请问imus_addr这个参数

请问这个参数代表什么意思呢?指的imu设备地址吗?还是?还有Imu数据格式能否开源?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.