Coder Social home page Coder Social logo

opengvlab / hulk Goto Github PK

View Code? Open in Web Editor NEW
78.0 78.0 2.0 229.41 MB

An official implementation of "Hulk: A Universal Knowledge Translator for Human-Centric Tasks"

Home Page: https://humancentricmodels.github.io/Hulk/

License: MIT License

Python 99.79% Shell 0.21%

hulk's People

Contributors

cohesion97 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

ymkiii vcadillog

hulk's Issues

AttributeError: 'PoseEvaluator' object has no attribute 'dataset'

It seems that there is a bug here.

Hulk/core/solvers/utils/pos_tester_dev.py", line 134, in evaluate
image_id = self.dataset.name2id[image_paths[i][len(self.dataset.img_prefix):]]

According line 53 self.dataset = config.evaluation.cfg.dataset, the initialization of self.dataset is based on the test YAML file, but no corresponding configuration was found in the YAML file.

Example of getting predictions

Could you demonstrate how to initialize model by pythonic way and get predictions on images tensor for specific task?
Best!

Question about generate_random_masks function in MaskViT

The paper mentions that Backbone uses the same ViT-base as UniHCP, but when looking at the code, generate_random_masks is used in vit to shuffle. I would like to ask what the purpose of this is and if there are any more literature on this approach.

Question about merging different task checkpoints

It seems that the open source weights have one ckpt per task. Is it possible to merge the weights of different tasks and only load one merged model during inference? Has this been used in practice?

Inference using the trained heads

Dear Authors,

First of all, thank you for sharing your code! I am trying to use it for inference, but I get an error here:

# load bert vectors
text_features = torch.load(f'./{description_dict_name}.pth')

The code tries to load ./checked_par_lip_name.pth file for LIP evaluation (this is the task for which I am trying to use your model in inference mode on my own images) but this file is not part of the repository. Could you help me out here how to get this file?

Questions about the practical application of Hulk

Thank you for your great work.
I have a question about practical inference. Is it necessary to infer twice for keypoint, first by detection to crop the human body and then to infer the key points?

ModuleNotFoundError: No module named 'petrelbox'

Traceback (most recent call last):
File "/mnt/data/yuxiong/Hulk/experiments/release/../..//test_mae.py", line 9, in
from core.testers import tester_entry
File "/mnt/data/yuxiong/Hulk/core/testers/init.py", line 1, in
from ..solvers.solver_mae_devnew import TesterMAEDev
File "/mnt/data/yuxiong/Hulk/core/solvers/init.py", line 3, in
from .solver_mae_devnew import SolverMAEDev
File "/mnt/data/yuxiong/Hulk/core/solvers/solver_mae_devnew.py", line 40, in
from core.solvers.utils.peddet_tester_dev import PedDetMAEEvaluator
File "/mnt/data/yuxiong/Hulk/core/solvers/utils/peddet_tester_dev.py", line 28, in
from petrelbox.io import PetrelHelper
ModuleNotFoundError: No module named 'petrelbox'

pip/conda install petrelbox doesn't work, I was trying to do the evaluation, pls provide an alternative way

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.