Confuse of input and label about pose-residual-network-pytorch

[abeardear]

Input(weights) and output are not same. Output only consider one person, every channel has only one peak. Input consider the overlap of several person, each channel may have several peak.

[salihkaragoz]

@xiongzihua Thank you for the clarification.

@xiaoxiaoSummer In addition to what is mentioned above;

why the input is coming from the known keypoints position information rather than the true image data?

This Repo includes the last part of the MultiPoseNet, in other words, Pose Residual Network. For more info have a look at #4 comment
We trained the PRN over the coco ground truth data.

A Sample of Input-Output Pairs;

Input has 17 channels, each channel represents one keypoint. The background image is set to a better understanding. The first channel(nose) has three different Gaussian peaks because in the bounding box there are three human noses.

Output has 17 channels same as the input. In the example, there is only one Gaussian peak in the first channel. It also belongs to the bounding-box owner.

Feel free for fresh questions otherwise please close this issue.
Hope This Helps

[xiaoxiaoSummer]

@salihkaragoz so this network only work as a role for matching one person pose from whole pose components given at previous stages like keypoints detection and human detections?

[salihkaragoz]

Yes exactly. PRN takes the output of Bounding Box results and Bottom-up keypoint estimator results as an input. Right now, it is working with Coco ground truth data.

Theoretically, it can work with any output of Bottom-up Estimator results plus Bounding-box results. But it doesn't work with current Repo adjustment. We need to configure it.
Best