Comments (3)
thanks for your reply, I solve this issue through setting smaller edge thickness and more keypoints!I will close this issue.
from autolink-self-supervised-learning-of-human-skeletons-and-object-outlines-by-linking-keypoints.
I remove pytorch lightning and transform the code to pure pytorch, and I add resume checkpoints function, I have trained 40 epoches in fact.
from autolink-self-supervised-learning-of-human-skeletons-and-object-outlines-by-linking-keypoints.
Hi wuyuanmm,
The heatmap result and its overlap on images seem fine to me, as it covers the face. I cannot be 100% sure if is good because I need more examples to see if it indeed models the shape variation in the dataset.
Note that it is an unsupervised method. Thus the results would not be the same as human annotation. The model would choose those keypoints that are enough to explain the shape variation in the dataset.
If you want the detailed keypoints and edges as those in the paper, I suggest more keypoints (~16) with smaller edge thickness (~1e-3). If memory is the issue, you could try generate smaller heatmaps (~64x64) and then resize them. You could also try to use smaller batch size (~8) as face is not a difficult dataset.
Finally, if you really want keypoints perform like those human-annotated ones, you could try few-shot learning as describe here: https://xingzhehe.github.io/FewShot3DKP/
where you sample partially from annotated examples and partially from unannotated examples. You could supervise both with AutoLink and supervise those with annotated ones with human annotations.
I hope these could help you. If not, ping me again and we can discuss in details how to deal with low-memory issues.
Bests,
Xingzhe
from autolink-self-supervised-learning-of-human-skeletons-and-object-outlines-by-linking-keypoints.
Related Issues (2)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autolink-self-supervised-learning-of-human-skeletons-and-object-outlines-by-linking-keypoints.