Comments (5)
You can either fit the model to an image similar to the 3D landmark fitting example, but optimizing for the difference between predicted 2D landmarks and the projected 3D landmarks (i.e. as described in the FLAME paper), or use a pre-trained regression model like RingNet, which directly outputs FLAME model parameters for an image.
from tf_flame.
You can either fit the model to an image similar to the 3D landmark fitting example, but optimizing for the difference between predicted 2D landmarks and the projected 3D landmarks (i.e. as described in the FLAME paper), or use a pre-trained regression model like RingNet, which directly outputs FLAME model parameters for an image.
It seems RingNet targets another version of FLAME model since it outputs 100 shape parameters and 50 expression parameters (RingNet/config_test.py):
flags.DEFINE_integer('pose_params', 6, 'number of flame pose parameters')
flags.DEFINE_integer('shape_params', 100, 'number of flame shape parameters')
flags.DEFINE_integer('expression_params', 50, 'number of flame expression parameters')
It is possible to optimize TF_FLAME parameters (300/100) given RingNet vertices output, but it doesn't look like the best way to fit TF_FLAME to image.
from tf_flame.
It seems RingNet targets another version of FLAME model since it outputs 100 shape parameters and 50 expression parameters (RingNet/config_test.py)
RingNet does not use another version of FLAME, just only a subset of the parameter. The shape parameters RingNet returns are the first 100 shape parameters of FLAME, the expression parameters are the first 50 expression parameters.
Recently, a demo got added to this repo to fit FLAME to sparse 2D keypoints.
It is possible to optimize TF_FLAME parameters (300/100) given RingNet vertices output, but it doesn't look like the best way to fit TF_FLAME to image.
Fitting 2D image keypoints only provides a very sparse signal about the facial shape and expression. Using more parameters for optimization than landmark constraints requires solving an underconstrained optimization problem. The more parameters are optimized for, the more carefully the regularization must be set.
from tf_flame.
All good, this answer explains the mismatch.
from tf_flame.
Wow, the fastest answer ever =).
Thank you!
from tf_flame.
Related Issues (20)
- AlbedoMM Clipping Textures HOT 11
- About tf2.3.1
- Unlabelled mask region in Flame. HOT 1
- Directly fitting the 3D mesh
- Help with projection Matrix
- ImportError: cannot import name 'plyutils' HOT 2
- windows HOT 3
- texture_data_512.npy missing HOT 1
- How to dump FLAME paramters from fitting results? HOT 1
- where is female_model.pkl? HOT 1
- imgHQ00088_lmks.npy HOT 3
- match shape and expression in TF_FLAME and blender HOT 1
- How to improve Texture Image HOT 4
- Some really honest questions HOT 2
- how to make imgHQ00088_lmks.npy file?
- Jaw articulation parameters HOT 6
- Render checkboard-like texture on flame models HOT 1
- About registration
- FLAME expression base meaning
- How to obtain the texture_data_1024.npy file?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tf_flame.