Comments (3)
Thank you! You are right.
Because the target in pre-training process is normalized, so the predict of model is unreal.
To visualize the reconstruction image, we add the predict and the original mean and var of each patch.
So, to avoid it, you need to use the real pixels as the target by setting --normlize_target
to False.
In fact, I am not sure that the reconstruction images shown in the paper from what kind of supervision.
And I will add the comment to avoid misunderstanding.
from mae-pytorch.
Dear author,
where the "--normlize_target"?I cannot find it. I hope you can say specificly,thank you.
from mae-pytorch.
OK,I find it,sorry to interrupt you.
from mae-pytorch.
Related Issues (20)
- pil_loader slowly
- typo error local-rank HOT 1
- TypeError: __init__() got an unexpected keyword argument 'pretrained_cfg'
- Do I need to specify the value of mask_ratio before finetune?
- training with 400 epoch has IndexError when training at the last iteration
- Which dataset is used for the released pretrained model?
- A warning when pretraining HOT 2
- Pretrained weight of vit-S
- Patch size for pretraining
- learning rate curve
- Visualize Problems HOT 2
- How to resume from the checkpoint?
- SimMIM test
- I wonder if you plan to release the mask prediction visualization code?
- RuntimeError: Given normalized_shape=[768], expected input with shape [*, 768], but got input of size[12]
- Visual loading model error HOT 6
- How to implement Layer-wise learning rate decay on ResNet?
- Error reported in code finetune, AttributeError: 'VisionTransformer' object has no attribute 'get_num_layers'.
- The import accimage cannot be parsed
- Is Mixup necessary for MAE fine-tuning?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mae-pytorch.