Comments (1)
Thanks for your interests.
Hi,
Thanks for the interesting work.
Just reviewing the paper here, I've got several questions regarding GT encoder.
You described GT encoder to be self-supervised -- Did you mean this as implementing auto-encoder?
RES: It is very similar to auto-encoder. Here, we are trying to overfit the ground truth mask.
In Figure 5(b), the depicted Ground Truth Encoder has only the encoder part -- does this mean that I only need to train the encoder part (not decoder), targeting the GT?
RES: Yes, you just need to train the encoder part for overfitting the GT. We also tried to use the full u2net as GT encoder, there isn't much differences. But the differences may also depends on your dataset. For overfitting the GT, only around 2000 iteration is enough.
Again in Figure 5(b), do I need to do extra upsampling to make the result of the encoder to have the same size as input? (For clarity, if I put 3X1024X1024 as input, after the green conv layer, the input reshapes into 16X512X512. And after going through EN_1, it will reshape to 64X512X512 and upsample to 3X512X512 (Assuming the upsampling used for u2net is used here in the same manner). Now, the question is how can we compare the upsampled result of EN_1 (3X512X512) and original input (3X1024X1024) in BCE loss calculation?
RES: You can either downsample the GT or upsample the final output. We suggest the later one if you have enough GPU memory.
-- One thought I had was temporarily adding extra upsampling layers for encoders while training the GT-encoder and remove those upsampling layers once I freeze the weights for GT-encoder. Would this be a viable option or did you mean something else?
RES: I think it should be fine for the GT encoder.
from dis.
Related Issues (20)
- Update environment from CUDA10.2 to CUDA 11.8! Adapt to 4090 and A100!
- Dataset image format issues HOT 2
- What words is “Adp” short for in paper?
- What words is “Adp” short for in paper?
- Fine_Tunning with isnet-general-use.pth HOT 3
- Could you provide the codes of other evaluation metrics except HCE? HOT 4
- DIS v2 Dataset
- DIS 2.0 release date? HOT 1
- DIS in SDXL Comfy UI
- How to configure this code for Multiclass segmentation
- Multiple sets of data sets, the accuracy of the last set cannot be improved
- Getting Less Accuracy on High resolution images HOT 4
- Ground Truth shape and data format for 2 class segmentation
- Require DIS v2 Dataset HOT 5
- Downloading weights issue HOT 7
- Regarding whether pre-trained encoders are necessary HOT 2
- what tar loss mean? HOT 2
- Build a high-quality dataset
- Training on custom dataset HOT 4
- Assistance with Running DIS on NVIDIA RTX A5000 GPU HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dis.