Comments (1)
Hi Armin,
Natural images are highly redundant, in the sense that nearby pixels often tend to have very close RGB values. A redundancy-reduced code of images is a code where components carry non-redundant information, and can thus be more compact. This is for example how JPEG compression works: by taking advantage of the high redundancy of nearby pixels it creates a compressed representation of the image. Another example of a redundancy-reduced code is found in the retina: https://direct.mit.edu/neco/article/2/3/308/5533/Towards-a-Theory-of-Early-Visual-Processing
In general, the principle of redundancy-reduction has been a powerful principle to explain the structure and organization of the visual system in Neuroscience. In Barlow Twins, we use this principle to build representations which do not collapse, in the sense that the representations learned are richly informative about the input image.
Let us know if you have more questions about this neat principle.
from barlowtwins.
Related Issues (20)
- transforms.Solarize probability is zero for transforms but not transforms_prime HOT 3
- Issue loading checkpoint.pth file HOT 1
- Augmentation Distribution HOT 1
- Will BarlowTwins overfit on the training data?
- When using the own dataset, loss is around 10,000 HOT 8
- About the last normalization layer HOT 1
- Dose we can add distorted image, like Y_a, Y_b, Y_c?
- A question on the BT loss with Batch Norm layers HOT 4
- Start index for each epoch HOT 3
- weight update for step=0,epoch=0 get's missed. HOT 2
- Applications on one-dimensional signal datasets HOT 4
- Where could we find the "reproduced version" of the other SSL methods HOT 1
- Question about Fig. 4 in the paper HOT 4
- Quality of Embeddings
- Possible bug on the loss computation HOT 1
- Error in saving resnet50.pth HOT 2
- efficiency proposal HOT 1
- NaN's introduced during training.
- providing the linear ImageNet classifier weights
- Pre-training model for CIFAR
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from barlowtwins.