Comments (1)
Hi @kalekundert
Thanks a lot for spotting this issue! I introduced a small bug recently which indeed broke the steerable bases used to construct R3IcoConv. This is fixed now!
Regarding the question:
Would you ever recommend using R3Conv instead of R3IcoConv with the icoOnR3 gspace?
I would generally recommend using R3Conv always. The R3IcoConv is using an unstable steerable basis (it often doesn't pass the equivariance tests) and it was implemented to demonstrate the benefits of the harmonic bases used in R3Conv (see Figure 5 in our paper).
I am realising now that this is not emphasised in the documentation. I'm sorry for the confusion, I'll add a warning about this!
I know that in the 2D case, you can do group convolutions that are C(n)-equivariant with standard, unconstrained kernels by "lifting" the input to a higher dimension. Can R3IcoConv be thought of as a 3D version of this?
Yes, that's correct, as long as you use an output regular representation.
If so, I'd expect that it wouldn't be necessary to calculate irreps. I suspect that this analogy is just wrong, but I'm not sure.
Are these irreps actually used by R3IcoConv?
This library implements general steerable CNNs, of which group convolution is just a special case given by the choice of the regular representation.
Moreover, unless one considers only the discrete group of symmetries of the grid (e.g. C_4 or the octahedral group), lifting unconstrained kernels still requires express them in terms of a steerable basis (as done for C_N equivariance in this paper). Working with a steerable basis implicitly implies working with the group's irreps.
For these reasons, we still need the irreps of the Icosahedral group to implement a GCNN equivariant to this group.
I notice that it takes ≈20s to build the icosahedral irreps when instantiating the icoOnR3 gspace
This should have been fixed thanks to your pull-request ;)
Hope this helps and sorry for the delay in my answer!
Gabriele
from escnn.
Related Issues (20)
- wide-resnet N=6 not equivariant
- Instance Norm as normalization? HOT 4
- What is the intuition behind conditioning the kernel size on the number of rotations in the example script? HOT 2
- check_equivariance test failed HOT 2
- escnn's conv, BN, relu is not equivariant? HOT 3
- Pretrained models for ResNet in SO(2) and SE(3) HOT 4
- Utility functions to save and load instances of Group and Representations HOT 2
- Missing indexing dimensions in GeometricTensors HOT 2
- Batched equivariant maps basis expansion (?) HOT 4
- Improved invariant feature extraction - Improved group pooling
- Migrate unit tests to pytest? HOT 4
- question about the 3D rotation order and the Fourier transformation matrix
- Information bottlenecks without warnings.
- Add LayerNorm layer HOT 2
- Add Unitary Group HOT 1
- Usage equivariant MLP HOT 4
- Multi-gpu training degrades performance HOT 1
- Can escnn be used to process one-dimensional data? HOT 1
- 【Passive Rotation】 HOT 3
- Planar symmetries with staggered grids HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from escnn.