Comments (2)
First responding to Question 2:
- Assuming you are aware of the theory behind transfer learning, you should have dataset which is similar to MNIST. So if you have any other dataset containing number or maybe characters than yes you may be able to work with that.
- Going a little more detail on the dataset, like MNIST, you input data should have the actual characters in white and the background in black.
- Regarding the input shape, you should try to keep the dimensions to the size of the MNIST images [28, 28]
Responding to question 1:
- Now which layers to freeze is selected based on the data on which the model was trained vs the data in which you want to fine-tune the model on.
- Incase if the data is very similar, then you can train very less layers. My personal opinion would be to fine-tune both the capsule layers, and the reason would be that the capsule in the primary capsule trigger the capsules in the next layer. I don't have any basis for making this statement and is purely based on intuition and could defer from any other actual implementation.
- For reconstruction layer, I am not entirely sure. You could empirically try it out and see does reconstruction loss add any benefit to you training.
Also, I would like to know if you are able to gain any success by implementing the fine-tuning task. So let me know if things turn out the way you expected them to be.
Thanks, have a great day!
from capsule-network.
Thank you very much for your complete and kind answers.
I will definitely inform you if I succeed in this field. But the following link fine-tune the original model using x-ray images of the chest. You may be interested to take a look at it.
https://github.com/ShahinSHH/COVID-CAPS
Thanks, Best regards.
from capsule-network.
Related Issues (3)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from capsule-network.