Comments (1)
Hi Zelex,
No, Genann doesn't use the cross entropy method. Genann implements very basic, standard back-propagation.
Why? Three reasons.
-
New features should be justified. i.e. if I'm going to add a new feature, I need a good reason to add it, not a good reason to leave it out.
-
I personally don't use back-prop at all in my personal applications for Genann (I'm doing reinforcement learning). The back-propagation was added mostly as a sanity check and because others expect it.
-
One of Genann strengths is that it's small and hackable. If we implement cross entropy, then why not also implement the 500 other techniques and optimizations in common use?
Anyway, I'm not very familiar with cross entropy, so if I'm missing a compelling argument for it, please let me know. I'd like to hear your input.
Best,
Lewis
from genann.
Related Issues (20)
- Why rand() has no seed? HOT 1
- link issue using msvc HOT 5
- How to implement bias value HOT 2
- I want to confirm that if the cost function of the project is quadratic cost function HOT 2
- Issue with changing activation functions HOT 13
- Implement relu HOT 4
- -nan Assertion Error HOT 2
- Feature Extraction HOT 2
- Error when trying to compile with G++ + bionic HOT 1
- DOS port HOT 3
- Anything about C++? HOT 2
- example1 not enough training. HOT 5
- Prediction HOT 1
- Non-linear regression HOT 1
- input data HOT 3
- Several hidden layers with different neurons number HOT 1
- Example1 always shows 1 or 0, even when output is {3,4,5,6} HOT 1
- OCR example? HOT 4
- Do the algorithms used by default work on complex problems? HOT 6
- Change type double to int16_t HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from genann.