okozelsk / net Goto Github PK
View Code? Open in Web Editor NEWReservoir computing library for .NET. Enables ESN , LSM and hybrid RNNs using analog and spiking neurons working together.
License: MIT License
Reservoir computing library for .NET. Enables ESN , LSM and hybrid RNNs using analog and spiking neurons working together.
License: MIT License
Bring possibility to setup StateMachine and other components directly from the code.
In addition to the existing horizontal spike coding (neural population), enable also classical vertical coding (spike-train) and direct analog coding for spiking hidden neurons.
Horizontal coding converts an analog value to a simultaneous activity of spiking input neurons population at the same time T. Vertical coding converts the analog value to a spike train on a single input neuron within the given post time frame (so there will be more reservoir cycles and thus much slower reservoir processing).
Direct analog coding means no conversion of analog value to spikes (analog value is used directly as a stimulation of hidden spiking neuron).
Prepare a tutorial application with code examples of using RCNet components
Remove the distinction between input and internal synapses. Remove the synapse's interface and base class and simply implement a synapse supporting both signal delay and short-term plasticity.
Currently predictors are collected only once, after all pattern data are processed in the reservoirs.
Newly will be possible to define multiple collection of predictors during pattern data processing in the reservoirs.
The configuration of predictors will now only be at the level of a group of neurons. Instead of a set of bool attributes and subsequent specification of parameters in separate child xml elements, each predictor will now have its own xml element. Multiple use of a predictor of the same type but with different parameter values will be allowed. The set of available predictors will be revised, unused predictors will be removed, used predictors will be generalized, and new predictors will be added.
Novel general input unit replacing existing input neuron. The aim is to enable both analog and spiking approaches of input coding together while keeping the same time resolution of coding. Unit will provide original analog and corresponding "spike train" in paralell. Spike train will be a horizontal bitwise representation of an analog value (in required precision - sensitivity).
Ongoing investigation...
Ensure that every component of the build chain has its own progress event and provides only information relevant for that component and its subordinate components.
Introduce definition of time-independent input fields within the patterned input feeding context and possibility to route them to the readout layer once.
It enables possibility to combine "static" and preprocessed "dynamic" information at the readout level.
Introduce more sophisticated weighting and postprocessing of the particular results produced by cluster member netwoks.
For each cluster member network, weighting to be taking into account number of samples and achieved accuracy during training and testing. Finally softmax to be used to balance member networks weights.
Introduce optional 2nd level network for computation on cluster, where computed outputs from member networks is an input for that network.
Allow to build the resulting interconnection of neurons by successive application of interconnection schemes. Start with random (existing) and chain / ring schemes.
Add more code examples showing an use of non-recurrent networks (Cluster, Cluster Chain and theirs builders) as standalone components with no relation to State Machine.
Add sub-menus to application root menu to make navigation better structured.
Aim is to make StateMachine able to solve both time dependent and time independent problems efficiently.
Try to introduce anti-spike neurons. The goal is to improve descriptivity of reservoir's predictors by enabling "mirrored" activity to be projected in a neural activity and thus also in the predictors.
Density of anti-spike neurons should be a parameter at analog-group and spiking-group level.
Helper component proposing State Machine configuration. It must be simple to use it.
Pseudoalg:
Set weights for "One winner" member clusters. Weight is cluster's total error from cross-validation / number of positive samples
Sort weighted clusters' predictions in descending order
Select the first (the winner)
Before cross-validation exclude data set of specified size for further calibration. After cross-validation use excluded data to train new network where inputs will be predictions of trained sub-networks (folds). Final cluster prediction will be the prediction of this new trained network.
Wrong way :-(
Introduce common separate input encoder providing input neurons for reservoirs (analog neuron and population of spiking neurons per each input feature).
Warning: This will have a major impact on setup xml.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.