Cascade Correlation with Hidden Node Networks
Posted: Wed 21. Jul 2010, 20:24
Just to see what would happen, I tried CC on a custom built network with hidden nodes and connections which were not full layer to layer.
First a quick description of my custom network:
If that is true, however, that would be nice because one could build an architecture with an abundance of Hidden nodes, connected as desired, and CC would simply arrive at some solution where a number of these nodes would be unused.
QUESTION: Is this how CC would operate on such a network?
First a quick description of my custom network:
- Imagine two 3-layer networks (In,Hid,Out) where they are combined, in parallel, to produce a single output: the output nodes of the two networks would become another hidden layer and the new output node would be an additional, 4th layer.
- The theory is that if inputs come from 2 different classes, allow the nnet to basically do a reduction in dimensionality before they are combined netwise to get an output.
If that is true, however, that would be nice because one could build an architecture with an abundance of Hidden nodes, connected as desired, and CC would simply arrive at some solution where a number of these nodes would be unused.
QUESTION: Is this how CC would operate on such a network?