Time variant net: Version #1
Mackey-Glass time variant net #1
As a first approach to make our net time variant we will add some delay neurons to the
input. For more information about delay neurons see the MemBrain help file in section
'Neurons in MemBrain' - 'Adding Delay Neurons'.
The net now looks as following.
Five delay neurons have been added to the input. These reflect the input signal at t = -1 through
t = -5.
We will now connect these delay neurons to the hidden neurons and the output neuron to build the
following net.
Note:
If you do not want to do the net edits yourself you can also load the example net from file:
MackeyGlassTimeVariant1.mbn
We now randomize the net and repeat the training. After some stabilization time
we get the following results:
As we can see things have become significantly better now! The training data set can
be learned quite well already.
Try to switch to the validation lesson during training: Change the number of the 'Net Error Lesson'
on the Lesson Editor to #2 using the arrows beside the corresponding text. You will have to check the box
<Set Manually> before you can change the Net Error Lesson.
The Net Error Viewer and the Pattern Error Viewer will immediately update to reflect the validation lesson result:
This now is the reaction of the net to the untrained validation data. As we can
see the net already generalizes very well.
Note that you can see the validation result during training already! You can switch back and forth
from training result to validation result using the Lesson Editor's setting 'Net Error Lesson'. The
training result is not influenced by this action at all, i.e. the net does not get trained on your
validation data. It is only trained on the lesson that is selected as the 'Currently Edited (Training)
Lesson' in the Lesson Editor which is Lesson #1, i.e. our training lesson.
We will now try to further improve our net using decay neurons in addition to the already used
delay neurons.
Continue with time variant net version #2
Copyright © 2003 - 2007, Thomas Jetter