Automated search for optimal net architecture

Want to provide feedback to MemBrain or post/discuss suggestions for improvements or new features? Detected a bug that should be resolved in a future version?

Then this is the right place for your contribution!
Post Reply
alexeymosc
Posts: 5
Joined: Tue 30. Nov 2010, 16:34

Automated search for optimal net architecture

Post by alexeymosc »

Hello!

Just an idea how to help reduce hand-work time needed to find an optimal neural network architecture.

A user specifies the limits on the number of neurons in the hidden layer, e.g., 2-20. Then, the user specifies the limit on the number of hidden layers, e.g., 1-3. He also selects from the list of functions on the neurons to use which functions will be applied. Also the limit on the total number of trials that the program will run.

The program then generates various nets and trains them till some minimum error on the test (or train) sample is achieved. The best - trained - architecture is stored in the end of the procedure.

This idea is derived from my experience in using other NN packages. Seems helpful and time saving.

BR
Alexey
User avatar
Admin
Site Admin
Posts: 438
Joined: Sun 16. Nov 2008, 18:21

Re: Automated search for optimal net architecture

Post by Admin »

Many thanks for the input, this would indeed be a valuable feature.

With the current MemBrain version you could still implement some approach like this on your own, using the scripting language of MemBrain.
I'll also consider to add this as an example script. This way it would have the flexibility to be expanded by the users.

Regards
Thomas Jetter
Post Reply