Choose Optimizer and Learning Rate in neural network

Hi everyone, I try to find and specify optimizer and learning rate in my custom network (I am using net=network(), I refer Edit Shallow Neural Network Properties - MATLAB & Simulink (mathworks.com) )

But I can't see parameter or instruction about change optimizer (adam, sgd,...) and learning rate for my training

Can you show me where are they or Can i specify them in my network?

Thank you so much!

[Katy]

Is there a solution for this? I'd also like to know how to change the learning rate for a shallow neural network.

Thanks!

Answer 1

[Jayanti]

Hi Phoung,

You can use the "trainFcn" property of the “net” to select one of the optimisers available.

net.trainFcn = 'traingd';

Refer to the official documentation below for list of all optimisers available:

https://www.mathworks.com/help/deeplearning/ug/train-and-apply-multilayer-neural-networks.html

In response to your query to change learning rate you can use the below code:

net.trainParam.lr=0.01;

I hope this helps.