Why can't I use the mae error with the Levenber-Marquardt algorithm?

1 view (last 30 days)
Hi, I'm training a neural network using a script I got using the matlab tool on neural networks.In particular I am using a timedelaynetwork for the prediction of a historical power series, I modified the network by inserting two hidden layers, one with a logsig activation function and one with a tansig activation function.I am using is the levenberg-marquardt, inserting the mae as a performance function, the message in the figure appears in the command window.
Why can't I use the mae with the trainlm?
Also, I would like to ask you, in your opinion is the architecture and type of network I am using to make the power prediction correct? or could it be improved in some way?

Accepted Answer

Matt J
Matt J on 4 Dec 2020
Edited: Matt J on 4 Dec 2020
Why can't I use the mae with the trainlm?
Just a guess, but Levenberg-Marquardt presumes that a Jacobian can be computed at the optimum parameter selection. In the ideal scenario where the optimal MAE=0, the Jacobian would fail to exist, due to the non-differentiability of at .
  3 Comments
Matt J
Matt J on 4 Dec 2020
Couldn't you just use trainNetwork, say with its default stochastic gradient descent algorithm?
Giuseppe D'Amico
Giuseppe D'Amico on 4 Dec 2020
I have never used it, would it be okay to use the trainNetwork function to train a network needed to predict a power time series?

Sign in to comment.

More Answers (0)

Categories

Find more on Deep Learning Toolbox in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!