MATLAB Answers

Testing error less than validation error but higher than training error. Is that okay?

36 views (last 30 days)
kareema jumoorty
kareema jumoorty on 24 Mar 2020
I am trying a multilayer perceptron with 5 hidden nodes. However the testing error is lower than the validation error and higher than the training error. The coefficient of correlation on the test set is also higher than that on the validation set. Is that acceptable for a network? I've included the regression and performance plots.The generalization is okay according to me; not the best but adequate.
Thank you in advance. I am new to neural networks and have been trying different combinations for my project.


Sign in to comment.

Answers (1)

Harsha Priya Daggubati
Harsha Priya Daggubati on 27 Mar 2020
Training Set: this data set is used to adjust the weights on the neural network.
Validation Set: this data set is used to minimize overfitting, and adjust the weights to retrain.
Testing Set: this data set is used only for testing the final solution in order to confirm the actual predictive power of the network
Test error is consistently higher than training error: if this is by a small margin, and both error curves are decreasing with epochs, it should be fine. However if your test set error is not decreasing, while your training error is decreasing alot, it means you are over fitting severely.
I dont think you have to be concerned about comparing Validation and Testing Errors. You should be comparing Training Error Vs Validation Error and Training Error Vs Testing Error.
Hope this helps!

  1 Comment

Sign in to comment.

Sign in to answer this question.