Validation Loss = Nan

Hello, I'm attempting to utilize lstm to categorize data but the validation loss Is Nan.

I reduced the learning rates to 1e-12 but I am still receiving Nan results.

Appreciate any guidance.

Best Regards,

options = trainingOptions("sgdm", ...
    "MaxEpochs",400, ...
    "InitialLearnRate",0.000000000001, ...
    "Shuffle", 'never', ...
    "Plots","training-progress",...
    "ValidationData",{XValidation,YValidation},...
    'ValidationFrequency',1);

%%

layers = [ ...
    sequenceInputLayer(1)
    bilstmLayer(100,"OutputMode","last")
    fullyConnectedLayer(2)
    softmaxLayer
    classificationLayer];

%  displaySequence(tones_cell{1}, label1{1})

net =  trainNetwork(XTrain,labelTrain, layers, options )
YPred = classify(net,XTest);

[KSSV]

Increase the learning rate and see.

Answer 1

[yanqi liu]

yes，sir，may be add dropoutLayer、batchNormalizationLayer to the model

[aryan ramesh]

I added the dropoutLayer. Tks