Working with LSTM and Bayes Optimization
조회 수: 13 (최근 30일)
이전 댓글 표시
I am trying to use bayesoptimization to tune the parameters
optimvars = [
optimizableVariable('InitialLearnRate',[1e-2 1],'Transform','log')
optimizableVariable('L2Regularization',[1e-10 1e-2],'Transform','log')];
layers = [ ...
sequenceInputLayer(inputSize,'Normalization','zscore')
bilstmLayer(numHiddenUnits,'OutputMode','last')
fullyConnectedLayer(numClasses)
softmaxLayer
classificationLayer];
maxEpochs =25;
options = trainingOptions('adam',...
'ExecutionEnvironment','cpu',...
'GradientThreshold',1,...
'MaxEpochs',maxEpochs,...
'MiniBatchSize',miniBatchSize, ...
'SequenceLength', 'longest', ...
'Shuffle','every-epoch', ...
'Verbose', 1, ...
'InitialLearnRate',optimvars.InitialLearnRate,...
'L2Regularization',optimvars.L2Regularization,...
'Plots','training-progress');
objFcn = makeObj(Xtrain,YTrain);
bayesObj = bayesopt(objFcn,optimvars, ...
'MaxTime', 14*60*60, ...
'IsObjectiveDeterministic',false,...
'UseParallel',false);
Where am i going wrong as i get the following error:
Unrecognized method, property, or field 'InitialLearnRate' for class 'optimizableVariable'.
Error in AllVsIndx (line 236)
'InitialLearnRate',optimvars.InitialLearnRate,...
The documentation regarding bayesian optimization is very vague especially when it comes to implementation with LSTM networks
Any help would be appreciated
Thanks
댓글 수: 0
채택된 답변
Jorge Calvo
2021년 5월 27일
If you have R2020b or later, you can use the Experiment Manager app to run Bayesian optimization to determine the best combination of hyperparameters. For more information, see https://www.mathworks.com/help/deeplearning/ug/experiment-using-bayesian-optimization.html.
추가 답변 (2개)
Don Mathis
2020년 2월 25일
You might find this similar example useful: https://www.mathworks.com/matlabcentral/answers/457788-lstm-time-series-hyperparameter-optimization-using-bayesian-optimization?s_tid=answers_rc1-2_p2_MLT
댓글 수: 0
Jorge Calvo
2021년 10월 5일
I thought you would like to know that, in R2021b, we are included an example for training long short-term memory (LSTM) networks using Bayesian optimization in Experiment Manager:
I hope you find it helpful!
참고 항목
카테고리
Help Center 및 File Exchange에서 Problem-Based Optimization Setup에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!