Is it possible to train LSTM Network without a Dataset?

조회 수: 1 (최근 30일)
Huzaifah Shamim
Huzaifah Shamim 2020년 7월 23일
편집: Huzaifah Shamim 2020년 7월 27일
In the following paper, they utilize Reinforcement Learning and within it, also use an LSTM network. On page 3, they say that they use some kind of loss function that allows the training of the LSTM network without a dataset. I was wondering how that could be possible? If someone could explain, I would greatly appreciate it.

채택된 답변

Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2020년 7월 27일
In the paper they mention "Although a readily available dataset is required to train an LSTM network, we devised an efficient way to tackle this challenge utilizing the experiences stored in the replay memory of the Q-network".
This is how training works with experience buffers in RL - you don't have data at the beginning, then you run simulations and store the data you collect in the experience buffer, which you are then using to train the policy. So the data is not "readily available" but you are still sing your experience buffer.
  댓글 수: 1
Huzaifah Shamim
Huzaifah Shamim 2020년 7월 27일
편집: Huzaifah Shamim 2020년 7월 27일
So is there a way in MATLAB for me to take the data collected in the experience buffer and input it into the LSTM network as I would like to replicate that aspect of the paper? Or would I have to add a lstmlayer somewhere in the following code to take care of that?
%% Setting Up DQN
hiddenLayerSize1 = 128;
hiddenLayerSize2 = 64;
DQNetwork = [
imageInputLayer([N_cols 1 1],'Normalization','none','Name','Binary Vector')
fullyConnectedLayer(hiddenLayerSize1,'Name','fc1')
% reluLayer('Name','CriticReLu1')
fullyConnectedLayer(hiddenLayerSize2,'Name','fc2')
% reluLayer('Name','CriticReLu2')
fullyConnectedLayer(2, 'Name', 'Val Corresponding to Action')
];

댓글을 달려면 로그인하십시오.

추가 답변 (0개)

카테고리

Help CenterFile Exchange에서 Sequence and Numeric Feature Data Workflows에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by