What is in a reinforcement learning saved agent .mat file

조회 수: 4 (최근 30일)
Michael Ciriacy
Michael Ciriacy 2021년 5월 24일
I am working with reinforcement learning in Simulink and MATLAB to perform continuous feedback control of a dynamic system. The saved agent files are very large after training on my model, and I was wondering what information is actually being saved in this file. Is there a way of looking at what is actually saved in the saved agent .mat file after training?

답변 (1개)

Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2021년 5월 28일
편집: Emmanouil Tzorakoleftherakis 2021년 5월 28일
Why don't you load the file and check? When you saved the agen tin the .mat file, did you save anything else with it? Are you maybe saving a large experience buffer with the agent?
Another thing to consider is that along with the agent, some training data is also saved to be able to recreate training results post training. This additional data also contains any logged signals from Simulink/Simscape. I would recommend turning off signal logging and checking the size of the mat file again.
  댓글 수: 4
Michael Ciriacy
Michael Ciriacy 2021년 6월 3일
편집: Michael Ciriacy 2021년 6월 3일
After shutting off the signal logging in the Simulink model the size of the agent is still increasing about 16,000 KB per episode. This did help but is there anything else that could help decrease the size of the saved agent files? I would also like to know what else is being saved in the agent file at the end of the episode if that is possible. I am working with a model that could take a large amount of episodes so I would like to keep the saved agent as small as possible for a large number of episodes.
Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2021년 6월 3일
How big are the neural networks you are using?

댓글을 달려면 로그인하십시오.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by