I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
조회 수: 1 (최근 30일)
이전 댓글 표시
嘻嘻
2023년 11월 6일
댓글: Emmanouil Tzorakoleftherakis
2023년 11월 9일
I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
댓글 수: 0
채택된 답변
Emmanouil Tzorakoleftherakis
2023년 11월 8일
Think of it as how often you need the agent to make decisions. Sometimes you need to make decisions very frequently (e.g. if your system dynamics are fast) and sometimes not. Could be viewed as the equivalent of a controller rate.
The smaller ts is, the more frequently the agent will make decisions, but that will make training much slower. On the other hand, if ts is large, training may progress faster, but depending on your system it may not converge.
Hope this helps
댓글 수: 3
Emmanouil Tzorakoleftherakis
2023년 11월 9일
You should be able to use a single agent for this application. However, since you already have a model of the system, I would first try with a model-based controller like MPC.
추가 답변 (0개)
참고 항목
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!