is generatePolicyFunction still not supported for agents with RNN

조회 수: 2 (최근 30일)
Mohammed AlSaba
Mohammed AlSaba 2023년 9월 16일
답변: Dhruv 2023년 9월 20일
is generatePolicyFunction still not supported for agents with RNN for C++ hardware deployment and is there a solution?

채택된 답변

Dhruv
Dhruv 2023년 9월 20일
The ‘generatePolicyFunction’ is not supported for agents with RNN (Recurrent Neural Network) when it comes to C++ hardware deployment. For detailed information, you can refer to the documentation available: https://in.mathworks.com/help/releases/R2023a/reinforcement-learning/ug/deploy-trained-reinforcement-learning-agents.html
The documentation explicitly mentions in paragraph two that " Code generation is not supported for continuous actions PG, AC, PPO, and SAC agents using a recurrent neural network (RNN)."
If your agent relies on an RNN architecture, it is important to note that it may not be directly deployable using 'generatePolicyFunction' for C++ hardware deployment.
In such cases, a potential workaround could involve switching to a feedforward neural network, even though RNNs are generally better suited for sequential data. However, this may be a feasible option if your task is relatively straightforward.

추가 답변 (0개)

카테고리

Help CenterFile Exchange에서 Deep Learning Toolbox에 대해 자세히 알아보기

제품


릴리스

R2023a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by