MATLAB Answers

Reinforcement learning with Simulink and Simscape

4 views (last 30 days)
David David
David David on 10 Jun 2021
improving control of physical systems with Reinforcement learning is tempting and might lead to real improvements.
If we considere a physical domain like Thermal for example, reinforcement learning would require to build a model to achieve offline training.
Are there limitations that would prevent the use of Simulink+Simscape to do this (algebraic loop issues for example)?

Answers (1)

Emmanouil Tzorakoleftherakis
Even outside the thermal domain, you most likely need to start with a simulation model. RL does not need to build that model necessarily (e.g. model-free methods).
You can certainly use Reinforcement Learning Toolbox with Simulink and Simscape without issues, assuming you have a Simulinm model that simulates without errors outside of RL. You may still run into algebraic loops depending on the problem, but these do not prevent you from applying RL (quick fix is to try adding a delay).

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!