How to Convert Entity Attribute Buses into Signal for RL Agent Observation Input?

3 views (last 30 days)
Dear Matlab Simulink Experts,
I am having troubles with my model, right now I have designed a model to emulate a single part that goes through operations and maintenance procedures. I am utilizing bus elements in an entity generator, the next step of my model is to connect the intended output of the model from entity server 'damage' to an observation input port of the RL agent block. The RL agent block will then produce an output through the action port, connected again to an option of entity servers. How do I convert and entity attribute into a signal that the RL agent can receive, and vice versa, how do I revert back the signal into an entity attribute, after the RL agent has made its decision? Or what are other options other than converting entities to signal?
The attempts I have made were using a signal conversion block, and a Matlab function block, but my efforts hasn't been rewarding so far.
Your help would be very much appreciated. Attached are my files:
  • ModelV1.slx (the simulink model)
  • BusProfile.mat (the bus elements containing the entity attribute)
  • initialize.m (to initialize the bus editor)
  • RLScriptV4.mlx (the Reinforcement Learning script)
And this is the error generated:
Thank you in advance.

Accepted Answer

Laurent Royer
Laurent Royer on 18 Jul 2024
Hi Aaron,
To convert an entity attribute into a signal, you can use a Simulink function. For example, to get the D attribute as a signal:
Add a Simulink Function "getD" as below:
This Simulink Function simply contains:
And you call it from your server complete action, see the last command below:
  7 Comments
Laurent Royer
Laurent Royer on 24 Jul 2024
I think there's an algebraic loop that you should break. Try inserting a Memory block just before the Simulink function getAction.
Aaron Bramhasta
Aaron Bramhasta on 29 Jul 2024
Hi Laurent,
Thank you for your reply, your solution worked!
The RL Agent was able to implement the actions onto the SimEvents blocks, although the results are not what I expected as I would get from a dry model (with SimEvents only and without RL), but I will find out why the results differ.
Once again, thank you for your time, consideration, and expertise, it is very much appreciated.
Best,
Aaron.

Sign in to comment.

More Answers (0)

Categories

Find more on Discrete-Event Simulation in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!