Emmanouil Tzorakoleftherakis

Last seen: Today

MathWorks

207 total contributions since 2018

Emmanouil Tzorakoleftherakis's Badges

Answered
Elements problem due to the deep learning toolbox 'Predict'
Hello, I see the problem. Typically, RL policies have post-processing part, which may vary from agent to agent, and the Predict...

3 dagar ago | 0

| accepted

Answered
Using RL, How to train multi-agents such that each agent will navigate from its initial position to goal position avoiding collisions?
It's possible that the scenario you described can be solved by training a single agent, and then "deploying" that trained agent ...

3 dagar ago | 0

Answered
Question regarding DDPG PMSM FOC control example
All RL agents in Reinforcement Learning Toolbox operate at fixed discrete-time intervals by default. However, you do not need to...

3 dagar ago | 0

Answered
Reinforcement Learning Using Action as Time series command
Let me make sure I understand the question: the RL Agent action is to close the gripper or not, but you want this action to be p...

3 dagar ago | 0

Answered
C code generation for reinforcement learning agent in Simliunk 2019b
I believe C code generation is not supported in 19b (only C++). Even if C++ works for you, that would require building one of th...

3 dagar ago | 0

| accepted

Answered
How to extract neural network of reinforcement learning agent?
For critics: criticNet = getModel(getCritic(trained_agent)) For actors actorNet = getModel(getActor(trained_agent)) Note tha...

3 dagar ago | 0

| accepted

Answered
How to set DQN network to approach Q0 ?
There is no single answer here that will get the training to work. My first instict would be to go for a simpler architecture wi...

3 dagar ago | 1

| accepted

Answered
Is it possible 'LSTM net' to be the env of reinforcement learning?
Hello, Looks like your environment is in MATLAB (i.e. not in Simulink). There is not restriction on using an LSTM as an environ...

7 dagar ago | 0

| accepted

Answered
How can we reduce the overshoot in a controller trained with reinforcement learning while it is tracking a square wave.
Hello, It's all about the reward signal in RL. It's not like with PIDs where you can play with gains and you know from theory w...

7 dagar ago | 0

Submitted

Playing Pong® with deep reinforcement learning
Train a reinforcement learning agent to play a variation of Pong®

7 dagar ago | 7 downloads |

Answered
Enforce action space constraints within the environment
If the environment is in Simulink, you can setup scopes and observe what's happening during training. If the environment is in M...

12 dagar ago | 0

Answered
why I get a different action result every new time with same sample observations after deploying trained RL policies?
Which agent are you using? Some agents are stochastic, meaning that the output is sampled based on probability distributions so ...

13 dagar ago | 0

| accepted

Answered
Epsilon greedy algorithm and environment reset do not work during DQN agent training
Hello, Here are some comments: 1.The reset function should not produce the same output. You should first doublecheck the reset...

13 dagar ago | 0

| accepted

Answered
Mix of static and dynamic actions for a Reinforcement Learning episode
Hello, I am not sure the approach you mention would work, since even if you constrain the constant action, the agent will still...

13 dagar ago | 0

Answered
Problems in using Reinforcement Learning Agent
Hello, I am assuming you have seen this example already? Seems similar. I don't see the script where you set up DDPG but there ...

13 dagar ago | 0

Answered
How to simulate saved agents?
Hello, Righ-click on the 'Agents' folder from within MATLAB and add it to path (or use addpath). Then load Agent1.mat xpr = s...

13 dagar ago | 0

Answered
Simulating environment while Training rlAgent
I can interpret your question in 3 ways so I will put my thoughts here and hopefully they will be sufficient. 1) Depending on t...

17 dagar ago | 0

Answered
How do I specify multiple, heterogeneous actions for the rl.env.MATLABEnvironment of the Reinforcement learning toolbox or another way, if there is one?
Hello, I probably don't understand your objective but the two actions you mention above (distance and speed) are still scalars....

18 dagar ago | 0

| accepted

Answered
How can I create a simulation environment with reinforcement learning?
rlFunctionEnv can be used to create an environment where the dynamics are in a MATLAB function. You could also create an environ...

18 dagar ago | 0

Answered
Reinforcement Learning Grid World multi-figures
Hello, I wouldn't worry about the spikes as long as the average reward has converged. Could be the agent exploring something. ...

20 dagar ago | 0

| accepted

Answered
Reinforcement Learning Toolbox Example Ball Balancing
Hello, This example was created as part of a tutorial for IROS 2020. The example files are here, in folder #3. Hope this helps...

20 dagar ago | 0

| accepted

Answered
How can I use the different Target Smooth Factor in actor and critic network? (Reinforcement Learning Toolbox)
Hello, This is not currently possible, but I have let the development team know and they will look into it. Thanks for bringin...

20 dagar ago | 0

Answered
Episode Q0 increases exponentially
Hello, Please take a look at this answer for some suggestions. Normalizing observations, rewards, and actions can also help avo...

20 dagar ago | 0

Answered
How GAE calculates in Reinforement Learning Toolbox(PPO)?
Hello, Thank you for catching this typo - it should be Gt = Dt+V. I have let the documentation team know.

20 dagar ago | 0

| accepted

Answered
Get observation of final episode of RL agent
Do you want to save the observations in the last time step of the final episode? Or all the observations shown in the final epis...

23 dagar ago | 1

Answered
Problem using scalingLayer for shifting actor outputs to desired range
If you remove ',...' from the 'tanh' row the error goes away. The way you have it now, you are adding the scaling layer in the s...

23 dagar ago | 0

| accepted

Answered
Prediction of NOx emissions by using the cylinderpressure curves of an internal combustion engine
This sounds like a supervised learning problem with time dependencies in which case I would recommend working with LSTMs and Dee...

27 dagar ago | 0

Answered
RL toolbox train on continuous simulation with delay between episodes
Hi Joe, I believe the setup you mention may be possible but it will require some work.Essentially, you need to set up training ...

27 dagar ago | 0

Answered
Hybrid reinforcement learning and traditional control environment
Hello, You can put the RL Agent block in an enabled subsystem and use the desired condition to indicate when to use RL and when...

27 dagar ago | 0

Answered
Reinforcement Learning : MaxSumWordLength is 65535 bits and a minimum word length of 65536 bits is necessary so that this sum or difference can be computed with no loss of precision - ( 'rl.simulink.blocks.AgentWrapper' )
It's a bit hard to find the cause of the error without a reproduction model, but based on the error you are seeing, I would chec...

27 dagar ago | 1