Emmanouil Tzorakoleftherakis
Last seen: 3 days ago
MathWorks
166 total contributions since 2018
Emmanouil Tzorakoleftherakis's Badges
20 of your answers have been accepted
Awarded to Emmanouil Tzorakoleftherakis on 23 Feb 2020
Contribute at least one answer each month for 6 consecutive months
Awarded to Emmanouil Tzorakoleftherakis on 12 Oct 2019
Answer 3 questions that were unanswered for more than 30 days
Awarded to Emmanouil Tzorakoleftherakis on 16 Sep 2019
Provide your first answer ever to someone else's question
Awarded to Emmanouil Tzorakoleftherakis on 08 Jan 2018
Answered
RL: Continuous action space, but within a desired range
Hello, There are two ways to enforce this: 1) Using the upper and lower limits in rlNumericSpec when you are creating the acti...
RL: Continuous action space, but within a desired range
Hello, There are two ways to enforce this: 1) Using the upper and lower limits in rlNumericSpec when you are creating the acti...
7 days ago | 0
Answered
Reinforcement Learning PPO Problem
Hello, Please take a look at how to create the actor and critic networks for continuous PPO here. It seems there is a dimension...
Reinforcement Learning PPO Problem
Hello, Please take a look at how to create the actor and critic networks for continuous PPO here. It seems there is a dimension...
7 days ago | 0
Answered
Warning: An error occurred while drawing the scene: Error in json_scenetree: Could not find node in replaceChild
My suspicion is that the error does not have much to do with the code you are showing but with how you create your environment. ...
Warning: An error occurred while drawing the scene: Error in json_scenetree: Could not find node in replaceChild
My suspicion is that the error does not have much to do with the code you are showing but with how you create your environment. ...
7 days ago | 0
Answered
How to change Agent policy option to continuing update the policy in Reinforcement Learning toolbox?
Hello, Thank you for going over the RL ebooks! This point you mention is a general reference on what you can do after training ...
How to change Agent policy option to continuing update the policy in Reinforcement Learning toolbox?
Hello, Thank you for going over the RL ebooks! This point you mention is a general reference on what you can do after training ...
11 days ago | 0
| accepted
Answered
How do I save Episode Manager training data for *plotting* later
Hi Rajesh, As mentioned in the comment above, if you are using R2020b, you can use >> help rlPlotTrainingResults to recreate...
How do I save Episode Manager training data for *plotting* later
Hi Rajesh, As mentioned in the comment above, if you are using R2020b, you can use >> help rlPlotTrainingResults to recreate...
11 days ago | 1
Answered
Realize MADDPG in Matlab
To create agents that share critics I believe you would have to implement that using a custom agent/training loop (see here and ...
Realize MADDPG in Matlab
To create agents that share critics I believe you would have to implement that using a custom agent/training loop (see here and ...
11 days ago | 0
Answered
Train PPO Agent to Swing Up and Balance Pendulum
I think the fully connected layer in the actor may not have enough nodes (actorLayerSizes is not used anywhere). Regardless, yo...
Train PPO Agent to Swing Up and Balance Pendulum
I think the fully connected layer in the actor may not have enough nodes (actorLayerSizes is not used anywhere). Regardless, yo...
11 days ago | 0
Answered
A mix of rlNumericSpec and rlFiniteSetSpec objects - observation for a RL environment
Hi Krupa, I don't think there is an example that shows how to do that in the documentation right now - I will let the doc team ...
A mix of rlNumericSpec and rlFiniteSetSpec objects - observation for a RL environment
Hi Krupa, I don't think there is an example that shows how to do that in the documentation right now - I will let the doc team ...
11 days ago | 0
| accepted
Answered
problem with simulation trained DRL agent
Hello, Please see this post that goes over a few potential reasons for discrepancies between training results and simulation re...
problem with simulation trained DRL agent
Hello, Please see this post that goes over a few potential reasons for discrepancies between training results and simulation re...
20 days ago | 1
Answered
Invalid observation type or size. error in simulink varies on quantization interval constraining observation signals in Simulink (Reinforcement Learning Toolbox)
Hello, This is likely due to numerical effects of rounding that happens when quantizing (see doc here). When quantization inter...
Invalid observation type or size. error in simulink varies on quantization interval constraining observation signals in Simulink (Reinforcement Learning Toolbox)
Hello, This is likely due to numerical effects of rounding that happens when quantizing (see doc here). When quantization inter...
24 days ago | 0
| accepted
Answered
Global parameters / data store memory with RL agent block Simulink
Not sure what error you are seeing, but if you only need to use the value of the previous time step, I think the Memory block is...
Global parameters / data store memory with RL agent block Simulink
Not sure what error you are seeing, but if you only need to use the value of the previous time step, I think the Memory block is...
25 days ago | 0
Answered
Algebraic loop in vehicle dynamics blockset + RL Agent
Please take a look at this question which is similar. You should be able to remove the algebraic loop by following the methods/l...
Algebraic loop in vehicle dynamics blockset + RL Agent
Please take a look at this question which is similar. You should be able to remove the algebraic loop by following the methods/l...
28 days ago | 0
| accepted
Answered
Is it possible to use the reinforcement learning toolbox in a Simulink/Adams co-simulation?
Hello, You should be able to use Reinforcement Learning Toolbox for cosimulation. It looks like closing the loops with observat...
Is it possible to use the reinforcement learning toolbox in a Simulink/Adams co-simulation?
Hello, You should be able to use Reinforcement Learning Toolbox for cosimulation. It looks like closing the loops with observat...
28 days ago | 1
| accepted
Answered
RL Agent training SimulationInput error
Hello, It looks to me like you are not implementing the localReset function that you assign to the environment. The ACC example...
RL Agent training SimulationInput error
Hello, It looks to me like you are not implementing the localReset function that you assign to the environment. The ACC example...
1 month ago | 0
Answered
The RL Agent block only supports Normal and Accelerator simulation modes.
Hi Mehmet, As I mentioned in the other thread, assuming you want to train your agent in External Model, I believe this is a cur...
The RL Agent block only supports Normal and Accelerator simulation modes.
Hi Mehmet, As I mentioned in the other thread, assuming you want to train your agent in External Model, I believe this is a cur...
1 month ago | 1
| accepted
Answered
Action Clipping and Scaling in TD3 in Reinforcement Learning
Hello, In general, for DDPG and TD3, it is good practice to include the scalingLayer as the last actor layer to scale/shift the...
Action Clipping and Scaling in TD3 in Reinforcement Learning
Hello, In general, for DDPG and TD3, it is good practice to include the scalingLayer as the last actor layer to scale/shift the...
1 month ago | 1
| accepted
Answered
Collaborative DDPG/Actor-Critic Example
Hello, As you noticed, as of R2020b we support (decentralized) multi-agent RL but only in Simulink. We are looking to expand th...
Collaborative DDPG/Actor-Critic Example
Hello, As you noticed, as of R2020b we support (decentralized) multi-agent RL but only in Simulink. We are looking to expand th...
1 month ago | 1
| accepted
Answered
Variable Sample Time in Reinforcement Learning
Hello, The current format of training in Reinforcement Learning Toolbox assumes you are taking actions at fixed time intervals ...
Variable Sample Time in Reinforcement Learning
Hello, The current format of training in Reinforcement Learning Toolbox assumes you are taking actions at fixed time intervals ...
1 month ago | 0
| accepted
Answered
reinforcement learning from scrach
Hello, Depending on whether your environment will be in MATLAB on Simulink, the following links would be a good starting point:...
reinforcement learning from scrach
Hello, Depending on whether your environment will be in MATLAB on Simulink, the following links would be a good starting point:...
1 month ago | 0
Answered
Problem of using DDPG agent in external mode
The root of the error is likely on Reinforcement Learning Toolbox side, not Polyspace. As the last error line mentions, "The R...
Problem of using DDPG agent in external mode
The root of the error is likely on Reinforcement Learning Toolbox side, not Polyspace. As the last error line mentions, "The R...
1 month ago | 0
Answered
Training agent using reinforcement learning
Hello, When you train using historical data, it is often a good idea to break down your dataset in smaller pieces. Then, instea...
Training agent using reinforcement learning
Hello, When you train using historical data, it is often a good idea to break down your dataset in smaller pieces. Then, instea...
1 month ago | 0
Answered
Reinforcement Learning Noise Model Mean Attraction Constant
Assuming you are using DDPG, there is some information on the noise model here. I wouldn't worry too much about the mean attract...
Reinforcement Learning Noise Model Mean Attraction Constant
Assuming you are using DDPG, there is some information on the noise model here. I wouldn't worry too much about the mean attract...
1 month ago | 1
| accepted
Answered
Hyperparameter optimization and saving the best agents for Reinforcement Learning
Hello, You can use something like this. We do not have any examples with Reinforcement Learning Toolbox that show how to use th...
Hyperparameter optimization and saving the best agents for Reinforcement Learning
Hello, You can use something like this. We do not have any examples with Reinforcement Learning Toolbox that show how to use th...
1 month ago | 0
| accepted
Answered
Reinforcement Learning experience buffer length and parallelisation toolbox
Hello, There is one big experience buffer on the host, the size of which you determine as usual in your agent options. Each wor...
Reinforcement Learning experience buffer length and parallelisation toolbox
Hello, There is one big experience buffer on the host, the size of which you determine as usual in your agent options. Each wor...
1 month ago | 0
| accepted
Answered
reinforcement learning agent simulation is not same with training agent
Hello, Please see this post that explains why simulation results may differ during training and after training. One thing to c...
reinforcement learning agent simulation is not same with training agent
Hello, Please see this post that explains why simulation results may differ during training and after training. One thing to c...
2 months ago | 0
Answered
Epsilon-greedy Algorithm in RL DQN
Hello, First off, RL typically solves a complex nonlinear optimization problem. So at the end of the day, you will most certain...
Epsilon-greedy Algorithm in RL DQN
Hello, First off, RL typically solves a complex nonlinear optimization problem. So at the end of the day, you will most certain...
2 months ago | 1
| accepted
Answered
reinforcement learning, 3D simulink model
There is nothing specific you need to do for a 3d Simulink model. You can follow any other Simulink example from Reinforcement L...
reinforcement learning, 3D simulink model
There is nothing specific you need to do for a 3d Simulink model. You can follow any other Simulink example from Reinforcement L...
2 months ago | 0
Answered
How to use GA in Reinforcement Learning instead of Gradient descent?
Hello, Evolutionary RL is not provided out of the box as of now. To use it you would have to implement a custom training loop (...
How to use GA in Reinforcement Learning instead of Gradient descent?
Hello, Evolutionary RL is not provided out of the box as of now. To use it you would have to implement a custom training loop (...
2 months ago | 0
| accepted
Answered
Error using rl.env.SimulinkEnvWithAgent>localHandleSimoutErrors (line 689) (By RL toolbox)
Hello, Based on the attached files, it seems like you are creating a PPO agent but you are creating a Q network for a critic. I...
Error using rl.env.SimulinkEnvWithAgent>localHandleSimoutErrors (line 689) (By RL toolbox)
Hello, Based on the attached files, it seems like you are creating a PPO agent but you are creating a Q network for a critic. I...
2 months ago | 0
Answered
Custom RL environment creation
Hello, Based on the updated files you sent on this post, you are setting this.IsDone, however this is a class variable which is...
Custom RL environment creation
Hello, Based on the updated files you sent on this post, you are setting this.IsDone, however this is a class variable which is...
2 months ago | 0
| accepted
Select a Web Site
Choose a web site to get translated content where available and see local events and offers. Based on your location, we recommend that you select: .
Select web siteYou can also select a web site from the following list:
Americas
- América Latina (Español)
- Canada (English)
- United States (English)
Europe
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)