Main Content

Simulink Environments

Model reinforcement learning environment dynamics using Simulink® models

In a reinforcement learning scenario, the environment models the dynamics with which the agent interacts. The environment:

  1. Receives actions from the agent

  2. Outputs observations resulting from the dynamic behavior of the environment model

  3. Generates a reward measuring how well the action contributes to achieving the task

You can create predefined and custom environments using Simulink models. For more information, see Create Simulink Reinforcement Learning Environments.

Functions

expand all

rlPredefinedEnvCreate a predefined reinforcement learning environment
rlSimulinkEnvCreate reinforcement learning environment using dynamic model implemented in Simulink
createIntegratedEnvCreate Simulink model for reinforcement learning, using reference model as environment
validateEnvironmentValidate custom reinforcement learning environment
SimulinkEnvWithAgentReinforcement learning environment with a dynamic model implemented in Simulink
generateRewardFunctionGenerate a reward function from control specifications to train a reinforcement learning agent
exteriorPenaltyExterior penalty value for a point with respect to a bounded region
hyperbolicPenaltyHyperbolic penalty value for a point with respect to a bounded region
barrierPenaltyLogarithmic barrier penalty value for a point with respect to a bounded region
rlFiniteSetSpecCreate discrete action or observation data specifications for reinforcement learning environments
rlNumericSpecCreate continuous action or observation data specifications for reinforcement learning environments
getActionInfoObtain action data specifications from reinforcement learning environment or agent
getObservationInfoObtain observation data specifications from reinforcement learning environment or agent
bus2RLSpecCreate reinforcement learning data specifications for elements of a Simulink bus

Blocks

RL AgentReinforcement learning agent

Topics

Create Simulink Reinforcement Learning Environments

Model environment dynamics using a Simulink model that interacts with the agent, generating rewards and observations in response to agent actions.

Create Simulink Environments for Reinforcement Learning Designer

Import a custom Simulink environment or create a predefined Simulink environment.

Define Reward Signals

Create a reward signal that measures how successful the agent is at achieving its goal.

Load Predefined Simulink Environments

Load predefined Simulink control system environments.

Water Tank Reinforcement Learning Environment Model

Create a reinforcement learning Simulink environment that contains an RL Agent block in place of a controller for the water level in a tank.