photo

ryunosuke tazawa


Last seen: 6 months ago |  Active since 2021

Followers: 0   Following: 0

Statistics

All
  • Thankful Level 2
  • Solver
  • Thankful Level 1
  • Explorer

View badges

Feeds

View by

Question


How to plot heat map on the trajectory?
I want to create a heat map from trajectory data. In the code below, xLo and yLo are trajectory data. (Strictly speaking, it is ...

1 year ago | 0 answers | 0

0

answers

Question


How to get the policy function?
I did simulation with pendulum in Reinforcement learning. After that, I would like to find a policy function of the post -learn...

2 years ago | 1 answer | 0

1

answer

Question


how to applay heatmap for trajectory line?
I want to know how to heatmap line on trajectory(x-y corrdinate)? How can I deal with duplicate data? %% フラクタル次元結果　ヒートマップで描画...

2 years ago | 0 answers | 0

0

answers

Question


How to estimate the fractal dimension of each data point？
I used the Em algorithm to perform point-dimensional estimation and estimated the following parameters. The input is the distan...

2 years ago | 0 answers | 0

0

answers

Question


Reinforcement learning and Paralle computation
I am condcting reinforcement learning with Sac agent. I tried to use GPU and Parallel computation, but in case of using paralle...

2 years ago | 0 answers | 0

0

answers

Question


Suddenly the reward value goes wrong
We are conducting reinforcement learning for two joint controllers. Reinforcement learning method is soft actor critic. The er...

2 years ago | 0 answers | 1

0

answers

Question


How to load pre trained agent model and simulation by using it?
I wanna do simulation by using pre trainned model(agnet). How should I do ? And Is there a way to check if I can use the train...

2 years ago | 0 answers | 0

0

answers

Question


What is Newton's method when there is a lot of input?
I am trying to estimate 3parameters of mixed weibull distribution. And I think the Nweton method for it. But, error happend '...

2 years ago | 1 answer | 0

1

answer

Question


Index exceeds the number of array elements. Index must not exceed 0.
Now I make code which estimate Correlation dimension．But ,error happed 「 Index exceeds the number of array elements. Index mu...

2 years ago | 1 answer | 0

1

answer

Question


How to calculate time delay coordinates？
i want to know the way to calculate the time delay coordinates. I made it . But, if the number of dimensions to be embedded in...

2 years ago | 0 answers | 0

0

answers

Question


How to increase gpu usage?
Now I am doing simulation with reiforcement tool box by using GPU. But, gpu usage can not become high. I checked some points. ...

3 years ago | 1 answer | 0

1

answer

Question


How to make discrete rewards in a continuous state
Is it possible to set a discrete reward in a continuous state? Is it possible to select only one best value from the cumulative...

3 years ago | 0 answers | 0

0

answers

Question


How to compare with the elements before and after
I want know the way to comapre with before element and after element. Please someone tell me. I want to comapare V_Ball(index)...

3 years ago | 1 answer | 0

1

answer

Solved


Times 2 - START HERE
Try out this test problem first. Given the variable x as your input, multiply it by two and put the result in y. Examples:...

3 years ago

Question


What is the relationship between the number of state values and numerical solutions?
If the number of state values is high, the numerical solution (result) should be good. However, even if the numerical solution ...

3 years ago | 0 answers | 0

0

answers

Question


What is the episodeQ0?
What does episode Q0 mean? I know it's the output from the critic, but is this a state-valued function? Also, when episode Q0 ...

3 years ago | 0 answers | 0

0

answers

Question


Is there way to make heatmap with 3variabls?
I have 3 dates and want to make the heatmap with 3datas. z is normalized so that the maximum is 1 and the minimum is 1. Does a...

3 years ago | 1 answer | 0

1

answer

Question


how to solve low-level graphics?
I want to slove the error about low-level graphics. Could you help me? Theta_Theory = linspace(D2, D1, 10000); Velocity_...

3 years ago | 0 answers | 0

0

answers

Question


how to make heatmap smooth?
I want to make heatmap smooth, but cell edge can not be without. Please tell me the way . D1 = rad2deg(-4.71); D2 = rad2deg...

3 years ago | 1 answer | 0

1

answer

Question


How to change the fontsize of labels not axsis.
I want to change the fontsize of labels of x and y. But if I change the font size of the label, the size of the numerical value...

3 years ago | 2 answers | 0

2

answers

Question


How should I call animation from classdef?
I want to know the way to call the animation from classdef. I defined the animatedline in classdef, and I called the animation ...

3 years ago | 1 answer | 1

1

answer

Question


How to get the value of value function in soft actor critic?
I want to know the way to get the value of value function. I am using soft actor critic. Someone tell me the way? % Soft...

3 years ago | 1 answer | 0

1

answer

Question


How to save state in reinforcement learning
I wanna know the way to save information of agent's state in reinforcement learning.

3 years ago | 0 answers | 0

0

answers

Question


How to reward after one simulation.
I have a simple pendulum throw a ball and perform reinforcement learning so that the error from the target point becomes small. ...

3 years ago | 0 answers | 0

0

answers

Question


How to add value to matrix?
I want to add elements to matrix. I want to add the calculated value to the end.　In the code below, I would like to add the ca...

3 years ago | 0 answers | 0

0

answers

Question


How to use isDone frag?
Does isDone frag have the ability to end the episode? I want to do trainning of simplependulum which can move in specific space...

3 years ago | 0 answers | 0

0

answers

Question


How to stop the simulation in one cycle of Simple Pendulum
I made the code of simple pendulum which is moved by trq. However, depending on the amount of torque, it will continue to rotat...

3 years ago | 0 answers | 0

0

answers

Question


How can I drow graph of episodes reward?
I made the cord using by reinforcement learning. I can see the graph of Reinforcement learning episode manager but I want to dr...

3 years ago | 0 answers | 0

0

answers

Question


How to to updata episodes number?
I am making code by reinforcement learning. The purpose of reinforcement learning describes a simple pendulum that throws a bal...

3 years ago | 0 answers | 0

0

answers

Question


How to make it finite?
I want to know the way to fix the erorr. The error masage said that make the value finite. There are four input state variable...

3 years ago | 0 answers | 0

0

answers

Load more