CS_ALearn/deep-rl-class
1
0
Fork 0
mirror of https://github.com/huggingface/deep-rl-class.git synced 2026-04-13 17:09:45 +08:00
Code Issues Projects Releases Wiki Activity

Merge pull request #348 from DhruvAwasthi/patch-2

Browse Source 
Fix symbol: Update clipped-surrogate-objective.mdx
This commit is contained in:
Thomas Simonini
2023-06-26 10:15:42 +02:00
committed by GitHub
parent 686baa4869 15681be324
commit 26cfa25eb7
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
units/en/unit8/clipped-surrogate-objective.mdx
View File

@@ -60,7 +60,7 @@ To do that, we have two solutions:
<img src="https://huggingface.co/datasets/huggingface-deep-rl-course/course-images/resolve/main/en/unit9/clipped.jpg" alt="PPO"/>
This clipped part is a version where rt(theta) is clipped between \\( [1 - \epsilon, 1 + \epsilon] \\).
This clipped part is a version where \\( r_t(\theta) \\) is clipped between \\( [1 - \epsilon, 1 + \epsilon] \\).
With the Clipped Surrogate Objective function, we have two probability ratios, one non-clipped and one clipped in a range between \\( [1 - \epsilon, 1 + \epsilon] \\), epsilon is a hyperparameter that helps us to define this clip range (in the paper \\( \epsilon = 0.2 \\).).