CS_ALearn/deep-rl-class
1
0
Fork 0
mirror of https://github.com/huggingface/deep-rl-class.git synced 2026-04-02 10:10:15 +08:00
Code Issues Projects Releases Wiki Activity

Update bellman-equation.mdx

Browse Source
This commit is contained in:
Thomas Simonini
2022-12-20 14:05:29 +01:00
committed by GitHub
parent beaef9b0a4
commit 3bdc44cd35
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
units/en/unit2/bellman-equation.mdx
View File

@@ -58,6 +58,6 @@ But you'll study an example with gamma = 0.99 in the Q-Learning section of this
To recap, the idea of the Bellman equation is that instead of calculating each value as the sum of the expected return, **which is a long process.** This is equivalent **to the sum of immediate reward + the discounted value of the state that follows.**
To recap, the idea of the Bellman equation is that instead of calculating each value as the sum of the expected return, **which is a long process.**, we calculate the value as **the sum of immediate reward + the discounted value of the state that follows.**
Before going to the next section, think about the role of gamma in the Bellman equation. What happens if the value of gamma is very low (e.g. 0.1 or even 0)? What happens if the value is 1? What happens if the value is very high, such as a million?