CS_ALearn/deep-rl-class
1
0
Fork 0
mirror of https://github.com/huggingface/deep-rl-class.git synced 2026-05-16 13:55:52 +08:00
Code Issues Projects Releases Wiki Activity

Merge pull request #395 from PierreCounathe/pierrecounathe/unit-2-frozenlake-observation-space

Browse Source 
Unit 2 Correct FrozenLake's observation space
This commit is contained in:
Thomas Simonini
2023-09-13 11:27:16 +02:00
committed by GitHub
parent fae7b9e4fb a14476a265
commit 94c0a413dd
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
units/en/unit2/hands-on.mdx
View File

@@ -247,7 +247,7 @@ print("Observation Space", env.observation_space)
print("Sample observation", env.observation_space.sample()) # Get a random observation
```
We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * nrows + current_col (where both the row and col start at 0)**.
We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * ncols + current_col (where both the row and col start at 0)**.
For example, the goal position in the 4x4 map can be calculated as follows: 3 * 4 + 3 = 15. The number of possible observations is dependent on the size of the map. **For example, the 4x4 map has 16 possible observations.**