CS_ALearn/deep-rl-class
1
0
Fork 0
mirror of https://github.com/huggingface/deep-rl-class.git synced 2026-04-05 03:28:05 +08:00
Code Issues Projects Releases Wiki Activity

Merge pull request #75 from theicfire/main

Browse Source 
Clear up some unneeded and confusing parts of Unit 2
This commit is contained in:
Thomas Simonini
2022-08-16 08:21:44 +02:00
committed by GitHub
parent 262ffd4ac3 f84c511332
commit 366ba14479
1 changed files with 3 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
unit2/unit2.ipynb
View File

@@ -315,7 +315,7 @@
"outputs": [],
"source": [
"# Create the FrozenLake-v1 environment using 4x4 map and non-slippery version\n",
"env = gym.make()"
"env = gym.make() # TODO use the correct parameters"
]
},
{
@@ -344,7 +344,7 @@
"id": "KASNViqL4tZn"
},
"source": [
"You can also custom your own grid using:\n",
"You can create your own custom grid like this:\n",
"\n",
"```python\n",
"desc=[\"SFFF\", \"FHFH\", \"FFFH\", \"HFFG\"]\n",
@@ -389,7 +389,7 @@
"For example, the goal position in the 4x4 map can be calculated as follows: 3 * 4 + 3 = 15. The number of possible observations is dependent on the size of the map. **For example, the 4x4 map has 16 possible observations.**\n",
"\n",
"\n",
"For instance, at this state = 0\n"
"For instance, this is what state = 0 looks like:\n"
]
},
{
@@ -725,7 +725,6 @@
"eval_seed = [] # The evaluation seed of the environment\n",
"\n",
"# Exploration parameters\n",
"epsilon = 1.0 # Exploration rate\n",
"max_epsilon = 1.0 # Exploration probability at start\n",
"min_epsilon = 0.05 # Minimum exploration probability \n",
"decay_rate = 0.0005 # Exponential decay rate for exploration prob"
@@ -1254,7 +1253,6 @@
" \"learning_rate\": learning_rate,\n",
" \"gamma\": gamma,\n",
"\n",
" \"epsilon\": epsilon,\n",
" \"max_epsilon\": max_epsilon,\n",
" \"min_epsilon\": min_epsilon,\n",
" \"decay_rate\": decay_rate,\n",
@@ -1459,7 +1457,6 @@
"gamma = 0.95 # Discounting rate\n",
"\n",
"# Exploration parameters\n",
"epsilon = 1.0 # Exploration rate\n",
"max_epsilon = 1.0 # Exploration probability at start\n",
"min_epsilon = 0.05 # Minimum exploration probability \n",
"decay_rate = 0.005 # Exponential decay rate for exploration prob\n"
@@ -1524,7 +1521,6 @@
" \"learning_rate\": learning_rate,\n",
" \"gamma\": gamma,\n",
"\n",
" \"epsilon\": epsilon,\n",
" \"max_epsilon\": max_epsilon,\n",
" \"min_epsilon\": min_epsilon,\n",
" \"decay_rate\": decay_rate,\n",