diff --git a/README.md b/README.md index b1881a6..035b517 100644 --- a/README.md +++ b/README.md @@ -30,9 +30,10 @@ This course is **self-paced** you can start when you want πŸ₯³. | [Published πŸ₯³](https://github.com/huggingface/deep-rl-class/tree/main/unit4#unit-4-an-introduction-to-unity-mlagents-with-hugging-face-) | [🎁 Learn to train your first Unity MLAgent](https://github.com/huggingface/deep-rl-class/tree/main/unit4#unit-4-an-introduction-to-unity-mlagents-with-hugging-face-) | [Train a curious agent to destroy Pyramids πŸ’₯](https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/unit4/unit4.ipynb) | | [Published πŸ₯³](https://github.com/huggingface/deep-rl-class/tree/main/unit5#unit-5-policy-gradient-with-pytorch) | [Policy Gradient with PyTorch](https://huggingface.co/blog/deep-rl-pg) | [Code a Reinforce agent from scratch using PyTorch and train it to play Pong 🎾, CartPole and Pixelcopter 🚁](https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/unit5/unit5.ipynb) | | [Published πŸ₯³](https://github.com/huggingface/deep-rl-class/tree/main/unit6#towards-better-explorations-methods-with-curiosity) | [Towards better explorations methods with Curiosity](https://github.com/huggingface/deep-rl-class/tree/main/unit6#towards-better-explorations-methods-with-curiosity)| | -| July the 15th | Actor-Critic Methods | πŸ—οΈ | -| July the 21th | Proximal Policy Optimization (PPO) | πŸ—οΈ | -| July the 28th | Decision Transformers and offline Reinforcement Learning | πŸ—οΈ | +| [Published πŸ₯³]() | [Bonus: Robotics Simulations with PyBullet πŸ€–]()| [Train a bipedal walker and a spider to learn to walk](https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/unit7/unit7.ipynb) | +| July the 22th | Actor-Critic Methods | πŸ—οΈ | +| July the 29th | Proximal Policy Optimization (PPO) | πŸ—οΈ | +| August | Decision Transformers and offline Reinforcement Learning | πŸ—οΈ | diff --git a/unit7/README.md b/unit7/README.md new file mode 100644 index 0000000..5c9d95c --- /dev/null +++ b/unit7/README.md @@ -0,0 +1,53 @@ +# Unit 7: Robotics Simulations with PyBullet πŸ€– +One of the major industries that use Reinforcement Learning is robotics. Unfortunately, having access to robot equipment is very expensive. Fortunately, some simulations exist to train Robots: +1. PyBullet +2. MuJoco +3. Unity Simulations + +We're going to use PyBullet today. And train two agents to walk: +- A bipedal walker 🦿 +- A spider πŸ•ΈοΈ + +You'll then be able to **compare your agent’s results with other classmates thanks to a leaderboard** πŸ”₯ πŸ‘‰ https://huggingface.co/spaces/chrisjay/Deep-Reinforcement-Learning-Leaderboard + +IMAGE + +We'll learn to use PyBullet environments and why we normalize input features. + +Let's get started πŸ₯³ + +## Required time ⏱️ +The required time for this unit is, approximately: +- 1 hour for the hands-on. + +## Start this Unit πŸš€ +Here are the steps for this Unit: + +The hands-on πŸ‘‰ [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/unit3/unit3.ipynb) + +The leaderboard πŸ‘‰ https://huggingface.co/spaces/chrisjay/Deep-Reinforcement-Learning-Leaderboard + +## How to make the most of this course + +To make the most of the course, my advice is to: + +- **Participate in Discord** and join a study group. +- **Read multiple times** the theory part and takes some notes +- Don’t just do the colab. When you learn something, try to change the environment, change the parameters and read the libraries' documentation. Have fun πŸ₯³ +- Struggling is **a good thing in learning**. It means that you start to build new skills. Deep RL is a complex topic and it takes time to understand. Try different approaches, use our additional readings, and exchange with classmates on discord. + +## This is a course built with you πŸ‘·πŸΏβ€β™€οΈ + +We want to improve and update the course iteratively with your feedback. **If you have some, please fill this form** πŸ‘‰ https://forms.gle/3HgA7bEHwAmmLfwh9 + +## Don’t forget to join the Community πŸ“’ + +We have a discord server where youΒ **can exchange with the community and with us, create study groups to grow each other and more**Β  + +πŸ‘‰πŸ»Β [https://discord.gg/aYka4Yhff9](https://discord.gg/aYka4Yhff9). + +Don’t forget toΒ **introduce yourself when you sign upΒ πŸ€—** + +❓If you have other questions, [please check our FAQ](https://github.com/huggingface/deep-rl-class#faq) + +### Keep learning, stay awesome πŸ€—