Reinforcement Learning 2
This lecture (5 ECTS) continues the lecture reinforcement learning from the previous semester. We fill gaps (such as Lai-Robbins lower bounds for bandits) that were left and discuss further topics (such as MCTS, ODE method for stochastic approximation,...).
Why is reinforcement learning useful?
Reinforcement learning is a type of machine learning that involves training an agent to make a sequence of decisions in an environment in order to maximize a reward. It is often used to control complex, dynamic systems or to optimize performance. Some applications of reinforcement learning include:
- Robotics: Reinforcement learning can be used to teach robots how to perform tasks by rewarding successful execution and punishing mistakes.
- Financial markets: Reinforcement learning can be used to develop trading strategies by learning how to take advantage of market conditions.
- Games: Reinforcement learning has been successfully used to control computer games by learning how to play against human or other computer opponents.
- Web optimization: Reinforcement learning can be used to optimize websites by learning how to control traffic on the site in order to achieve certain goals.
Overall, reinforcement learning offers a way to optimize complex systems by learning how to act in certain situations in order to maximize rewards.
Attention: This text was written by chatGPT, an AI tool based on reinforcement learning (RL) itself (and transformer networks). I do not quite agree with chatGPT, financial markets seem not be very well suited to ML methods. Anyways, as we will cross RL in our future lives in manifold occasions it will be useful to know how RL works.
Target group
Students from the study programs Mathematics, WiMa, WiFo, MMDS. We will cover the mathematical background of reinforcement learning, coding (in python) will be part of the exercises.
Team
Prof. Dr. Leif Döring, Prof. Dr. Mathias Staudigl, Prof. Dr. Simon Weißmann
Lecture notes
Further reading
Sutton & Barto: “Reinforcement Learning – an Introduction” is available online. This covers all major ideas but skipps essentially all details. In essence, this lecture course follows the core ideas of Sutton & Barto but tries to include as much of the missing mathematics as possible.