MARL Chapter 9.9: Population-Based Training

About this event

Previous Meeting Recording (https://youtu.be/_BAsCfs4Cr0) This meeting will continue the material from Chapter 9 in Multi-Agent Reinforcement Learning: Foundations and Modern Approaches (https://www.marl-book.com/). In the last meeting we started the discussion of population based training and the double oracle algorithm in the context of zero-sum games. This time, we will dive deeper into the theoretical limits of the algorithm by comparing it to exact solution techniques with tabular stochastic games. We will start with the zero-sum case and minimax solutions where we can compare the oracle to value iteration. If time permits, we will also consider general sum games where we will need to use a meta solver such as WoLF-PHC to solve the metagame. As usual you can find below links to the textbook, previous chapter notes, slides, and recordings of some of the previous meetings. Meetup Links: Recordings of Previous RL Meetings (https://youtube.com/playlist?list=PLYqXmZaxvwmy2CNaK-DLailou1VIU1UZn&si=n6uQm863MCcHuKT7) Recordings of Previous MARL Meetings (https://youtube.com/playlist?list=PLYqXmZaxvwmzikjw-cNyZfI051ms05czB&si=A7-AeX0dcRW67PDB) Short RL Tutorials (https://youtube.com/playlist?list=PLYqXmZaxvwmyLEXMpk-n4RFr59tpJjNXt&si=RHy_FAnOJnPa4p1N) My exercise solutions and chapter notes for Sutton-Barto (https://github.com/jekyllstein/Reinforcement-Learning-Sutton-Barto-Exercise-Solutions) My MARL repository (https://github.com/jekyllstein/MARL_course/tree/main) Kickoff Slides which contain other links (https://docs.google.com/presentation/d/1QD3iw5BgIpPpl_K_ApAlDr1NRseR1WmXme1dKQGqTOg/edit?usp=sharing) MARL Kickoff Slides (https://docs.google.com/presentation/d/1FHXGVWkzjKsnNxzVN-29dx5vdkffAx5Vji5nWrDvg1Y/edit?usp=sharing) MARL Links: Multi-Agent Reinforcement Learning: Foundations and Modern Approaches (https://www.marl-book.com/) MARL Summer Course Videos (https://youtube.com/playlist?list=PLkoCa1tf0XjCU6GkAfRCkChOOSH6-JC_2&si=lEljXo65s3fMUsRC) MARL Slides (https://github.com/marl-book/slides) Sutton and Barto Links: Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto (http://incompleteideas.net/book/the-book.html) Video lectures from a similar course (https://youtube.com/playlist?list=PLqYmG7hTraZDVH599EItlEWsUOsJbAodm)