Target update frequency paper in ICML 2026

Our paper „The Role of Target Update Frequencies in Q-Learning“ was accepted at ICML! The paper, based on the Masters thesis of Tilman Aach, rigorously analyses the target network trick of DeepMind's famous DQN paper. We show in the tabular setting, how decreasing update frequencies can improve the learning