Lucid Dreaming for Experience Replay: Refreshing Past States with the Current Policy
arXiv Preprint Archive September 29, 2020 Yunshu Du, Garrett Warnell, Assefaw Gebremedhin et al.
Experience replay (ER) improves the data efficiency of off-policy reinforcement learning (RL) algorithms by allowing an agent to store and reuse its past experiences in a replay buffer. While many techniques have been proposed to enhance ER by biasing how experiences are sampled from the buffer, thus far they have not considered strategies for refreshing experiences inside the buffer. In this...