TransWikia.com

Should I save DQN parameters for performance spikes?

Data Science Asked by GeV on April 24, 2021

I am currently running a DQN on the Atari Breakout OpenAI Gym. Over time the total number of points per episode is increasing, but occasionally the performance spikes to achieve 200+ points on a single episode:

Performance Spike

Should I capture the params for this specific run and call it a day, or is this anomalous and I’m missing something? In general, should additional code always be written to capture spikes like this?

I’m using BreakoutNoFrameskip-v4. Is something about the game random, such that this won’t generalize and play well for other runs?

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP