First steps in reinforcement learning towards continual learning and transfering knowledge to new domains.

Still restricted to compatible source and task domains.


Learning to solve complex sequences of tasks—while both leveraging transfer and
avoiding catastrophic forgetting—remains a key obstacle to achieving human-level
intelligence. The progressive networks approach represents a step forward in this
direction: they are immune to forgetting and can leverage prior knowledge via
lateral connections to previously learned features. We evaluate this architecture
extensively on a wide variety of reinforcement learning tasks (Atari and 3D maze
games), and show that it outperforms common baselines based on pretraining and
finetuning. Using a novel sensitivity measure, we demonstrate that transfer occurs
at both low-level sensory and high-level control layers of the learned policy.

Click here to read the research.

 

 

 

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s