Start ordering with Uber Eats

Order now
AI, Engineering

Incremental Few-Shot Learning with Attention Attractor Networks

October 6, 2019 / Global

Abstract

This paper addresses the problem, incremental few-shot learning, where a regular classification network has already been trained to recognize a set of base classes; and several extra novel classes are being considered, each with only a few labeled examples. The model is then evaluated on the overall performance of both base and novel classes. To this end, we propose a meta-learning model, the Attention Attractor Network, which regularizes the learning of novel classes. In each episode, we train a set of new weights to recognize novel classes until they converge. We demonstrate that the learned attractor network can recognize novel classes while remembering old classes, outperforming baselines that do not rely on an iterative optimization process.

Authors

Mengye Ren, Renjie Liao, Ethan Fetaya, Richard S. Zemel

Conference

Meta Learning workshop @ NeurIPS 2018

Full Paper

‘Incremental Few-Shot Learning with Attention Attractor Networks’ (PDF)

Uber ATG