Lifelong learning with weighted majority votes Conference Paper


Author(s): Pentina, Anastasia; Urner, Ruth
Title: Lifelong learning with weighted majority votes
Affiliation IST Austria
Abstract: Better understanding of the potential benefits of information transfer and representation learning is an important step towards the goal of building intelligent systems that are able to persist in the world and learn over time. In this work, we consider a setting where the learner encounters a stream of tasks but is able to retain only limited information from each encountered task, such as a learned predictor. In contrast to most previous works analyzing this scenario, we do not make any distributional assumptions on the task generating process. Instead, we formulate a complexity measure that captures the diversity of the observed tasks. We provide a lifelong learning algorithm with error guarantees for every observed task (rather than on average). We show sample complexity reductions in comparison to solving every task in isolation in terms of our task complexity measure. Further, our algorithmic framework can naturally be viewed as learning a representation from encountered tasks with a neural network.
Conference Title: NIPS: Neural Information Processing Systems
Conference Dates: December 5-10, 2016
Conference Location: Barcelona, Spain
ISBN: 10495258
Publisher: Neural Information Processing Systems  
Date Published: 2016-12-01
Sponsor: This work was in parts funded by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no 308036.
URL:
Notes: OA available: https://repository.ist.ac.at/id/eprint/775
Open access: yes (repository)
IST Austria Authors
Related IST Austria Work