Biological underpinnings for lifelong learning machines
Dhireesha Kudithipudi,Mario Aguilar-Simon,Jonathan Babb,Maxim Bazhenov,Douglas J. Blackiston,Josh C. Bongard,Andrew Brna,Suraj Chakravarthi Raja,Nick Cheney,Jeff Clune,Anurag Reddy Daram,S. Fusi,Peter Helfer,Leslie Kay,Nicholas A. Ketz,Zsolt Kira,Soheil Kolouri,Jeffrey L. Krichmar,Sam Kriegman,Michael Levin,Sandeep Reddy Madireddy,Santosh Manicka,Ali Marjaninejad,Bruce L. McNaughton,Risto Miikkulainen,Zaneta Navratilova,Tej Pandit,Alice Virginia Parker,Praveen K. Pilly,Sebastian Risi,Terrence J. Sejnowski,Andrea Soltoggio,Nicholas Soures,Andreas S. Tolias,Darío Urbina-Meléndez,Francisco J. Valero-Cuevas,Gido M. van de Ven,Joshua T. Vogelstein,Felix Wang,Ron Weiss,Angel Yanguas-Gil,Xinyun Zou,Hava T. Siegelmann +42 more
TL;DR: Kudithipudi et al. as mentioned in this paper identified a set of key capabilities that artificial systems will need to achieve lifelong learning, and discussed pathways to developing biologically inspired approaches for lifelong learning machines.
read more
Abstract: Biological organisms learn from interactions with their environment throughout their lifetime. For artificial systems to successfully act and adapt in the real world, it is desirable to similarly be able to learn on a continual basis. This challenge is known as lifelong learning, and remains to a large extent unsolved. In this Perspective article, we identify a set of key capabilities that artificial systems will need to achieve lifelong learning. We describe a number of biological mechanisms, both neuronal and non-neuronal, that help explain how organisms solve these challenges, and present examples of biologically inspired models and biologically plausible mechanisms that have been applied to artificial systems in the quest towards development of lifelong learning machines. We discuss opportunities to further our understanding and advance the state of the art in lifelong learning, aiming to bridge the gap between natural and artificial intelligence. It is an outstanding challenge to develop intelligent machines that can learn continually from interactions with their environment, throughout their lifetime. Kudithipudi et al. review neuronal and non-neuronal processes in organisms that address this challenge and discuss pathways to developing biologically inspired approaches for lifelong learning machines.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Three types of incremental learning
TL;DR: In this article , the authors describe three fundamental types of continual learning: task-incremental, domain-increasing and class-increasing learning, and provide a comprehensive empirical comparison of currently used continual learning strategies.
A Comprehensive Survey of Continual Learning: Theory, Method and Application
TL;DR: A comprehensive survey of continual learning can be found in this article , where the authors summarize the general objectives of continuous learning as ensuring a proper stability-plasticity trade-off and an adequate intra/inter-task generalizability in the context of resource efficiency.
Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos
B. Baker,Ilge Akkaya,P. A. Zhokhov,Joost Huizinga,Jie Tang,Adrien Ecoffet,Brandon Houghton,Raul Sampedro,Jeff Clune +8 more
- 23 Jun 2022
TL;DR: This work extends the internet-scale pretraining paradigm to sequential decision domains through semi-supervised imitation learning wherein agents learn to act by watching online unlabeled videos, and is the first to report computer agents that can craft diamond tools.
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Liyuan Wang,Xingxing Zhang,Hang Su,Jun Zhu +3 more
TL;DR: A comprehensive survey of continual learning covering theory, method and application. The survey explores the challenges and opportunities associated with continual learning, including catastrophic forgetting and resource efficiency. It also provides a detailed taxonomy of representative strategies and their adaptation to various applications.
133
Battery safety: Machine learning-based prognostics
Jingyuan Zhao,Xuning Feng,Quanquan Pang,Michael Fowler,Yubo Lian,Minggao Ouyang,Andrew F. Burke +6 more
TL;DR: This review explores machine learning-based prognostics for lithium-ion battery safety, covering mechanisms of failure, predictive models, and fault diagnosis techniques, including supervised, unsupervised, and few-shot learning, to enhance battery reliability and prevent catastrophic events.
49
References
The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World
TL;DR: It is proposed that principles of the neuromodulatory system could provide a framework for controlling artificial agents that may improve current artificial agent behavior.
•Proceedings Article
Biologically inspired sleep algorithm for increased generalization and adversarial robustness in deep neural networks
Timothy Tadros,Giri P. Krishnan,Ramyaa Ramyaa,Maxim Bazhenov +3 more
- 30 Apr 2020
TL;DR: The use of a biologically inspired sleep phase in ANNs is utilized and the benefit of sleep on defending against adversarial attacks as well as increasing ANN classification robustness is demonstrated.