Neural Networks That Forget: The Promise of Lifelong Learning Without Catastrophic Forgetting
Introduction One of the most remarkable traits of human intelligence is the ability to learn continuously, accumulating knowledge and adapting to new environments without forgetting what was previously learned. Traditional artificial neural networks, however, lack this flexibility. When trained sequentially on different tasks, these networks tend to forget earlier tasks in favor of the most …