Catastrophic Forgetting

One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic Forgetting

This work addresses the catastrophic forgetting problem in one-shot neural architecture search by treating supernet training as a constrained optimization problem. The proposed method uses a novelty search-based architecture selection approach to …