Razvan Pascanu

Pascanu helped explain why neural networks struggle to learn long sequences when their training signals fade or grow uncontrollably. He co-developed gradient clipping, which limits oversized training updates, and elastic weight consolidation, which helps models learn new tasks without forgetting earlier ones.