GH
Backpropagation and deep learning
Hinton co-authored the 1986 Nature paper that made backpropagation widely known, and in 2006 showed how networks with many layers could be trained. His Toronto group built AlexNet in 2012, the result that turned computer vision towards deep learning.
He left Google in May 2023 after about a decade there, saying he wanted to talk about the risks of AI without worrying about how it affected Google's business.
Honours Turing Award 2018 (with Bengio and LeCun) · Nobel Prize in Physics 2024 (with John Hopfield)
Also sourced from Nobel Prize press release, 2024 · AP on leaving Google, May 2023
In the History of AI Backpropagation, 1986 · Deep belief networks, 2006 · AlexNet, 2012
YB
Neural language models and AI safety
Bengio's 2003 paper on a neural probabilistic language model introduced the idea of learning word representations inside a network that predicts text, an ancestor of today's language models. He founded the Mila institute in Montréal.
In October 2025 Mila reported that he had become the first living scientist to pass one million citations on Google Scholar. In June 2025 he launched LawZero, a nonprofit lab building AI systems designed to be safe.
Honours Turing Award 2018 (with Hinton and LeCun)
Also sourced from Mila, one million citations, October 2025 · SiliconANGLE on LawZero, June 2025
In the History of AI Deep belief networks, 2006
YL
Convolutional neural networks
LeCun developed convolutional neural networks, which learn to recognise patterns in images, and used them to read handwritten digits on cheques. The design underlies most computer vision systems built since.
He was the founding director of Meta's FAIR research lab and later its chief AI scientist. In November 2025 he confirmed he was leaving Meta to start a company built on his “advanced machine intelligence” research agenda: systems that understand the physical world, remember and plan.
Honours Turing Award 2018 (with Hinton and Bengio)
Also sourced from The Decoder on leaving Meta, November 2025
In the History of AI AlexNet, 2012
JS
Long short-term memory (LSTM)
With Sepp Hochreiter, Schmidhuber co-authored the 1997 paper introducing long short-term memory, a kind of recurrent network that can carry information across long sequences. LSTMs powered speech recognition and machine translation for much of the 2010s.
He has argued publicly that the field under-credits earlier work, including his own lab's, which makes him one of its most outspoken voices on the history of AI.
SH
The vanishing gradient problem and LSTM
As a student in 1991, Hochreiter analysed why deep and recurrent networks struggled to learn: error signals shrink as they pass back through many steps, the vanishing gradient problem. His answer, developed with Jürgen Schmidhuber, was long short-term memory, published in 1997.
LSTM became one of the most widely used neural network designs before Transformers took over.