Nobel Prize

Alumni

Statistical Sciences

Subheadline

Three former students who worked with the "godfather of AI" recall his passionate and playful approach to research

In the wake of Geoffrey Hinton’s 2024 Nobel Prize in Physics, former students and colleagues from the University of Toronto are sharing their favourite anecdotes about the “godfather of AI” – including one involving the classic Atari video game Asteroids.

Nick Frosst (photo by Nina Haikara)

Nick Frosst, a ��TV alumnus and co-founder of generative AI startup Cohere, said Hinton, University Professor Emeritus of computer science, once spoke of an intense, button-mashing session that left him with nerve damage.

“This kind of explains, perhaps, the way in which he types, which is still two fingers at a time,” said Frosst, who began working with Hinton as a ��TV undergraduate student and was his first employee at Google Brain.

He shared the story at a recent event hosted by the department of computer science in the Faculty of Arts & Science, saying it offered a telling glimpse into Hinton’s character.

“It’s that fever-pitched intensity, passion and playfulness that he brings to everything … He found something that was fun and engaging and he played it until it damaged a finger and then he continued to push for it.”

Frosst said he also appreciates Hinton’s thoughtful consideration about the potential negative consequences of the revolutionary technology he helped create and praised him for looking past formal qualifications to spot potential and creativity.

“I don't have a master's degree or a PhD, but he was willing to work with me and I saw that in the types of people he brought into Google Brain to work with him,” Frosst said.

“He took lots of chances on people and gave them the time of day once they were there. And for that, I'll always be thankful and deeply privileged, and honoured, to have him in my life.”

Other former students at ��TV tell similar stories.

Chris Maddison (supplied image)

Chris Maddison, now an assistant professor in ��TV’s departments of computer science and statistical sciences in the Faculty of Arts & Science, was also an undergraduate student when he started working with Hinton in 2011.

He also painted a picture of Hinton’s vibrant office – where everyone knew when he had a new idea.

“The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility,” said Maddison. “He was famous for bursting into a room and pronouncing that, he now finally, after all these years, understood how the brain worked.”

Kevin Swersky (photo by Johnny Guatto)

Kevin Swersky, a research scientist at Google DeepMind, worked with Hinton as a graduate student at ��TV and similarly described visiting Hinton as a memorable academic experience.

“Normally when you go to a supervisor's office, you give them a progress update. You go through what your latest results are, you talk about a couple of your ideas and you get some feedback,” he said.

“Going to Geoff’s office was a completely different story. He would be telling you what his latest idea was. He would show you his latest results. And his whole thing was just that he was really excited about it, and his hope was to inspire you enough to start running with it.”

He added that he was particularly inspired by Hinton’s focus on small, solvable puzzles that would ultimately lead to significant breakthroughs over time.

“Geoff would think completely intuitively – like the universe was a puzzle and he was just kind of figuring out where all the pieces went, and the math would always follow whatever he was talking about,” he said.

He also remarked on Hinton’s kindness.

“He offered to put me up for a few weeks,” he said of a time when he found himself looking for a place to stay in Toronto. “He offered to go and get dishes. I was thinking to myself, ‘Wow, Geoff Hinton wants to go out shopping for dishes for me so that I can be comfortable for a few weeks.’”

Geoffrey Hinton shakes hand at a recent ��TV event celebrating his Nobel Prize (photo by Mac Pattanasuttinont)

Frosst, too, has a Hinton home-making story: the AI luminary built him a desk from scratch.

“He's a carpenter,” Frosst said. “It’s a small wooden desk that fits in the corner of my room at home.

“That's where I keep my computer and work from.”

‘One of the great minds of the 21st century’: ��TV celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle — Thu, 17 Oct 2024 17:24:21 +0000

‘One of the great minds of the 21st century’: ��TV celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle Thu, 10/17/2024 - 13:24

Cutline

University Professor Emeritus Geoffrey Hinton, who won the 2024 Nobel Prize in Physics, attends a celebration event held at the Schwartz Reisman Innovation Campus (photo by Mac Pattanasuttinont)

Rahul Kalvapalle

Topic

Schwartz Reisman Innovation Campus

Leah Cowen

Wesley Hall

Schwartz Reisman Institute for Technology and Society

Department of Computer Science

CIFAR

Faculty of Applied Science & Engineering

Subheadline

The 2024 co-winner of the Nobel Prize in Physics - known to many as the "godfather of AI" - was honoured at an event attended by a who's who of the Toronto research community

There were standing ovations, peals of laughter and even a few tears as the University of Toronto welcomed Geoffrey Hinton back to campus after he won the 2024 Nobel Prize in Physics.

A University Professor Emeritus of computer science, Hinton traded the “cheap hotel room in California,” where he received the life-changing news, for an emotional reception in the Schwartz Reisman Innovation Campus’s airy event hall.

The Oct. 10 event drew ��TV leaders, supporters, dignitaries and other luminaries. They included Deputy Prime Minister Chrystia Freeland, University Professor Emeritus John Polanyi, who won the Nobel Prize in Chemistry in 1986, and Massey College Principal James Orbinski, who accepted the Nobel Peace Prize on behalf of Doctors Without Borders in 1999.

Several of Hinton’s many collaborators and proteges also attended the event – not to mention students who were simply eager to catch a glimpse of the “godfather of AI.”

Hinton chats with ��TV Scarborough Professor David Fleet and Google Research Scientists Sara Sabour and Daniel Watson (photo by Johnny Guatto)

Though sleep deprived, Hinton regaled the audience with fond recollections of his early years as an AI researcher, snapshots of his trademark dry humour and warm expressions of gratitude for mentors, collaborators and, of course, his many students.

“I’ve been blessed to have brilliant graduate students and post-docs,” Hinton said.

“I had a principle when selecting graduate students: ‘If they’re not smarter than me, what’s the point?’ And I’ve had quite a number of graduate students who were smarter than me.

“They did things I wouldn’t have been able to do, so I’d like to thank them.”

He said two figures in particular played a huge role in the work that led to his Nobel Prize, which he shared with Princeton University’s John J. Hopfield. The first was Terry Sejnowsky, a computational neuroscientist and former student of Hopfield’s, who worked with Hinton on Boltzmann machines – a period Hinton described as “the most happy research time of my life.”

He also praised the contributions of the late David Rumelhart, a psychologist at Stanford University, who worked with him to develop backpropagation algorithms, a key breakthrough.

“[He] should have won the Nobel Prize,” Hinton said. “But unfortunately, Dave got a horrible brain disease and he died quite young.” (The Nobel organization doesn’t award the honour posthumously).

Hinton poses for a picture with Assistant Professor Chris Maddison, who was one of the last graduate students Hinton supervised (photo by Mac Pattanasuttinont)

Chris Maddison joined Hinton’s research group as an undergraduate and was one of the last students he supervised. Now an assistant professor in ��TV’s departments of computer science and statistical sciences in the Faculty of Arts & Science, Maddison lauded Hinton as “a steadfast mentor and supporter who saw strength in me that I didn’t see” and said one of his greatest attributes was his sheer enthusiasm.

“No matter what’s going on, you can find him in the lab on Sundays at 8 p.m. playing with his MATLAB scripts like a child playing with Legos,” Maddison said. “He never lost that child-like sense of wonder that buoyed him and the group.”

��TV President Meric Gertler said, via video message from Indonesia, where he was on university business, that Hinton is “one of the great minds of the 21st century” (photo by Johnny Guatto)

��TV President Meric Gertler, who was in Indonesia on university business when the prize was announced, hailed Hinton in a video message as “one of the great minds of the 21st century” and someone who “literally created new ways of thinking about thinking and learning.”

He noted that Hinton’s AI leadership extends to the pressing question of responsible and safe development of the technology.

“With his Nobel win, he’s now perfectly positioned to amplify this concern on a world stage.” President Gertler said.

Hinton shares a laugh with University Professor Molly Shoichet of the Faculty of Applied Science & Engineering (photo by Johnny Guatto)

The event’s guest list served as a reminder of Hinton’s outsized influence on the research community in Toronto and beyond, drawing key figures from: the Vector Institute, where Hinton is co-founder and chief scientific adviser; the Schwartz Reisman Institute of Technology and Society, where he sits on the advisory board; and CIFAR (Canadian Institute for Advanced Research), where Hinton is an adviser and longtime fellow.

Hinton poses for a photo with Leah Cowen, ��TV’s vice-president, research and innovation, and strategic initiatives (photo by Johnny Guatto)

Leah Cowen, ��TV’s vice-president, research and innovation, and strategic initiatives, reminded the accomplished audience that Hinton’s historic achievement – both the Nobel Prize and the AI revolution he helped spark – was the result of years toiling in an “unpromising backwater” of AI research.

“It is tempting to think that it happened almost overnight, but it didn’t,” Cowen said.

University Professors Emeriti – and fellow Nobel Prize-winners – Geoffrey Hinton and John Polanyi have their photo taken together (photo by Johnny Guatto)

Hinton took time to reflect on periods of personal struggle and tragedy – and thank those who helped him in his hour of need.

When his wife had an incurable form of cancer, he recalled how ��TV President Emeritus David Naylor, a physician, medical researcher and former dean of the Temerty Faculty of Medicine, carried out research on a possible alternative treatment that was being explored – incorporating input from top medical experts – and presented him with a report of his findings.

“He’s a tremendous human being,” Hinton said of Naylor, who was in the audience.

Hinton shares a moment with ��TV President Emeritus David Naylor (photo by Johnny Guatto)

Hinton also recalled how, when his first wife became ill in 1993 – also with cancer – his post-doctoral trainee Peter Dayan, now a director at the Max Planck Institute for Biological Cybernetics, stepped in to advise Hinton’s graduate students, giving him time to care for his ailing spouse.

“At times like this, you remember the people who helped you most when things were very difficult,” Hinton said.

He later pointed out that Dayan went on to supervise one of this year’s winners of the Nobel Prize in Chemistry, Demis Hassabis, joking that this made Dayan “the meat in a Nobel sandwich.”

Deputy Prime Minister Chrystia Freeland said Canada was lucky to have Hinton, who was born in the U.K., and thanked his daughter for sharing her father with the country, with science and the world (photo by Johnny Guatto)

For Minister Freeland, Hinton’s award showcased the value of ideas and of fundamental research. She said Hinton’s Nobel Prize sent waves of pride across Canada, which she said was “lucky as a country” that Hinton arrived on its shores back in 1987.

“Geoff shows that you can be a really brilliant intellectual and also a really great human being who cares about his community and his country,” Freeland said. “I am constantly struck by how Geoff thinks about the bigger implications of his ideas and how Geoff thinks about really wanting to make Canada and the world a better place.”

Hinton chats with Melanie Woodin, dean of the Faculty of Arts & Science, who thanked him for his friendship and mentorship – and his dedication to science and scholarship (photo by Johnny Guatto)

Following the program – which also featured remarks by ��TV Chancellor Wes Hall, Faculty of Arts & Science Dean Melanie Woodin and Christine Szustaczek, ��TV’s vice-president, communications – Hinton mingled with members of the audience, shook hands with students and caught up with former colleagues and trainees.

Clockwise from top left: Christine Szustaczek, Wes Hall, Chris Maddison, Leah Cowen, Geoffrey Hinton and Melanie Woodin (photo by Johnny Guatto)

Brendan Frey, professor in the Faculty of Applied Science & Engineering and CEO of AI-powered therapeutics startup Deep Genomics, said he was one of many who earned his PhD under Hinton’s supervision.

“I think of Geoff as the father of a community that includes myself, other graduate students and all the people who didn’t believe but then came to believe – and he inspired all of us,” said Frey, who shared a hug with his former supervisor following the event.

“I’m really happy for him.”

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle — Thu, 10 Oct 2024 16:26:59 +0000

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle Thu, 10/10/2024 - 12:26

Cutline

Geoffrey Hinton, University Professor Emeritus of computer science at the University of Toronto and winner of the 2024 Nobel Prize in Physics, takes questions during a virtual press conference hosted by ��TV (image via YouTube)

Rahul Kalvapalle

Topic

Department of Computer Science

Global

President Meric Gertler

Subheadline

"If you believe in something, don’t give up on it until you understand why that belief is wrong"

Empower curiosity-driven research. Follow your convictions. Think not just about how to advance technology, but how to direct its use for good.

These were among the key messages delivered by Geoffrey Hinton, University Professor Emeritus of computer science at the University of Toronto and winner of the 2024 Nobel Prize in Physics, during an Oct. 8 press conference held by the university to mark his historic award.

Widely regarded as “the godfather of AI,” Hinton was named a co-winner of the prize – alongside John J. Hopfield of Princeton University – for his work on Boltzmann machines and artificial neural networks, which laid the groundwork for advancements in AI and stimulated new research directions in physics.

��TV President Meric Gertler hailed Hinton for having “a profound impact on multiple fields and disciplines,” crediting “his leadership and exemplary mentorship of young scholars” with helping ��TV become a global leader in AI and machine learning.

“I think one cannot overstate the impact of a win like this on the ability of Canada, Toronto and the University of Toronto to be able to welcome talented newcomers, great students and wonderful faculty from across the country and around the world because of the recognition that arises with Geoff’s win,” President Gertler said.

For his part, Hinton echoed his remarks from earlier in the day that he was “flabbergasted” to receive the prize and pleased that the Nobel committee recognized the advancements in artificial neural networks.

He also answered questions about his influences, legacy and how it feels to go from being an obscure researcher who toiled in a largely forsaken field to a Nobel Laureate – and his advice for researchers who hope to one day follow in his footsteps.

Here are five key themes that emerged from Hinton's news conference:

His legacy

“I’m hoping AI will lead to tremendous benefits, to tremendous increases in productivity and to a better life for everybody. I’m convinced that it will do that in health care.

“My worry is that it may also lead to bad things, and in particular, when we get things more intelligent than ourselves, no one really knows whether we’re going to be able to control them.

“We don’t know how to avoid [catastrophic AI scenarios] at present. That’s why we urgently need more research. So I’m advocating that our best young researchers, or many of them, should work on AI safety and governments should force large companies to provide the computational facilities they need to do that.”

A collaborative effort

“I think of the prize as a recognition of a large community of people who worked on artificial neural networks for many years.

“I’d particularly like to acknowledge my two main mentors: David Rumelhart, with whom I worked on the backpropagation algorithm … and my colleague Terry Sejnowsky, who I worked with a lot in the 1980s on Boltzmann machines and who taught me a lot about the brain.

“I’d also like to acknowledge my students. I was particularly fortunate to have many clever students, much cleverer than me, who actually made things work. They’ve gone on to do great things.

“I should also acknowledge Yoshua Bengio and Yann LeCun who were close colleagues and very instrumental in developing this whole field.”

Canada’s research strengths

“I think the main thing about Canada as a place to do research is there isn’t as much money as there is in the U.S., but it uses its money quite wisely.

“In particular, the main funding council for this type of research, called NSERC, uses money for basic curiosity-driven research, and all of these advances in neural networks came out of basic curiosity-driven research – not out of throwing money at applied problems, but out of letting scientists follow their curiosity to try and understand things. And Canada’s quite good at that.”

Many thought he was wasting his time

“It was a lot of fun doing the research, but it was slightly annoying that many people – in fact, most people in the field of AI – said that neural networks would never work.

"They were very confident these things were a waste of time and we would never be able to learn complicated things – for example, understanding natural language – using neural networks. And they were wrong."

Believe in your ideas

"My message is this: if you believe in something, don’t give up on it until you understand why that belief is wrong.

"Often, you believe in things and you eventually figure out why that’s a wrong thing to believe in. But so long as you believe in something and you can’t see why that’s wrong – like, ‘the brain has to work somehow so we have to figure out how it learns the connection strengths to make it work’ – keep working on it and don’t let people tell you it’s nonsense if you can’t see why it’s nonsense."

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen — Wed, 09 Oct 2024 19:24:35 +0000

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen Wed, 10/09/2024 - 15:24

Cutline

(photo by Polina Teif)

Topic

Research & Innovation

News of Geoffrey Hinton’s Nobel Prize in Physics travelled around the globe, making international headlines for the British-Canadian scientist known as the “godfather of AI.”

A University Professor Emeritus of computer science at the University of Toronto, Hinton won the prize jointly with Princeton’s John J. Hopfield for early discoveries and inventions in the realm of physics that laid the groundwork for today’s artificial intelligence boom.

Hinton told The New York Times he was, “shocked and amazed and flabbergasted. I never expected it.”

After receiving the call from Stockholm in the wee hours, Hinton, who was in California, spent much of the day attending press conferences and speaking with reporters from a “cheap hotel room with no internet,” even oscillating mid-interview between the Times and the BBC.

Nevertheless, he seized the moment to emphasize both the promise and pitfalls of AI-based technologies.

“It’s going to be like the Industrial Revolution – but instead of our physical capabilities, it’s going to exceed our intellectual capabilities," he told the BBC. “… but I worry that the overall consequences of this might be systems that are more intelligent than us that might eventually take control.”

Independent UK acknowledged the unusual nature of Hinton’s win in the physics category.

“I’m not a physicist, I have very high respect for physics,” Hinton said. “I dropped out of physics after my first year at university because I couldn’t do the complicated math. So, getting an award in physics was very surprising to me. I’m very pleased that the Nobel committee recognised that there’s been huge progress in the area of artificial neural networks.”

Closer to home, Hinton’s award was lauded in the national media, from CBC: The National – which highlighted his emphasis on the importance of supporting curiosity-driven research and his role in training many of today’s AI leaders – to the front pages of The Toronto Star and The Globe and Mail.

“I want to emphasize that AI is going to do tremendous good,” Hinton told the Globe after receiving the news about the win. “In areas like health care, it’s going to be amazing. That’s why its development is never going to be stopped. The real question is can we keep it safe?”

Read Hinton’s interview in the New York Times (paywall)

Read the BBC story

Read the Globe and Mail story (paywall)

Watch CBC: The National’s report

Congratulations pour in for Geoffrey Hinton after Nobel win

mattimar — Tue, 08 Oct 2024 19:43:16 +0000

Congratulations pour in for Geoffrey Hinton after Nobel win

mattimar Tue, 10/08/2024 - 15:43

Cutline

(Photo by Johnny Guatto/University of Toronto)

Mariam Matti

Topic

Alumni

University Health Network

Vector Institute

Subheadline

“You always knew when Geoff had a new idea. The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility"

Reactions to Geoffrey Hinton’s Nobel Prize win began almost immediately after it was announced Tuesday morning.

Known as the “godfather of AI,” the University Professor Emeritus of computer science at the University of Toronto shared the Nobel Prize in Physics with John J. Hopfield of Princeton University for groundbreaking work that laid the foundation for machine learning using artificial neural networks.

��TV’s Geoffrey Hinton and Princeton’s John J. Hopfield are pictured during the announcement for the 2024 Nobel Prize in Physics (photo by Jonathan Nackstrand/AFP via Getty Images)

At ��TV, students, faculty and staff gathered at an event hosted by the department of computer science in the Faculty of Arts & Science, which Hinton joined as a professor in 1987.

Those in attendance described a revered and beloved figure, citing Hinton’s determination, playful approach to research and excitement for new ideas.

"I really don’t think there’s anyone more deserving of this recognition," said Chris Maddison, assistant professor in ��TV’s departments of computer science and statistical sciences, and one of Hinton’s former students.

"Geoff was a fantastic adviser. He worked really, really hard to remove the barriers for his students and he was laser focused on ideas and building his own understanding."

Hinton also received congratulations from universities and other research organizations around the world, including the Royal Society, the Alan Turing Institute and Cambridge University, Hinton’s alma mater.

Meanwhile, friends, colleagues and leaders in politics and business took to social media to express their congratulations for Hinton’s remarkable achievement.

Here’s a snapshot of what some of them said:

From left: Melanie Woodin, Chris Maddison, Nick Frosst, Kevin Swersky and Eyal de Lara (photo by Johnny Guatto)

“Congratulations to Geoffrey Hinton on this fantastic recognition which is a testament to the importance of supporting basic research and the long journey that can lead to profound discoveries like deep learning that forever change our world. Hinton's phenomenal work has seeded new and innovative research by his former students and many around the world who are using AI to solve global challenges in areas like medicine and climate change.“

– Leah Cowen, vice-president, research and innovation, and strategic initiatives at ��TV

“I would say his approach to science has stuck with me. Everything I know about how to do science, I mostly learned from him. It's his curiosity and playfulness ... that has been most impactful. I would also say his thoughtfulness, thinking about the consequence of the technology and how it affects society is something that we have taken seriously at Cohere as well.”

– Nick Frosst, ��TV alumnus and co-founder of Cohere

“You always knew when Geoff had a new idea. The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility. He was famous for bursting into a room and pronouncing that, he now finally, after all these years, understood how the brain worked. Above all, he understood that research was a human endeavor. Research is really hard. It becomes personal. It's intertwined with tragedies and compromises. I saw him go through some of his own when I was a student in the group, and I went through my own. I remember when I was going through some health challenges, I went to him and I said, 'Geoff, sometimes it's really hard to go on.’ And he looked at me and he said, ’But we're not going to let that slow us down, will we?’"

– Chris Maddison, assistant professor in ��TV’s departments of computer science and statistical sciences, Faculty of Arts & Science

��TV is the only computer science department with a Nobel Prize winner, says Professor Michael Brudno (photo by Johnny Guatto)

“It's a once-in-a-lifetime opportunity to celebrate an award for somebody who has made huge contributions – obviously in AI broadly, [and] to this department. No other computer science department can say that they have a Nobel Laureate. But I think beyond that, it really goes back to show how the birthplace of modern AI is Toronto, how this is the place where it all started and how it's upon us as the AI faculty in this department to continue this legacy.”

– Michael Brudno, professor in ��TV’s department of computer science, acting vice-dean, graduate education in Faculty of Arts & Science, a chief data scientist at University Health Network and a faculty member at the Vector Institute

Geoffrey Hinton shares a laugh with fellow AI researcher Raquel Urtasun, left, at the Vector Institute’s opening in 2017 (photo by Lisa Lightbourn)

"Geoff is the most influential person in AI, and our field would certainly not be the same without his immense contributions. He is also a tremendous educator, and has mentored many students and postdocs who have gone on to become very influential in the field of AI. Geoff cares deeply about the Toronto and Canadian ecosystem and was the driving force in the formation of the Vector Institute, which we co-founded together. Through our time as colleagues at the University of Toronto, I've deeply admired his commitment to the advancement of AI for good. This recognition is well-deserved and acknowledges his decades of work leading AI innovation and building the foundation for the AI revolution that is happening today.”

– Raquel Urtasun, professor in ��TV’s department of computer science, faculty member and co-founder at the Vector Institute, founder and CEO of Waabi

“I was the first to call Geoff Hinton “Godfather of Deep Learning,” which later became “Godfather of AI.” Thrilled to see him win the Nobel prize together with John Hopfield for AI. Congrats @geoffreyhinton.”

– Andrew Ng, co-founder of Coursera, founder GoogleBrain, former chief scientist at Baidu

Prime Minister Justin Trudeau speaks with Geoffrey Hinton at a 2019 event (photo by Nick Iwanyshyn)

“Dr. Hinton is a stalwart in his field. Celebrated as one of the ‘Godfathers of AI’, he brings decades of leading expertise in AI research as a Professor Emeritus at the University of Toronto’s Department of Computer Science, and the current Chief Scientific Advisor at the Vector Institute in Toronto – one of our three national AI institutes. Dr. Hinton is also an outspoken advocate for the responsible development and adoption of AI, educating the world about the benefits and challenges this technology poses.

“Canada is at the forefront of AI technology thanks to trailblazers like Dr. Hinton. His curiosity for discovery and contributions to innovation will inspire generations to come. On behalf of all Canadians, I congratulate him on his remarkable achievement.”

– Justin Trudeau, Prime Minister of Canada

A.M. Turing Award winners Yann LeCun, left, Yoshua Bengio, middle, and Geoffrey Hinton at an AI summit in Montreal (photo courtesy of RE•WORK)

"@HopfieldJohn and @geoffreyhinton, along with collaborators, have created a beautiful and insightful bridge between physics and AI. They invented neural networks that were not only inspired by the brain, but also by central notions in physics such as energy, temperature, system dynamics, energy barriers, the role of randomness and noise, connecting the local properties, e.g., of atoms or neurons, to global ones like entropy and attractors. And they went beyond the physics to show how these ideas could give rise to memory, learning and generative models; concepts which are still at the forefront of modern AI research. Their ideas inspired me so profoundly that I decided to choose learning in neural networks for my own research as a graduate student. They motivated me to look for abstract principles that could be as simple as the laws of physics, but could explain biological as well as artificial intelligence. I'm truly delighted for them and for our field."

– Yoshua Bengio, professor at Université de Montréal and co-winner of the A.M Turing Award with Geoffrey Hinton and Yann LeCun

“It was the first thing I saw in the morning. I opened my phone, and it was the headline of The New York Times and I was like, ‘Yes!’ I was very excited. I saw his perseverance – he always goes with what he believes, not what the flow is – and it's quite inspirational for me. That’s what I look for, especially in the health care area. I want to do something meaningful, something big.”

–Tina Behrouzi, second year PhD student in ��TV’s department of computer science

Geoffrey Hinton poses with graduate students Ilya Sutskever, left, and Alex Krizhevsky, right, in 2013 (photo by Johnny Guatto)

“Congratulations to @geoffreyhinton for winning the Nobel Prize in physics!!”

– Ilya Sutskever, ��TV alumnus, co-founder of OpenAI and co-founder and chief scientist at Safe Superintelligence

“Going to Geoff’s office was always fun. Normally when you go to a supervisor's office, you give them a progress update. You go through what your latest results are, you talk about a couple of your ideas and you get some feedback. Going to Geoff’s office was a completely different story. He would be telling you what his latest idea was. He would show you his latest results. And his whole thing was just that he was really excited about it, and his hope was to inspire you enough to start running with it.”

– Kevin Swersky, ��TV alumnus and research scientist at Google DeepMind

“[Hinton's] pioneering research at the University of Toronto not only revolutionized the field of AI but has also been instrumental in establishing Canada as a global powerhouse in AI research and innovation."

– Tony Gaffney, president and CEO of the Vector Institute

Fei-Fei Li and Geoffrey Hinton speak at a 2023 event in Toronto (photo by Polina Teif)

“This is beyond exciting! #AI’s far reaching impact is just beginning.”

– Fei-Fei Li, professor of computer science at Stanford University and co-director of Stanford’s Human-Centered AI Institute

“Congratulations to @geoffreyhinton, University Professor Emeritus at@UofT, on winning the 2024 Nobel Prize in Physics! Widely regarded as the “godfather of AI,” Hinton’s pioneering work in artificial neural networks has transformed the global AI landscape. Dr. Hinton’s achievement highlights the best of #Ontario’s world-class talent and thriving AI ecosystem, driving innovation and shaping the future of critical #technology!

– Victor Fedeli, Ontario’s minister of economic development, job creation and trade

"On behalf of the Department and the University, we are very proud to acknowledge Geoff's global achievements and this international recognition. His contributions to machine learning and artificial intelligence have benefited virtually every discipline in science, engineering, social sciences and medicine. As we celebrate the department’s 60th anniversary, this award embodies six decades of impact and innovation in computer science and technology.”

– Eyal de Lara, professor and chair of ��TV’s department of computer science, Faculty of Arts & Science

“Heartfelt congratulations to Geoff Hinton @geoffreyhinton on winning the Nobel Prize! What an incredible honor! I feel deeply privileged to have had the opportunity to be your PhD student, work with you, and learn from you.”

– Russ Salakhutdinov, professor of computer science at Carnegie Mellon University

Hinton approached his research with an “almost childlike playfulness,” says Graduate student Ujan Sen (photo by Johnny Guatto)

“Waking up today, seeing that news, just motivates me even more and reaffirms the decision that coming to ��TV was the absolutely the best decision I could have taken. I think one of the people who had previously worked with him mentioned something along the lines of: Geoff didn't really care too much about pedigree. He cared about ideas, regardless if you have a master's or PhD. And the way he approached his research and the almost childlike playfulness and innocence he had with sort of getting to the answer is something that I really resonate with.”

– Ujan Sen, master’s student in ��TV’s department of computer science, Faculty of Arts & Science

"I want to extend my heartfelt congratulations to Dr. Geoffrey Hinton on winning the 2024 Nobel Prize in Physics. His groundbreaking work in machine learning has made Canada world-renowned in the field of AI. He is a true inspiration for the next generation of Canadian researchers!"

– François-Philippe Champagne, Canada’s minister of innovation, science and industry

“I’m originally a chemist. It was a surprising thing for me that a Nobel Prize is being awarded to a computer scientist. This is a big moment for computer science. I think it will bring recognition to physics-based approaches and core thinking.

“I think it’s great that some universities like ��TV are willing to believe in crazy ideas. People need to encourage outside-the-box thinking.”

– Ella Rajaonson, PhD student in the Matter Lab with ��TV professor Alán Aspuru-Guzik

“Congratulations!”

– Olivia Chow, mayor of Toronto

Geoffrey Hinton wins Nobel Prize in Physics

davidlee1 — Tue, 08 Oct 2024 19:35:09 +0000

Geoffrey Hinton wins Nobel Prize in Physics

davidlee1 Tue, 10/08/2024 - 15:35

Cutline

(Photo by Johnny Guatto/University of Toronto)

Rahul Kalvapalle

Topic

Faculty of Arts & Science Staff

Physics

Research & Innovation

Subheadline

A ��TV University Professor Emeritus, Hinton shared the honour with Princeton University's John J. Hopfield for discoveries and inventions that enable machine learning with artificial neural networks

Geoffrey Hinton, a University Professor Emeritus of computer science at the University of Toronto, has won the 2024 Nobel Prize in Physics.

Widely regarded as the “godfather of AI,” Hinton shared the prize with John J. Hopfield of Princeton University for foundational discoveries and inventions that enable machine learning with artificial neural networks.

Hinton said he was “flabbergasted” at the honour as messages poured in from around the world.

“I had no expectations of this,” he told ��TV News shortly after the win was announced in Stockholm Tuesday morning. “I am extremely surprised and I'm honoured to be included.”

He later told reporters at a press conference he was “in a cheap hotel in California” with no Internet and a poor phone connection when he was notified about his Nobel Prize.

“I was going to get an MRI scan today, but I think I’m going to have to cancel that.”

Hinton and Hopfield are credited with wielding tools from physics to advance basic research in the field. Specifically, Hopfield created an associative memory that can store and reconstruct images in data, while Hinton invented a way to find properties in data and perform tasks such as identifying specific elements in pictures.

“On behalf of the University of Toronto, I am absolutely delighted to congratulate University Professor Emeritus Geoffrey Hinton on receiving the 2024 Nobel Prize in Physics,” said ��TV President Meric Gertler. “The ��TV community is immensely proud of his historic accomplishment.”

Hinton was selected for the high-profile award for his use of the Hopfield network – invented by his co-laureate – as the foundation for a new network called the Boltzmann machine that can learn to recognize elements within a given type of data.

The Boltzmann machine can classify images and generate new examples of the pattern on which it was trained, with Hinton and his graduate students later building on this work to help usher in today’s rapid development of machine learning – a technology that now underpins a host of applications ranging from large language models such as ChatGPT to self-driving cars.

Johan Jarnestad/The Royal Swedish Academy of Sciences

“The laureates’ work has already been of the greatest benefit. In physics we use artificial neural networks in a vast range of areas, such as developing new materials with specific properties,” said Ellen Moons, chair of the Nobel Committee for Physics.

The win by Hinton and Hopfield was covered by media and other organizations around the globe, with The New York Times describing the Nobel committee’s decision as “an acknowledgement of AI’s growing significance in the way people live and work,” and the prestigious journal Nature noting Hinton’s innovations now “form the basis of many state-of-the-art AI tools.”

Hinton joined ��TV as a professor of computer science in 1987 after working in various universities in the U.K., where he was born, and in the United States. He went on to be named a University Professor – ��TV’s highest academic appointment – in 2006.

Driven by a desire to understand the human brain, Hinton and his graduate students built on his early efforts with an array of developments that paved the way for an explosion in deep learning. One of the first cohort of researchers supported by the Canadian Institute for Advanced Research (CIFAR), Hinton’s work helped catapult Canada to its current status as a global leader in AI development.

The Royal Swedish Academy of Sciences, which awards the Nobel Prize in Physics, noted Hinton persisted with his research even as the scientific community lost interest in artificial neural networks during the 1990s, and ultimately “helped start the new explosion of exciting results” in the 2000s.

Hinton, for his part, said during a ��TV press conference Tuesday evening that his achievements wouldn’t have been possible without support for curiosity-based research – something he said Canada was good at.

He added that his shock at winning the Nobel stemmed from the fact that, while his work has drawn on statistical physics, he isn’t a physicist himself – and even “dropped out of physics after my first year in university because I couldn’t do the complicated math.”

He also said that he plans to donate the money associated with the prize to various charities, including one that provides jobs for neurodiverse young adults.

Hinton likened the influence of AI to that of the Industrial Revolution during a virtual press conference with the academy earlier in the day – “But instead of exceeding people in physical strength, it’s going to exceed people in intellectual ability.”

He added that the rise of AI “is going to be wonderful in many respects,” citing health care and workplace productivity as two areas poised to benefit hugely from the technology. “But we also have to worry about a number of possible bad consequences, particularly the threat of these things getting out of control,” Hinton said.

In early 2023, Hinton quit his job at Google and focused on sounding the alarm about the risks of rapid and unfettered AI development. He outlined his reasoning in a 46-minute ��TV video last year, urging young researchers to focus their efforts on the emerging field of AI safety – a message he repeated in media interviews following his Nobel win.

He has continued to tackle the issue at lectures and public appearances around the world, including at ��TV and at Cambridge University, his alma mater.

“I am thrilled Geoffrey Hinton, an esteemed colleague and dear friend has been awarded the Nobel Prize in Physics,” said Melanie Woodin, dean of ��TV’s Faculty of Arts & Science.

“Geoff is an historic visionary whose groundbreaking work in deep learning and neural networks has made ��TV and the Toronto region a leading global centre for AI. And it speaks volumes about his integrity that while he helped lay the foundation for the artificial intelligence revolution, he is also one of the leading voices urging that we develop this technology responsibly and ethically.”

Similarly, Prime Minister Justin Trudeau lauded Hinton for his efforts to realize responsible AI development, releasing a statement and writing on X: “Geoffrey, we’re glad to have a mind like yours developing safe and responsible AI for the world.”

Geoffrey Hinton delivers a lecture about responsible AI to ��TV students and faculty (photo by Johnny Guatto)

Hinton, who is co-founder and chief scientific adviser at the Vector Institute in Toronto, joins an illustrious list of past Nobel Prize in Physics winners that includes Albert Einstein and Marie Curie (who also won a Nobel in chemistry). The prestigious award is the latest in a long list of accolades for Hinton. They include the Association for Computing Machinery’s A.M. Turing Award – widely considered “the Nobel Prize of computing” – in 2019 alongside collaborators Yann LeCun and Yoshua Bengio.

Hinton is the fourth ��TV faculty member to win a Nobel Prize over the years.

Sir Frederick Banting and J.J.R Macleod won a Nobel Prize in Physiology or Medicine for their work with Charles Best in 1923 to isolate insulin. In 1986, John Polanyi was one of three winners of the Nobel Prize in Chemistry for the development of the new field of reaction dynamics.

Other members of the ��TV community, including several alumni, have received or been associated with the international honour.

Oliver Smithies, a past professor at ��TV, was a joint winner of the Nobel Prize in Physiology or Medicine in 2007 for discovering the “principles for introducing specific gene modifications in mice by the use of embryonic stem cells.”

Also in 2007, Professor Robert Jefferies shared in the Nobel Peace Prize awarded to the Intergovernmental Panel on Climate Change (IPCC), in which he was a key Canadian representative as an international leader in Arctic science and global change biology.

In 1999, ��TV Professor James Orbinski accepted the Nobel Peace Prize on behalf of Doctors Without Borders, which was recognized for its humanitarian work.

Anti-nuclear activist and ��TV alumna Setsuko Thurlow accepted the Nobel Peace Prize in Norway in 2017 on behalf the International Campaign to Abolish Nuclear Weapons (ICAN).

In 2001, Michael Spence, an alumnus of University of Toronto Schools, was one of three joint winners of the Bank of Sweden Prize in Economic Sciences in Memory of Alfred Nobel for his contributions to analyses of markets with asymmetrical information.

Bertram Brockhouse, who completed two degrees at ��TV, was a co-winner of the Nobel Prize in Physics in 1994 for the development of neutron scattering techniques for studies of condensed matter.

Arthur Schawlow, an alumnus, was one of three winners of the same prize in 1981 for his contribution to the development of laser spectroscopy.

In 1998, ��TV alumnus Walter Kohn was a co-winner of the Nobel Prize in Chemistry for development of the density-functional theory.

Former Prime Minister Lester B. Pearson, who received a bachelor’s degree from ��TV, won the Nobel Peace Prize in 1957.

Work of Nobel Prize-winner John Polanyi celebrated in ��TV exhibit

Christopher.Sorensen — Tue, 28 May 2024 18:48:11 +0000

Work of Nobel Prize-winner John Polanyi celebrated in ��TV exhibit

Christopher.Sorensen Tue, 05/28/2024 - 14:48

Cutline

University Professor Emeritus and Nobel laureate John Polanyi said he is "deeply humbled and grateful” for the new permanent exhibit, which honours his seminal research and his advocacy for responsible science (photo by Diana Tyszko)

Topic

Department of Chemistry

John Polanyi

Laboratory Medicine and Pathobiology

Subheadline

The department of chemistry also recently renamed the research wing of the Lash Miller building in Polanyi's honour

The groundbreaking work of University Professor Emeritus John Polanyi, celebrated chemist and winner of the Nobel Prize in Chemistry in 1986, is the focus of a new permanent exhibit at the Lash Miller building, home of the department of chemistry in the Faculty of Arts & Science.

Through still images, video and equipment, the dynamic exhibit tells the story of Polanyi's career including his seminal work in the field of reaction dynamics – a branch of chemistry that investigates what happens during chemical reactions.

The centrepiece of the exhibit is a replica of the 1986 Nobel Prize in Chemistry medal awarded to Polanyi (photo by Diana Tyszko)

The display includes original equipment used in Polanyi’s early research, a reproduction of the lab notebook used by his graduate student to document their experiments and a video chronicling the process of discovery – along with a replica of his Nobel Prize medal.

"It’s been my good fortune to be surrounded by brilliant colleagues and other supporters throughout my life and career," Polanyi said. "I'm deeply humbled and grateful for this marvelous display and ongoing recognition of my life’s work.”

“John Polanyi holds a revered place in the history of the University of Toronto and his legacy is an inspiration for all of us,” said ��TV President Meric Gertler. “This installation is a compelling expression of his achievements. All those responsible deserve our thanks and congratulations.”

The exhibit includes a reproduction of the notebook in which Polanyi’s graduate student Ken Cashion documented the results of the experiment that delivered the groundbreaking discovery (photo by Diana Tyszko)

Polanyi came to ��TV from Princeton University in 1956, and not long after, made his seminal discovery: his detection of infrared radiation released upon the collision of hydrogen and chloride molecules was the first observation of energy produced from the vibration of new molecules immediately after their formation.

His work went on to influence the development of advanced instrumentation in domains like pharmaceutical research, medicine and chemical manufacturing – including the development of the first chemical lasers.

“The university made a significant investment in me, a young scholar,” said Polanyi. “The environment and the resources I received enabled me to pursue a new and unknown direction in chemical physics.”

In 1974, he was named a University Professor – the highest academic honour bestowed by the university on its faculty members – and in 1994, the John C. Polanyi Chair in Chemistry was established.

The exhibit tells the story of the Nobel Prize-winning discovery in the field of reaction dynamics, and University Professor Emeritus John Polanyi’s advocacy for nuclear disarmament and the responsible use of science (photo by Diana Tyszko)

In tandem with the new exhibit, the department of chemistry also recently renamed the research wing of the Lash Miller building in his honour.

“The John Polanyi research wing and this new display will serve to permanently highlight John's legacy for current and future young scholars,” said Professor Mark Lautens, chair of the department of chemistry. “John has brought great visibility and prestige to the University of Toronto through his groundbreaking studies and his contributions that go well beyond scientific discovery. We are equally grateful [for] and proud of his advocacy for science, for peace and for a better world.”

Inspiration for the exhibit came after Polanyi donated some of his equipment to the department of chemistry upon his retirement in 2020. A special celebration was held in his honour at Massey College in the fall of 2022, after which Professor Robert Batey, then department chair, with support from the Faculty of Arts & Science dean Melanie Woodin and the Offices of the President and the Vice-President, Research & Innovation, led the development of the exhibit to celebrate Polanyi’s impact and legacy.

“John has made tremendous contributions to the world of science as well as society at large through his advocacy for nuclear disarmament," said Batey. "We are proud to be able to celebrate his work this way in the place that has been his professional home for so many years.”

“This display is a fantastic tribute to Professor Polanyi's remarkable career as a scientist, a teacher and a global citizen,” said Woodin. “It is a fitting acknowledgement for someone who has engendered a network of excellence that stretches across countries and continents.”

University Professor Emeritus John Polanyi (pictured second from the right) was joined in viewing the exhibit by (l to r) department of chemistry chair Mark Lautens, portrait painter Brenda Bury and former department chair Robert Batey (photo by Diana Tyszko)

The department of chemistry and Toronto-based communications and design firm Snack worked closely with Polanyi on the development of the display, drawing from his extensive archive of memorabilia and donated equipment.

The exhibit also captures Polanyi’s advocacy for the responsible use of science and a keen social conscience that compelled him to campaign for the elimination of nuclear weapons throughout his career. “A great university that invests in science must also strain to warn of the accompanying risks to humanity," he said.

Prohibition of nuclear weapons the only rational way forward: John Polanyi in the Globe and Mail

rahul.kalvapalle — Wed, 01 Dec 2021 18:13:53 +0000

Prohibition of nuclear weapons the only rational way forward: John Polanyi in the Globe and Mail

rahul.kalvapalle Wed, 12/01/2021 - 13:13

Cutline

(Photo by Johnny Guatto)

Topic

Nuclear weapons continue to pose a threat to humanity and should be banned if reason is to prevail over might, says the University of Toronto’s John Polanyi.

In a Globe and Mail op-ed based on a recent speech to the Conference on the Treaty on Prohibition of Nuclear Weapons in Ottawa, the University Professor Emeritus and Nobel laureate says that the lingering threat of nuclear war is “bereft of reason.”

“Reason gave us science; laws of nature and some laws of man. From this came courts where laws are argued. There is a profound difference between that and drawing a gun,” writes Polanyi, who won the Nobel Prize in Chemistry in 1986 and has long argued for abolishing nuclear weapons.

“To set aside the gun will, however, require an act of will, opposing the continual call for armaments. The rationale for arming is that others do it. This defies logic, since it is a race to no destination except war.”

Polanyi notes that while 122 countries have provided their backing for the UN Treaty on the Prohibition of Nuclear Weapons, the world’s nuclear-armed states – as well as Canada – continue to hold out.

He writes that the goal of prohibition will require these countries to set aside the pursuit of armed power and make a “break with history” for the greater good.

Read the op-ed in the Globe and Mail

‘Science is a contact sport’: What one ��TV researcher learned in the lab of Nobel laureate William Kaelin

noreen.rasbach — Fri, 15 Nov 2019 05:00:00 +0000

‘Science is a contact sport’: What one ��TV researcher learned in the lab of Nobel laureate William Kaelin

noreen.rasbach Fri, 11/15/2019 - 00:00

Cutline

From left, ��TV's Meredith Irwin, Nobel laureate William Kaelin Jr. and ��TV's Micahel Ohh, celebrating Kaelin's 60th birthday at the Harvard Faculty Club (photo courtesy of Michael Ohh)

Topic

Research & Innovation

When University of Toronto Professor Michael Ohh was scouting postdoctoral positions at Harvard Medical School in the mid-1990s, a group of Canadians that often gathered to talk science told him to check out the molecular oncology floor at the Dana-Farber Cancer Institute, run by legendary virologist David Livingston.

It turned out to be good advice.

Ohh met with three young investigators Livingston had trained and hired, including the clinician-scientist William Kaelin Jr. “The floor was full of bright and driven people, and the electricity in the air was palpable,” recalls Ohh, now a professor of laboratory medicine and pathobiology and of biochemistry at ��TV.

Ohh spent the next five years in Kaelin’s lab and co-authored several papers on how cells respond to changes in oxygen levels – research that contributed to Kaelin being awarded the 2019 Nobel Prize in Physiology or Medicine.

The work also set the stage for Ohh’s career as an independent scientist in Toronto, and it continues to bear fruit and hold promise for treatments of cancer and other diseases.

“One of the most significant things I learned in Bill’s lab was a rigorous approach to science,” says Ohh. “He really wanted you to nail the mechanism with a series of elegant experiments and he understood that process is highly competitive with other labs. He often said, ‘Science is a contact sport.’”

Ohh calls his time in Kaelin’s lab a “tour of duty” – unbearably stressful at times, but balanced by the excitement of doing fascinating science with talented people.

Kaelin’s lab was focused on three tumour suppressor genes. Two were well known, but the third was a newly discovered gene called VHL that had been shown to cause von Hippel-Lindau syndrome, a rare hereditary disorder in which patients develop multiple benign and cancerous tumours.

Only a handful of labs in the world studied VHL at the time and virtually nothing was known about its function. “We tried a guilt-by-association approach, looking for proteins with which VHL interacted in the hope that these might shed clues to VHL function,” says Ohh.

By the late 1990s, they had found several and determined that those proteins are part of a larger complex that likely targets other proteins for destruction.

They showed that without a functional VHL protein, these complexes are unable to degrade another protein called hypoxia-inducible factor (HIF), which in turn spurs tumour cell survival and growth even in low-oxygen microenvironments.

The mechanism at play in von Hippel-Lindau syndrome, in other words, also impacts how all cells sense and adapt to oxygen deprivation. “The worlds of hypoxia and VHL collided in that discovery,” says Ohh.

Researchers have since developed ways to control how cells sense and adapt to changes in oxygen, and are applying those findings for various conditions. A drug based on this approach is in clinical trial for various cancer types, and the findings also look promising in pre-clinical research for cardiovascular disease and anemia.

Ohh’s lab in Toronto has just figured out why certain people with mutations in another HIF gene get cancer and/or polycythemia (an excess of red blood cells). Recent clinical reports have detailed the plight of people with this mutation, and clinicians are now asking Ohh’s lab if they can help predict what disease their patients will eventually develop, so they can better monitor their patients for these conditions.

“Early detection is critical for outcomes in cancer treatment, so this is useful, highly personalized medicine,” says Ohh. “And it’s an extension of the work we did 20 years ago, which is gratifying.”

Ohh and his lab are also looking at evolutionary aspects of this molecular pathway. They are studying evolutionary diversions of the pathway among different animals over millions of years to see which genetic sequences and motifs are conserved.

Insights into these diversions could offer ways to understand the precise mechanisms and critical regions of HIF and VHL by which cells better respond to oxygen fluctuations.

Great science isn’t the only product of the Kaelin lab. Ohh met his wife Meredith Irwin there when she was a research trainee, and they have been together for two decades. Irwin is a professor of pediatrics, medical biophysics and laboratory medicine and pathobiology at ��TV, as well as a clinician-scientist at The Hospital for Sick Children.

Irwin was born and raised in New York, studied at the Massachusetts Institute of Technology and Harvard, and trained at Boston Children’s Hospital and Dana-Farber for more than a decade.

The couple travelled to Boston for Kaelin’s 60^th birthday two years ago. “They asked us to give talks, and afterward Bill made a comment about me stealing an American to Canada,” says Ohh. “We really are very happy here in Toronto.”

Nobel Laureate John Polanyi: 'What can we do to prevent nuclear war?'

Christopher.Sorensen — Thu, 14 Nov 2019 05:00:00 +0000

Nobel Laureate John Polanyi: 'What can we do to prevent nuclear war?'

Christopher.Sorensen Thu, 11/14/2019 - 00:00

Cutline

��TV's John Polanyi remains committed to raising the public’s awareness of the threat of the arms race: “Our task is to keep that process of education going" (photo by Johnny Guatto)

Chris Sasaki

Topic

Alumni

Barbara Sherwood Lollar

Chemistry

Earth Sciences

Global

John Polanyi