Geoffrey Hinton

Statistical Sciences

Subheadline

Three former students who worked with the "godfather of AI" recall his passionate and playful approach to research

In the wake of Geoffrey Hinton’s 2024 Nobel Prize in Physics, former students and colleagues from the ��߲ݴ�ý are sharing their favourite anecdotes about the “godfather of AI” – including one involving the classic Atari video game Asteroids.

Nick Frosst (photo by Nina Haikara)

Nick Frosst, a U of T alumnus and co-founder of generative AI startup Cohere, said Hinton, University Professor Emeritus of computer science, once spoke of an intense, button-mashing session that left him with nerve damage.

“This kind of explains, perhaps, the way in which he types, which is still two fingers at a time,” said Frosst, who began working with Hinton as a U of T undergraduate student and was his first employee at Google Brain.

He shared the story at a recent event hosted by the department of computer science in the Faculty of Arts & Science, saying it offered a telling glimpse into Hinton’s character.

“It’s that fever-pitched intensity, passion and playfulness that he brings to everything … He found something that was fun and engaging and he played it until it damaged a finger and then he continued to push for it.”

Frosst said he also appreciates Hinton’s thoughtful consideration about the potential negative consequences of the revolutionary technology he helped create and praised him for looking past formal qualifications to spot potential and creativity.

“I don't have a master's degree or a PhD, but he was willing to work with me and I saw that in the types of people he brought into Google Brain to work with him,” Frosst said.

“He took lots of chances on people and gave them the time of day once they were there. And for that, I'll always be thankful and deeply privileged, and honoured, to have him in my life.”

Other former students at U of T tell similar stories.

Chris Maddison (supplied image)

Chris Maddison, now an assistant professor in U of T’s departments of computer science and statistical sciences in the Faculty of Arts & Science, was also an undergraduate student when he started working with Hinton in 2011.

He also painted a picture of Hinton’s vibrant office – where everyone knew when he had a new idea.

“The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility,” said Maddison. “He was famous for bursting into a room and pronouncing that, he now finally, after all these years, understood how the brain worked.”

Kevin Swersky (photo by Johnny Guatto)

Kevin Swersky, a research scientist at Google DeepMind, worked with Hinton as a graduate student at U of T and similarly described visiting Hinton as a memorable academic experience.

“Normally when you go to a supervisor's office, you give them a progress update. You go through what your latest results are, you talk about a couple of your ideas and you get some feedback,” he said.

“Going to Geoff’s office was a completely different story. He would be telling you what his latest idea was. He would show you his latest results. And his whole thing was just that he was really excited about it, and his hope was to inspire you enough to start running with it.”

He added that he was particularly inspired by Hinton’s focus on small, solvable puzzles that would ultimately lead to significant breakthroughs over time.

“Geoff would think completely intuitively – like the universe was a puzzle and he was just kind of figuring out where all the pieces went, and the math would always follow whatever he was talking about,” he said.

He also remarked on Hinton’s kindness.

“He offered to put me up for a few weeks,” he said of a time when he found himself looking for a place to stay in Toronto. “He offered to go and get dishes. I was thinking to myself, ‘Wow, Geoff Hinton wants to go out shopping for dishes for me so that I can be comfortable for a few weeks.’”

Geoffrey Hinton shakes hand at a recent U of T event celebrating his Nobel Prize (photo by Mac Pattanasuttinont)

Frosst, too, has a Hinton home-making story: the AI luminary built him a desk from scratch.

“He's a carpenter,” Frosst said. “It’s a small wooden desk that fits in the corner of my room at home.

“That's where I keep my computer and work from.”

‘One of the great minds of the 21st century’: U of T celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle — Thu, 17 Oct 2024 17:24:21 +0000

‘One of the great minds of the 21st century’: U of T celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle Thu, 10/17/2024 - 13:24

Cutline

University Professor Emeritus Geoffrey Hinton, who won the 2024 Nobel Prize in Physics, attends a celebration event held at the Schwartz Reisman Innovation Campus (photo by Mac Pattanasuttinont)

Topic

Schwartz Reisman Innovation Campus

Leah Cowen

Wesley Hall

Schwartz Reisman Institute for Technology and Society

Department of Computer Science

CIFAR

Faculty of Applied Science & Engineering

Subheadline

The 2024 co-winner of the Nobel Prize in Physics - known to many as the "godfather of AI" - was honoured at an event attended by a who's who of the Toronto research community

There were standing ovations, peals of laughter and even a few tears as the ��߲ݴ�ý welcomed Geoffrey Hinton back to campus after he won the 2024 Nobel Prize in Physics.

A University Professor Emeritus of computer science, Hinton traded the “cheap hotel room in California,” where he received the life-changing news, for an emotional reception in the Schwartz Reisman Innovation Campus’s airy event hall.

The Oct. 10 event drew U of T leaders, supporters, dignitaries and other luminaries. They included Deputy Prime Minister Chrystia Freeland, University Professor Emeritus John Polanyi, who won the Nobel Prize in Chemistry in 1986, and Massey College Principal James Orbinski, who accepted the Nobel Peace Prize on behalf of Doctors Without Borders in 1999.

Several of Hinton’s many collaborators and proteges also attended the event – not to mention students who were simply eager to catch a glimpse of the “godfather of AI.”

Hinton chats with U of T Scarborough Professor David Fleet and Google Research Scientists Sara Sabour and Daniel Watson (photo by Johnny Guatto)

Though sleep deprived, Hinton regaled the audience with fond recollections of his early years as an AI researcher, snapshots of his trademark dry humour and warm expressions of gratitude for mentors, collaborators and, of course, his many students.

“I’ve been blessed to have brilliant graduate students and post-docs,” Hinton said.

“I had a principle when selecting graduate students: ‘If they’re not smarter than me, what’s the point?’ And I’ve had quite a number of graduate students who were smarter than me.

“They did things I wouldn’t have been able to do, so I’d like to thank them.”

He said two figures in particular played a huge role in the work that led to his Nobel Prize, which he shared with Princeton University’s John J. Hopfield. The first was Terry Sejnowsky, a computational neuroscientist and former student of Hopfield’s, who worked with Hinton on Boltzmann machines – a period Hinton described as “the most happy research time of my life.”

He also praised the contributions of the late David Rumelhart, a psychologist at Stanford University, who worked with him to develop backpropagation algorithms, a key breakthrough.

“[He] should have won the Nobel Prize,” Hinton said. “But unfortunately, Dave got a horrible brain disease and he died quite young.” (The Nobel organization doesn’t award the honour posthumously).

Hinton poses for a picture with Assistant Professor Chris Maddison, who was one of the last graduate students Hinton supervised (photo by Mac Pattanasuttinont)

Chris Maddison joined Hinton’s research group as an undergraduate and was one of the last students he supervised. Now an assistant professor in U of T’s departments of computer science and statistical sciences in the Faculty of Arts & Science, Maddison lauded Hinton as “a steadfast mentor and supporter who saw strength in me that I didn’t see” and said one of his greatest attributes was his sheer enthusiasm.

“No matter what’s going on, you can find him in the lab on Sundays at 8 p.m. playing with his MATLAB scripts like a child playing with Legos,” Maddison said. “He never lost that child-like sense of wonder that buoyed him and the group.”

U of T President Meric Gertler said, via video message from Indonesia, where he was on university business, that Hinton is “one of the great minds of the 21st century” (photo by Johnny Guatto)

U of T President Meric Gertler, who was in Indonesia on university business when the prize was announced, hailed Hinton in a video message as “one of the great minds of the 21st century” and someone who “literally created new ways of thinking about thinking and learning.”

He noted that Hinton’s AI leadership extends to the pressing question of responsible and safe development of the technology.

“With his Nobel win, he’s now perfectly positioned to amplify this concern on a world stage.” President Gertler said.

Hinton shares a laugh with University Professor Molly Shoichet of the Faculty of Applied Science & Engineering (photo by Johnny Guatto)

The event’s guest list served as a reminder of Hinton’s outsized influence on the research community in Toronto and beyond, drawing key figures from: the Vector Institute, where Hinton is co-founder and chief scientific adviser; the Schwartz Reisman Institute of Technology and Society, where he sits on the advisory board; and CIFAR (Canadian Institute for Advanced Research), where Hinton is an adviser and longtime fellow.

Hinton poses for a photo with Leah Cowen, U of T’s vice-president, research and innovation, and strategic initiatives (photo by Johnny Guatto)

Leah Cowen, U of T’s vice-president, research and innovation, and strategic initiatives, reminded the accomplished audience that Hinton’s historic achievement – both the Nobel Prize and the AI revolution he helped spark – was the result of years toiling in an “unpromising backwater” of AI research.

“It is tempting to think that it happened almost overnight, but it didn’t,” Cowen said.

University Professors Emeriti – and fellow Nobel Prize-winners – Geoffrey Hinton and John Polanyi have their photo taken together (photo by Johnny Guatto)

Hinton took time to reflect on periods of personal struggle and tragedy – and thank those who helped him in his hour of need.

When his wife had an incurable form of cancer, he recalled how U of T President Emeritus David Naylor, a physician, medical researcher and former dean of the Temerty Faculty of Medicine, carried out research on a possible alternative treatment that was being explored – incorporating input from top medical experts – and presented him with a report of his findings.

“He’s a tremendous human being,” Hinton said of Naylor, who was in the audience.

Hinton shares a moment with U of T President Emeritus David Naylor (photo by Johnny Guatto)

Hinton also recalled how, when his first wife became ill in 1993 – also with cancer – his post-doctoral trainee Peter Dayan, now a director at the Max Planck Institute for Biological Cybernetics, stepped in to advise Hinton’s graduate students, giving him time to care for his ailing spouse.

“At times like this, you remember the people who helped you most when things were very difficult,” Hinton said.

He later pointed out that Dayan went on to supervise one of this year’s winners of the Nobel Prize in Chemistry, Demis Hassabis, joking that this made Dayan “the meat in a Nobel sandwich.”

Deputy Prime Minister Chrystia Freeland said Canada was lucky to have Hinton, who was born in the U.K., and thanked his daughter for sharing her father with the country, with science and the world (photo by Johnny Guatto)

For Minister Freeland, Hinton’s award showcased the value of ideas and of fundamental research. She said Hinton’s Nobel Prize sent waves of pride across Canada, which she said was “lucky as a country” that Hinton arrived on its shores back in 1987.

“Geoff shows that you can be a really brilliant intellectual and also a really great human being who cares about his community and his country,” Freeland said. “I am constantly struck by how Geoff thinks about the bigger implications of his ideas and how Geoff thinks about really wanting to make Canada and the world a better place.”

Hinton chats with Melanie Woodin, dean of the Faculty of Arts & Science, who thanked him for his friendship and mentorship – and his dedication to science and scholarship (photo by Johnny Guatto)

Following the program – which also featured remarks by U of T Chancellor Wes Hall, Faculty of Arts & Science Dean Melanie Woodin and Christine Szustaczek, U of T’s vice-president, communications – Hinton mingled with members of the audience, shook hands with students and caught up with former colleagues and trainees.

Clockwise from top left: Christine Szustaczek, Wes Hall, Chris Maddison, Leah Cowen, Geoffrey Hinton and Melanie Woodin (photo by Johnny Guatto)

Brendan Frey, professor in the Faculty of Applied Science & Engineering and CEO of AI-powered therapeutics startup Deep Genomics, said he was one of many who earned his PhD under Hinton’s supervision.

“I think of Geoff as the father of a community that includes myself, other graduate students and all the people who didn’t believe but then came to believe – and he inspired all of us,” said Frey, who shared a hug with his former supervisor following the event.

“I’m really happy for him.”

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle — Thu, 10 Oct 2024 16:26:59 +0000

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle Thu, 10/10/2024 - 12:26

Cutline

Geoffrey Hinton, University Professor Emeritus of computer science at the ��߲ݴ�ý and winner of the 2024 Nobel Prize in Physics, takes questions during a virtual press conference hosted by U of T (image via YouTube)

Topic

Department of Computer Science

Global

President Meric Gertler

Subheadline

"If you believe in something, don’t give up on it until you understand why that belief is wrong"

Empower curiosity-driven research. Follow your convictions. Think not just about how to advance technology, but how to direct its use for good.

These were among the key messages delivered by Geoffrey Hinton, University Professor Emeritus of computer science at the ��߲ݴ�ý and winner of the 2024 Nobel Prize in Physics, during an Oct. 8 press conference held by the university to mark his historic award.

Widely regarded as “the godfather of AI,” Hinton was named a co-winner of the prize – alongside John J. Hopfield of Princeton University – for his work on Boltzmann machines and artificial neural networks, which laid the groundwork for advancements in AI and stimulated new research directions in physics.

U of T President Meric Gertler hailed Hinton for having “a profound impact on multiple fields and disciplines,” crediting “his leadership and exemplary mentorship of young scholars” with helping U of T become a global leader in AI and machine learning.

“I think one cannot overstate the impact of a win like this on the ability of Canada, Toronto and the ��߲ݴ�ý to be able to welcome talented newcomers, great students and wonderful faculty from across the country and around the world because of the recognition that arises with Geoff’s win,” President Gertler said.

For his part, Hinton echoed his remarks from earlier in the day that he was “flabbergasted” to receive the prize and pleased that the Nobel committee recognized the advancements in artificial neural networks.

He also answered questions about his influences, legacy and how it feels to go from being an obscure researcher who toiled in a largely forsaken field to a Nobel Laureate – and his advice for researchers who hope to one day follow in his footsteps.

Here are five key themes that emerged from Hinton's news conference:

His legacy

“I’m hoping AI will lead to tremendous benefits, to tremendous increases in productivity and to a better life for everybody. I’m convinced that it will do that in health care.

“My worry is that it may also lead to bad things, and in particular, when we get things more intelligent than ourselves, no one really knows whether we’re going to be able to control them.

“We don’t know how to avoid [catastrophic AI scenarios] at present. That’s why we urgently need more research. So I’m advocating that our best young researchers, or many of them, should work on AI safety and governments should force large companies to provide the computational facilities they need to do that.”

A collaborative effort

“I think of the prize as a recognition of a large community of people who worked on artificial neural networks for many years.

“I’d particularly like to acknowledge my two main mentors: David Rumelhart, with whom I worked on the backpropagation algorithm … and my colleague Terry Sejnowsky, who I worked with a lot in the 1980s on Boltzmann machines and who taught me a lot about the brain.

“I’d also like to acknowledge my students. I was particularly fortunate to have many clever students, much cleverer than me, who actually made things work. They’ve gone on to do great things.

“I should also acknowledge Yoshua Bengio and Yann LeCun who were close colleagues and very instrumental in developing this whole field.”

Canada’s research strengths

“I think the main thing about Canada as a place to do research is there isn’t as much money as there is in the U.S., but it uses its money quite wisely.

“In particular, the main funding council for this type of research, called NSERC, uses money for basic curiosity-driven research, and all of these advances in neural networks came out of basic curiosity-driven research – not out of throwing money at applied problems, but out of letting scientists follow their curiosity to try and understand things. And Canada’s quite good at that.”

Many thought he was wasting his time

“It was a lot of fun doing the research, but it was slightly annoying that many people – in fact, most people in the field of AI – said that neural networks would never work.

"They were very confident these things were a waste of time and we would never be able to learn complicated things – for example, understanding natural language – using neural networks. And they were wrong."

Believe in your ideas

"My message is this: if you believe in something, don’t give up on it until you understand why that belief is wrong.

"Often, you believe in things and you eventually figure out why that’s a wrong thing to believe in. But so long as you believe in something and you can’t see why that’s wrong – like, ‘the brain has to work somehow so we have to figure out how it learns the connection strengths to make it work’ – keep working on it and don’t let people tell you it’s nonsense if you can’t see why it’s nonsense."

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen — Wed, 09 Oct 2024 19:24:35 +0000

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen Wed, 10/09/2024 - 15:24

Cutline

(photo by Polina Teif)

Topic

News of Geoffrey Hinton’s Nobel Prize in Physics travelled around the globe, making international headlines for the British-Canadian scientist known as the “godfather of AI.”

A University Professor Emeritus of computer science at the ��߲ݴ�ý, Hinton won the prize jointly with Princeton’s John J. Hopfield for early discoveries and inventions in the realm of physics that laid the groundwork for today’s artificial intelligence boom.

Hinton told The New York Times he was, “shocked and amazed and flabbergasted. I never expected it.”

After receiving the call from Stockholm in the wee hours, Hinton, who was in California, spent much of the day attending press conferences and speaking with reporters from a “cheap hotel room with no internet,” even oscillating mid-interview between the Times and the BBC.

Nevertheless, he seized the moment to emphasize both the promise and pitfalls of AI-based technologies.

“It’s going to be like the Industrial Revolution – but instead of our physical capabilities, it’s going to exceed our intellectual capabilities," he told the BBC. “… but I worry that the overall consequences of this might be systems that are more intelligent than us that might eventually take control.”

Independent UK acknowledged the unusual nature of Hinton’s win in the physics category.

“I’m not a physicist, I have very high respect for physics,” Hinton said. “I dropped out of physics after my first year at university because I couldn’t do the complicated math. So, getting an award in physics was very surprising to me. I’m very pleased that the Nobel committee recognised that there’s been huge progress in the area of artificial neural networks.”

Closer to home, Hinton’s award was lauded in the national media, from CBC: The National – which highlighted his emphasis on the importance of supporting curiosity-driven research and his role in training many of today’s AI leaders – to the front pages of The Toronto Star and The Globe and Mail.

“I want to emphasize that AI is going to do tremendous good,” Hinton told the Globe after receiving the news about the win. “In areas like health care, it’s going to be amazing. That’s why its development is never going to be stopped. The real question is can we keep it safe?”

Read Hinton’s interview in the New York Times (paywall)

Read the BBC story

Read the Globe and Mail story (paywall)

Watch CBC: The National’s report

Congratulations pour in for Geoffrey Hinton after Nobel win

mattimar — Tue, 08 Oct 2024 19:43:16 +0000

Congratulations pour in for Geoffrey Hinton after Nobel win

mattimar Tue, 10/08/2024 - 15:43

Cutline

(Photo by Johnny Guatto/��߲ݴ�ý)

Mariam Matti

Topic

University Health Network

Vector Institute

Subheadline

“You always knew when Geoff had a new idea. The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility"

Reactions to Geoffrey Hinton’s Nobel Prize win began almost immediately after it was announced Tuesday morning.

Known as the “godfather of AI,” the University Professor Emeritus of computer science at the ��߲ݴ�ý shared the Nobel Prize in Physics with John J. Hopfield of Princeton University for groundbreaking work that laid the foundation for machine learning using artificial neural networks.

U of T’s Geoffrey Hinton and Princeton’s John J. Hopfield are pictured during the announcement for the 2024 Nobel Prize in Physics (photo by Jonathan Nackstrand/AFP via Getty Images)

At U of T, students, faculty and staff gathered at an event hosted by the department of computer science in the Faculty of Arts & Science, which Hinton joined as a professor in 1987.

Those in attendance described a revered and beloved figure, citing Hinton’s determination, playful approach to research and excitement for new ideas.

"I really don’t think there’s anyone more deserving of this recognition," said Chris Maddison, assistant professor in U of T’s departments of computer science and statistical sciences, and one of Hinton’s former students.

"Geoff was a fantastic adviser. He worked really, really hard to remove the barriers for his students and he was laser focused on ideas and building his own understanding."

Hinton also received congratulations from universities and other research organizations around the world, including the Royal Society, the Alan Turing Institute and Cambridge University, Hinton’s alma mater.

Meanwhile, friends, colleagues and leaders in politics and business took to social media to express their congratulations for Hinton’s remarkable achievement.

Here’s a snapshot of what some of them said:

From left: Melanie Woodin, Chris Maddison, Nick Frosst, Kevin Swersky and Eyal de Lara (photo by Johnny Guatto)

“Congratulations to Geoffrey Hinton on this fantastic recognition which is a testament to the importance of supporting basic research and the long journey that can lead to profound discoveries like deep learning that forever change our world. Hinton's phenomenal work has seeded new and innovative research by his former students and many around the world who are using AI to solve global challenges in areas like medicine and climate change.“

– Leah Cowen, vice-president, research and innovation, and strategic initiatives at U of T

“I would say his approach to science has stuck with me. Everything I know about how to do science, I mostly learned from him. It's his curiosity and playfulness ... that has been most impactful. I would also say his thoughtfulness, thinking about the consequence of the technology and how it affects society is something that we have taken seriously at Cohere as well.”

– Nick Frosst, U of T alumnus and co-founder of Cohere

“You always knew when Geoff had a new idea. The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility. He was famous for bursting into a room and pronouncing that, he now finally, after all these years, understood how the brain worked. Above all, he understood that research was a human endeavor. Research is really hard. It becomes personal. It's intertwined with tragedies and compromises. I saw him go through some of his own when I was a student in the group, and I went through my own. I remember when I was going through some health challenges, I went to him and I said, 'Geoff, sometimes it's really hard to go on.’ And he looked at me and he said, ’But we're not going to let that slow us down, will we?’"

– Chris Maddison, assistant professor in U of T’s departments of computer science and statistical sciences, Faculty of Arts & Science

U of T is the only computer science department with a Nobel Prize winner, says Professor Michael Brudno (photo by Johnny Guatto)

“It's a once-in-a-lifetime opportunity to celebrate an award for somebody who has made huge contributions – obviously in AI broadly, [and] to this department. No other computer science department can say that they have a Nobel Laureate. But I think beyond that, it really goes back to show how the birthplace of modern AI is Toronto, how this is the place where it all started and how it's upon us as the AI faculty in this department to continue this legacy.”

– Michael Brudno, professor in U of T’s department of computer science, acting vice-dean, graduate education in Faculty of Arts & Science, a chief data scientist at University Health Network and a faculty member at the Vector Institute

Geoffrey Hinton shares a laugh with fellow AI researcher Raquel Urtasun, left, at the Vector Institute’s opening in 2017 (photo by Lisa Lightbourn)

"Geoff is the most influential person in AI, and our field would certainly not be the same without his immense contributions. He is also a tremendous educator, and has mentored many students and postdocs who have gone on to become very influential in the field of AI. Geoff cares deeply about the Toronto and Canadian ecosystem and was the driving force in the formation of the Vector Institute, which we co-founded together. Through our time as colleagues at the ��߲ݴ�ý, I've deeply admired his commitment to the advancement of AI for good. This recognition is well-deserved and acknowledges his decades of work leading AI innovation and building the foundation for the AI revolution that is happening today.”

– Raquel Urtasun, professor in U of T’s department of computer science, faculty member and co-founder at the Vector Institute, founder and CEO of Waabi

“I was the first to call Geoff Hinton “Godfather of Deep Learning,” which later became “Godfather of AI.” Thrilled to see him win the Nobel prize together with John Hopfield for AI. Congrats @geoffreyhinton.”

– Andrew Ng, co-founder of Coursera, founder GoogleBrain, former chief scientist at Baidu

Prime Minister Justin Trudeau speaks with Geoffrey Hinton at a 2019 event (photo by Nick Iwanyshyn)

“Dr. Hinton is a stalwart in his field. Celebrated as one of the ‘Godfathers of AI’, he brings decades of leading expertise in AI research as a Professor Emeritus at the ��߲ݴ�ý’s Department of Computer Science, and the current Chief Scientific Advisor at the Vector Institute in Toronto – one of our three national AI institutes. Dr. Hinton is also an outspoken advocate for the responsible development and adoption of AI, educating the world about the benefits and challenges this technology poses.

“Canada is at the forefront of AI technology thanks to trailblazers like Dr. Hinton. His curiosity for discovery and contributions to innovation will inspire generations to come. On behalf of all Canadians, I congratulate him on his remarkable achievement.”

– Justin Trudeau, Prime Minister of Canada

A.M. Turing Award winners Yann LeCun, left, Yoshua Bengio, middle, and Geoffrey Hinton at an AI summit in Montreal (photo courtesy of RE•WORK)

"@HopfieldJohn and @geoffreyhinton, along with collaborators, have created a beautiful and insightful bridge between physics and AI. They invented neural networks that were not only inspired by the brain, but also by central notions in physics such as energy, temperature, system dynamics, energy barriers, the role of randomness and noise, connecting the local properties, e.g., of atoms or neurons, to global ones like entropy and attractors. And they went beyond the physics to show how these ideas could give rise to memory, learning and generative models; concepts which are still at the forefront of modern AI research. Their ideas inspired me so profoundly that I decided to choose learning in neural networks for my own research as a graduate student. They motivated me to look for abstract principles that could be as simple as the laws of physics, but could explain biological as well as artificial intelligence. I'm truly delighted for them and for our field."

– Yoshua Bengio, professor at Université de Montréal and co-winner of the A.M Turing Award with Geoffrey Hinton and Yann LeCun

“It was the first thing I saw in the morning. I opened my phone, and it was the headline of The New York Times and I was like, ‘Yes!’ I was very excited. I saw his perseverance – he always goes with what he believes, not what the flow is – and it's quite inspirational for me. That’s what I look for, especially in the health care area. I want to do something meaningful, something big.”

–Tina Behrouzi, second year PhD student in U of T’s department of computer science

Geoffrey Hinton poses with graduate students Ilya Sutskever, left, and Alex Krizhevsky, right, in 2013 (photo by Johnny Guatto)

“Congratulations to @geoffreyhinton for winning the Nobel Prize in physics!!”

– Ilya Sutskever, U of T alumnus, co-founder of OpenAI and co-founder and chief scientist at Safe Superintelligence

“Going to Geoff’s office was always fun. Normally when you go to a supervisor's office, you give them a progress update. You go through what your latest results are, you talk about a couple of your ideas and you get some feedback. Going to Geoff’s office was a completely different story. He would be telling you what his latest idea was. He would show you his latest results. And his whole thing was just that he was really excited about it, and his hope was to inspire you enough to start running with it.”

– Kevin Swersky, U of T alumnus and research scientist at Google DeepMind

“[Hinton's] pioneering research at the ��߲ݴ�ý not only revolutionized the field of AI but has also been instrumental in establishing Canada as a global powerhouse in AI research and innovation."

– Tony Gaffney, president and CEO of the Vector Institute

Fei-Fei Li and Geoffrey Hinton speak at a 2023 event in Toronto (photo by Polina Teif)

“This is beyond exciting! #AI’s far reaching impact is just beginning.”

– Fei-Fei Li, professor of computer science at Stanford University and co-director of Stanford’s Human-Centered AI Institute

“Congratulations to @geoffreyhinton, University Professor Emeritus at@UofT, on winning the 2024 Nobel Prize in Physics! Widely regarded as the “godfather of AI,” Hinton’s pioneering work in artificial neural networks has transformed the global AI landscape. Dr. Hinton’s achievement highlights the best of #Ontario’s world-class talent and thriving AI ecosystem, driving innovation and shaping the future of critical #technology!

– Victor Fedeli, Ontario’s minister of economic development, job creation and trade

"On behalf of the Department and the University, we are very proud to acknowledge Geoff's global achievements and this international recognition. His contributions to machine learning and artificial intelligence have benefited virtually every discipline in science, engineering, social sciences and medicine. As we celebrate the department’s 60th anniversary, this award embodies six decades of impact and innovation in computer science and technology.”

– Eyal de Lara, professor and chair of U of T’s department of computer science, Faculty of Arts & Science

“Heartfelt congratulations to Geoff Hinton @geoffreyhinton on winning the Nobel Prize! What an incredible honor! I feel deeply privileged to have had the opportunity to be your PhD student, work with you, and learn from you.”

– Russ Salakhutdinov, professor of computer science at Carnegie Mellon University

Hinton approached his research with an “almost childlike playfulness,” says Graduate student Ujan Sen (photo by Johnny Guatto)

“Waking up today, seeing that news, just motivates me even more and reaffirms the decision that coming to U of T was the absolutely the best decision I could have taken. I think one of the people who had previously worked with him mentioned something along the lines of: Geoff didn't really care too much about pedigree. He cared about ideas, regardless if you have a master's or PhD. And the way he approached his research and the almost childlike playfulness and innocence he had with sort of getting to the answer is something that I really resonate with.”

– Ujan Sen, master’s student in U of T’s department of computer science, Faculty of Arts & Science

"I want to extend my heartfelt congratulations to Dr. Geoffrey Hinton on winning the 2024 Nobel Prize in Physics. His groundbreaking work in machine learning has made Canada world-renowned in the field of AI. He is a true inspiration for the next generation of Canadian researchers!"

– François-Philippe Champagne, Canada’s minister of innovation, science and industry

“I’m originally a chemist. It was a surprising thing for me that a Nobel Prize is being awarded to a computer scientist. This is a big moment for computer science. I think it will bring recognition to physics-based approaches and core thinking.

“I think it’s great that some universities like U of T are willing to believe in crazy ideas. People need to encourage outside-the-box thinking.”

– Ella Rajaonson, PhD student in the Matter Lab with U of T professor Alán Aspuru-Guzik

“Congratulations!”

– Olivia Chow, mayor of Toronto

Geoffrey Hinton wins Nobel Prize in Physics

davidlee1 — Tue, 08 Oct 2024 19:35:09 +0000

Geoffrey Hinton wins Nobel Prize in Physics

davidlee1 Tue, 10/08/2024 - 15:35

Cutline

(Photo by Johnny Guatto/��߲ݴ�ý)

Topic

Physics

Subheadline

A U of T University Professor Emeritus, Hinton shared the honour with Princeton University's John J. Hopfield for discoveries and inventions that enable machine learning with artificial neural networks

Geoffrey Hinton, a University Professor Emeritus of computer science at the ��߲ݴ�ý, has won the 2024 Nobel Prize in Physics.

Widely regarded as the “godfather of AI,” Hinton shared the prize with John J. Hopfield of Princeton University for foundational discoveries and inventions that enable machine learning with artificial neural networks.

Hinton said he was “flabbergasted” at the honour as messages poured in from around the world.

“I had no expectations of this,” he told U of T News shortly after the win was announced in Stockholm Tuesday morning. “I am extremely surprised and I'm honoured to be included.”

He later told reporters at a press conference he was “in a cheap hotel in California” with no Internet and a poor phone connection when he was notified about his Nobel Prize.

“I was going to get an MRI scan today, but I think I’m going to have to cancel that.”

Hinton and Hopfield are credited with wielding tools from physics to advance basic research in the field. Specifically, Hopfield created an associative memory that can store and reconstruct images in data, while Hinton invented a way to find properties in data and perform tasks such as identifying specific elements in pictures.

“On behalf of the ��߲ݴ�ý, I am absolutely delighted to congratulate University Professor Emeritus Geoffrey Hinton on receiving the 2024 Nobel Prize in Physics,” said U of T President Meric Gertler. “The U of T community is immensely proud of his historic accomplishment.”

Hinton was selected for the high-profile award for his use of the Hopfield network – invented by his co-laureate – as the foundation for a new network called the Boltzmann machine that can learn to recognize elements within a given type of data.

The Boltzmann machine can classify images and generate new examples of the pattern on which it was trained, with Hinton and his graduate students later building on this work to help usher in today’s rapid development of machine learning – a technology that now underpins a host of applications ranging from large language models such as ChatGPT to self-driving cars.

Johan Jarnestad/The Royal Swedish Academy of Sciences

“The laureates’ work has already been of the greatest benefit. In physics we use artificial neural networks in a vast range of areas, such as developing new materials with specific properties,” said Ellen Moons, chair of the Nobel Committee for Physics.

The win by Hinton and Hopfield was covered by media and other organizations around the globe, with The New York Times describing the Nobel committee’s decision as “an acknowledgement of AI’s growing significance in the way people live and work,” and the prestigious journal Nature noting Hinton’s innovations now “form the basis of many state-of-the-art AI tools.”

Hinton joined U of T as a professor of computer science in 1987 after working in various universities in the U.K., where he was born, and in the United States. He went on to be named a University Professor – U of T’s highest academic appointment – in 2006.

Driven by a desire to understand the human brain, Hinton and his graduate students built on his early efforts with an array of developments that paved the way for an explosion in deep learning. One of the first cohort of researchers supported by the Canadian Institute for Advanced Research (CIFAR), Hinton’s work helped catapult Canada to its current status as a global leader in AI development.

The Royal Swedish Academy of Sciences, which awards the Nobel Prize in Physics, noted Hinton persisted with his research even as the scientific community lost interest in artificial neural networks during the 1990s, and ultimately “helped start the new explosion of exciting results” in the 2000s.

Hinton, for his part, said during a U of T press conference Tuesday evening that his achievements wouldn’t have been possible without support for curiosity-based research – something he said Canada was good at.

He added that his shock at winning the Nobel stemmed from the fact that, while his work has drawn on statistical physics, he isn’t a physicist himself – and even “dropped out of physics after my first year in university because I couldn’t do the complicated math.”

He also said that he plans to donate the money associated with the prize to various charities, including one that provides jobs for neurodiverse young adults.

Hinton likened the influence of AI to that of the Industrial Revolution during a virtual press conference with the academy earlier in the day – “But instead of exceeding people in physical strength, it’s going to exceed people in intellectual ability.”

He added that the rise of AI “is going to be wonderful in many respects,” citing health care and workplace productivity as two areas poised to benefit hugely from the technology. “But we also have to worry about a number of possible bad consequences, particularly the threat of these things getting out of control,” Hinton said.

In early 2023, Hinton quit his job at Google and focused on sounding the alarm about the risks of rapid and unfettered AI development. He outlined his reasoning in a 46-minute U of T video last year, urging young researchers to focus their efforts on the emerging field of AI safety – a message he repeated in media interviews following his Nobel win.

He has continued to tackle the issue at lectures and public appearances around the world, including at U of T and at Cambridge University, his alma mater.

“I am thrilled Geoffrey Hinton, an esteemed colleague and dear friend has been awarded the Nobel Prize in Physics,” said Melanie Woodin, dean of U of T’s Faculty of Arts & Science.

“Geoff is an historic visionary whose groundbreaking work in deep learning and neural networks has made U of T and the Toronto region a leading global centre for AI. And it speaks volumes about his integrity that while he helped lay the foundation for the artificial intelligence revolution, he is also one of the leading voices urging that we develop this technology responsibly and ethically.”

Similarly, Prime Minister Justin Trudeau lauded Hinton for his efforts to realize responsible AI development, releasing a statement and writing on X: “Geoffrey, we’re glad to have a mind like yours developing safe and responsible AI for the world.”

Geoffrey Hinton delivers a lecture about responsible AI to U of T students and faculty (photo by Johnny Guatto)

Hinton, who is co-founder and chief scientific adviser at the Vector Institute in Toronto, joins an illustrious list of past Nobel Prize in Physics winners that includes Albert Einstein and Marie Curie (who also won a Nobel in chemistry). The prestigious award is the latest in a long list of accolades for Hinton. They include the Association for Computing Machinery’s A.M. Turing Award – widely considered “the Nobel Prize of computing” – in 2019 alongside collaborators Yann LeCun and Yoshua Bengio.

Hinton is the fourth U of T faculty member to win a Nobel Prize over the years.

Sir Frederick Banting and J.J.R Macleod won a Nobel Prize in Physiology or Medicine for their work with Charles Best in 1923 to isolate insulin. In 1986, John Polanyi was one of three winners of the Nobel Prize in Chemistry for the development of the new field of reaction dynamics.

Other members of the U of T community, including several alumni, have received or been associated with the international honour.

Oliver Smithies, a past professor at U of T, was a joint winner of the Nobel Prize in Physiology or Medicine in 2007 for discovering the “principles for introducing specific gene modifications in mice by the use of embryonic stem cells.”

Also in 2007, Professor Robert Jefferies shared in the Nobel Peace Prize awarded to the Intergovernmental Panel on Climate Change (IPCC), in which he was a key Canadian representative as an international leader in Arctic science and global change biology.

In 1999, U of T Professor James Orbinski accepted the Nobel Peace Prize on behalf of Doctors Without Borders, which was recognized for its humanitarian work.

Anti-nuclear activist and U of T alumna Setsuko Thurlow accepted the Nobel Peace Prize in Norway in 2017 on behalf the International Campaign to Abolish Nuclear Weapons (ICAN).

In 2001, Michael Spence, an alumnus of ��߲ݴ�ý Schools, was one of three joint winners of the Bank of Sweden Prize in Economic Sciences in Memory of Alfred Nobel for his contributions to analyses of markets with asymmetrical information.

Bertram Brockhouse, who completed two degrees at U of T, was a co-winner of the Nobel Prize in Physics in 1994 for the development of neutron scattering techniques for studies of condensed matter.

Arthur Schawlow, an alumnus, was one of three winners of the same prize in 1981 for his contribution to the development of laser spectroscopy.

In 1998, U of T alumnus Walter Kohn was a co-winner of the Nobel Prize in Chemistry for development of the density-functional theory.

Former Prime Minister Lester B. Pearson, who received a bachelor’s degree from U of T, won the Nobel Peace Prize in 1957.

With U of T innovators front and centre, Collision conference wraps up five-year Toronto run

rahul.kalvapalle — Fri, 21 Jun 2024 14:52:23 +0000

With U of T innovators front and centre, Collision conference wraps up five-year Toronto run

rahul.kalvapalle Fri, 06/21/2024 - 10:52

Cutline

U of T alumna Nuha Siddiqui, co-founder and CEO of Erthos, on stage at the Collision tech conference (photo by Johnny Guatto)

Adina Bresge

Topic

Institutional Strategic Initiatives

U of T Entrepreneurship

Innovation & Entrepreneurship

Innovations & Partnerships Office

Startups

Budding entrepreneurs, leading scientists and future business leaders from the ��߲ݴ�ý community played a leading role at the 2024 Collision tech conference in downtown Toronto.

Running over three days this week, the conference drew some 40,000 attendees from across the spheres of tech, business and media, including more than 1,600 startups and 700 investors.

The rapid development of artificial intelligence technologies and their impact on business and society were key themes for many of the conference’s keynotes and exhibits – so it was no surprise that U of T’s AI luminaries were front and centre.

They included U of T alumnus Aidan Gomez, co-founder of language processing startup Cohere – which has raised hundreds of millions from investors and generated significant industry buzz.

He urged businesses to commit to adopting AI tools to support their workers.

“Making sure that you’re delivering the tools that your employees need to be competitive and effective is crucial,” Gomez said during his talk on Tuesday.

He added that augmentation of workforces with AI co-pilots and assistants is inevitable – including in industries that might not stand out as obvious adopters of the technology. He shared the example of a natural resources insurance firm that built an AI co-pilot – powered by Cohere – to help their actuaries speed up their research, craft more accurate bids and win more contracts.

“I never would have thought a natural resources insurance company would be adopting LLMs [large language models], but they are, and it’s having an impact. It’s actually helping them win more business,” Gomez said. “So I think the technology is completely horizontal.”

Gomez also cited the medical sector – particularly, drug discovery – as another area that’s poised to benefit massively from AI advances.

Aidan Gomez, a U of T alumnus, talked about how AI will be used to augment the workforce (photo by Polina Teif)

University Professor Emeritus Geoffrey Hinton, the influential computer scientist often dubbed the “godfather of AI,” also identified medical care and productivity as two key areas that will see significant improvements thanks to AI. However, much of his discussion, titled "Can We Control AI?", focused on his previously-cited concerns about how AI development could ultimately wrest control from humans given the current race to develop the technology and the absence of sufficient safeguards.

“Even if I’m totally benevolent and I just want to achieve what you asked me to achieve, I’ll realize that if I get more control, it will be easier to do that,” Hinton said of AI agents.

“And actually, if these things are much smarter than us, they’ll realize: Just take the control away from people and it will be much more efficient … and that seems to be like a very slippery path.”

Geoffrey Hinton warned of the existential dangers posed by unchecked AI development (photo by Johnny Guatto)

Gomez, for his part, said he doesn’t believe AI poses a serious threat.

“The notion that the technology is going to start self-improving, that it’s going to start manipulating people, that it’s going to take over, seize power and displace humans: that’s a sci-fi narrative,” he said. “I am empathetic to it – we’ve been writing stories about that exact scenario for decades, since before computers, and so it’s very deeply embedded in our cultural brainstems ... I just don’t think it’s true.”

Earlier at the conference, Raquel Urtasun, founder of self-driving trucking startup Waabi, spoke about generative AI and how Waabi is applying the technology to autonomous trucks. Her keynote took place following the company’s announcement that it raised US$200 million in Series B funding to support the deployment of driverless trucks in 2025.

“Everything will be controlled by generative AI systems inside the vehicle and nothing else. This is a breakthrough for the industry, where such a thing has never happened before,” said Urtasun, a professor in the department of computer science in U of T's Faculty of Arts & Science.

Raquel Urtasun spoke about her self-driving truck startup Waabi (photo by Polina Teif)

The conference also featured demos from other promising U of T startups including Erthos, which has invented sustainable alternatives to plastics and is now using machine learning to accelerate biomaterials discovery.

“Our platform allows us to design effective biomaterials five times faster and with 92 per cent less cost compared to our industry,” said co-founder and CEO Nuha Siddiqui.

Collision’s final year in Toronto was expected to draw some 40,000 attendees (photo by Johnny Guatto)

During the conference, U of T’s booth near the main stage featured exhibits from campus-linked accelerators, institutional strategic initiatives, academic divisions and the Innovations and Partnerships Office. U of T’s Black Founders Network was also at Collision as one of the organizers of the Black Innovation Zone.

Collision 2024 marked the fifth and final edition of the annual conference in Toronto.

Waabi, founded by U of T's Raquel Urtasun, raises US$200 million to launch self-driving trucks

lanthierj — Wed, 19 Jun 2024 20:26:16 +0000

Waabi, founded by U of T's Raquel Urtasun, raises US$200 million to launch self-driving trucks

lanthierj Wed, 06/19/2024 - 16:26

Cutline

(photo by Nick Iwanyshyn)

Topic

Department of Computer Science

Entrepreneurship

Waabi, a self-driving trucking startup founded by ��߲ݴ�ý artificial intelligence (AI) expert Raquel Urtasun, has raised US$200 million in series B funding to support the deployment of fully autonomous, AI-powered trucks in 2025.

The funding round was led by previous investors Uber Technologies Inc.– where Urtasun previously worked as chief scientist of the self-driving division – and Khosla Ventures and includes an array of other high-profile strategic investors including NVIDIA Corp., Volvo Group and Porsche Automobil Holding.

The latest funding brings total investment in Waabi to more than C$380 million and will be used to expand the Toronto-headquartered company’s team in both Canada and the U.S., as well as to launch driverless commercial deliveries in Texas by next year.

(photo Nick Iwanyshyn)

Urtasun, a professor in the department of computer science at U of T’s Faculty of Arts & Science and co-founder of the Vector Institute for Artificial Intelligence, said Waabi’s end-to-end AI system is advancing self-driving technologies to frontiers beyond the reach of other industry players thanks to its unique ability to carry out complex reasoning.

“What we have at Waabi is a technology that brings generative AI to the physical world for the first time, where the idea is that you have a single AI system that is able to reason like a human does, and is able to generalize to situations everything that might happen on the road – including things that it has never seen before,” she said.

“It does so in a way that is interpretable, so you can validate and verify the system, and provably safe, which is very important as you deploy these massive robots in the real world.”

Paired with Waabi’s advanced simulator, the AI system reduces the need for time-consuming road testing, Urtasun explained.

The announcement came hours before Urtasun took to the main stage at the Collision tech conference in Toronto to deliver a talk on generative AI. Her remarks touched on the technological underpinnings of generative AI and future applications, and outlined how Waabi is bringing generative AI to the physical world – starting with trucking.

Raquel Urtasun at the 2024 edition of Collision (photo by Polina Teif)

Urtasun is one of several experts from U of T’s technology, innovation and entrepreneurship ecosystem who are speaking at Collision. Others include University Professor Emeritus Geoffrey Hinton, a world-renowned AI luminary and investor in Waabi.

“Self-driving technology is a prime example of how AI can dramatically improve our lives,” Hinton said in a news release. “Raquel and Waabi are at the forefront of innovation, developing a revolutionary approach that radically changes the way autonomous systems work and leads to safer and more efficient solutions.”

Earlier in the week, Urtasun brought one of Waabi’s trucks to the St. George campus and showcased some of its capabilities to Melanie Woodin, dean of the Faculty of Arts & Science, Tony Gaffney, president and CEO of the Vector Institute, and Michael Brudno, professor in the department of computer science and chief data scientist at the University Health Network.

From left: Melanie Woodin, Raquel Urtasun, Tony Gaffney and Michael Brudno (photo by Nick Iwanyshyn)

Urtasun underscored the importance of the company being headquartered in Toronto. “We’re an AI company and Toronto has always been at the forefront of AI,” Urtasun said. “There’s tremendous talent here, a busy ecosystem, and for me it’s important to be in Canada, where I’m very aligned with the values of the country as well.”

Reflecting on her journey at U of T, where she started as an assistant professor in 2014, Urtasun said she initially assumed she would “just be an academic doing research for the rest of my life” – but soon realized that involvement in industry would be critical to advancing AI technologies for use in the real world.

“Three years ago, I saw a tremendous opportunity to start a new company and what you see today is the fruit of that, where we’re really close to deployment on public roads without a human [driver],” said Urtasun.

“It’s amazing – not just for Waabi, not just for Canada, but for the industry at large.”

U of T’s AI thought leaders take centre stage at Collision 2024

Christopher.Sorensen — Fri, 14 Jun 2024 14:14:37 +0000

U of T’s AI thought leaders take centre stage at Collision 2024

Christopher.Sorensen Fri, 06/14/2024 - 10:14

Cutline

Left to right: Geoffrey Hinton, Aidan Gomez and Raquel Urtasun – all U of T community members who are leaders in the AI field – are among the most anticipated speakers this year's Collision tech conference (photos by Johnny Guatto, Piaras Ó Mídheach/Collision via Sportsfile and Polina Teif)

Mariam Matti

Topic

U of T Entrepreneurship

Creative Destruction Lab

Entrepreneurship