Geoffrey Hinton in conversation with Fei-Fei Li — Responsible AI development
Arts & Science - University of Toronto2 HN recommenders · 2024–2024
226K views · interview · dated · Uploaded 2024-02-23
A 2023 University of Toronto conversation between Geoffrey Hinton and Fei-Fei Li on responsible AI development. They look back at the history of deep learning and ImageNet and discuss the ethics and risks of AI.
HN recommends it for Hinton's research history and the two pioneers reflecting on a decade of progress.
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
18:40But what is a neural network? | Deep learning chapter 1
3Blue1Brown
15:01What Happened to Horses Is Happening to Us
CGP Grey
1:30:28AlphaGo - The Movie | Full award-winning documentary
Google DeepMind
27:14Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
51:22USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
USENIX
1:08:40Lecture 1 | Machine Learning (Stanford)
Stanford
5:58MarI/O - Machine Learning for Video Games
SethBling
3 comments from Hacker News
This 'conversation' with Geoffrey Hinton and Fei-Fei Li goes over a lot of the history of things (1h50m): * [VIDEO] * [LINK] ('mirror') Goes over Hinton's history and why he went the direction he did with his research, as well as Li's efforts with ImageNet.
François Chollet says LLMs do not learn in-context. But Geoff Hinton says LLMs' few-shot learning compares quite favorably with people! [VIDEO] The truth is in the middle, I think. They learn in-context, but not as well as humans. The approach in the article hides the unreliability of current LLMs by generating thousands of programs, and still the results aren't human-level. (This is impressive work though -- I'm not criticizing it.)
See "Geoffrey Hinton in conversation with Fei-Fei Li" where the two got together and looked back at the developments over the last ~10 years, including why and how they did their part: * [VIDEO]