Deepmind artificial intelligence @ FDOT14
Elizr2 HN recommenders · 2014–2016
288K views · demo · dated · Uploaded 2014-04-19
A short smartphone-recorded clip from a 2014 event in Paris where DeepMind CEO Demis Hassabis presents an AI learning to play old Atari games. The system learns from only the video signal and the score. Audio quality is poor.
HN commenters use it as the canonical demo of deep reinforcement learning, noting that watching it teaches more than an article does.
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
18:40But what is a neural network? | Deep learning chapter 1
3Blue1Brown
1:04:04Overwatch Gameplay Architecture and Netcode
GDC Festival of Gaming
1:30:28AlphaGo - The Movie | Full award-winning documentary
Google DeepMind
27:14Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
51:22USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
USENIX
1:08:40Lecture 1 | Machine Learning (Stanford)
Stanford
42:30RustConf 2018 - Closing Keynote - Using Rust For Game Development by Catherine West
Rust Programming Language
6 comments from Hacker News
Thanks for the correction. The "arbitrary" qualifier is not in TFA, but (as, indeed, you said) that's the point of the demo, e.g.: [VIDEO] Note that they're using just the video signal from the game as input. It's really a sad comment on the state of reporting at MIT Tech Review that you learn more about the tech from a youtube video than from an article. (My complaint is not with the DeepMind people, it's with the article, which should put the work in context.)
Creating a GAI which can learn how to act human, on its own, in virtual worlds and in robots with realistic bodies isn't serious research? [VIDEO]
I was also under the misapprehension that deep learning is just about classification, but that isn't true. Yes, reinforcement learning is the path to general intelligence, and the deep learning community is showing impressive progress on that front as well. The Deepmind demo [1] and the recent robotics work at Berkeley[2] are good examples. Thanks for the link to Stan Franklin's work. I'm glad to hear there is work to integrate the two approaches. [1] [VIDEO] [2] [LINK]
In psychology, this is called "Reinforcement"[1] and that goes back to Skinner (1938) and Thorndike (1911). In AI research its called "Reinforcement learning"[2]. One of the earliest papers relating reinforcement learning to AI was “Theory of Neural-Analog Reinforcement Systems”[3] by Minsky, 1954 A cool reinforcement learning demo is the DeepMind Atari video from last year[4] [1] [LINK] [2] [LINK] [3] [LINK] [4] [VIDEO] (this is awesome)
AGI is the idea of creating general intelligence. Which almost certainly requires some reinforcement learning (the ways dogs and humans learn, by having a goal and an internal reward system). Deepmind's Atari player is based on deep reinforcement learning, where increasing the score represents a reward: [VIDEO] I used to believe the moving goalpost idea, that AI is anything that isn't yet possible. I now disagree. I saved myself a lot of energy by avoiding entirely the question "what counts as AI?" by switching to the question, "what counts as AGI?" which is a term with a clearer threshold: [LINK]
The Deepmind Atari Player is only 22KB of source code: [LINK] If you haven't seen the video it's remarkable: [VIDEO]