RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning

Google DeepMind9 HN recommenders · 2017–2026
1.9M views · course · evergreen · Uploaded 2015-05-13

The first lecture of David Silver's reinforcement learning course, introducing the field and its basic concepts. The course follows the Sutton and Barto textbook.

Frequently recommended as an excellent, clear introductory RL course from the lead of AlphaGo, pairing well with Sutton and Barto.

Watch on YouTube

11 comments from Hacker News

@deepnet2017 · in “Ask HN: Best books on AI?”

Sutton & Barto's Reinforment Learning complete this triumvirate [LINK] David Silver's Reinforcement Course is based on Sutton & Barto [VIDEO]

RecommendsView on HN
@magoghm2017 · in “Mastering Chess and Shogi by Self-Play with General Reinforcement Learning”

You can check this Reinforcement Learning Course by David Silver on YouTube: [VIDEO] By the way, I believe David Silver was the lead programmer for AlphaZero.

RecommendsView on HN
@igravious2018 · in “Ask HN: Best introductory video courses on ML and Deep Learning?”

fast.ai Making neural nets uncool again. fast.ai is dedicated to making the power of deep learning accessible to all.[0] Udacity. Intro to Machine Learning: Pattern Recognition for Fun and Profit[1] MIT 6.S099: Artificial General Intelligence[2] Lecture Series on Artificial Intelligence by Prof. P. Dasgupta, Department of Computer Science & Engineering, Indian Institute of Technology, Kharagpur[3] DeepMind. Reinforcement Learning Course by David Silver[4] Stanford Winter Quarter 2016 class: CS231n: Convolutional Neural Networks for Visual Recognition.[5] [0] [LINK] [1] [LINK] [2] [LINK] [3] [LINK] [4] [VIDEO] [5] [LINK]

RecommendsView on HN
@crisbal_2018 · in “Reinforcement Learning – Bandit Problems”

As someone who is doing his bachelor thesis on Reinforcement Learning this is some useful information. OT (but not really) question: does anyone here use Reinforcement Learning techniques at work? For the thesis I am working on black-box optimization of 2 variable functions with Reinforcement Learning (and comparing it with Bayesian Optimization techniques). As someone else suggested the Sutton & Barto book is really great knowledge but I would also like to suggest these lessons ( [VIDEO] ) by David Silver (who worked on AlphaGo)

RecommendsView on HN
@visarga2018 · in “Philosophy Has Made Plenty of Progress”

The notions of agent, environment and reward are encountered in Reinforcement Learning which is a sub-field of ML but also relevant to biological agents. There is a great RL course on YouTube by David Silver (one of the creators of AlphaGo, which is probably the most famous application of RL so far). [VIDEO] The course can properly set the perspective of RL and shed new light on the philosophy of mind, if you take what it says and then extrapolate to humans and other agents. What I find fascinating about RL is that it can be defined concretely. Consciousness can only be defined by reference to other words, in a less exact and concrete way. RL can also explain how meaning appears, based on future reward prediction. The rich sensations we have can be explained by an encoding-decoding architecture based on reconstruction error. Many difficulties in RL map back to difficulties humans have in choosing how to act - the exploration-exploitation tradeoff, instinct vs reason (two different ways to perform RL, one based purely on rewards and the other based on an internal model of the world and rewards). Some of the problems related to multi-agent RL are also covered in Game Theory, such as the prisoner's dilemma. Regarding philosophy of language: we have today numerical representations of meaning in words and phrases. They are usually represented as vectors in high dimensional space or sets of vectors. For example it is customary to use 300-1000 dimensions for representing words. Thes

RecommendsView on HN
@alkhatib2019 · in “Dopamine framework: Fast prototyping of reinforcement learning algorithms (2018)”

I came across this a few days ago: For Reinforcement Learning specifically, the standard text is Reinforcement Learning: An Introduction[1]. Dave's UCL Course on RL[2] is great too (playlist of all lectures)[3]. Source: Julian Schrittwieser works on Deepmind at Google [LINK] [1] [LINK] [2] [LINK] [3] [VIDEO]

RecommendsView on HN
@colmvp2019 · in “Reinforcement Learning: An Introduction (2018) [pdf]”

I also recommend interested people to watch David Silver's RL lectures at UCL on YouTube. He covers material from the book. [VIDEO]

RecommendsView on HN
@colmvp2020 · in “ACM Prize in Computing Awarded to AlphaGo Developer”

I almost knew exactly who it was going to be when they mentioned AlphaGo Developer. For those who aren't that well versed in RL, I recommend watching his lectures at UCL ( [VIDEO] ). Really clear explanations that went hand in hand when I was reading Sutton and Barto's introductory book.

Strongly recommendsView on HN
@confuseshrink2020 · in “Powerful AI Can Now Be Trained on a Single Computer”

I would start with David Silvers (DeepMind) youtube series to get an idea of what's possible or not. Running an already trained reinforcement learning agent is relatively cheap (unless your model is massive). I suspect the reason people aren't using it yet is because it's a) really difficult to get right in training, even basic convergence is not guaranteed without careful tuning b) really difficult to guarantee reasonable behavior outside of the scenarios you're able to reach in QA. edit: Link to lecture series [VIDEO]

RecommendsView on HN
@briandw2025 · in “Q-learning is not yet scalable”

This papers assumes that you know quite a bit about RL already. If you really want to dig into RL, this intro course from David Silver (Deep Mind) is excellent: [VIDEO]

Strongly recommendsView on HN
@aanet2026 · in “A Man Behind AlphaGo Thinks AI Is Taking the Wrong Path”

Not "A Man Behind AlphaGo..." but rather "The Man Behind AlphaGo..." On David Silver's Ineffable Intelligence startup and their $1 Billion (!) seed round (!!) His RL lectures [1] are quite popular [2] [1] [LINK] [2] [VIDEO]