Sacha Arnoud, Director of Engineering, Waymo - MIT Self-Driving Cars
Lex Fridman3 HN recommenders · 2018–2023
109K views · lecture · dated · Uploaded 2018-02-16
Sacha Arnoud, Waymo's Director of Engineering, gives a lecture in MIT's 2018 deep learning for self-driving cars course on the rise of machine learning in autonomous vehicles. It covers how Waymo uses deep learning and how it handles tricky driving situations.
Pointed to during self-driving news threads as an insider view of Waymo's progress, deep learning's role and its limits.
1:03:43How to Speak
MIT OpenCourseWare
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
57:151. Introduction to Human Behavioral Biology
Stanford
1:21:52LEADERSHIP LAB: The Craft of Writing Effectively
UChicago Social Sciences
18:40But what is a neural network? | Deep learning chapter 1
3Blue1Brown
1:11:40MIT's Pathway to Fusion Energy (IAP 2017) - Zach Hartwig
MIT Plasma Science and Fusion Center
52:29Stanford's Sapolsky On Depression in U.S. (Full Lecture)
Stanford
54:56Justice: What's The Right Thing To Do? Episode 01 "THE MORAL SIDE OF MURDER"
Harvard University
4 comments from Hacker News
I believe this talk will specifically and completely answer your questions: [VIDEO] Short answer: Self driving vehicles do use deep learning, but they avoid some types not because it is unreliable, but it is processing power intense. Traffic lights, road signs, pedestrians etc.. That's a whole ball of wax to unravel. Check the lecture, its fantastic imo.
It is both an over and underhyped field depending on the area you are looking at. HUGE difference between consumer self driving car [Everywhere, at all times] and the Machines as a Service [Geo, time, weather-fenced operations][1]. Waymo appears to be at the head of the pack; Sacha Arnoud, Director of Engineering for Waymo gave a talk a few weeks ago at MIT[2] and gives a good idea. We are about 5 years out until these start rolling out as MaaS (machines as a service). Probably 10+ years for level 4 highway operations for consumer models according to Frazzoli. [1]Emilio Frazzoli, CTO of nuTonomy [LINK] [2] [VIDEO]
The second article I linked to also mentioned work on unmapped roads: [LINK] Waymo has solved problem after problem you think they haven't solved yet, for some reason. They've intentionally gone after unpredictable situations and dealt with them. Look at any video where they explain how it works, and you'll notice how many situations they can manage: [VIDEO] And even if Waymo only works on well-mapped cities? That's still far from "can only work if they repurpose existing transportation infrastructure to only belong to self-driving cars" which is the comment I was replying to.
Google/Waymo demo'd the AI driving in a snow storm and the method they used to see through the flakes and maintain object detection. Having trouble finding the video I'm thinking of. Here are some videos related to self-driving in snow and progress on weird edge cases. - [LINK] (snow, like the google demo) - [VIDEO] | [VIDEO] (snow, but not the one I was thinking of)