Peter Norvig at Startup School 08
startupschool2 HN recommenders · 2009–2014
6K views · talk · dated · Uploaded 2009-01-30
Peter Norvig, then Director of Research at Google, talks at Startup School 2008 about leveraging large amounts of data and about technical challenges in Google projects such as image search. A central idea is that data can beat hand-written programming.
HN points to it as a source for Norvig's 'unreasonable effectiveness of data' argument and for his views on image search and the semantic web.
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
18:40But what is a neural network? | Deep learning chapter 1
3Blue1Brown
1:00:43Jim Simons (full length interview) - Numberphile
Numberphile2
1:05:37Designing the Ideal Bootstrapped Business with Jason Cohen
Rob Walling
14:34Steve Jobs Stanford Commencement Speech 2005
JoshuaG
1:30:28AlphaGo - The Movie | Full award-winning documentary
Google DeepMind
27:14Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
1:07:26Alan Kay - Normal Considered Harmful
powerfuloutlet
5 comments from Hacker News
This line of thought follows previous posts on the same subject. It's very Norvig-esq ( [VIDEO] ), but there's also [LINK] and also Chris Anderson and Wired's flame bait [LINK] (that month's wired was dedicated to this subject) And like someone at the previous discussions has said, this is the base of the scientific method, not it's death
[LINK] - (Steve Blank / Eric Ries - part 1) [LINK] - (Steve Blank / Eric Ries - part 2) [LINK] - (Steve Blank / Eric Ries - part 3) [LINK] - (Steve Blank at the Startup Lessons Learned conference) [LINK] - (Steve Blank: The Democratization of Entrepreneurship) [LINK] - (Alexander Osterwalder speaking @ Google) [LINK] - (Eric Ries speaking @ Google) [LINK] - (pg at Startup School '08) [VIDEO] - (Peter Norvig at Startup School '08)
Norvig's talk at Startup School '08 went into more details on this: [VIDEO] They do use SIFT (or at least a variant thereof) for finding and describing interest points, but by itself, there is no geometric matching in SIFT. There are various competing approaches on how do it, although in many cases, you can get very good results even without it. (It's very slow to do geometric matching so people often skip that step, or only apply it to the best matches.) Landmark detection is a recent "hot topic" in computer vision, and given a large enough dataset, it essentially works now for the most part.
Programming bubble will pop. Automated Machine learning is taking over. Even at google, Jeff Dean has recently stated that his Perceptual AI project is aimed at reducing feature engineering in their machine learning projects. In plain terms this means eliminating the need for programming in their search engines and other machine learning focused projects like google now and google goggles (the mobile app, not google glass). The only programmers left will be to manage cloud computing infrastructure and front end programmers. As things like siri and google now take off, front end programmers will also be in less demand. Microsoft, Apple, and Amazon are also increasingly focusing on machine learning. Automated analysis of text will take over the role of sql databases as demonstrated in IBM watson. In manufacturing, the role of programming also diminishing as vision guided robots like Baxter by Rodney Brooks's team take off. All this is a good thing though, programming is slow and data is agile, as talked about by Peter Norvig in his startup school 2008 speech [VIDEO] Startups should aim at doing as little programming as possible and leaving it to data crunching.
Peter Norvig put it best: "The semantic web is the future of the web, and always will be." (For what it's worth, the startup school video that quote comes from is worth watching: [VIDEO] )