Why Can't AI Make Its Own Discoveries? — With Yann LeCun
Alex Kantrowitz2 HN recommenders · 2025–2026
222K views · podcast · dated · Uploaded 2025-03-19
Yann LeCun on the Big Technology Podcast discusses why current AI models cannot make discoveries despite their knowledge. He argues systems need abstract world models and also covers limits of AI research, investor expectations, and open source after DeepSeek.
Pointed to as LeCun's argument for the limits of LLMs and the need for world models.
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
18:40But what is a neural network? | Deep learning chapter 1
3Blue1Brown
1:00:43Jim Simons (full length interview) - Numberphile
Numberphile2
14:34Steve Jobs Stanford Commencement Speech 2005
JoshuaG
1:30:28AlphaGo - The Movie | Full award-winning documentary
Google DeepMind
27:14Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
1:07:26Alan Kay - Normal Considered Harmful
powerfuloutlet
53:31Growing a Language, by Guy Steele
Bill Pugh
3 comments from Hacker News
What? The "article" is from anthropic, so I think they would know what they write about. Also, RL is an additional training process that does not negate that GPT / transformers are left-right autoencoders that are effectively next token predictors. [Why Can't AI Make Its Own Discoveries? — With Yann LeCun] ( [VIDEO] )
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material. It's quite eye opening. 0. [VIDEO]
This is not an appeal to authority, but this video probably contains the answers to your questions if you are open minded about it [VIDEO]