Change w/ Jim Keller
Tenstorrent1 HN recommenders · 2023–2023
61K views · talk · evergreen · Uploaded 2023-01-11
Jim Keller, CTO of Tenstorrent, gives a keynote at Stanford's System X conference on change, understanding and the future of computing. He touches on Moore's Law, how far transistors are from physical limits, and ideas like DNA origami.
HN commenters cite it as a thoughtful talk from a legendary chip architect, both for the s-curves view of progress and for concrete technical details on semiconductor scaling.
1:01:20Indistinguishable From Magic: Manufacturing Modern Computer Chips
Andor Gafotas
6:538-bit computer update
Ben Eater
1:00:43Jim Simons (full length interview) - Numberphile
Numberphile2
1:21:22Light Years Ahead | The 1969 Apollo Guidance Computer
TNMoC
14:34Steve Jobs Stanford Commencement Speech 2005
JoshuaG
27:25“Hello, world” from scratch on a 6502 — Part 1
Ben Eater
47:52Finding the Missing Memristor - R. Stanley Williams
The Qualcomm Institute
1:07:26Alan Kay - Normal Considered Harmful
powerfuloutlet
5 comments from Hacker News
If you are fan of the stack of s-curves, you will probably like this talk by Jim Keller. Jim Keller on Change [VIDEO]
K8 seems pretty small after he made the fucking Zen architecture (and Tesla AI). Lex has good interviews with Jim[1], he's not just very smart, he is wise. He started Tenstorrent some time ago with Ljubisa Bajic so I'm assuming this fab is related. Here is youtube channel for Tenstorrent[2], and last time I checked it was getting under 100 views per video... Ian also interviewed him[3] some time ago. Long story short if I had money that would be relevant in this context I would invest really hard into Tenstorrent. Investing time to listen to the guy seems to be not worse. 1a. [LINK] 1b. [LINK] 2. [VIDEO] 3. [LINK]
"Is this really the way forward?" No. The way forward for scale-free systems which implement a hierarchy of competence is to have "the factory smaller than the product" [1]. Instead of the Chrome Canary team and the various Working Groups dictating from above what passes as valid, let the rules be sent at the same time with the interpretation of the rules [2]. In the same manner DNA encodes proteins with no mention of the underlying morphology, but once the RNA starts building the morphology arises. [1] Jim Keller talking about DNA Origami at 19:18, [VIDEO] [2] Not even such a new idea, "Building a Better Web Browser - James Mickens - Harvard CS Colloquium 2015", on rendering at 04:20, [LINK]
We are ridiculously far from physical limits in our current artificial computers (both theoretical [1], and practical [2]). For more technical details see Jim Keller: [3] [4] [5]. [1] [LINK] [2] The ~12 watts computer inside each living human adult skull (and perhaps each eukaryote cell [6]) is still the state-of-the-art, for quite some time. [3] 2021, Jim Keller: The Secret to Moore's Law , [LINK] [4] 2019, Jim Keller: Moore’s Law is Not Dead , [LINK] [5] 2023, Change w/ Jim Keller , [VIDEO] [6] Our computers aren't yet able of polycomputation, where the computation topology, data, and functions depend on the observer, instead of computation in a passive implementation, once done forever set in s̶t̶o̶n̶e̶ silicon, 2023, Michael Levin, Agency, Attractors, & Observer-Dependent Computation in Biology & Beyond , [LINK]
Transistor measurements in nanometers has been more or less meaningless since the introduction of FinFETs over a decade ago, and IIRC it was TSMC that started the let's play funny business with nanometers affair. Today they are marketing terms and the different fabs try to align them somewhat, but have inherent conflicts of interest when it comes to overselling their tech. For example a TSMC N5 transistor is roughly 100x100x100nm in size as per [VIDEO] .