Modernizing Compiler Design for Carbon Toolchain - Chandler Carruth - CppNow 2023

CppNow1 HN recommenders · 2023–2025
71K views · talk · evergreen · Uploaded 2023-08-17

Chandler Carruth's CppNow 2023 talk on modernizing compiler design for the Carbon toolchain, using data-oriented design and modern hardware assumptions. It covers lexing, parsing and compact data structures aimed at compiler performance.

Recommended as a recent take on rethinking compiler architecture, and cited in discussions of flattened ASTs and fast lexers.

Watch on YouTube

4 comments from Hacker News

@di4na2023 · in “How to speed up the Rust compiler in August 2023”

No but it is endemic to how we think about compilers up to now, and especially when the rust compiler arch was massively developed, more than 10 years ago. I recommend a watch of this for a recent take on trying to change how we think of these. It is an open research field [VIDEO]

RecommendsView on HN
@pas2024 · in “Rhombus: Macro-extensible language with conventional syntax built on Racket”

Cache the position of quotes/apostrophes, etc. Optimizing for your edge case would require everyone writing and reading code to conform to this extra thing, which seems completely unnecessary. Machines are pretty fast. [VIDEO] Modernizing Compiler Design for Carbon Toolchain - Chandler Carruth - CppNow 2023

@wrsh072025 · in “Flattening ASTs and other compiler data structures (2023)”

Chandler discusses it in this video though! [VIDEO] You get some traversals for free with this layout (preorder, reverse post order). Can search for subtrees with string searching algorithms or more complex things with regex.

@norskeld2025 · in “Strategies for Fast Lexers”

Is lexing ever a bottleneck though? Even if you push for lexing and parsing 10M lines/second [1], I'd argue that semantic analysis and codegen (for AOT-compiled languages) will dominate the timings. That said, there's no reason not to squeeze every bit of performance out of it! [1]: In this talk about the Carbon language, Chandler Carruth shows and explains some goals/challenges regarding performance: [VIDEO]