Google I/O 2012 - Go Concurrency Patterns

Google for Developers9 HN recommenders · 2012–2025
894K views · talk · evergreen · Uploaded 2012-07-02

Rob Pike's Google I/O 2012 talk shows how goroutines and channels solve tricky concurrency problems with simple Go code. It features a playful goroutine demo with gophers passing messages and a search engine example.

The canonical recommendation for learning Go concurrency, praised as entertaining and clarifying when to use channels versus mutexes.

Watch on YouTube

19 comments from Hacker News

@luriel2012 · in “Golang at CloudFlare”

In one word: channels. They might be theoretically equivalent to some degree, but in practice they are quite different, and I find reasoning about both concurrency and parallelism using goroutines and channels much more natural. Also see this talk by Rob Pike on the origins of Go's concurrency model here: [LINK] See also this article by Russ Cox about CSP: [LINK] And Rob Pike's latest talk about concurrency patterns at Google IO last week: [VIDEO]

RecommendsView on HN
@mseepgood2012 · in “Having a Go - first time experience with Golang”

Great talk by Rob Pike: [VIDEO] "Go Concurrency Patterns" with cute little gophers playing Chinese whispers with megaphones

Strongly recommendsView on HN
@mseepgood2012 · in “Will Go be the new go-to programming language?”

The "Talks and Videos" page ( [LINK] ) is outdated as well. Here's my personal list: Why Learn Go? [LINK] Short interview with Rob Pike, OSCON 2012 Get Started with Go [LINK] Andrew Gerrand A Tour of Go [LINK] Russ Cox Go Concurrency Patterns [VIDEO] Rob Pike, Google I/O 2012 Goroutines, Channels Meet the Go Team [LINK] Panel (Pike, Thompson, Griesemer, Gerrand, Fitzpatrick, Simons), Google I/O 2012 Computing Map Tiles with Go on App Engine [LINK] Chris Broadfoot, Andrew Gerrand, Google I/O 2012 Go in Production [LINK] Gustavo Niemeyer, Google I/O 2012 Go: Code that grows with grace [LINK] (Contains some audio glitches) Andrew Gerrand Interview with Rob Pike [LINK] Rob Pike, GOTO Conference Lexical Scanning in Go [LINK] Rob Pike Cuddle, A Go AppEngine Demo [LINK] Andrew Gerrand Building Integrated Apps on Google's Cloud Platform [LINK] Andrew Gerrand, Google Developer Day Japan 2011 Real World Go [LINK] Andrew Gerrand, I/O BootCamp 2011 Go: it's that simple?! [LINK] Andrew Gerrand, OSDC 2011 Practical Go Programming [LINK] Andrew Gerrand, FOSDEM 2011 Writing Web Apps in Go [LINK] Andrew Gerrand, Rob Pike, Google I/O 2011 Go Programming [LINK] Rob Pike, Google I/O 2010 Another Go at Language Design [LINK] Rob Pike, Stanford University Public Static Void [LINK] Rob Pike, OSCON 2010 The Go Programming Language [LINK] Rob Pike, Google Tech Talk

@ralph2012 · in “Go Bloviations”

Agreed, Rob Pike, in his search engine example at Google's I/O 2012 IIRC, made the explicit point that mutexes are there and that channels are for joining large concurrent parts of the program together; guarding a data structure seems too small even though it's a common (toy?) example. [VIDEO]

@Ezra2013 · in “Go concurrency patterns”

Video of rob giving the talk: [VIDEO] this makes use of the excellent "Golang Present Tool", which makes most of the code on the slides executable.[1] [1]: [LINK]

@biot2013 · in “Go concurrency patterns”

Rob Pike has a Q&A at the end of his video where he answers (what sounds like) the exact same question you ask: [VIDEO] Essentially, it gets garbage collected without you having to worry about it unless you're doing something fairly special.

@shurcooL2013 · in “How We Went from 30 Servers to 2: Go”

> "We also weren't sure if we would be able hire top talent if we chose Go, but we soon found out that we could get top talent because we chose Go." I feel[1] that a smart/talented C/C++/anything developer can go from someone who has never seen or heard of golang to a proficient and productive Go developer in a matter of a few weeks, maybe even _days_, if not less. That's how long it takes to go through the following materials (and fav some for later reference) and play with the language a bit. [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] - use as reference [VIDEO] [LINK] [LINK] [LINK] And a some more similar things that you can mostly get to from golang.org site. The beauty of how concise the language and even its website are, is that you can literally just go through everything there one thing after another. [1] This is my personal opinion based on playing with go the last few weeks/months. I'd love to verify this theory. It's not yet the primary language in which I do things in (I use C++11 atm), but for all my side tasks[2] it proved to be indispensable. And I found it very easy to pick up. I can't wait until I start doing all my work in Go, that will be a true test of its productivity efficiency. [2] [LINK]

@NyxWulf2013 · in “The Beauty of Concurrency in Go”

Observing other channels, or seeing when a channel does fire is what the select structure is for. It is one of the features that makes channels and goroutines very nice in go. [LINK] [LINK] [LINK] Video for the slides: [VIDEO]

@mseepgood2013 · in “Why Node and Scala will dry up: Go will drink their milkshake”

I'm a fan of Go, but this is not a very good talk. The first half is unnecessary trolling, and the second half is based on some code snippets taken from Rob Pike's "Go Concurrency Patterns", but in this case badly presented. So I prefer the original: [VIDEO]

RecommendsView on HN
@danneu2013 · in “ClojureScript Core.async Todos”

You're responding to: > Clojurescript is the browser language I always > wanted. JS seems like such a hack. You're getting downvoted for reading into someone's enthusiastic personal endorsement and then ending it with the tiring "Tell me something good about <thing I refuse to read or understand on my own time but I'll partake in discussion anyways>...". Start with Rob Pike's "Go Concurrency Patterns" ( [VIDEO] )

RecommendsView on HN
@canthonytucci2013 · in “Less is exponentially more (2012)”

For those who don't know who Rob Pike is, he's pretty awesome, helped create UTF-8 among other things, and now works on Go. [LINK] He has given some really great Go talks which are available on youtube, about an hour each: Origins of Go Concurrency Style - [LINK] Lexical Scanning in Go - [LINK] Go Concurrency Patterns (One of my favorites) - [VIDEO]

Strongly recommendsView on HN
@aray2014 · in “Go Concurrency Patterns: Pipelines and cancellation”

Great explanation in document form of these patterns. Also very succinct and easy to reference. For those that would rather read this in presentation form: [LINK] And for those that would rather watch a video presentation: [VIDEO]

RecommendsView on HN
@srcreigh2014 · in “Go support for Android”

In my experience with Android apps, I've almost never had to use the NDK. When I did have to use the NDK, it wasn't because I wanted to code in C/C++---it was because there were strong, open-source libraries written in C/C++ that I wanted to use in an app (Though, I have no experience making games on Android). If you want to check out Go, then the Go Tour [1] and the various talks by Rob Pike [2] [3] / Sameer Ajmani [4] are great resources. The Go Tour stands on its own as an interest-building resource; the several programming exercises it has you do are fun and challenging. [1]: [LINK] [2]: [VIDEO] [3]: [LINK] [4]: [LINK]

RecommendsView on HN
@enneff2017 · in “The State of Go”

Reveal wasn't a thing when I wrote present. I probably would have used it as a front end, had it existed. Tools like Keynote and Google Slides were exactly the kind of thing we were trying to improve upon. They're great for making pretty slides, but a total PITA for authoring and editing technical content. Can any of those tools execute code from within the slides? [VIDEO] [LINK] And do they let us store our code snippets in actual testable (or at least buildable) source files?

@staunch2018 · in “Ask HN: Concurrency in Go vs. C/C++”

Rob Pike did a number of interesting talks on concurrency in Go. If you search "Go concurrency" on YouTube there are more good talks. Go Concurrency Patterns [VIDEO] Concurrency Is Not Parallelism [LINK]

RecommendsView on HN
@cratermoon2021 · in “The ecosystem of the Go programming language”

Go was built as a language to make communicating sequential processes[1] first-class citizens. Thus the ubiquity of channels and goroutines. No locks, no condition variables, no callbacks[2]. Writing a bunch of code using locks and callbacks in Go goes against the grain of the language. [1] [LINK] [2] [VIDEO]

@gravypod2021 · in “Loom: Project Loom Early-Access Builds”

All implementations of in-process thread multiplexing is sort of like a garbage collector. You have a resource, you manage the allocation of a resource to something that consume it, etc. A lot of house keeping and some overhead code that needs to execute before any work is done (each time). In my mind, it makes sense to have a single, well tested, and abstracted implementation that all other systems can use. You can see a need for this at least in the Android space: RxJava, Kotlin coroutines, etc. Also, in a user-managed thread multiplexing system you can't guarantee "fair" scheduling. If you have some DOS bugs in your server you can lock up an entire serving thread. A language-level multiplexing system will not have these same kinds of edge cases. There are many places this sort of thing becomes helpful. We could also see concurrent processing utilities that could be very helpful. See this for more info on how this could lead to cleaner programs: [VIDEO]

@gunapologist992022 · in “What's New in Python 3.11?”

This is true, that's exactly what exceptions are. One could argue (I would) that this is a very powerful part of Python, but the indeterminate nature of the exception (where is it coming from, how is it defined, what should I provide to my client) makes it easier to catch exceptions as they percolate upward, but more difficult to correctly know how to handle them (especially as the permutations approach infinity as underlying libraries get upgraded). Golang actually has a back-channel communication path that is somewhat similar as a second channel of communications. (Actually they're called channels!) They're a first-class and extremely powerful feature of the language. You can even run a for loop over them, block or not block while waiting for an incoming message, etc. Here's a great video that talks about use cases and the patterns in using them, and they pair great with goroutines (and you don't have to sprinkle async before every function, either): [VIDEO]

RecommendsView on HN
@pbohun2025 · in “A million ways to die from a data race in Go”

Not quite. Erlang uses the Actor model which delivers messages asynchronously to named processes. In Go, messages are passed between goroutines via channels, which provide a synchronization mechanism (when un-buffered). The ability to synchronize allow one to setup a "rhythm" to computation that the Actor model is explicitly not designed to do. Also, note that a process must know its consumer in the Actor model, but goroutines do not need to know their consumer in the CSP model. Channels can even be passed around to other goroutines! Each have their own pros and cons. You can see some of the legends who invented different methods of concurrency here: [LINK] There's also a nice talk Rob Pike gave that illustrated some very useful concurrency patterns that can be built using the CSP model: [VIDEO]

RecommendsView on HN