"Stop Rate Limiting! Capacity Management Done Right" by Jon Moore
Strange Loop Conference4 HN recommenders · 2017–2024
41K views · talk · evergreen · Uploaded 2017-10-01
Jon Moore's Strange Loop 2017 talk argues that rate limiting is the wrong tool for protecting services from noisy clients. He proposes concurrency-based capacity management and quotas instead.
HN engineers recommend it for its core insight that limiting concurrency naturally yields request-rate limits, and for its link to queueing theory.
38:47RailsConf 2014 - All the Little Things by Sandi Metz
Confreaks
42:03The Soul of Erlang and Elixir • Sasa Juric • GOTO 2019
GOTO Conferences
1:01:39"Simple Made Easy" - Rich Hickey (2011)
Strange Loop Conference
25:06"Making Impossible States Impossible" by Richard Feldman
elm-conf
40:20"Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson
Strange Loop Conference
1:00:19How To Design A Good API and Why it Matters
Google TechTalks
31:44The Value of Values with Rich Hickey
InfoQ
19:10Velocity NY 2013: Richard Cook, "Resilience In Complex Adaptive Systems"
O'Reilly
4 comments from Hacker News
For a different view on the topic watch "Stop Rate Limiting! Capacity Management Done Right" [VIDEO] The basic premise is not do do req/s limiting but rather concurrency limiting which results in req/s limiting by itself. Concurrency limiting is rather simple and doesn't require a lot of code complexity.
* To Serve The People: Public Interest Technologists. Matt Mitchell is a hacker, security researcher, operational security trainer, and data journalist who founded & leads CryptoHarlem, impromptu workshops teaching basic cryptography tools to the predominately African American community in upper Manhattan. [LINK] * Stop Rate Limiting! Capacity Management Done Right. Jon Moore is the Chief Software Architect at Comcast Cable, where he focuses on delivering a core set of scalable, performant, robust software components for the company's varied software product development groups. [VIDEO] * Keeping Time in Real Systems. This talk will tour the fascinating timekeeping mechanisms used in real systems. We will explore atomic clocks, NTP and GPS through systems that use them, and logical clocks in the context of systems built on logical time. [LINK] * Level Up Your Concurrency Skills With Rust. This talk will show you how Rust will catch many concurrency errors at compile time. [LINK] * Diablo: A Classic Game Postmortem. Diablo developer David Brevik returns to the GDC stage to give a classic post-mortem on Blizzard's action RPG hit Diablo in this 2016 talk. [LINK] * The Flash Games Postmortem . In this 2017 GDC talk, Kongregate's John Cooney attempts to encapsulate the immense history of Flash games and how it has shaped the current game industry by giving game developers their first chance to build and publish their games quickly to the web. [LINK] * Siege Battle AI in Total War:
Relevant to queueing theory: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore [VIDEO]
You will like the Strange Loop 2017 talk about this subject: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore [VIDEO] Concurrent capacity might not be the best metric.