AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)

Amazon Web Services0 HN recommenders · 2018–2022
18K views · talk · dated · Uploaded 2017-12-13

A Netflix performance engineer presents how Netflix tunes EC2 instances, covering instance type choice, Xen modes, SR-IOV and kernel tuning. The goal is near bare-metal performance in the cloud.

HN cites it as an example of workload-dependent performance tuning at scale and of Netflix's AWS practices.

Watch on YouTube

3 comments from Hacker News

@scarface742018 · in “Show HN: Corral – A Serverless MapReduce Framework”

They use a lot of AWS services - not just virtual machines - First they use Ubuntu Linux - SES (Email) - ElasticSearch (AWS has their own managed version) - SQS (queueing system) - S3 (storage) -auto scaling Most of the optimization's they do are standard things at scale where they are tuning by measuring performance. [VIDEO] and the slide deck from the presentation. [LINK] But that's even more of a reason to choose AWS, Netflix has open sourced dozens of tools specifically related to AWS. You get to take advantage of their tools and knowledge.

@ignoramous2019 · in “The creation of the io.latency block I/O controller”

Well, most distributions choose saner defaults. For instance, RHEL/CentOS/AmazonLinux use noop io-scheduler by default for SSD based machines. Though, I get your point: for instance, the TCP keep-alive defaults aren't suitable for all kinds of workloads: [LINK] I guess, that's why performance tuning is an art form as it is workload dependant: [VIDEO]

@dijit2022 · in “Cloud Pricing Comparison: AWS vs. Azure vs. Google Cloud Platform in 2022”

it was actually 5x, my bad, but here's the references: Original info being mentioned as a rumour (2016): [LINK] Slides for confirmation by Greeg (2017): [LINK] Talk (2017): [VIDEO] More discussion: [LINK] Original tweet has been deleted, but I have a screenshot here slide 9: [LINK]