hackertube.io

"Stop Rate Limiting! Capacity Management Done Right" by Jon Moore

Strange Loop Conference · talk · Watch on YouTube

Distributed systemsCloud, DevOps & reliabilitySoftware architecture & design

What it is

Jon Moore's Strange Loop 2017 talk argues that rate limiting is the wrong tool for protecting services from noisy clients. He proposes concurrency-based capacity management and quotas instead.

Why Hacker News recommends it

HN engineers recommend it for its core insight that limiting concurrency naturally yields request-rate limits, and for its link to queueing theory.

  • 4 people recommended it
  • 4 different months
  • 0 strong recommendations
  • first 2017, last 2024

What HN commenters said

  1. “The basic premise is not do do req/s limiting but rather concurrency limiting which results in req/s limiting by itself.”

    Argues for concurrency limiting rather than requests-per-second limiting

    luckystarr, 2017-12 · Recommendation · in “How to Design a Scalable Rate Limiting Algorithm”

  2. “Stop Rate Limiting! Capacity Management Done Right.”

    Listed among favorite 2017 talks

    cpeterso, 2018-01 · Recommendation · in “Ask HN: What’s your favorite talk from 2017?”

  3. “Relevant to queueing theory”

    Relevant talk on capacity management and queueing

    oftenwrong, 2019-06 · Recommendation · in “It’s Time for Some Queueing Theory”

  4. “You will like the Strange Loop 2017 talk about this subject”

    Strange Loop talk on concurrent capacity limits

    Lanzaa, 2024-11 · Recommendation · in “Amazon S3 Adds Put-If-Match (Compare-and-Swap)”

Excerpts from Hacker News comments, linked to the originals. Summaries and labels were written by a language model from those comments.

Topics: rate limiting, concurrency limits, queueing theory, microservices, strange loop

Also recommended by the same people