Mini-game

API Latency Tuner Lab

Beat the target SLA, rack up streak multipliers, and experiment with caching, retries, and jitter.

Back homeAPI Latency Tuner
Score0Streak: 0

Ship a faster endpoint

Adjust caching, retries, timeouts, and jitter to land under the target SLA. Each change influences tail latency and overhead.

How to play

  • - Goal: make Effective (est.) go below the Target SLA.
  • - Caching ON = faster. Jitter ON = smoother spikes.
  • - Retries add overhead; keep low unless baseline is great.
  • - Lower timeouts cap slow requests; too low may cut off useful work.
  • - Use Reset or New challenge anytime.

Quick start

  • 1) Leave baseline as-is.
  • 2) Turn caching ON.
  • 3) Lower timeout until you pass.
  • 4) Keep retries low.
Controls
Current challenge: base 320ms to target 220ms

Represents downstream p95 before tuning.

Retries can help flakiness but add latency per attempt.

Fast cutoffs reduce tail risk400ms
Outcome
Tune to pass

Target SLA

220 ms

Effective (est.)

320 ms

Too slow

Each pass: +10 points (+2 per streak). Beat the bar to keep the streak alive.

What changed?

  • - Timeout caps at 400ms