Request Hedging Tail Latency: Cutting p99 Without Overload
Learn how hedged requests cut p99 tail latency in microservices: delay tuning, hedge budgets, cancellation, idempotency, routing, and when to avoid it.
13 min read
Archive
295 published
Learn how hedged requests cut p99 tail latency in microservices: delay tuning, hedge budgets, cancellation, idempotency, routing, and when to avoid it.
13 min read
Learn to diagnose a slow monolith endpoint: scope the problem, use APM traces, pick on-CPU or wall-clock profiling, read flame graphs, and fix N+1 queries.
16 min read
Run an nx migrate upgrade as a reviewable change: inspect migrations.json, apply in small commits, verify behavior, and handle breaking changes safely.
16 min read
Mark serve targets as continuous in Nx and wire them with task dependencies so nx serve web starts your API too, plus readiness, ports and e2e.
13 min read
Configure Nx named inputs, implicit dependencies and workspace-root filesets so changes to SQL, protobuf, YAML and template files trigger the right tasks.
13 min read
Model SQL migrations, .proto schemas and config files with Nx namedInputs and dependency edges so affected detection and caching stop skipping changed projects.
13 min read
Learn how NAT Gateway billing stacks with AWS data transfer costs, how to attribute bytes with flow logs, and when VPC endpoints actually save money.
13 min read
How Node's fetch pools connections through undici, and how to size, scope, time out and observe dispatchers so outbound HTTP calls stop failing intermittently.
14 min read
Learn how to profile application boot time, defer modules safely, keep readiness honest, and weigh lazy loading against first-request latency and late failures.
14 min read
Compare Cluster Autoscaler and Karpenter by architecture, scale-down, spot handling and portability, with a decision guide and a safe migration path for EKS.
14 min read
Design an in-process event bus for a modular monolith: domain events, in-transaction vs after-commit handlers, outbox durability, boundaries and testing.
14 min read
Build smaller Python API images with a docker multi-stage build: pass one venv between stages, order layers for caching, use uv and slim bases safely.
13 min read