Skip to content
tezvyn:

All bites

The whole library, newest first. Filter by what you are here for, or pick a topic if you already know.

4330 bites

Page 205

Monitoring & SRE1 min read

Black-box vs white-box monitoring for legacy apps

Black-box probes from outside, white-box reads internal state; start black-box for fast user-facing signal.

Monitoring & SRE1 min read

What is high-cardinality data in Prometheus?

Cardinality is the count of unique label combinations; each is a separate series; explosion blows up memory and query cost.

Monitoring & SRE2 min read

Head-based vs tail-based trace sampling

Head-based decides at trace start cheaply but blindly; tail-based waits for the full trace to keep errors and slow requests.

Monitoring & SRE2 min read

Symptom-based vs cause-based alerting

Symptom alerts fire on user-visible impact, cause alerts on internal conditions; page on symptoms to cut noise and catch unforeseen failures.

Monitoring & SRE2 min read

Relationship between SLI, SLO, and SLA

SLI is the measured metric, SLO is the internal target for that metric, SLA is the external contract with consequences.

Monitoring & SRE2 min read

What is an error budget?

Error budget is one minus the SLO, the allowed unreliability; it gates feature velocity versus reliability work.

Monitoring & SRE2 min read

Proposing availability and latency SLIs for an auth API

Availability as the ratio of successful valid requests; latency as the fraction served under a threshold; measure at the edge from the user's view.

Monitoring & SRE2 min read

Diagnosing a healthy p50 but breaching p99

One percent of requests are slow, hurting power users and fan-out calls; investigate GC, locks, contention, cold caches, retries.

Monitoring & SRE2 min read

Defining SLOs for a new critical service

Start from user journeys, pick SLIs, involve product, engineering, and business stakeholders, set realistic targets iteratively.

Monitoring & SRE2 min read

Handling planned maintenance in SLOs and error budgets

Either charge maintenance to the error budget or formally exclude it via a maintenance window; each trades honesty against fairness.

Monitoring & SRE2 min read

Setting SLOs across a dependency chain

Serial dependencies multiply, so each backend needs a tighter SLO than the target; mitigate with redundancy, caching, and graceful degradation.

Monitoring & SRE2 min read

Launching a risky feature with no error budget left

Bring burn history, what consumed the budget, blast radius, and rollback safety; offer mitigations like flags and canaries.

Monitoring & SRE2 min read

Fixing watermelon SLOs that hide unhappy users

Green-outside, red-inside SLOs come from server-side measurement, coarse aggregation, wrong events, and lax thresholds; fix by measuring at the client and using meaningful SLIs.

Monitoring & SRE2 min read

The three pillars of observability

Metrics show what and when via cheap aggregates, logs give detailed per-event context, traces show where across services.

Monitoring & SRE1 min read

Structured vs unstructured logging

Unstructured logs are free-text lines; structured logs are machine-readable key-value or JSON, enabling reliable parsing, filtering, and aggregation.

Monitoring & SRE2 min read

Essential tags for a request latency metric

Add method, route template, status code, and maybe service or region; they enable slicing while staying low-cardinality.

Monitoring & SRE2 min read

OpenTelemetry API, SDK, and Collector

API defines vendor-neutral instrumentation, SDK implements and exports it, Collector receives, processes, and routes telemetry to backends.

Monitoring & SRE2 min read

Trace context and propagation across services

Trace context bundles trace ID, span ID, and flags; propagated via headers like W3C traceparent so each service extracts and continues the trace.

Monitoring & SRE2 min read

Redesigning a high-cardinality request metric

Cardinality is unique label combinations; user_id and raw path are unbounded; redesign by dropping user_id and templating the path.

Monitoring & SRE1 min read

When to add custom OpenTelemetry instrumentation

Wrap domain logic in custom spans, attach business attributes like tenant or plan, answer revenue and per-customer questions.