All bites
The whole library, newest first. Filter by what you are here for, or pick a topic if you already know.
4330 bites
Page 68
Set up a client-side button color A/B test
Stable hashing of a persistent ID into buckets, conditional rendering of the variant, exposure plus click event logging.
Design a centralized experimentation service
A config/assignment API, deterministic SDK-side bucketing, and a separate exposure-logging pipeline.
Experiment design under network effects
Cluster-level randomization, graph or geo clustering to contain spillover, and analysis at the cluster unit.
Client-side vs server-side event tracking
Client captures UI intent but loses data to ad blockers and tampering; server is trustworthy for transactions but blind to UI interactions.
Design an analytics event schema
Consistent object-action naming, snake_case, typed properties with units, and shared context like user, session, timestamp.
Migrate a breaking analytics schema change
Dual-write both fields during overlap, backfill history, migrate consumers, then deprecate the old field.
Design a streak-saver mechanism
Timezone-aware streak state, capped saver inventory with replenish rules, and A/B testing forgiveness against retention plus guardrails.
Components of a testable A/B hypothesis
A specific change, a predicted directional effect on one primary metric, a rationale, and a measurable success threshold.
Communicate experiment results and check guardrails
Explain the lift and confidence in plain business terms, report a confidence interval not just a point, and verify guardrails before shipping.
Capture UTM params and attribute on signup
Parse UTMs on landing, persist them in a cookie tied to an anonymous ID, then stamp them onto the account at signup.
Design a unique referral code system
A unique DB constraint as the source of truth, generation via random retry or an encoded counter, and collision handling.
Explain deferred deep linking flow
Capture link payload server-side at click, route to the store, then match the new install to the click on first launch to route the user.
Detect fraudulent app installs
Click-to-install timing distributions, device and IP fingerprints, post-install engagement, and attribution anomalies.
Implement a welcome-message A/B test
Deterministic hash of a stable ID for sticky assignment, conditional rendering of the personalized variant, and exposure plus click tracking keyed to the same ID.
Cross-platform stateful onboarding sync
Store onboarding state server-side keyed to the user, expose idempotent step-completion APIs, and push updates to other clients.
Dynamic personalized onboarding architecture
A segmentation pipeline, a serving layer choosing task order per segment, an experimentation engine, and a feedback loop measuring activation.
Cold-start to personalized feed transition
Start with popularity or onboarding-declared interests, collect implicit signals like dwell and clicks, then blend toward personalized as confidence grows.
Peeking in A/B tests and how to mitigate it
Peeking is checking significance repeatedly and stopping at the first significant result, which inflates false positives; mitigate with fixed sample sizes or sequential…
Build a SaaS churn prediction model
Define churn and the prediction window, engineer usage-trend and tenure features, try logistic regression then gradient-boosted trees, and evaluate on class-imbalanced metrics.
Sensitivity analysis on a growth model
Perturb each input by a normalized amount, measure the change in the long-term output, and use elasticities or global methods to rank drivers.