06.7.3 · Skill in Evidence-based decisions
Balancing signals
Combining numbers, user feedback and judgment into one decision.
Quantitative data shows what is happening, qualitative data shows why. They often disagree at first. Good decisions weigh both, along with strategy and cost, instead of letting one metric decide.
Resources
3- articleStart hereLeading vs. lagging indicators: how to identify and map your metrics ↗Amplitude · 2024 · 8 min
How to find the early signals that predict slow outcomes such as retention and revenue.
- articleStart hereGuardrail metrics for A/B tests, explained ↗PostHog · 5 min
Written for product engineers. What guardrail metrics are, which ones to pick, and how companies such as Airbnb use them.
- articleGo deeperMeasuring the user experience on a large scale: user-centered metrics for web applications ↗Kerry Rodden, Hilary Hutchinson, Xin Fu (Google) · 2010 · 10 pages
The original HEART paper. Happiness, engagement, adoption, retention and task success, plus the goals-signals-metrics process for choosing them.
Tools
none yetTools for this topic are being researched.