Experiment guardrail metrics

실험 가드레일 지표

Pause a conversion win if refunds or errors worsen.

···
html
<div class="guard"><div>CONVERSION <strong>+8%</strong><i class="up"></i></div><div>ERROR RATE <strong>+3%</strong><i class="risk"></i></div><div class="verdict">HOLD: GUARDRAIL CROSSED</div></div>
css
.guard{width:min(78%,430px);display:grid;gap:clamp(8px,2vmin,16px);font:800 clamp(10px,max(1.8vmin,1vw),14px)/1.1 sans-serif}.guard>div:not(.verdict){display:grid;grid-template-columns:1fr auto;gap:5px}.guard strong{color:var(--accent)}.guard i{grid-column:1/-1;display:block;height:clamp(10px,2.5vmin,20px);background:var(--line);position:relative}.guard i:after{content:'';display:block;height:100%;background:var(--fg);animation:fillguard 4s infinite}.guard .up:after{width:85%}.guard .risk:after{width:67%;background:var(--accent)}.risk:before{content:'';position:absolute;left:55%;height:140%;top:-20%;width:2px;background:var(--fg);z-index:1}.verdict{background:var(--accent);color:white;text-align:center;padding:7px;animation:warn 4s infinite}@keyframes fillguard{0%,10%{transform:scaleX(0);transform-origin:left}55%,85%{transform:scaleX(1);transform-origin:left}100%{transform:scaleX(0);transform-origin:left}}@keyframes warn{0%,40%{opacity:.25}55%,85%{opacity:1}100%{opacity:.25}}

Guardrail metrics monitor qualities that must not deteriorate while improving a primary outcome. A conversion lift can coincide with more payment errors or refunds.

The demo shows a conversion bar passing its target while an error gauge crosses its limit, holding the decision. Define thresholds and observation windows before the test.

Too many metrics create noisy alarms. Pick a small set tied to customer harm, and handle severe incidents through operating procedures even before statistical completion.

When to use

Use it for checkout or signup changes where conversion alone is insufficient.

Open as page ↗