Or something else changed at the same time. Hard to know without a control group... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

a123b456c on Oct 28, 2020 | parent | context | favorite | on: Amazon destroys $1.5m of sellers inventory – now h...

Or something else changed at the same time. Hard to know without a control group.

londons_explore on Oct 28, 2020 | [–]

We did a randomised A/B test.

To ensure it wasn't some other wierd effect, we also fixed the bug and then deliberately re-added the same error message.

This bug was worth 15% of our revenue, so we did a lot of tests and trials...

iosonofuturista on Oct 28, 2020 | [–]

Do you know what an A/B test is? It has a control group by design.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact