a single source, nothing corroborates it

Turn each note into the smallest change

Raw session notes are not findings. Sort them into actionable and not, rewrite each actionable one as a concrete task, then rank by how much it matters to visitors, how often it came up and how hard it is to fix. Each task becomes the smallest edit that would answer it, run against the current page. Acting on the list moves the standard metrics, which makes this conversion work rather than research.

The method

1. 01

   Sort the notes into actionable and not, rewrite each actionable one as a concrete task, then rank the tasks by how much it matters to visitors, how often it came up, and how hard it is to fix.

2. 02

   Convert each note from that walkthrough into the smallest change that would answer it, then A/B test that change against the current version.

3. 03

   Acting on usability findings moves the standard site metrics measurably, so treat the sessions as conversion work rather than research.

What it returned

• 30%

  After the Scalyr changes: overall bounce rate down 30%, exit rate from the pricing page down 17%.

• Example conversion: a participant not expecting a contact link to open their mail client became the task of building a contact page with a form and pointing all contact links at it.

• Real notes from one of his evaluations included wondering why free shipping was not highlighted and not knowing what a subscribe button did.

Sources

• How to Find Quick Wins in A/B TestingGreg Kogan · gkogan.co · How to Find the Quick Wins · 2014-12-08
• Usability Testing is Easier Than You ThinkGreg Kogan · gkogan.co · Methodology: How We Ran Successful Usability Tests, and You Can, Too · 2014-05-07