User Experience Research & Software. Tweets by Jeff Sauro, Jim Lewis & MeasuringU Team: Authors of Quantifying the User Experience + 8 Other UX Books.

Denver, CO US
Joined January 2010
In our study of digital twin prediction of business software SUS scores, we found high correlation (.80) with human scores but average errors of about +10 points (AI prediction consistently higher than human scores). measuringu.com/digital-twins…
23
Randomization tests use computer functions to randomly shuffle data many times. To evaluate mean differences after each shuffle, the means computed from the shuffled data are compared with the observed mean difference. measuringu.com/randomization…
64
The real value is not in the equipment or technology but in the technique. Here are the basics of what you need to moderate a #usability test. measuringu.com/conduct-moder…
1
64
When setting #benchmark targets, aim high but realistic. measuringu.com/benchmark-tar…
77
“Surely, God loves the .06 nearly as much as the .05” (Rosnow & Rosenthal, 1989, p. 1277). measuringu.com/setting-alpha…
126
For research contexts in which classical test theory provides inadequate measurement of individual differences, use item response theory (including Rasch analysis) instead. measuringu.com/applying-rasc…
147
A bipolar measure of likelihood to recommend appears to better predict negative word of mouth than the NPS measure of likelihood to recommend, but it cannot be interpreted with current NPS benchmarks. measuringu.com/does-the-nps-…
131
What is the N−1 two-proportion test, and why do we recommend it over chi-square and Fisher exact tests for analyzing 2 x 2 tables? measuringu.com/what-is-the-n…
129
Methods for conducting surveys include face-to-face, telephone, mail, and online. measuringu.com/census-poll-s…
168
Our confirmed version of a new standardized questionnaire for perceived website clutter has separate measures of Overall Clutter, Content Clutter, and Design Clutter. measuringu.com/confirming-a-…
1
3
194
Unlike our previous research, we found no significant differences in predicted SUS scores from two types of digital twins (summary and full)—but both were very different from human scores. measuringu.com/digital-twins…
202
The SUPR-Q has high internal-consistency reliability (Cronbach-alpha = .86). measuringu.com/10-things-sup…
212
How Much Should You Over-Recruit? measuringu.com/how-much-shou…
1
121
Math and empirical data indicate that the first few users in a formative #usability study will uncover most of the common problems that are available for discovery, but how can this help when planning these types of studies? measuringu.com/predicting-n-…
147
In an experiment with digital twins predicting SUS scores for business software, we found similar standard deviations for humans and AI but very different shapes (skewness and kurtosis). measuringu.com/digital-twins…
129
The Product Market Fit item score is the percentage of respondents who would be very disappointed if they could no longer use a product that they have been using. measuringu.com/product-marke…
149
As a #UX researcher, have you ever worried about using the wrong rating scale format? Would it surprise you to learn that it often doesn’t matter? measuringu.com/changes-to-ra…
66
User-Centered Design and Design Thinking: Different Origins, Similar Practices. measuringu.com/ucd-and-desig…
87
Our analyses of three versions of a technical activity checklist indicate that a list of 16 activities is too much, 9 isn’t quite enough, and 10 is just right. measuringu.com/rasch-analysi…
85
Our study of clothing websites found that they provide experiences that are above average (collectively, at the 82nd percentile in the SUPR-Q). Individually their SUPR-Q percentiles ranged from the 50th percentile (H&M) to the 98th (Banana Republic). measuringu.com/ux-nps-benchm…
77