HCDE517: Usability Analysis - Schedule - W16

Required

• Katie Hafner. “Wanted by the Police: A Good Interface,” NY Times.
• W Craig Tomlin. “UX Killed Usability.”

From the books (required)

• Tullis & Albert, “Introduction”
• Rubin & Chisnell, Chapters 1 -3

Required

• Jeff Sauro, “What's the Difference between A Heuristic Evaluation and a Cognitive Walkthrough?”
• Stephanie Rosenbaum, “Usability Evaluations Versus Usability Testing: When and Why?”
• Jakob Nielsen, “Usability Heuristics” (ch5), Usability Engineering.

Optional

• John D Gould & Clayton Lewis, “Designing for Usability: Key Principles and What Designers Think.”
• Research-Based Web Design & Usability Guidelines, from Usability.gov.

Extend topic: Heuristic evals for specific settings

• Menno de Jong and Thea van der Geest, “Characterizing Web Heuristics”
• Jennifer Mankoff, Anind K. Dey, Gary Hsieh, Julie Kientz, Scott Lederer, & Morgan Ames. 2003. Heuristic evaluation of ambient displays. CHI 2003.
• Enrico Bertini, Silvia Gabrielli, & Stephen Kimani. 2006. Appropriating and assessing heuristics for mobile computing. AVI '06.

From the books (required)

• Rubin & Chisnell, “Develop the Test Plan” (ch 5) & “Set Up a Testing Environment” (ch 7)
• Tullis & Albert, “Background” (ch 2)

Required

• UPA Code of Conduct for Usability Practitioners (2005)
• Joe Dumas, “How Many Participants in Usability Test is Enough?”
• Steve Krug, “Usability Testing on 10 cents a day” (ch 9) from Don't Make Me Think: A Common Sense Approach to Web Usability. New Riders 2000.
• Jakob Nielsen. (2000). “Why You Only Need to Test with 5 Users.”

Optional

• Jakob Nielsen. (2007). “Fast, Cheap, and Good: Yes, You Can Have it All.”
• Jeff Sauro. (2010). “Why You Only Need To Test With Five Users (Explained).”
• Laura Faulkner. “Beyond the five-user assumption: Benefits of increased sample sizes in usability testing.”

Extend topic: Accessibility

• Web Accessibility in Mind
• Petrie & Bevan. “The evaluation of accessibility, usability and user experience” in The Universal Access Handbook.
• Reframing Accessibility for the Web
• Design for Autism

From the books (required)

• Rubin & Chisnell, “Skills for Test Moderators” (ch 4) & “Find and Select Participants” (ch 7)
• Tullis & Albert, “Planning a Usability Study” (ch 3)

Required

• Medlock MC, Wixon D, McGee M, & Welsh D. “The Rapid Iterative Test and Evaluation Method (RITE): Better Products in Less Time”
• Walji et al. “Are Three Methods Better Than One? A Comparative Assessment of Usability Evaluation Methods in an EHR?”, IJMI 2014

Optional

• Susan Dray & David Siegel. “Penny-Wise, Pound-Wise: Making Smart Trade-offs in Planning Usability Studies.”
• Jeff Sauro. “What goes into a good usability test plan?”

Extend topic: Usability and automation

• 99% Invisible: Children of the Magenta (Automation Paradox, pt. 1)
• 99% Invisible: Johnnycab (Automation Paradox, pt. 2)

From the books (required)

• Rubin & Chisnell, “Prepare Test Materials” (ch 8).
• Tullis & Albert, “Performance Metrics” (ch 4), “Issues-based Metrics” (ch 5), “Self-reported Metrics” (ch 6).

Required

• Joe Dumas, “Usability Testing Methods: Subjective Measures,” in The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, 3^rd ed.
• Froehlich, et al. “My Experience.” Mobisys 2007.
• MS Andreasen, HV Nielsen, SO Schroder, J Stage. 2007. “What happened to remote usability testing?: an empirical study of three methods.” CHI 2007.

Optional

• Hyewon Suh, Nina Shahriaree, Eric B. Hekler, Julie A. Kientz. “Developing and Validating the User Burden Scale: A Tool for Assessing User Burden in Computing Systems” CHI 2016.

Extend topic: The Hamburger Icon

From the books (required)

• Rubin & Chisnell, “Conduct the Test Sessions” (ch 9).
• Tullis & Albert, “Behavioral and Physiological Metrics” (ch 7).

Required

• Jeff Sauro & Joe Dumas. “Comparison of Three One-Question, Post-Task Usability Questionnaires,” CHI 2009.
• Michael Hawley. “User Interview Techniques, Guidelines for Obtaining Better Results,” User Experience 8(3).
• Judy Ramey. “Methods for successful "Thinking Out Loud" procedures.”
• Michael Margolis. “How to hack your body language for better interviews,” Design Staff.

Optional

• M. Ted Boren & Judy Ramey. (2000). “Thinking Aloud: Reconciling Theory and Practice,” IEEE Transactions on Professional Communication 43(3).
• Mie Norgaard & Kasper Hornbaek, “What Do Usability Evaluators Do in Practice? An Explorative Study of Think-Aloud Testing,” DIS 2006.

Extend topic: Additional Techniques

• Still & Morris. (2010). “The Blank-Page Technique: Reinvigorating Paper Prototyping in Usability Testing,” IEEE Transactions on Professional Communication 53(2).

From the books (required)

• Rubin & Chisnell, “Analyze Data and Observations” (ch 11).
• Tullis & Albert, “Combined and Comparative Metrics” (ch 8).

Required

• Chauncey Wilson. “Analyzing and Reporting Usability Data,” STC Usability SIG Newsletter.
• Michael Hughes. “Rigor in Usability Testing,” Technical Communication, Fourth Quarter (1999): 488-94.

Optional

• Jeff Sauro & James Lewis. “Correlations Among Prototypical Usability Metrics: Evidence for the Construct of Usability,” CHI 2009
• Laurie Kanter, Deborah Sova, & Lori Anschuetz. “Organizing Qualitative Data from Lab and Field: Challenges and Methods,” UPA 2005.
• Walter C. Mankowski, Peter Bogunovich, Ali Shokoufandeh, & Dario D. Salvucci. “Finding Canonical Behaviors in User Protocols,” CHI 2009.

Extend Topic: Invisible OSs, Recognition, and Recall

• R Budiu. Memory Recognition and Recall in User Interfaces Nielsen Norman Group.
• J Pavlus. "No UI" Design's Next Move: Fake UI. FastCompany
• Dan Norman and Bruce Tognazzini. How Apple Is Giving Design A Bad Name. FastCompany

From the books (required)

• Rubin & Chisnell, “Report Findings and Recommendations” (ch 11).

Required

• Kerry Rodden, Hilary Hutchinson, & Xin Fu. “Measuring the User Experience on a Large Scale, ” CHI 2010.
• Sheryl Ehrlich, Karen Cross, Wilson Chan, Darcey Imm. “More for Less: A Novel Hybrid Method to Maximize the Impact of Research,” Ext. Abstracts CHI 2003.
• Dave Yeats & Locke Carter. “The Role of the Highlights Video in Usability Testing: Rhetorical and Generic Expectations,” Technical Communication, May 2005: pp. 156-162(7).
• Amy Schade. 2013. “Making Usability Findings Actionable: 5 Tips for Writing Better Reports.”

Optional

• Jakob Nielsen. 2005. “Formal Usability Reports vs. Quick Findings.”
• Chauncy E. Wilson & Kara P. Coyne. 2001. Tracking Usability Issues: To Bug or Not to Bug?, ACM interactions.

Extend topic: Website size and other infrastructure issues

• Maciej Ceglowski. The Website Obesity Crisis
• Toby Biddle. Site Speed and Usability

From the books (required)

• Tullis & Albert, “Special Topics” (ch 9) and choose 2 case studies from (ch 10) and be prepared to present/discuss them, specifically comparing methodologies, metrics, and data representation.

Required

• Erin Friess, 2010. “The Sword of Data: Does Human-Centered Design Fulfill its Rhetorical Responsibility?” Design Issues 26(3).
• Greenberg & Buxton, “Usability Evaluation Considered Harmful (Some of the Time),” CHI 2008.

Extend topic: New Technologies, New Methods

• Morgan Dixon & James Fogarty. 2010. “Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure.” CHI 2010.

Optional

• Janice Redish. 1995. “Are we really entering a post-usability era?” SIGDOC Asterisk J. Comput. Doc. 19(1): 18-24.
• James Kelway. “Usability is dead.”
• N Tractinsky, AS Katz, D Ikar. 2000. “What is beautiful is usable,” Interacting with Computers 13(2): 127-145.