P3+User+Testing

=User Testing= Each group member is to develop their own strategies for testing their functional prototype. The individual member will test a specific and unique aspect of the prototype and are to conduct //1 test// with a //minimum of 3 test subjects// from their defined user group.

Each group is then to publish their results that outline:
 * the objectives of the testing
 * what methodologies were applied and why
 * how the test was conducted
 * an analysis of the results
 * how this will determine the refinement of their system

Deliverables
The testing will require a plan to initiate the process and will include individual and group components. All of this work needs to organized as a single group document with authors credited for individual components. This work will be posted to the wiki and printed out in hard copy for submission.

1. User Test Plan - **due Mar 2 -** hand in with User Test Report Mar 9
This plan will consist of the following parts:
 * User Test Design that follows the DECIDE framework to develop the methodology (individual)
 * Project Brief (group)
 * Test Script (individual)
 * Consent Form (individual)

2. User Test Report - **due Mar 9**
This report will consist of these two parts:
 * An analysis of test results (individual):
 * the testing procedure - how things went; what actually occurred during the testing? expectations met? any challenges or surprises
 * findings - what did you discover about your designs? what are the answers to your "big" questions?
 * reflection - how did you find this process, what you have learned? would you change anything next time?
 * Further analysis of user test results to formulate an integrated group report with the objectives of the new design requirements clearly stated (group)

//All of the User Testing phase will be due on the Mar 9 th in class//

DECIDE Framework
 >> Student Example 1
 * 1) **Determine overall goals of the evaluation**
 * What do you want to find out and why it is important?
 * 1) **Explore the questions that need to be answered**
 * What are the "big" questions you want answered that provide actionable insights?
 * 1) **Choose the evaluation paradigm and techniques to answer questions**
 * Provide a rationale for the selection of methods, for example, why select structured task instead of unstructured exploration
 * 1) **Identify the practical issues that must be addressed**
 * Describe the testing environment, equipment and participants ? Are there any possible concerns?
 * 1) **Decide how to deal with the ethical issues**
 * Are there any ethical issues that you may encounter? How will you address these?
 * 1) **Evaluate, interpret and present the data**
 * Analysis and interpret the collected data to identify patterns or themes that emerge

media type="custom" key="5410855"

Project Brief
This document is read to the participant as an introduction to the project and the designers. It is meant to set a tone of trust and sincerity, creating an atmosphere in which the participants feel comfortable and free to perform the test. In doing so, expectations and limits are clearly stated, so the participants are not be distracted or concerned with uncertainties that may be counterproductive to the test.

The opening statement will set the stage as in this example:

//“We are researchers from the University of Woodbridge who are working on developing new computer software to help students learn math. We are going to show you the screen and ask you to perform some tasks. We are checking our work to see if it can actually help you. In no way are we testing your abilities but rather testing our software and looking for ways to improve it’s capabilities.”//

Test Script
This also read to the participant to set the context and instruct them in their tasks.It can take the form of a scenario in setting up the situation and then direct them in performing a task. Although task performance is only one example of user testing, this is the most common example:

//"The teacher has just finished teaching an introductory lesson on Volume from the class math textbook. She wants everyone to read over the chapter. You, as the student, choose to skip the textbook and try out the new computer software that the teacher told the class about the other day. Now, go to the computer to start to read over the chapter on Volume.//"

Consent Form
The consent form is a must when using human participants in any kind of academic research. This is for the protection of all involved and should clearly state the rules involved. Please see this example from [|York Research]. These completed [|consent forms] must be kept on file and will need to be submitted as requested by your instructor.