user_test_tra_tj


 * TJ: Focusing on the Information Architecture**


 * Test Script

The user will be asked to perform the following tasks to evaluate the navigation and information architecture found in the events page and events montage (flash). ** **Task 1** A friend briefly mentions that Joan Miller, a famous designer, is visiting the campus for a special guest lecture. You want to know more information about her and the event. __Find the details of Joan Miller and the topic of her lecture__.

You are a prospective student interested in attending a Visual Arts program and have not yet decided between the Visual Arts program at York University or OCAD. Your deciding factor is the amount of events the school offers. __Explore the current events montage__.
 * Task 2 **

//Questions: Is the events page easy to understand? Does the events montage (flash) hinder or help promote exploration of upcoming events? Is the events page layout easy to use? Does the visual hierarchy of information allow you to find information (e.g dates, address,subject) easily?//

//Is the information that is displayed relevant to Visual Arts students? Will it motivate you to explore events occurring in the Visual Arts department? Is the way the information is presented communicate a visual arts feel? Does the events page communicate the values and beliefs of the Visual Arts department?//
 * //Additional Questions:// **


 * DECIDE Framework**

//What do you want to find out and why it is important?// **
 * Determine overall goals of the evaluation

The purpose of the evaluation is to assess the usability of the navigation found in the proposed redesign for the Visual Arts Department of York University website. Moreover, the purpose of this test is to gain a strong understanding of the effective and successful parts of the navigation structure (particularily the events page) of the design, as well as locate and repair the faulted areas of the proposed design. The particular goal of the evaluation is to discover three pieces of data, whether the events page and events montage (flash) encourage exploration, whether the events page can be easily navigated to, and whether critical information can be found immediately. The evaluation is important to the success of the system, as it serves as a tool to measure the success of the navigation structure as well pinpoint problems in the information architecture.


 * Explore the specific questions to be answered **

//What are the "big" questions you want answered that provide actionable insights? //


 * Does the events page and events montage (flash) encourage exploration of the site further?
 * Does the events montage (flash) hinder or help promote exploration of upcoming events?
 * Does the visual hierarchy of information allow you to find information (e.g. dates, address,subject) easily?

 Provide a rationale for the selection of methods, for example, why select structured task instead of unstructured exploration **
 *  Choose the evaluation paradigm and techniques to answer questions

The paradigm chosen for this evaluation is a combination of the ‘quick and dirty’ and ‘usability testing’. A combination of paradigm allows us to gain an understanding of two different types of navigation. The first type is a non-linear navigation style, where the user has no determined destination. This can also be referred to as exploring and will be tested through the ‘quick and dirty’ paradigm. The latter type is a linear navigation style, where the user has a determined destination. This can also be referred to a user inquisition and will be tested through the ‘usability testing’ paradigm. In addition, there will be the use of interviewing. This will allow further insight into what the user feels and thinks about the design, but it will only be utilized if the evaluation does not fulfill our level of knowledge on the user’s experience.


 * Identify the practical issues that must be addressed **

//Describe the testing environment, equipment and participants? Are there any possible concerns? //

The testing environment will be quiet and will attempt to mimic the environments where the prototype will be used (e.g. study room, campus, library) as close as possible. The equipment being used is an Apple Macbook Pro, with the option between trackpad and mouse, as many users may not know how to use one or the other. In addition, the user will be asked to perform the evaluation in Safari web browser. The participants selected for the evaluation will predominantly be majors from the Visual Arts department at York University, but non-majors will also be asked to participate to gain an understanding of whether the variable makes a significant difference in user experience.


 * Decide how to deal with the ethical issues **

//Are there any ethical issues that you may encounter? How will you address these? //

<span style="font-family: Arial,Helvetica,sans-serif; font-size: 10pt;">Ethical issues are uncommon when approaching user usability testing for an education institution’s website. Although for this evaluation, the protection of the test subject’s identity is an ethical issue. To address this issue, the subject will first be read a project brief, so they have a clear understanding of what will occur during the evaluation. Second, the subject will be given a consent form to clarify they understand that their identity will be protected. Lastly, since we will be filming the subject’s actions, the angle of the camera will only capture the screen interaction, as well as the fingers of the subject. If the displaying of the subject’s fingers is disputed, they can easily be cropped out of the video, to further protect the identity of the subject. This also applies to the voice of the subject, which can be distorted digitally.


 * <span style="font-family: Arial,Helvetica,sans-serif; font-size: 10pt;">Evaluate, interpret and present the data **

//<span style="color: #808080; font-family: Arial,Helvetica,sans-serif; font-size: 10pt; line-height: 25px;">Analysis and interpret the collected data to identify patterns or themes that emerge. //

<span style="font-family: Arial,Helvetica,sans-serif; font-size: 10pt;">Using the data we collect, we intend on using a compare-and-contrast style of analysis. This will be carried out through comparing our intended system of navigation to how the subject navigates during the evaluation. If there is a parallel, it will confirm the success of our design. If there is a contradiction, it would indicate a flaw in our design. Moreover we intend on observing the video data to roughly time the subjects in their ability to complete the task, and produce an average time to complete each task. In addition, the opinions, suggestions and criticisms verbally expressed during the evaluation will be analyzed and may be implemented into the final design.