Wen's+Decided+Framework

**Determine overall goals of the evaluation**
What do you want to find out and why it is important?

For me, I always want my design to become an interactive dialog between information and users. In this process, the user will see/read what they unconsciously expect to see the most. In this project, I want the user to navigate themselves through the website following our carefully designed implications. So that they will envision themselves in the environment, and at the same time, be provided all the information they are looking for. In regarding to virtual experience, I think it is more important to attract the user by providing an easy, simple and innovative relationship rather than narrative information.

Through evaluation, I want to know whether the experience we provided is the best solution for potential problems that users might encounter. It is important to make sure the experience we provide reach an agreement with users' expectations. For our specific project, I want to know whether the interaction can provide appropriate feedback, and build up an active and joyful relationship between the user and our website (information). It is necessary to see whether the user can find the information in the most efficient and easy way, whether they can understand our intention and whether they are comfortable with the envision process. The quality of user experience has a large impact on the overall success of the system. The feedback they provide are the experience we want to design with. Therefore, the user evaluation is crucial.

**Explore the questions that need to be answered**
What are the "big" questions you want answered that provide actionable insights?

Do users find it is interesting to interactive with information, or does it become a distraction? Does our navigation a effective way finding system for the user? How users identify themselves and locate the information they are looking for? Is there anything causes misunderstanding? Is there anything needs to be hide or be more visible?

**Choose the evaluation paradigm and techniques to answer questions**
Provide a rationale for the selection of methods, for example, why select structured task instead of unstructured exploration

We are going to do a structured task evaluation and ask the user to think out loud.

We are designing a small part of the system. The user will get confused if they are allowed in all directions. By asking them to look for specific information and think out loud, we will know the decision making process they basically go through. We will ensure our design follows their expectation; and also there are no misunderstandings and distractions blocking their way.

The academic website we are designing is information based. Therefore, the first thing we need to make sure the experience is efficiency. The time one user needs to find certain information reflects the efficiency. Also, by observing the user's overall reaction, we will know whether the experience is pleasurable. We will then determine whether the user is satisfied with their experience or there's something more we need to consider.

**Identify the practical issues that must be addressed**
Describe the testing environment, equipment and participants ? Are there any possible concerns?

The test environment will be in school during a leisure time. Most future students access school website to prepare their application from home. Therefore, we want to modify that free and sort of personal space as much as possible. However, it is still different because the whole browsing process is monitored. The exploration process a user goes through becomes more critical.

The test equipment will be on laptop of both PC and MAC due to different operation systems that are used.

The participants will be ideally high school students who are interested in visual arts. In case we could not perfectly reach there, we are going to test it among first year visual arts students. There are possibilities if the students have already known where they should find their information. However, since we changed the way information is cataloged, the test would still be effective.

**Decide how to deal with the ethical issues**
Are there any ethical issues that you may encounter? How will you address these?

I do not think there would be any ethical issues if their decisions are appropriately respected. We will ensure that they know they can quit the testing anytime due to any reasons or none; and their information will be kept confidential. We also want to confirm that the purpose of the test is not for commercial use or public presentation. They do not have to worry about the quality of their performance.

**Evaluate, interpret and present the data**
Analysis and interpret the collected data to identify patterns or themes that emerge

We are going to ask them to speak out their thoughts. At the same time, we are going to observe their performances and actions. We want to keep records of the activities that the users naturally do without intention. We are going to observe their reactions and mouse movements. We would like to keep track of the time they spend on each page and the activities they do on each page. In this case, we will know the elements that interests the users the most; also the areas we need or redesign or modify. Combine with their own thinking process, we will know the areas that we missed or over estimated during our design process.