Test report by Sandra Yuen

HAPPY FOLK

TEST REPORT Inthernship at Happy Folk Student Name: Sandra Yuen Studentnr: 464474 Email: sandra.y32@live.com Mobile: 06 31956774 Education: HAN University of Applied Sciences Major: Communication & Multimedia Design (CMD-C) Company Name: Happy Folk Address: Nieuwe Oeverstraat 31-33, 6811 JB Arnhem Website: www.happy-folk.com Manager: Mark Tamea Email manager: mark@happy-folk.com Mobile manager: 06 14989990 University Coach: Yvonne Brinkman Email: yvonne.brinkman@han.nl Mobile: 06 28304356 Date: 18 May 2017 Verion: 3.0 1

TABLE OF CONTENT Preface.....................................................................................................................................................................................................................................................................................3 1. Purpose of research/test...................................................................................................................................................................................................................................................4 2. Description of animation.................................................................................................................................................................................................................................................5 3. Testplan...............................................................................................................................................................................................................................................................................6 4. Interview questions...........................................................................................................................................................................................................................................................7 5. Testresults............................................................................................................................................................................................................................................................................8 5.1 Moving storyboard...........................................................................................................................................................................................................................................8 5.2 Proof of concept...............................................................................................................................................................................................................................................9 6. Conclusion and recommendation...............................................................................................................................................................................................................................10 7. Appendix.............................................................................................................................................................................................................................................................................11 7.1 Moving storyboard...........................................................................................................................................................................................................................................11 7.2 Proof of concept..............................................................................................................................................................................................................................................12

PREFACE

This document is written in conclusion for the test research of the graduation project at Happy Folk conducted by Spine Advice. The graduation assignment is to create a proof of concept which could be a solution for Spine Advice’s communaction and understanding problem for the future. This test repport consists of two test phases, which in the beginning a moving storyboard is tested among the target group in order to definde the content requierements of the target group. The next test is going to be the proof of concept, which this test is the main part of the project. From this test the main question should be able to have a concrete answer. Main research question: How can Spine Advice improve patient’s knowledge and understanding of Orthopedic surgery through animation? Sub questions: 1. How can spine Advice assure the degree of understanding of patients about Orthopedic surgery? 2. What content must be provided in the animation regarding the understanding of patients about Orthopedic surgery? 3. Which type of animation can be used to improve patients’ knowledge and understanding regarding the target group? 4. How can animation improve patient’s knowledge and understanding? At the end of this document there is a chapter of conlusion about the tests. In the conclusion the main question and the sub-questions are being answered.

1. PURPOSE OF THE TEST

There is going to be two test phases during the process of the project. Before creating the proof of concept the first test phase takes place to know or to define the content of the animation. The content is the storyline or the script which the targetgroup requieres to know in order to understand Orthopedic surgery of Hip Replacement. Therefore, the first test is going to test out if the content meets the requierments of the targetgroup. To do the first test, a moving storyboard is created by sketches. These sketches are just images to illustrate the information that is going to be provided. Testers are going to be tested base on the content of the storyboard. During the test there are several questions will be asked in order to find out if the content is revelant or is it understandable.

In the second test phase is going to be the real test of the proof of concept. The proof of concept is a draft of the animation that is going to be created for the targetgroup. The test of the proof of concept is to find out if animation is the solution of Spine Adviceâ&#x20AC;&#x2122;s issue. Base on this test, testers can give their opinions on everything such as the graphic, audio, colors, effect, feeling etc. This test is also to test out if animation really can improve patients knowledge and understanding on Hip replacement of Orthopedic surgery.

2. DESCRIPTION OF THE ANIMATION

This animation is created in order to define if medical animation can improve patients knowledge and understanding of hip replacement of Orthopedic surgery. The animation is a 3D animation which provides the proces of the surgery for hip replacememt. According to the research results the targetgroup for this animation is for seniors/elders from 60 years old or older. However this targetgroup is not the only targetgroup for this animation. Others beyond this targetgroup can also be possible as a targetgroup, which means the main point is to seniors/elders but other can also be possible to be educated by this animation. The animation consists of three session of content/story such as the preoperative, procedure and the recovery. From the survey results in the targetgroup analysis it show, most people requires those three session of information in an Orthopedic surgery. These information are the headlines of the animation. Furthermore, an active voice-over is included in order to explain the 3D illustrations.

3. TESTPLAN The animation is going to be tested with the targetgroup of 55 to 64 years old and 65 years or older without any experience with Orthopedic or hip replacement before. This targetgroup without any experience is selected in order to really find out if the provided information is understandable or not. If the test is going to be tested on targetgroup that already has experienced Orthopedic or hip replacement before, then the testers already know how the steps of the procedure are made. However, targetgroup without any experience can give a trully of their first impression or opinion about the storyboard or proof of concept. From them the test will be accurate to define if animation can really improve patients knowledge and understanding of the surgery. Targetgroup with experience will be bias to what they already experince and cannot give their first feeling about the content of the moving storyboard or animation. These targetgroup from 60 years or older are selected base on the research results of the targetgroup analysis. The animation is going to be tested on 5 testers in order to meet the requierements of this testreport. Tester 1: Maartje Teunis, Administration (55 years) Tester 2: Barbara Schiphorst, Banker (64 years) Tester 3: Gisella van der Jong, unemployed (58 years) Tester 4: Fina Christiaans, Accountant (56 years) Tester 5: Rosalina Pieters, Accountant (55 years) The tester is going to watch the moving storyboard and the proof of concept through a laptop, which the testee is sitting next to the tester to observe and to take notes of the testee. Before starting with the test, the testee is going to give an introduction about the storyboard or the proof of concept to the testee. Furthermore, the testee explains what the purpose of this testing is about. In order to make it clear to the testee, the teste is also going to explain that this test is made for a graduation project conducted by Spine Advice. From this test Spine Advice can find out if animation is a solution to improve patients knowledge and understanding of Orthopedic surgery. The first task for the tester is to watch the storyboar or the proof of concept of hip replacement surgery. When the testee is finished watching the storyboard or proof of concept the tester is going to ask some questions regarding the content of the storyboard or the proof of concept.

4. INTERVIEW QUESTIONS Interview question for moving storyboard 1. 2. 3. 4. 5.

What do you think about the storyline of the storyboard? Do you think these provided infomation/illustrations are sufficient for you to understand the surgey of hip replacement? Does the provided information fulfill your needs of curiosity regarding the surgery? Do you think the visualization of the information are clear enough in order to follow the story or to understand the story? Do you think the story is told in a logical way?

Interview question for proof of concept 1. What is your first impression about the hip replacement animation? 2. How do you feel after watching the hip replacement animation? 3. What do you think about the provided information? 4. What do you think about the storyline? 5. Does the provided information fulfill your needs of curiosity regarding the surgery? 6. What do you think about the 3D graphic? ‘ To test out if the tester has understand the animation correctly: 1. Can you give a short summary about the animation? 2. Can you tell a story regarding the steps that have to be taken for a hip replacement surgery? 3. Can you name the medical term of the artificial hip? 4. Can you point out on your own body where the incision is going to be in order to be operated? Well phrased confirmation questions can help to assure others’ understanding by asking the following questions (Guy Harris, 2012): • “Let me say back to you what I think you just said, so that I can be sure I understood you correctly…” • “Please correct me if I am wrong. I understood you to say ________. Is that correct?” • “If I hear you correctly, you are saying _____________. Is that right?” • “I hear you saying ____________. Is that right?” • “It sounds to me like you feel/think ____________. Did I understand you correctly?”

5. TEST RESULTS 5.1 Moving storyboard

The test results of the moving storyboard are given as an overview in the table 1.1 down below. The table is listed with the key points that are mentioned during the test with each testees. To have a full detailed summary of each testee review the story in the chpater 7 Appendix. The purpose of this test is to find out if the story is provided correctly and understandable throughout the illustrations. According to all the testees, the story of the moving storyboard was very clear to understand. The story is provided in a logical way, which the story is easy to follow even without a voice-over. For most of the testees the moving story board covers most of the headlines of the surgery. This means the most important information regarding a hip replacement surgery are given or illustrated in the moving storyboard. From the results, there are no confusion encountered during the test, which means every testees understand what the moving storyboard is about. The provided sequence of illustrations creates a link to the story flow how the procedure is going to be held by the surgeons/doctors. Furthermore, testees find the illustrations are clear enough for them to understand what it represents. These results will be in taken for further implementation in the design phase, which it shows these are the key scenes that must be provided in order to have an understandable storyline.

Moving storyboard results Test Story is provided in logical way Clear story to understand Pre-operative is important The animation covers most of the headlines Illustrations are clear to understand what they represent Content/illustration is specific and direct to the point Clear sequence of images to follow Graphical element enhance the understanding of illustration Animation doesn't fullfill all the needs to undergo the surgery

1 X X X X X

2 X

3 X X

4 X X

X X X X

X X

5 X X X X

Total 3 5 1 3 3 1 2 1 1 Table 1.1

5.2 Proof of concept

The test results of the proof of concept is listed down below in table 1.2. Like mentioned before the testees are the same person as the testees from the moving storyboard test. The purpose of the proof of concept is to find out if the animation meets all the requirements of the target group regarding hip replacement surgery. Therefore, the focus of the animation is on the understandability of the story or content. The main points are listed in the table, which it shows how frequently the same answer are being mentioned by the testees. From the result, it shows all testees think the procedure is being explained step by step in the animation. Furthermore, there are four testees out of five say the content is understandable. During this test, there is checking test for understandability. After watching the animation, the tester used the â&#x20AC;&#x153;teach-me backâ&#x20AC;? method from AMA Foundation to assure a patient understandability. This small test is also listed below in the table, which most of the testees do understand the provided information and also retain the main steps of the procedure. From the test, there are also some feedback from the target group, which the feedback will be taken as development in the final proof of concept. The feedbacks from the test are: information about the effected muscles, the risk of the surgery, the arms are distracting, the timing of the medical terms are too fast and the duration of the surgery.

Proof of concept Test The animation is clear The graphic is modern The content/animation is understandable The procedure is narrated step by step Testee feels more secure after watching the animation 3D graphic is clear and clean 3D graphic gives different angle/ perspective view The animation gives an interesting feeling The animation minimize the complexity/confusion of a surgery The content covers all the headlines of a surgery The animation looks very accurate to realism

1 X X X X

X X X X X

3 X

4 X

X X

X X X X

X X X

Total 3 1 4 5 1 3 3 3 2 3 1

Checking for understandablity Testee can give a summary Testee can tell the procedure step by step Testee remembers the artificial hip name called "Prosthesis" Testee can point out the incision position on his/her body

X X X

X X X X

X X X

X X X X

5 4 4 4 Table 1.2

6. CONCLUSION AND RECOMMENDATION The moving storyboard is tested to answer one of the sub-question of the project. The sub-question is “What content must be provided in the animation regarding the understanding of patients about hip replacement of Orthopedic surgery”. The sub-question is about the content of the animation; therefore a moving storyboard is the best approach to define the exact content requirements for the target group. In conclusion from the moving storyboard test, it turns out positively which most of the testees have understand the purpose of the test. The sequence of the illustrations is clear for the patient to understand what they represent. The selected content is provided in a logical way, which patient can follow the procedure of the surgery step by step. The content is direct to the point what a patient should know regarding hip replacement surgery. Therefore, the target group confirms the content requirements to be clear and understandable. The second test is the most important test of the entire project. From this test, it should answer the main question of the project “How can Spine Advice improve patient’s knowledge and understanding of Orthopedic surgery through animation?”. The test of the animation comes out positively, which animation has high influence on patient’s knowledge and understanding regarding hip replacement surgery. During the test, there is also a test to assure the understanding of the patient, which the “teach-me back” method is applied. This means after providing the animation the doctor can assure the understanding by asking them what they have understand from the animation. By knowing how to assure the degree of understanding is answering to the sub-question “How can Spine Advice assure the degree of understanding of patients about Orthopedic surgery?”. From the test it shows, patients do retain the provided information better than just verbal communication. In the proof of concept, the story is divided into three session: pre-operative, procedure and the recovery. These contents are the headlines of the animation that makes it clear to the patient to understand which steps are taken for the surgery. The proof of concept is made in a 3D animation, which patient can have a perspective view of the surgery. From the test results, patients do think 3D is the best graphic style to provide a complex surgery. The 3D graphic is very accurate to realism according to the target group. This should answer the sub-question of “Which type of animation can be used to improve patients’ knowledge and understanding regarding the target group?”. Furthermore, patients do require interacting with the doctor in order to feel secure and trustworthy which the animation is going to be played during the consultation of the patient. The patient is able to ask further questions if misunderstand some information.

7. APPENDIX Guy Harris, 2012. Five Questions to Make Sure that You Understand Others Correctly. Consulted on 14 November 2016, from https://recoveringengineer.com/resolving-conflict/five-questions-to-makesure-that-you-understand-others-correctly/

7.1 Moving storyboard

Tester 1: Maartje Teunis 55 years old, Administrator Maartje is the first tester that is going to watch the storyboard. She is going to give her feedback base on the content of the storyboard regarding hip replacment surgery. Maartje thinks the storyboard is provided in a very logical way, which she tells that the preoperative session is important to know what she has to prepare or how the surgeons are going to prepare her before the surgery itself. Furthermore, Maartje think the storyline is good, because the contet already covers the main or headlines of the entire procedure of the operation. The visualization of the illustrations are very clear what is going to happened or what it is about eventhough there isn’t any voice over. Tester 2: Barbara Schiphorst 64 years old, Banker Barbara thinks the content of the storyboard is very specific and direct to the point what is going to happened. She is impressed about the illustration where it shows what the names are of the bone where is going to be operated. In general she thinks the content gives a general information what is going to happened when you are about to go for a hip replacement surgery. Through a single image she cannot understand what this is about, but after all those images linked together it comes to a very clear story that this moving storyboard is about hip replacement surgery.

Tester 3: Fina Christiaans 56 years old, Accountant Fina thinks the storyline is good, because it shows the damaged part of the bones and indicate which part of the body it is. In general the storyline is understandable and in a good order to follow. Fina says the storyboard does take her step by step to the procedure of the surgery, which all the main information are illustrated. Tester 4: Gisella van der Jong 58 years old, unemployed In the beginning the tester doesn’t understand what the moving storyboard is about, but after she finish watching the moving storyboard she understands what the story is about. The testee thinks that the content is very good, which the content covers up most of the important thing of a surgery. She also says that if one day she is about to undergo for an Orthopedic surgery, she already has an idea what to expect. Gisella doesn’t think by watching this it would fullfill all the needs in order to undergo for a hip replacement surgery. She would still have some other questions to ask the doctor, such as how long does it take to do the surgery. In general or for other people it’s not important, but she would ask to know such information. Tester 5: Rosalina Pieters, 55 years old, Accountant Base on the content, Rosalina thinks that it’s very clear to understand and to follow what the moving storyboard is about. According to Rosalina, these information are the most important to her as a patient. She would like to know how the doctor is going to prepare her before the surgery and the procedure is in step by step explained through those illustrations, which it’s understandable. The storyline is in a very logical way provided according to Rosalina.

7.2 Proof of concept

Tester 2: Barbara Schiphorst 64 years old, Banker

Tester 1: Maartje Teunis 55 years old, Administrator

After watching the animation, she says “I feel more assure, because of knowing the steps that are going to be made in the operation.” In the The first impression of Maartje is, that it’s very clear and clean which it impresses her. She thinks it’s very modern like. In the beginning she expects to beginning Barbara shows a bit tense, because she hasn’t experienced see like very common skeleton image and how the hip is going to be replaced. anything like this before and cannot imagine how it could be. According to Maartje this proof of concept is very understandable, because it Now that she watched the animation she has an overview about how shows the procedure step by step with the same 3D body. However, some of the animation that she saw before provides only images and that she cannot everything is going to be, which she feels more secure. Barbara thinks get the entire idea of the operation. According to Maartje the graphic is very the storyline is very well told that the she can understand and follow the animation. According to Barbara the provided information from the specific which it shows where the incision is going to be cut. animation does fullfill a big part of her curiosity. It’s a good animation, but After the test Maartje could summarize what she has watched in general. She thinks she still may have more questions if this situation is happening to her. Barbara likes the 3D graphic, because it’s very clear to see which bones and also could tell a short story about all is going to happened when there is a muscles are related to the operation. It also gives a different angle which it day that she has to undergo for a hip replacement. Maartje also remembers the name of the artificial hip called “prosthesis”. She says it is a good point to doesn’t limited your view. label the artificial or other bones that is related to the operation in order to remember them. From that she could remember the name and otherwise she After watching the proof of concept Barbara was able to summarize what she couldn’t remember it. Furthermore, Maartje also point out on her body where saw. She also was able to tell the steps of the operation that have to be made from the proof of concept. Barbara couldn’t remember the name of the the incision is going to be made regarding a hip replacement. artificial hip, because she was focusing on the given information. She says she focused more on the given information how the surgery is going to be instead Feedback: Maartje suggested to give more content about the side effect if of memorize everything of the animation. As last she could point out where the musceles are being cut through. the incision is going to be made in order to be operated. Feedback: Barbara suggested to give more information about the muscles related to the operation. In the animation the muscles have a fading effect, but that isn’t the reality. It would be better to give some information about how the doctors/surgeons are going to handle the muscles that covers the hip joint. 12

Tester 3: Gisella van der Jong 58 years old, unemployed

is goin to be to do the surgery.

Gisella is the first testee that gives a very nervous behavior in the beginning of the test, but after watching the animation she become less nervous. She was feeling nervous, because it’s not a simple or small operation. This situation is very serious and it’s a big operation that can affect her mobility and maybe forever. According to Gisella the given information in the animation is very clear and direct to the point what the main purpose of this animation is about. The animation doesn’t give her the assuring to undergo for the surgery, because she still has alot of questions regarding the surgery. Gisella says the animation is an example of how the operation is going to be, however the reality is not the same and especially per person. She gives an example like she can lose blood very easily and the doctors/surgeons have to be aware and concern about her situation during the operation. She thinks in general the animation does give a very clear story of the operation in step by step. The animation really gives her an idea about how the procedure is going to be, because such operation is very complicated. However, the doctor can explain it by verbal communication, but it’s still hard to picture how it’s really done. Furthermore, she thinks the 3D graphic animation does give an interesting feeling and a perspective view how the operation is going to be held. According to Gisella a surgery is a very complicated situation, that a people cannot explain it by simple phrases. However, the animation does mimimize the complication and complexity of a surgery. From the test, Gisella was able to summarize the hip replacement surgery. She also could tell the steps that are taken for the surgery in the animation. Gisella was watching the animation very attentively that she remembers the name of the artificial hip. She thinks this animation is a very good tool in order to increase patients’ knowledge about hip replacement surgery. She says “Now I know what they are going to do with me, if this happens to me in the future”. By this she means that she has an idea or picture how the process is going to be for such surgery. As last Gisella can pin point where the incision

Feedback: The content about the risk of the operation is missing. She would like to know how the doctors/surgeons are going to put the artificial hip into the bone. That part of information is not clear enough for her to understand what is going to happened to the bone. Tester 4: Fina Christiaans 56 years old, Accountant Fina’s first impression about the animation was good clear to understand what the animation is about. The animation gives a very clear view in the hip how the procedure is going to be held. Fina feels scary/affraid when she is watching the animation, because she is affraid of the pain that she has to go through. However, she knows she will be under anestesia, but still after the effect of the anestesia it’s still painfull. She thinks the content is well provided, which she can understand and follow the instruction or steps of the procedure. The stroyline is very clear how the doctors/surgeons are going to prepare the patient before the surgery and then follow by a brief introduction what the animation is about. The story is very structural that, there is a beginning, a middle and an end in the animation. According to Fina, the provided information does covered most of her questions that she has regarding hip replacement surgery. From the animation Fina can understand the headlines about a hip replacement surgery. She finds the 3D graphic very interesting, because it’s very accurate. The 3D model is very accurate to realism, however the style is very clean instead of too realistic and crowded to give an unpleasant feeling.

After watching the animation, Fina could give a short summary about what she understands from the animation. She also understands the given steps about the procedure of the surgery. She remembers the name of the artificial hip, but it was difficult for her to pronounce it. The pronounciation wasn’t correct, because the animation was too fast. Furthermore, she can point out on her own body where the incision will take place for the operation. Feedback: the arms of the body is a little bit distracting, maybe put more emphasize on the hip only. The animation is going to fast, which she coulcn’t remember how to pronounce the artificial hip.

Rosalina says that she is an easy person which means she is very acceptance about the reality or the happenning of her live. Therefore, she doesn’t have so many questions about the situation, instead of just accept the situation and hope the doctors/surgeons could help her to recover. Rosalina already mentioned in the beginning that she is impressed by the graphic of the animation, but the 3D graphic gives a better view of the surgery. After watching the animation Rosalina could give a short summary about what she learned and understood from the animation. She told a very detailed story about what she has watched, especially the steps that are made in the procedure. Rosalina could mentioned the medical name of an artificial hip from the animation, but she was doubting about it. Furthermore, she also could pin point where the incision will take place in order to be operated.

Tester 5: Rosalina Pieters, 55 years old, Accountant Rosalina is the last testee for this test session of the proof of concept. She is very impressed by the animation, because of the quality of the graphics. Rosalina has seen some other medical animation before, but there isn’t any medical animation that looks so clean and relaxing. She says many medical animations looks very crowded and complicated which in this proof of concept is very simple to understand what is going on in the procedure. In general she thinks this proof of concept looks more like an instruction how hip replacement is going to be held. Rosalina finds the proof of concept very interesting, because she hasn’t been through such surgery like this before. She does feel worried in the beginning, but later on she was more interested into the information. During the animation Rosalina was giving an behavior that she is very interested into the hip replacement srugery. She was noding and saying that “oh this going to be like that”. All these are signs/behavior that the testee is attentive to the animation. Rosalina thinks the storyline is good enough for people to understand how a complex hip replacement surgery is held by explaining it in just several steps. Furthermore, she thinks the provided information does fullfill all her needs regarding the surgery.

Feedback: Rosalina thinks the only missing information in the animation is the duration of the operation. She says hip replacement surgery is not like a small surgery, thus it must be on going for hours. By knowing this information is just an add up just to know, not that this information is very important that must be provided in the animation in order to understand the procedure.