4D Arcade MAchine by Jung OuYang

4D ARCADE MACHINE 4 senses interactive device Final Review

[Table of Contents] 1. Introduction • Executive Summary

• Inspiration

• Problem Statement

• Project Goal

• Thesis Statement

• Social networking

2. Research Phase • • • •

Social Networking Current Social Context 3 Design Directions 5 Senses Communication Device:

12 13 14 15

user scenario / storyboard / sketches / mock-ups / UI design • Online Shopping Device: Interview/ survey / user scenario / storyboard / sketches / mock-ups

• 4D Arcade Game Machine: Interview/ survey / user scenario sketches / mock-ups • Technologies • Design Direction Summery

31 42 56

3. Design Ideation Phase • Production Requirement

• Design Criteria

• Marketing Analysis

• Technologies and Function Summary

• Ideation

Ideation Sketch (Main console)

Ideation Mock-up (Main console)

Ideation Sketch (Helmet)

Ideation Mock-up (Helmet)

Ideation Sketch (Glove)

Ideation Mock-up (Glove)

Ideation Sketch (Vest)

Ideation Mock-up (Vest)

• Conclusion

4. Design Refinement • Final Design Sketch (Main console)

101

• Final Design Mock-up (Main console)

102

• Final Design Sketch (Helmet)

103

• Final Design Mock-up (Helmet)

104

• Final Design Sketch (Glove)

105

• Final Design Mock-up (Glove)

106

• Final Design Sketch (Vest)

107

• Final Design Mock-up (Vest)

108

• Quick 3D Model Rendering

109

• Storyboard

117

5. Design Implementation (Final Design) • Main Console Refinement

119

• UI design

123

Task Analysis

123

Storyboard

131

Wire Frame

135

• Final 3D Rendering

140

• Product Environment

150

6. Design Implementation (Manufacturing) • Materials & Process

157

• Orthographic Views

160

• Exploded Views and Part list

164

• Bibliography

172

7. Portfolio • Resume

175

• Portfolio

176

4D ARCADE MACHINE 4 senses interactive device

1. Introduction

Final report

[Executive Summary ]

4D ARCADE BOXING GAME is an all-new design of arcade game device that provides gammers and consumers a new experience of physical sensational feedback and visual reality impressions. By using four key technologies ( Fvision 3D display system, Motion detection system, Odor generating device and woofer vibration logic ), it can simulate the physical punch feedback without any harm from our head to the upper part of the body during gaming interaction with other online players. It not only provides the reality of a boxing experience but also it recreates the faculty of our four senses (sight, hear, scent and touch). This can improve a physical and mental excitement by simulating the reality in the entertainment world. Moreover, this device can also lead the future trends of the gaming experiences by using the 3D hologram technology.

Final report

[Inspiration]

Social networking - Virtual social networking

5 senses - The arcade machine and the gaming devices should fit for human body and its movements.

Aesthetics - It should be colorful

and easy to get attention and create the sense of futuristic.

Technology - It will have many

new tech inside and need to collaborate together.

Final report

[Problem Statement]

Home entertainment system and virtual social networking makes people interact face to face less often. Therefore, to increase the senses of nearness and contact in virtual interactive devices will enhance relationships and it is the future trend. This is a new form of social networking and life style changed by virtual reality.

Final report

[Project Goal]

Recreates the entertainment environments beyond whatâ&#x20AC;&#x2122;s on a computer screen to a new gaming experience. To bridge the gap between the virtual gaming environment and physical interaction by using sensational simulation. Use entertainment way to communicate with people expressing mental and physical feelings and interacting between virtual and real life. Use 4 senses technologies into this system to enhance the sensational simulation in the entertainment world

Final report

[Thesis Statement]

I want to create a device that will restore the balance between virtual and actual experiences. It will use the four senses in the context of an arcade game machine that is designed to enhance relationships in real life.

Final report

[Design Direction]

4D arcade machine The product is designed to give a person the experience of simulating the 4 different senses while playing arcade and connecting with the players worldwide. The product will have gaming devices such as interactive touch sense vest, gloves and helmet that can provide more senses to interactive with other players.

Final report

2. Research Phase

Final report

[Social Networking]

In the last ten years, there has been a huge change in social interaction among people. Because of the internet and technology, people use different ways to interact with each other, and distance is no longer a problem for communication. People who use to use online social networking as a second life and spent more and more time on it, there are some social phenomena such as social isolation and alienation issues. How to get people go out and socialize with others become a major problem in the future.

Final report

[Current Social Context]

50% of Americans Online Ages 18-44 Play Social Games Daily The results were based on a May 2011 study of 2,004 U.S. adults ages 18-44, evenly distributed across gender, conducted by Ipsos OTX MediaCT for Saatchi & Saatchi.

25% Americans spent their time on Virtual networking & 6% on Physical social networking per day

Hikikomomori Hikikomori is a Japanese term to refer to the phenomenon of reclusive adolescents or young adults who have chosen to withdraw from social life, often seeking extreme degrees of isolation and confinement because of various personal and social factors in their lives. Their major activity at home is playing online games and video games.

Virtual Social networking 6 hr per day

25% 6% Physical social networking 43 mins per day

Final report

[3 Directions] -Based on the research of the social phenomenon and statistics

5 senses communication device Online Shopping Device 4D Arcade Game Machine

Final report

[5 Senses Communication Device]

User scenario Storyboard Sketches Mock-ups UI design

Final report

[User Scenario] Current Situation & Problems

Andrew 23 Lives in San Francisco Occupation: International student Interests: Play video games, surfing internet, movies, online games

Andrew is an international student who came from Taiwan to start his Master of Business Administration degree. He has only been here for three months and luckily, he passed the TOEFL test but he is afraid to speak English with his classmates and his Instructor. He also canâ&#x20AC;&#x2122;t get used to the meals here and he always finds himself in Chinatown looking for Asian food. However, the taste is totally different from what he expected, and isn't like what he had back home. He misses his motherâ&#x20AC;&#x2122;s homemade cuisine from Taiwan. He tried to cook by himself and asked his mom for recipes by using Skype or long distance telephone calls. The food he made often fails because of the not understanding the correct instructions from phone calls with his mother. Additionally, the calls are also cost him alot of money. His best friends and girl friend lives in Taiwan, so he always use Skype or MSN to contact with his friends and uses webcam to chat with his girl friend and family. Sometimes, he really wants a hug or physical touch from them because of the loneliness. He does have friends in school but nothing yet can free him from his anxiety in this new community. Possible Future Scenario Andrew began using the 5 senses communication device frequently to contact his girl friend and his mother. He can use the 3D hologram system in this device to project himself into his home in Taiwan. Sensors can detect and scan the whole body, which can transfer the data to create the 3D images to the other side of the user. He can see the detailed process of his mom cooking his favorite cuisine and uses the E-nose to smell and print the taste test paper to compare the difference between what he cooked and what his mom cooked. There is also a camera device which can capture pictures. He often uses it to take pictures of his mother's recipe and ingredients. He also took pictures of his girlfriend. He can feel the touch sense by using the tickle touch sense airborne jet system inside the device while he is chatting with his girl friend to simulate reality. He can also connect with his teacher in Taiwan that he knows very well for oral practices in English. This gives him a lot of support because he has been practicing English frequently through this device. Now, he is using the device to communicate with his current professors from his school and classmates.

Final report

[Storyboard]

Final report

[Sketches]

Final report

[Mock-ups]

Final report

Communicate in real time Feel the senses of five

Final report

[UI Design]

Facial Recognition

Username Log in

Facial Recognition

Username Log in

3D Chat

Contacts

Message

3D Chat

Contacts

Message

Internet

5 Senses

Profile

Internet

5 Senses

Profile

Setting

Help

Setting

Help

Screen + 3D

3D Projection

Favorites

3D Projection

Screen + 3D

Favorites username:

username:

Brian Ou Yang

Enter

caps

123

caps

123

caps

123

Facial Recongnition

BACK

Contacts

space

Ashley Harrison

Amy Liu

Apple Cheng

Alex Chen

space

Facial Recongnition

BACK

space

Facial Recongnition

BACK

Return

Bryant Kobe

Add 3D Projection

3D Projection

Screen + 3D

Back

Add

Screen + 3D

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Touch

Alex Chen

Mute End

Use Avatar

Return

3D Live Chat

Use Avatar

Screen + 3D

3D Projection

Return

Full Size

Screen + 3D

3D Projection

Half Size

Taste Smell Scanning... Contacts

Taste

Hold Mute End

Smell Complete Scan Contacts

Alex Chen

Hold Mute

Call Half Size

End

3D Projection

Screen + 3D

Call

3D Projection

Smell Sending Image... Contacts

scan

Put item in front of scan sensor bar for scan

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Touch

End

Touch

Live

Saved

San Fancisco 06:05 pm 11/OCT/2016

Scan Taste Smell Contacts

Hold Mute End

Taste

Saved

San Fancisco 06:05 pm 11/OCT/2016

Scan Taste Smell Contacts

scan

Screen + 3D Put item in front of scan sensor bar for scan

Final report

End

scan

Return

Screen + 3D

Mute

Put item in front of scan sensor bar for scan

scan

3D Projection

Taste

Hold

Put item in front of scan sensor bar for scan

Touch

Full Size

Scan

Screen + 3D

Live

Alex Chen

Touch Live Saved

San Fancisco 06:05 pm 11/OCT/2016

Return

San Fancisco 06:05 pm 11/OCT/2016

Alex Chen

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Touch

Scan

scan

3D Projection

Screen + 3D

Live Saved

San Fancisco 06:05 pm 11/OCT/2016

Scan

Hold

Alex Chen

Back

3D Projection

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Live Saved

San Fancisco 06:05 pm 11/OCT/2016

3D Live Chat

Screen + 3D

password:

Enter

Return

Recents

username:

password:

Recents

Contacts

Put item in front of scan sensor bar for scan

Hold Mute End

Smell Contacts

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Touch Touch

Touch

Taste Taste

Taste San Fancisco 06:05 pm 11/OCT/2016

Hold

Please stand infront of the touch pad

Smell Contacts

San Fancisco 06:05 pm 11/OCT/2016

Hold

Mute

End

Smell Smell Contacts Contacts

Connecting ... Use Avatar

End

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Touch

Live San Fancisco 06:05 pm 11/OCT/2016

Hold Mute End

Scan Taste Smell Contacts

San Fancisco 06:05 pm 11/OCT/2016

Hold Mute End

Touch

Live

Saved

Outgoing Calls New York 03:05 pm 11/OCT/2016 00:03 secs

Live

Saved Scan Taste Smell Contacts

San Fancisco 06:05 pm 11/OCT/2016

Hold Mute End

Taste

Saved

San Fancisco 06:05 pm 11/OCT/2016

Scan Taste Smell Contacts

Smell Contacts

Hold

Alex Chen

Mute End

Alex Chen

Outgoing Calls

00:35:43

03:40 pm

scan

Contacts

Put item in front of scan sensor bar for scan

Back

3D Chat

Contacts

Message

3D Chat

Contacts

Message

Internet

5 Senses

Profile

Internet

5 Senses

Profile

Setting

Help

Setting

Help

Screen + 3D

3D Projection

Contacts

Back

Screen + 3D Hold for 2 seconds to turn off

Final report

[Online Shopping Device]

Interview User scenario Storyboard Sketches Mock-ups

Final report

[Interview] Bestbuy Sales

Comcast analyst

1.He said this device will reduce the chance of return products.

1. He didn’t shop online that often, because he needs to see the real products and needs to compare with others.

2.This device will also help them save time for doing return process. 3.He said the size of the device should be like smell printer. 4.The 3D images will help customers to see more details of the products and enhance the experience of shopping online. 5.He suggests that will have an interface with this device. 6.He thinks electronic products will be the potential area for this device to will presenting online with 3D hologram. 7.People always return products because of the wrong size and bad quality.

2. After interview he thinks it will be interesting for him to try online shopping more. 3. He thinks the 3D images will perceives more info and help him to compare with similar products. 4. The device if have sense of touch will enhance the desire of shopping. 5. He didn’t want to have sense of taste function in this device, because of chemical issue. 6. The price matters. He want less than $100. 7. The size of his expectation will be as small as possible, like a mouse size.

Conclusion PROS: • This device may reduce the chance of customers returning the products. • This device may help store sales to save time for the returning/exchanging process. • This device may enlarge the popularity of online shopping yet decrease store sales. • This device increase electronic product sales when presenting online with 3D hologram. • The 3D images will perceive more information and help online shoppers to compare with similar products. • The sense of touch function from this device may interest online shoppers. CONS: • The sense of taste function may have health concerns (due to chemical issues) from online shoppers. • The price of this device is significant for customers. The value of this device may be under $200. • The size of this device may be considered between mini-printers to a computer mouse.

[User Scenario]

Wayne 21 Lives in New York Occupation: International student Interests: Internet surfing, reading magazines, photography

Current Situation & Problems Wayne is an international student who came from Japan to start his degree in photography. He is very interested in photography and wants to purchase a new camera. However, he does not know much about camera and asked his professor for a recommendation. Afterwards, he went to buy the camera in a camera shop and bought the cameras the professor recommended. However, he realized the difficulty of how to use a professional DSL camera; he came to realize the camera he bought wasn’t suitable for him. He regretted his purchase, returned it and bought another in the same store. He realized that the cost of the camera would be less expensive online and regrets buying it in the store so fast. He wants to buy a new camera online but he does not know if online shopping is secure and if the camera is how it appears in the pictures. Additionally, he is concerned if the online description represents the product exactly. Possible Future Scenario Wayne began using the Online Shopping Device, which has a 3D hologram system that projects the objects through the online shopping website. The online shopping device has easy instructions for purchasing things online at home and can guarantee the value of the object as seen on the device. He used the device to buy his new camera and found it to be very convenient. While shopping online, he plugs the shopping device in to his computer and it will transfer the data on the online shopping website to the shopping device. Then it will show on his computer screen “3D view” and when he clicks it, his shopping device will scan the object and project a 3D hologram on the device. He can then physically see the image of the camera, the size, color and details projecting clearly. He can even rotate and open the lens from the camera to check the details such as opening the place where you put the memory card and make sure if the memory card size is the one he wants. Also checking the camera’s battery charger is included. He then feels very comfortable about the item he is going to purchase online and hit the purchase button. It quickly transfers back to the online shopping website and finishes the procedures for purchasing the camera. The price of the camera is cheaper than buying it in store and even free of charge for delivery. He feels confident and that the Online Shopping Device is reliable and decides to rely on this device when he purchases things online.

Final report

[Storyboard]

Final report

[Sketches]

Final report

[Mock-ups]

Final report

[4D Arcade Game Machine]

Interview User scenario Storyboard Sketches Mock-ups

Final report

[Interview] 1.

Buckshot Restaurant, Bar and Game Room Location: 3848 Geary Blvd San Francisco, CA 94118 Number: 415-831-8838 Hours: Mon – Sun 12PM – 2AM Games in the bar: Darts, Shuffleboard, Skee Ball, Pool Table, Arcade machine games Date of interview: July 23, 2011Saturday Customer (User) Profile: User 1: Ivan 24 years old User 2: Paisley 22 years old User 3: Dan 22 years old Customer (User) Interview: a) Do you often go to a bar/game room like this? User 1. Yes, I often hang out with my friends during weekend nights to relax User 2. Yes, I love hanging out in this chilled bar User 3. Yea, sort of, I come once in a while b) Why do you like to hang out in a bar like with a game room? User 1. Because I feel the games in a bar could be easy to socialize with friends, we have something to do. User 2. Because we just won a softball game this morning and came to celebrate User 3. I came with my friends, they know the chicken fried bacon is good and I like playing the shuffleboard here. c)

Which of these games do you like best? User 1. I like to play the pool tables and maybe darts! User 2. Well, my favorite game here is probably the shooting arcade games, but the darts are fun! User 3. I love the shuffleboards, I think this is the only place they have in town!

If there are games that can project 3D hologram images without wearing 3D glasses, would you be interested? User 1. 3D sounds interesting but I think it could be expensive to play those games right? User 2. I personally like the traditional hard board games, but I could give it a try! User 3. Sure, sounds interesting, but I wouldn’t want to play long on a 3D game which may hurt my eye sight.

Final report

What comments or suggestions do you have if there is a 4D arcade device in a bar/lounge that plays on a dartboard and you can hit points when you throw your darts on the 4D images appearing before the dart board? User 1. Interesting! But I think the maintenance of the gear would be significant. I don’t to pay on something that could easily damage the device. User 2. Sounds fun to play but maybe not in a crowded place like this. It could be very crowded towards the late evening and people would get drunk and probably break this device by accident. It would be probably be better at an arcade place I think. User 3. I’m wondering how much is it per game? I don’t want to pay much for a game.

What comments or suggestions do you have if there is a 4D arcade device in a bar/lounge that plays on a shooting game that projects a 4D image appearing in front of you? User 1. Sure, but I like to play games that involve with more than two or three players. I come to a bar to chill with my friends, so if this sort of game device is located in a bar, I don’t think I’ll take a lot of time one it. I would rather play darts game with my friends. User 2. Sounds awesome, I would love to! Sounds very intense and I sure would give it a try! Great idea! User 3. Sounds interesting, but this might be better in an arcade since it sounds more expensive and I think people may break it if they are drunk.

What comments or suggestions do you have if there is a 4D arcade device in a bar/lounge that plays like a live boxer? By wearing the gloves and the vest provided from the game devices, you can physically feel the contact with the opponent and win for points when hitting at the level of the punch. User 1. Wow! This sounds awesome! I love playing boxing actually. But I was wondering if this game is played long, and many people wear the vest and glove, wouldn’t it get dirty or lose the connection? Again, the maintenance of the gears is important. User 2. I’ve tried those boxing games before in the arcade, it was alright. But I hope it won’t physically hurt me. User 3. Sounds fun and really tech! But I wouldn’t recommend it in the bar and lounge. It may cause a fight of some sort when they are drunk or something.

Final report

Players Arcade & Sports Grill Location: Pier 39 San Francisco, CA 94133 Number: 415-981-6300 Website: www.playerssf.com Hours: Mon – Sun 10AM – 11pM Games in the arcade/restaurant : Dance machines, Skee Ball, Basketball games, Jumping rope machines, motorbike games, racing games, football machines, Arcade machine games Date of interview: July 24, 2011 Sunday Customer (User) Profile: User 1: Chris 25 years old User 2: Brad 20 years old (college student) User 3: Tianna 19 years old (college student) Customer (User) Interview: a) Do you often go to an arcade like this? User 1. Not a lot, there’s only a few in town. User 2. No, I just came for the restaurant, maybe two or three times a month User 3. Yea, once in a while, I live around here b)

Do you like to hang out in a restaurant with an arcade like this? User 1. Sure, it’s entertaining with food and sports to watch. User 2. Yea, it could be noisy but I like it, the games are alright too User 3. I came with my friends today, just thought to chill around

Which of these games do you like best? Why? User 1. I like to play the racing games, I think the games here are fun because I get to win the tickets and it could exchange for a price (reward). User 2. Maybe the shooting games! Those basketball games or the football games are alright too. Those basketball games can be like a workout, it makes me sweat a lot. User 3. I like the racing games

If there are games that can project 3D hologram images without wearing 3D glasses, would you be interested? User 1. 3D could be fun User 2. I have played 4D shooting games before, but it was pricy, like two dollars per game User 3. Sounds interesting! But I’m afraid it could be tiring since it may sore my eyes What comments or suggestions do you have if there is a 4D arcade device in an arcade/restaurant that plays on a dartboard and you can hit points when you throw your darts on the 4D images appearing before the dart board? User 1. Sounds very interesting! But I don’t think this sort of games can win tickets or a prize for it right? User 2. I haven’t been to an arcade with darts games yet, I’ve been one at a karaoke and it was entertaining while you sing. Maybe it would be better at a restaurant/lounge area. User 3. Awesome! I played those ordinary darts board a lot near the inner Richmond, it’s entertaining and this device sounds amusing! But I think it should be at a lounge where you can grab a beer and chill with the game.

Final report

What comments or suggestions do you have if there is a 4D arcade device in an arcade/restaurant that plays on a shooting game that projects a 4D image appearing in front of you? User 1. I would give it a try! But how much would it cost? Expensive? I would pay for a dollar or a bit more but nothing more than two dollars or more for each game. User 2. Sure! I love shooting games and it would be amazing if I can see the blood pours out of the zombies head or something. It can give me satisfaction of winning the game. User 3. This reminds me of my 3D television at home; I rarely watched it because it hurt my eyes. And you said you don’t require to wear 3D glasses, I haven’t try a 4D game before so I might not know if it could hurt directly in my eye or make me sick.

What comments or suggestions do you have if there is a 4D arcade device in an arcade/restaurant that plays like a live boxer? By wearing the gloves and the vest provided from the game devices, you can physically feel the contact with the opponent and win for points when hitting at the level of the punch. User 1. Sounds fun! Great idea! It reminds me of the wii game I have at home except that I don’t physically feel the sense of being punched. It would be attracting because its new and I never heard of it yet before. I would give it a try! User 2. I think it’s awesome if it’s at an arcade. But I think the maintenance of the gloves and the vest should be well protected. If it’s tear apart or looks very unclean, I wouldn’t want to put my hands in them. User 3. I never played those games before but I hope it won’t physically hurt my body.

Final report

Conclusion PROS Users are attracted by 3D/4D effects in gaming because they think it is entertaining in movies, 3D/4D games could be more exciting and it is rare. Users likes the live boxer idea Users like games that involves more than two players Users hope to see the arcade industry expand Users like to have games in bar/restaurant environment Users like to win tickets on games to exchange rewards 4D Shooting games/Dart games can provide satisfaction to users CONS Userâ&#x20AC;&#x2122;s priority concern is the price for each game in this 3D/4D game devices Users are aware of the health concerns such as affecting eye sights or fear for physical harm when playing Live boxing The maintenance of the gear and cleanliness (ex: Boxing vest and gloves) is significant Live boxing is preferred in arcade in case of damage in bar/lounge

Final report

[User Scenario] Current Situation & Problems

Jonathon 26 Lives in San Francisco Occupation: Advertisements FreeLancer Interests: Softball, photography, gaming

Jonathon works as a freelancer focusing on advertisements and script story lines. He usually works at home during the day time and on weekends; he used to go play softball with his team from college. He still remains in good relationships with his college friends. However, he always hopes to make more friends. During weekends, after playing softball, they would hang out in the lounge bar/game room. He and his team would buy some drinks and play in the game room, which has several arcade games such as basketball shooting, pool, darts, shuffle board, and arcade machines. Those machines involve one to two players and he would ask his team friends to join him. But as time passed, his friends got bored of those games and join other groups to chat and drink instead. Jonathon wants to make new friends but he does not know how and every time he does, he only asks the new friend to play arcade games with him. He does not know how to socialize and hopes some kind of new environment or entertainment could help him make new friends. Possible Future Scenario Jonathon started playing the 4D Arcade Game Machine that has 3D and 4D holographic images. These games involve more than two players and usually add up to eight players to play against each other in darts or boxing and other games. The games are interesting because there are 3D and 4D holographic images appearing in front of the dartâ&#x20AC;&#x2122;s board, and if you shoot those images, there are extra points for the team. The boxing game involves up to four players and each team has two players. By wearing the gloves and the vest provided from the game devices, you can physically feel the contact with the opponent and win for points when hitting at the level of the punch. Jonathon noticed by playing this five-sense game machine, he has contact with his friends and even people he does not know from the bar/lounge. Strangers started to scream and cheer for him and his team mate and wanted to join in the game. Using the game device in the beginning frightened him because of his fear to interact with others and he was not used to socializing with people he does not know. However, he finds that he overcame his fear quickly and had a common ground to talk about while playing those games. The game device provided him with the motivation to use his body language and facial expressions to show his feelings without feeling embarrassed. Because of this game device, he had begun to share a common interest with others and make teams to play the game. He then decided to develop the game device into soft ball and recommended to his boss at the advertisement company. Where then the advertisement company started to help him develop this direction and introduced him to the gaming company and hired him as a gaming designer. Final report

[Storyboard]

Final report

[Sketches]

Final report

[Mock-ups]

Final report

[Technologies]

Sense of Sight Sense of Hear Sense of Touch Sense of Smell Sense of Taste

Final report

[Sense of Sight] Based on the research of user needs, the device is trying to show the detail of products. The 3D holographic technology will be recommended to offer better experiences for user in this device. On the other hand, this device must have motion detection system to track and create 3D images of the products.

3D Hologram/Images 1. Musion Eyeliner 3D Holographic Projection

Musion Eyeliner 3D Holographic Projection

Musion Eyeliner is a sensory technology that transforms visual capital into reality of human, animated characters and objects. It is set up from a 2m3 cube including a camera shoot, projector playback, and 3D glasses. Eyeliner holograms can project up to 20m x 100m high definition holographic projection system. It also integrates visual ecosystem that fully presents the HD media. Musion Eyeliner creates the 3D illusion that sets up from a 4 legged ground support that can be stretched into framework and flown. It can be used on an entire working stage or behind the foil where performers can be able to interact with the virtual images/objects where it can let the audience believe the images/objects are physically on stage being interacted with the performers. Not only for objects/images but also live “virtual partner/character” can be projected from this eyeliner system.

Cisco Telepresence On Stage Holographic Video Conferencing

The pros: Provide high definition quality images by hi-def projector.Full size hologram on stage.

Activ8 3D Holographic Projection

USC ICT 3D display Teleconferencing system

FVisiOn NICT, Universal Communication Research Institute

Claytronics, Carnegie Mellon University

DVE teleconference system

3D hologram

The cons: Requires a lot of space. It needs a large mirror downward in front of the stage. It cannot provide real time virtual communication. The transmission is simply 2D high definition video projected onto the stage using a Pepper’s Ghost effect [1] only viewable from particular perspective view.

Motion detection system

1. 2.

Microsoft kinect for Xbox360 Nintendo Wii

Final report

Cisco Telepresence On Stage Holographic Video Conferencing

The Cisco TelePresence On-Stage Experience is the collaboration between Cisco and Musion Systems, which took place during the opening of Cisco’s Globalization Centre East in Bangalore, India in 2007. Cisco’s TelePresence’s system collaborates with Musion 3D holographic display technology to create the world’s first real time virtual presentation. The pros: Provide Hi-def. images and real time virtual interaction. Full size hologram on stage. The cons: Requires a lot of space. It needs hi speed internet to transmit the data. The transmission is simply 2D high definition video projected onto the stage using a Pepper’s Ghost effect [1] only viewable from particular perspective view.

USC ICT (Institute for Creative Technologies) 3D Display Teleconferencing System

The ICT 3D teleconferencing system, made by folks from USC Institute for Creative Technologies, consists of a 3D scanning system to scan the remote participant (RP), 3D display to display the RP, and 2D video link to allow the RP to see their audience(RobAid 2009). The 3D display works by projecting high-speed video onto a rapid spinning mirror made from brushed aluminum. As the mirror turns, it reflects a different and accurate image to each potential viewer. The size, geometry, and material of the spinning surface have been optimized for the display of a life-sized human face(ICT 2010). The pros: Provides real 3D images and interact in real time. It reflects a different perspective and an accurate life-size facial image to each viewer. The cons: Only can provide life-size facial image.

Final report

Activ8 3D Holographic Projection

It does one part of Activ8 3D hologram system service that uses high definition projector to project images on polymer films to provide large scale 3D holographic projection systems at events, shows, product launches, and conferences. It can create life-size 3D holograms on stage that offers entertainments and interactions with the audience. They also have small scale 3D hologram projection system such as 3D holopyra360 (Pic01), 3Dholopod (Pic02). The pros: Full size hologram on stage. They provide motion capture for 3D images that can let user interactive in real time. The cons: The transmission is simply 2D high definition video projected onto the stage using a Pepper’s Ghost effect [1] only viewable from particular perspective view.

5. Claytronics, Carnegie Mellon University “Claytronics transforms them from a flat surface to a three dimensional object that you can touch and hold in your hand. That same application can create a duplicate of your form in another location,” said senior staff researcher Jason Campbell. It’s an ongoing research project at Carnegie Mellon University in collaboration with Intel and the US Air Force Research Lab. The project combines modular robotics, systems nanotechnology and computer science to create the dynamic, 3-Dimensional display of electronic information known as Claytronics. Claytronics atoms, or catoms, can actually make three-dimensional faxes possible. Want to show a coworker across the country a prototype of a new product you’re developing? Push your gizmo into a bucket of claytronics, and the miniscule robots will mimic the form and transmit it to a corresponding claytronics receptacle, thousands of miles away. The copy will look, feel, sound, and work just like the original gizmo. The pros: Can use catoms to mimic the form of the products and you can also physical interact with it. Create more realistic model of the products in front of you. The cons: It’s an ongoing research project and it does not create nanosacle modular robots yet.

Final report

FVisiOn NICT, Universal Communication Research Institute

fVisiOn is a novel glasses-free tabletop 3D display. The developed novel technique canfloat standing 3D image on a blankflat tabletop surface, and allow multiple viewers to observe the 3D from omnidirection of 360° in seated condition. It is designed to be a friendly interface for multiple users for varied tabletop tasks by featuring our glasses-free method and observation style. For generation of the 3D images, fVisiOn employs a newly developed special optical device as a screen and a series of micro projectors arranged circularly. The combination of those devices reproduces a light field in a certain volume on the table. The light field represents a bunch of directional rays radiated from surfaces of objects which are assumed to be on the table. The light field of our method is optimized for observing in seated condition. In other words, the fVisiOn’s viewing area occupies an oblique position above the table. Additionally, our entire 3D imaging mechanism is installed underneath the table. It keeps the tabletop area clear and does not disturb collaborative work and natural communications. For example, fVisiOn can display virtual 3D images beside printed documents and physical mock-ups. The pros: Can provide 360 degree for multiple viewers .The system is installed underneath the table. The cons: The 3D images only can be viewed below eye level. The device now only can provide 100X100 pixel resolution images and needs 100 mini projectors to create the 360° 3D images.

Final report

7. DVE teleconference System DVE Eye Contact Silhouette: The DVE Eye Contact Silhouette is an ideal product solution to improve desktop telepresence with true eye contact. The patented optically embedded camera resolves the eye contact parallax problem so that participants are engaged in the conversation with true eye contact. The DVE Eye Contact Silhouette is designed as a flexible platform to meet the specific needs of the client’s applications. For example, the Silhouette is commonly used with new powerful PC software videoconferencing codecs with embedded high-end web cameras. This makes for a very affordable desktop telepresence system that is far superior to web chat PC conferencing. The Silhouette can also be connected to appliance codecs that range from the low-end to the very high-end. DVE also, on a OEM basis, integrates an entire codec solution into the Silhouette for a turnkey desktop system. The Silhouette is ideal for executives desktops, and also unique applications such as; Bank sales terminals, Telemedicine endpoints, and a whole host of telepresence applications.

DVE Immersion room Tele-immersion is the new frontier of conferencing. The DVE Immersion Room™ eliminates the boundaries of a screen and creates the amazing appearance that imaged individuals are actually walking around in the physical space of the room. In essence, the DVE Immersion Room™ is a highly sophisticated, augmented reality environment, where live video images are superimposed in the physical space of the room. The patented technology is backed up with over a decade of R&D by DVE, a company with years of experience creating many of the world’s most sophisticated videoconferencing facilities. The pros: Full size hologram for long distance teleconference. Create direct eye- contact during communication The cons: The transmission is simply 2D high definition video projected onto the transparent glass using a Pepper’s Ghost effect [1] only viewable from particular perspective view.

Final report

Motion Detection System 1.

Microsoft kinect for Xbox360

Kinect use a sophisticated depth-sensing camera (actually a single color camera for image recognition, and two monochrome cameras placed a few inches apart to determine where you are in a three-dimensional space), Kinect can track your movements without a physical controller. All of the heavy lifting is handled by the Kinect sensor and the console, and you can navigate menus and play games without laying a finger on a piece of plastic. A microphone array adds voice recognition to the mix, letting users control the system using voice commands or hand-waves. Because the system is camera-only, it needs a lot of space; Microsoft recommends 6 to 8 feet between the Kinect sensor and the user. The pros: Totally hands-free. One Kinect accommodates multiple players. Voice control is very cool and works well. The cons: Requires a lot of space. Slightly more lag whan than Playstation Move.

Final report

Nintendo Wii

All the motion-control magic for will is in the remote. An accelerometer tracks movement, while an IR sensor monitors the positioning of lights emitted by the sensor bar. Its motionsensing abilities weren’t so great at first; initially, your movements with the Wiimote were reflected only approximately in games with gestures and broad motions. The addition of Wii MotionPlus, an accessory that gives the Wiimote a gyroscope sensor to complement the accelerometer, improves the motion detection greatly. Nintendo recently began to sell the Wii Remote Plus, a Wiimote with built-in MotionPlus sensors, removing the need for a separate accessory. The Wii’s biggest weakness (wiikness?) is its graphics; unlike the PlayStation 3 and Xbox 360, the Wii doesn’t display highdefinition content. The pros: Inexpensive. The cons: The least accurate motion sensing of the three systems. Not high-def.

[Sense of Hear] Audio Systems 1.

Dolby Digital

DTS

Dolby Digital is an audio compression technology that elbaroates the audio sounds with up to six discrete channels where mono and stereo is as well supported. Dolby Digital 5.1 channel surround format was first created for both the theaters and home audio marketplace and can extend to 7.1 channel surround sound now.

DTS is a series of multichannel audio technologies owned by DTS, Inc. The basic and most common version of the format is a 5.1-channel system, similar to a Dolby Digital setup, which encodes the audio as five primary (full-range) channels plus a special LFE (low-frequency effect) channel for the subwoofer and also can extend to 7 primaries channels too.

The pros: Good to Very Good sound for movies. Digital 5.1 channel surrounding sound can simulate real environment.

The pros: Great sound for movies and music. Digital 5.1 channel surrounding sound can simulate real environment.

The cons: No Audio CD's. Dynamics are sometimes lacking due from too much compression. Need more speakers to provide Digital 5.1or 7.1channel sound.

The cons: Limited DVD Software. Rear channels are sometimes a tad too loud and must be attenuated on some discs. Need more speakers to provide Digital 5.1 or 7.1channel sound.

Final report

[Sense of Sight] Touch sensory device The sense of touch will be needed in this device and can provide physical touch sensation during 3D hologram images interaction. The current technology may not be in the user’s expectation for the content of physical touch sensation requirement such as hug or shake hands but might be able to provide the difference sense of texture and materials. It also needs tracking sensor system to detect full size human body scale that can let the touch sensory device measure and provide the accurate sense of touch experience for users. Touch sensory device 1. Touchable Holography 2. Airborne Ultrasound Tactile Display 3. GhostGloves 4. iFeel_IM! 5. Claytronics Motion detection system 1. Microsoft kinect for Xbox360 2. Nintendo Wii

Final report

Touchable Holography

Touchable hologram is the holographic images that can be physically touched by the tactile sensation, including a stimulator in the work space dilutes the appearance of holographic images. Touchable hologram can provide the tickle sensation without wearing any gloves or any other attachments on the user’s hands. It adds the tactile feedback to the hovering image in the 3D work free space. It uses the “Airborne Ultrasound Tactile Display” to provide the tickled sensation. It uses the tracking system to track the location of the user’s hand which can make user feel the object or image from the 3D hologram. It can immediately be responded and interacted with the object or image. There is hand-tracking system, which is like the Wii remote (Nintendo) that the retro reflective marker would reflect from sensor to the user’s fingers and from the floating virtual image, user can handle hand-tracking system by their fingers. The pros: User can interact with the 3D Hologram by tactile sensation without wearing gloves. There is a hand tracking system that can detecting and tracking the movement of hands. The cons: The touch sensory only can provide tactile sensation from one direction. It only can provide sense of touch in particular work space.

Airborne Ultrasound Tactile Display

Airborne Ultrasound Tactile Display is a tactile display which provides tactile sensation onto the userâ&#x20AC;&#x2122;s hand. It utilizes the nonlinear phenomenon of ultrasound; acoustic radiation pressure. When an object interrupts the propagation of ultrasound, a pressure field is exerted on the surface of the object. Termed acoustic radiation pressure, this form of haptic feedback is actually a creation of very high frequency sound pulses. A speaker system sets up a specific acoustic wave that creates a difference in pressure density at a given location above it. Modulating the sound carefully around the speaker allows shapes to be made in the air, that exert differing amounts of pressure on anything passed through there - such as body parts. This replicates the feeling of brushing wind, or a ghostly almost-solid object. This prototype system includes a camera which tracks the position of a user's hand and shifts the output from the transducers to move the focus around with the hand. The result is a feeling of tracing the edge or surface of the virtual object.

GhostGloves

GhostGloves is a wearable haptic device that represents forces on entire hand. It has a simple haptic effecter on each finger and the palm. It recognizes the visual sensation from the haptic sensation for portraying the realism of the virtual world. Novel technology which provides the realistic of the touch sensation is one of the most significant procedure in the GhostGloves that reproduces the stress on the finger and the palm. The pros: User can interact with the 3D Hologram by haptic sensation of entire hands include fingers and the palm. It might simulate the touch sensory by shaking hands. The cons: The touch sensory can only provide tactile sensation on the hands.

The pros: User can interact with the 3D Hologram by haptic sensation without wearing gloves in the mid-air. The cons: The touch sensory only can provide tactile sensation from one direction. It only can provide sense of touch in particular work space.

Final report

iFeel_IM!

5. Claytronics, Carnegie Mellon University

ifeel_im! (short for "I feel, therefore I am!") is a hapticfeedback communication system. The brainchild of Japanese telepresence research group Tachi Lab, the ifeel_im! proposal seeks to let users express emotions over the internet. The entire system is a set of clothing worn by the user while interacting online on forums like Second Life. Different gadgets mounted all over activate, depending on the transmitted emotion. HaptiHug for instance is a harness that shrinks slightly to simulate hugs. HaptiButterfly and HaptiTickler go on the abdomen, and are designed to make the wearer fell the butterflies or feel tickled. On the opposite end of the emotional spectrum are HaptiShiver and HaptiTemper, which induce negative emotions by sending shivers up and down the user's spine. Last but not least, HaptiHeart is a tiny speaker that emits heart pump patterns to create more immersion for the other emotions.( Rico Mossesgeld, Tom's guide US 2010) The pros: User can feel the touch sensation of hug by this device and it can express simple emotions by easy orders. The cons: The touch sensory only can provide for certain part of body and it needs to wear on the use’s body.

“Claytronics transforms them from a flat surface to a three dimensional object that you can touch and hold in your hand. That same application can create a duplicate of your form in another location,” said senior staff researcher Jason Campbell. It’s an ongoing research project at Carnegie Mellon University in collaboration with Intel and the US Air Force Research Lab. The project combines modular robotics, systems nanotechnology and computer science to create the dynamic, 3-Dimensional display of electronic information known as Claytronics. Claytronics atoms, or catoms, can actually make three-dimensional faxes possible. Want to show a coworker across the country a prototype of a new product you’re developing? Push your gizmo into a bucket of claytronics, and the miniscule robots will mimic the form and transmit it to a corresponding claytronics receptacle, thousands of miles away. The copy will look, feel, sound, and work just like the original gizmo. The pros: Can use catoms to mimic the form of the products and you can also physical interact with it. Create more realistic model of the products in front of you. The cons: It’s an ongoing research project and it does not create nanosacle modular robots yet.

Final report

[Sense of Smell]

SMELLIT Technology

Electronic Nose (ENose) is a sensitive device like a human nose that can recognize almost any compound. When certain compound absorbs into the 16 different polymer films, the films expands and conducts electricity. It is like a smoking detector that could transfer smell into digital data. It could also be used for gas buildup offshore oilrigs, detect spoilage in the food industry, unexpected vapors in space habitats and analyze strange gases exploration. When incidents like fire event happens, ENose is already connected to the central computer from the fire department that be notified immediately.

SMELLIT works just like your printer, but instead of ink cartridges, it works with smell cartridges. As your DVD player reads the video and sound information from your favorite DVD disc, SMELLIT processes the same DVD, but the ”smell CARD” decodes all the smell information from 10 to 20 seconds ahead of the actual scene so the odors have time to reach the spectators. After decoding the smell information, the cartridge vaporizes a very small amount off concentrated “smell gels”, and the central fan distributes equally the smell in all directions. It can be loaded with 118 cartridges, each one with a different concentrated “smell gel”. All the cartridges can be easily changed and last 3 times more than a regular ink cartridge. (Nuno Teixeira 2010) The industrial designer Nuno Teixeira said their design team is already developing the real product.

The pros: E-nose is long used for safety and quality control in the food, wine and perfume industries. It also can be a smoking detector for house safety alarm.

The pros: This device can transform the odor sensory form digital information and create the smell immediately. The smell gel can be rechargeable and capacity is enough for long term use.

The cons: E-nose may detect inaccurately and be mixed by other smells that users expect due to its sensitivity.

The cons: The scale device may be problematic. The duration usage of smell gel may be problematic.

1. Electronic Nose

Final report

Ordor-Generating Device

The compact odor-generating device attached to the back of your TV set. Unless the scent is fading, in which case you just need to buy a new one like you would to replace the ink cartridge on your printer. Next steps in the research would include developing a prototype and demonstrating that it is reliable enough to release odors on cue and scalable to the size needed for consumer electronics like TVs and cell phones. And there are a few other considerations. For example, perfume companies could let you sample new scents through TV, but your TVâ&#x20AC;&#x2122;s odor-generating device would have to carry that particular perfume meaning the device probably needs to be upgradable like software for your home computer. And TV producers will probably want scents that are tailored to match the personalities of their characters. The pros: The X-Y matrix system can simulate more than 10,000 odors and the size can be small enough to fit on the back of your TV. The compact odor-generating device can replace the scent storage case like the ink cartridge. The cons: Itâ&#x20AC;&#x2122;s need to collaborate with computer program to simulate the scents and itâ&#x20AC;&#x2122;s need can be upgradable the new software to receive new scents.

An electrical current is sent through the lead wires to heat an aqueous solution. The heat builds pressure, causing a tiny hole in an elastomer to open, releasing the odor, which is measured by the detector.

Final report

[Sense of Taste] 1.

Electronic tongue

Electronic tongue is an instrument that measures taste with seven sensors of electronic instruments and the reference electrode that detects chemical, organic and inorganic compounds. It generates electric signals and interprets the sensor data into taste patterns. The E-tongue has a similar or better detection threshold to the human tongue for all basic tastes. The main application for E-tongue is in the pharmaceutical, food and beverage industries, but it is often for human to taste test new drugs as they are toxic while the E-tongue can test it. E-tongue can easily measure the non/low volatile molecules (responsible for taste) and dissolved organic compounds (responsible for flavors in liquids). The pros: Fast answers with a run time of couple minutes. Provides tests for toxic samples and compounds. Allows analysis of liquid samples or dissolved compounds. Does not fatigue like the human tongue (particularly for bitterness). The cons: The scale device may be problematic. The sensor of this device might be changed.

Final report

[Design Direction Summary]

During the research, the recent 5 senses communication device’s design direction had limited by current technology and the size fit is not appropriate for home use. Meanwhile, the feedback of this deign direction also shows that the detail of the sense of touch cannot be simulated and cannot create the temperature during simulation. The sense of taste will not be accepted by most of the users, because of the variety of foods, textures and forms (liquid, soft, etc.). The most important thing is that the user are concern of the chemical toxic that might cause health issues. After interview with some users and experts, there are other potential design opportunities of the 5 senses or 3D images simulation interactive design. I took the suggestion from Google Search Consumer Operations Manager, Jonas Shen, about my design direction to online shopping device. It is closer to reality and is only limited to use 3D projection technology and smell simulation technology for home use. Additionally, based on current technologies and user’s expectation, the size of the device can fit for personal home use. The second design direction will be 4D arcade machine. This design direction can designed for bigger size and can provide sight, hear, touch and smell into one device. I’m trying to use the advantage of the virtual reality simulation technology and provide more reality simulation into arcade game and create new experiences of entertainment system for public space use. It also can enhance between people’s interaction in real life while playing in the arcade. Additionally, the expectation of the arcade machine is Multicade that can be upgradeable and installable for more games into one single device to create diversity and multitasking functions to fit for different age range of users.

Final report

3. Design Ideation phase

[Product Requirement]

Physical Requirements: 1. Size: (Estimation according to KONAMI Arcade Companyâ&#x20AC;&#x2122;s game machine example) Height: 91.11â&#x20AC;? Width: 77.21" Depth: 97.52" Weight: around 800 lbs. 2. The product needs helmet, gloves and a vest for gaming needs 3. The product will need coin selector and refund slide course/coin tray for starting the machine 4. The product will be designed with air jet holes for smell printers to create sense of smell. 5. The product will have push buttons for choosing the selections of the games 6. The product will need internal speakers or stereos for the sound of the games 7. The product will need a cabinet to control the internal work machines 8.

There will be a storage for the smell gel.

9. There will be a gaming item hanger to hang vests, guns, gloves and darts 10. The device might have a screen interface for showing information like switch games or instructions 11. The external color of the device could be in white, black, red. 12.

The device should have short throw projector

to create the background environment for gaming.

Final report

Functional Requirements: 1. The product will be in 110V~220 Voltage because of current gaming usage 2. The product will need a security device such as anti-interference and circuit breaker 3. The product will have sub-woofer or woofer inside the vest to create the haptic feedback by using the low frequency sound.

11. The device will have a program to trigger the electrical currents that can be sent through the lead wires to heat a chemical aqueous compound. 12. The product should have a power to turn on and shut off control hidden inside the device for staff to use.

4. The product will have switch locks for maintenance of the gears.

13. The product should have alarm systems for warning the system is not working correctly.

5. The product must have a 3D hologram projector in the center.

14. The product may be operated by more than one person.

6. The product must have a sensor bar to detect human scale and movements.

Performance Requirements:

7. The product may have a sheet of plastic or glasses on the table top 3D display system that can project for the whole human body scale. 8. The device might have multiple games inside it and could be upgraded or uploaded for new games. 9. The device will have elastomers (Reference: http://www.jacobsschool.ucsd.edu/news/ news_releases/release.sfe?id=1082) to store the chemical aqueous compound and could be refillable 10. The product may have a video projector, should be DLP with an HD card/minimum native resolution of 1400 x 1050 and brightness of 7000+ lumens. Shop windows, trade stands or other kinds of installations in areas of high ambient light require LED wall of 6mm or 4mm pitch as the

1. The device will have special optical system (fVision) to create 3D images light field. 2. The product should be in a HD 1080p screen for good eyesight quality. Interface Requirements: 1. The product will have user instructions on how to play the different games 2. The product will have directions on wearing the vest and gloves 3. The gloves, vest, and helmet should be easily stored and used 4. Use in: a. Business: Arcade hall, restaurant, lounge, bar, mall b. Commercial/Non-commercial

video source. Final report

Motion detection system 3 vibration motor

Helmet

Main Console

Ultra short throw projector

Motion detection system

Fvision 3D display system

2 vibration motor

Odor generating system

Glove

Motion detection system

Vest

Woofer vibration system Motion detection system

Final report

[Design Criteria]

Durability - The gaming devices should be durable for long term use. Cleanness will be concerned for long term use Ergonomics - The arcade ma-

chine and the gaming devices should fit for human body and its movements.

Aesthetics - It should be colorful and easy to get attention and create the sense of futuristic. Technology - It will have many new tech inside and need to collaborate together.

Final report

[Marketing Analysis]

Price

4D arcade game machine will give you the emerging 3D display technology haptic feedback and also give you the odor scents simulation to create a virtual environment beyond the realistic feelings. In the current market, there is no arcade that can provide interactive feedbacks and all sensational collaboration with immersion background projection.

X-Rider 3D Motion Theater Ride

$96575 (4 seats)

Mini Rider 2 Motion Simulator Attraction Ride

4D Arcade game machine

$ 60000

$46000 Typhoon "Mad Wave" Motion Theater Deluxe

$23875

Motion Simulator Pump It Up 2011 Fiesta EX | CX Model Dance Arcade Machine

$8975

Super Bikes 2 - 42" Motorcycle Racing Game

$7875 iBoxer Striptease Boxing Machine Arcade Legends 3 â&#x201E;˘ Upright Multi Game

$2995 Final report

$4775

[Technology & Function Summary]

3D Display - FVisiOn 3D table top display system Motion Detection - Motion tracking system

Woofer/Vibration Feedback

- Woofers and eccentric-mass motors

Smell Printer

- Odor-generating device

Ultra Short Throw Projector - New DLP projector

Final report

3D Display FVisiOn NICT, Universal Communication Research Institute fVisiOn is a novel glasses-free tabletop 3D display. The developed novel technique can float standing 3D image on a blank flat tabletop surface, and allow multiple viewers to observe the 3D from one direction of 360Â° in seated condition. It is designed to be a friendly interface for multiple users for varied tabletop tasks by featuring our glasses-free method and observation style. For generation of the 3D images, fVisiOn employs a newly developed special optical device as a screen and a series of micro projectors arranged circularly. The combination of those devices reproduces a light field in a certain volume on the table. The light field represents a bunch of directional rays radiated from surfaces of objects which are assumed to be on the table. The light field of our method is optimized for observing in seated condition. In other words, the fVisiOnâ&#x20AC;&#x2122;s viewing area occupies an oblique position above the table. Additionally, our entire 3D imaging mechanism is installed underneath the table. It keeps the tabletop area clear and does not disturb collaborative work and natural communications. For example, fVisiOn can display virtual 3D images beside printed documents and physical mock-ups.

Final report

Motion Detection System 1. Mircrosoft Xbox Kinect Kinect use a sophisticated depth-sensing camera (actually a single color camera for image recognition, and two monochrome cameras placed a few inches apart to determine where you are in a three-dimensional space), Kinect can track your movements without a physical controller. All of the heavy lifting is handled by the Kinect sensor and the console, and you can navigate menus and play games without laying a finger on a piece of plastic. A microphone array adds voice recognition to the mix, letting users control the system using voice commands or hand-waves. Because the system is camera-only, it needs a lot of space; Microsoft recommends 6 to 8 feet between the Kinect sensor and the user.

Final report

Sony PlayStation Move

The PlayStation Move combines a video camera with a physical controller packed with motion-sensing electronics, making it the technological cross between Kinect and the Nintendo Wii. The Move Motion Controller, or “wand,” combines a gyroscope, accelerometer, and magnetic sensor (a sort of digital “compass” that uses the Earth’s magnetic field to determine the controller’s orientation) to track the controller in three dimensions, while the glowing ball at the end gives the PlayStation Eye camera a visual reference for handling aiming, cursor movement, and other motion. Like Kinect, PlayStation Move requires room to function; Sony recommends 5 to 9 feet between the player and the PlayStation Eye, but you can play anywhere from 2 to 10 feet of the camera.

Final report

Nintendo Wii

All the motion-control magic for will is in the remote. An accelerometer tracks movement, while an IR sensor monitors the positioning of lights emitted by the sensor bar. Its motion-sensing abilities weren’t so great at first; initially, your movements with the Wiimote were reflected only approximately in games with gestures and broad motions. The addition of Wii MotionPlus, an accessory that gives the Wiimote a gyroscope sensor to complement the accelerometer, improves the motion detection greatly. Nintendo recently began to sell the Wii Remote Plus, a Wiimote with built-in MotionPlus sensors, removing the need for a separate accessory. The Wii’s biggest weakness is its graphics; unlike the PlayStation 3 and Xbox 360, the Wii doesn’t display high-definition content.

Final report

Haptic Feedback 1. Woofer Woofer is the term commonly used for a loudspeaker driver designed to produce low frequency sounds, typically from around 40 hertz up to about a kilohertz or higher. When you apply low frequency sounds, it generates from the woofer and it also create the vibration, and it will provide realistic feedback to create greater sensory immersion within the gaming vest. This ideation of haptic feedback is come from the robotics engineer Saurabh Palan who created the Tactile Gaming Vest (TGV).

Final report

2. Eccentric Rotating Mass Motor The Eccentric Rotating Mass vibration motor, or ERM, is a DC motor with an offset (non-symmetric) mass attached to the shaft. As the ERM rotates, the centripetal force of the offset mass is asymmetric, resulting in a net centrifugal force, and this causes a displacement of the motor. With a high number of revolutions per minute, the motor is constantly being displaced and moved by these asymmetric forces. It is this repeated displacement that is perceived as a vibration.

Final report

Smell Printer Odor-Generating Device The compact odor-generating device attached to the back of your TV set. Unless the scent is fading, in which case you just need to buy a new one like you would to replace the ink cartridge on your printer. Next steps in the research would include developing a prototype and demonstrating that it is reliable enough to release odors on cue and scalable to the size needed for consumer electronics like TVs and cell phones. And there are a few other considerations. For example, perfume companies could let you sample new scents through TV, but your TVâ&#x20AC;&#x2122;s odor-generating device would have to carry that particular perfume meaning the device probably needs to be upgradable like software for your home computer. And TV producers will probably want scents that are tailored to match the personalities of their characters.

Final report

Ultra Short Throw Projector Itâ&#x20AC;&#x2122;s a new advancement in projection which allows a DLP projector to light up a big screen (70 inches or more), from only inches away from the screen surface.

Final report

[Ideation]

Main Console -

It will provide 3D display, DLP projector, small touch penal screen, coin slot and storage, motion

Helmet - It should be

durable, easy to attach on, cleanness and create the sense of futuristic.

Gloves - The gloves should provide the sense of impact, cleanness and it can be easy to attach on.

Vest - It will have sense of

touch feedback and circuit board inside and need to fit ergonomic and easy to attach on and take off.

Final report

[Ideation Sketch]

Main Console

Final report

Gaming device hanger

Half dome background

Cushion cover Final report

3D display design

Table-like 3D display

Final report

[Ideation Mock ups]

Dome-like design The first mock up uses the dome-like private area idea to enclose the area for gamers not being interrupted by others. The two sides of the console is the storage for the gaming devices. The back of the console is the main operation system which includes a computer and a smell printer and a motion detection system. For the smell test, I put the air refresher inside the back of the mock up to simulate the smell printer.

Final report

Main Console

Open area design The second mock up is to design an open area to let the companions accompany the gamers playing the arcade machine. The hanger in between the front and the back cabin is for putting the gaming devices. The front cabin is the main operation system which includes a computer, a smell printer and a coin operator. The motion detection system is mounting on the top of the 80â&#x20AC;? LED screen in the back. For the 3D display, it will put beside the front cabin. The front cabin is also designed to have a touch screen for user to operate this device.

Final report

Full size mock up Base on the second mock up and the feedback from the instructor, the device is to build a full size of the mock up which can let me fully understand the real userâ&#x20AC;&#x2122;s environment and the storage space. For the third mock up, at the back of the console, I will use the 80â&#x20AC;? LED screen to create the background images. And in front of the screen, it will have a 3D display system. During this time, I also went to visit the director of Game Design, Christopher Schenck . He gave me the suggestion about the gaming area that should be designed more enclosed than this design direction I have now, because it could enhance a better gaming experience without interruption. Also, he thinks that the arcade machine should be designed for only one game because the console and the gaming device are designed to fit one theme. He wants me to brand the arcade machine and the specific game together which can draw more attention from the user.

Final report

[Ideation Sketch]

Helmet

Adjustable cheek vibration pad

Final report

Half cover style

Final report

[Ideation Mock ups]

Helmet

Existing product base mock up The first mock-up is used with the base of current skateboard helmetâ&#x20AC;&#x2122;s inner cushion. Iâ&#x20AC;&#x2122;m trying to study and find out the existing helmets in different area in order to know how they provide the similar functionality. The light weight and easy to attach will be my concern. In the outcome, my consideration is the bike helmet, that can provide light weight and the strip attach way. The snowboarding helmet and motorcycle helmet both have ear cover which I can lean about how to cover the ears and also have place to put the speaker inside. After the research, I took apart the skateboard helmet and use the inner cushion to make the first mock-up of the half size style helmet.

Final report

Functional and half cover request mock up

The second mock up refine the size of the ear pad to become bigger and extend it in to a space which can attach the cheek vibration pad. In order to test the vibration function, I brought the vibrator and put inside the mock-up to do the user testing about the vibration feedback if it is strong enough to represent the punch feedback. Most of the users think the vibration feedback is enough especially for the cheek part. At the beginning of the mock-up, it only have back elastic band to hold with the head but after the user testing, the top of the head should have an elastic strip to hold the helmet with the head.

Final report

[Ideation sketch]

Glove

Strip attach

Final report

Velcro attachment

Use fewer materials and attach area with hands for cleanness

Final report

Vibration feedback position

Final report

[Ideation Mock ups]

Functional mock up To research the first mock-up of the glove, I used the existing boxing gloves or training gloves as an inspiration. For the functional test part, I also put the vibrator inside to test the feedback for the sense of punch. The user testing of the vibration part is decent too, however due to the fact that there is no computer software to operate it, I have to stand beside the user and turn on the vibrator when they simulate the swing of their hands.

Final report

Glove

Fewer material mock up The second mock-up of the glove is to focus on how to solve the cleanness problem. After the first mock-up, the functional part is ok but as for the user concern about the gloves, it will be used by a lot of people in public space. Therefore the concern of cleanness will be a significant issue by the userâ&#x20AC;&#x2122;s feedback and instructor too. This mock-up uses fewer materials and covers less area of the hand therefore it reduces the contact space between hands and gloves to maintain the cleanness. The other suggestion is for the arcade hall or the arcade game provider, who can give the user latex or disposable gloves while they are playing this arcade machine.

Final report

The third mock up The third mock up is to combine the functional part with fewer material designs. The glove only uses two PE strip to fasten on the hand and uses the Velcro to adjust different sizes of the hands. In the front of the glove, it has a wire that can use the two middle fingers to make the glove attach with the hands more closely resulting the sense of the vibration feedback. For the user testing part, the user may feel not as easy to put on the glove by themselves due to the separate strips.

Final report

[Ideation Sketch]

Vest

Based on the TN game 3rd space gaming vest design

Final report

The 3rdSpace Vest The 3rdSpace Vest developed by Redmond, Wash.–based TN Games looks like the bulletproof flak jackets worn by police officers. Rather than block bullets, however, the vest is designed to simulate the feeling of being shot. Each features eight impact points—four in the front and four in the back—that use a system of pneumatic actuators and micro compressors to deliver a blow of 30 pounds per square inch, or psi (2.1 kilograms per square centimeter) TN Games plans to offer a version of the vest that delivers blows at 45 psi (3.2 kg/cm2) for players who want a greater sensation. The vest technology will evolve beyond shooter games and will eventually be available for flight-simulation and racing games as well as role-playing and children’s games. The HTX Helmet is meant to complement the vest and make you feel the bullets fired on your head as it happens, creating the best gaming system. Based on the 3rd Space technology

Final report

The haptic feedback design is inspired by the airsoft gunâ&#x20AC;&#x2122;s piston system

Security cable on the vest Final report

The design of the haptic feedback is inspired by Tactile Gaming Vest (TGV)

Hard shell front

Final report

Tactile Gaming Vest (TGV) University of Pennsylvania engineering student Saurabh Palan worked with his professor, Katherine Kuchenbecker, to develop this haptic vest that allows you to feel the sensation of being shot when playing a first person shooter game. The idea is to develop a haptic interface for first person shooting games. The vest uses four solenoid actuators in the chest and shoulders in front, and two solenoids in the back. Vibrating motors clustered against the shoulder blades simulate a reaction similar to getting stabbed. All the components are controlled and linked to the game such that the appropriate solenoid â&#x20AC;&#x153;firesâ&#x20AC;? depending on where the character in the video game is getting hit.

Final report

Electric Solenoid Actuators A typical electric solenoid actuator is consists of a coil, armature, spring, and stem. Electric Solenoid Actuator The coil is connected to an external current supply. The spring rests on the armature to force it downward. The armature moves vertically inside the coil and transmits its motion through the stem to the valve. When current flows through the coil, a magnetic field forms around the coil. The magnetic field attracts the armature toward the center of the coil. As the armature moves upward, the spring collapses and the valve opens. When the circuit is opened and current stops flowing to the coil, the magnetic field collapses. This allows the spring to expand and shut the valve.

Solenoid Feedback System

Based on the research, I create this solenoid haptic system in order to put inside the vest that can provide better simulation of punch feedback.

Final report

Battery

Adjustable shoulder strip

Final report

[Ideation Mock ups]

Vest

Air compressor functional mock up At the very beginning of developing the gaming vest, the problem is how to simulate the punch feedback more accurately. The first idea is by using the air that pump into the air bladder to create the sense of punch. In order to create this haptic feedback, I brought an air compressor with small tank that can compress air inside the storage. During the test, if the air pressure is 110psi, the bag canâ&#x20AC;&#x2122;t afford that pressure and it would explode. The result shows that the volume of the air and the pressure need to be adjusted. I tried to use 100psi, 90psi, 80psi and 70psi, to find the appropriate volume and pressure of the air for air bladder. The result shows that the air pressure should be 70psi and by pressing one shot from the air gun, it fills up the air bladder that can simulate the punch and could prevent from exploding the air bladder. The air bladder should use thicker ABS rubber for the material, which will be durable and expendable enough for a long term use.

Final report

Solenoid functional mock-up The second mock-up is by using different haptic feedback system. One of the reasons is the air compress base haptic system that needs air compressor to operate and store the compressed air next to the arcade game machine. The air compressor is too loud and the air tank will be huge causing inconveniences for a long term use. The other reason is because of the further research about gaming vest and I found out that a company called the GN game, had already used air compressor into manufactured gaming vest. But the mini USB-based air compressor canâ&#x20AC;&#x2122;t provide strong compressed air and it is as well too loud. I found out there is a studentâ&#x20AC;&#x2122;s research from the University of Pennsylvania in the engineering department called Tactile Gaming Vest (TGV), which used electric solenoid to simulate gunshot feedback, so I changed the functional design direction to the solenoid-base haptic feedback. I brought the DC type solenoid and 12V battery to do the test but the solenoid is too long while I put it inside the vest. The instructor gave me an idea about the use of the carâ&#x20AC;&#x2122;s suspension system to reduce the distance inside the vest. Therefore, I designed the mechanical drawing about the solenoid-base haptic feedback system to show how it works in the gaming vest.

Final report

Woofer functional mock up The third mock-up is designed to have woofers inside to simulate punch feedback. Due to the last mock up test, the result and the feedback is that the solenoids are too heavy and the system had mechanical issues. So I contacted with the inventor of the Tactile Gaming Vest (TGV) called Saurabh Palan, who is a robotic engineer and he is working in Palo Alto now. He told me a lot of the design process of his gaming vest and the mechanical part of the solenoid. I told him about the designing process of the similar gaming vest for the arcade game machine and he gave me a new idea about using the woofer to create the haptic feedback by using low frequency sounds. He said this will be easier to install into the vest and maintenance. The woofer can also provide sound during the gaming too. I took his suggestion and brought the 3â&#x20AC;? and 5â&#x20AC;? woofer to attach on this mock-up for the functional test. Through the amplifier that played the low frequency sound which can actually create the vibration feedback from the woofer. The problem of this system is still heavy due to the magnet inside the woofer but a bit lighter than the solenoidbased system.

Final report

[Conclusion]

For the main console and each part of the gaming device, it had already solved the functional or ergonomic problems individually. Some of the mock-ups should be refined by shape and ergonomic adjustment. For the current status, all of the device should have the same design language and it needs to brand into a series together. I took the Director of Game Designâ&#x20AC;&#x2122;s feedback, which is to only choose one game to brand my final design direction and create a theme to fit between a game and arcade game machine. I chose boxing game to brand this arcade machine because this game style can provide physical interaction between two users in two different arcade machines and places. The boxing sport also required the helmet equipment, vest and gloves during training. Therefore all of the gaming devices can achieve the requirements and the users can easily adapt to use these gaming devices to play the boxing arcade game. Moreover, the color of the theme is chose to be black and white as the main color tone because these neutral colors fit for both genders. As well as the passion red color that represents the boxing sport which fits the excitement of the physical interactive game play. For the game itself, it will not just only be a boxing game, it will use robot and Si-Fi environment to create the sense of futuristic that can be an appropriate emerging 3D display technology. The robot avatar also hides the userâ&#x20AC;&#x2122;s real identity to avoid the unpredictable social issues and lets the user fully enjoy the gaming experiences.

Final report

4. Design Refinement

Final report

100

[Final Design Sketch]

Main Console

Glass cover

Glass holder

Top cover

Short throw projector

Smell Printer

Special Optical Device 200 Mini Projectors

Circuit Board

Final report

101

[Final Design Mock up]

Final report

102

Main Console

[Final Design Sketch]

Helmet

Accelerometer ERM Front Cover

Magnesium Neodymium Magnet Mylar Plate Speaker Plate & Net Cover Cushion Slide bar cover ERM ERM Cover

Cheek Pad Cover

Cushion

Final report

103

[Final Design Mock up]

Final report

104

Helmet

[Final Design Sketch]

Glove

Cushion Accelerometer

Cushion

ERM

Front Cover

Cushion Elastic Strip

ERM Accelerometer

Velcro

Final report

105

[Final Design Mock Up]

Final report

106

Glove

[Final Design Sketch]

Vest

Chest Cushion & Woofer cloth

Woofer Holder

Woofer Woofer Holder Nylon Polyster Fabric

Front Cushion & Woofer cloth Back Cushion

Circuit Board Back Cover

Velcro

Final report

107

[Final Design Mock up]

Final report

108

Vest

[Quick 3D Modeling Rendering]

Main Console

Final report

109

Short throw projectors in the back

Motion Detection system on the top of the background screen

Smell Printer in the front of the 3D display cabinet

Touch screen panel and coin operator

Final report

110

Helmet

Final report

111

Ear pad with speaker inner cushion covered by soft leather

Ear pad with speaker and cheek pad with vibration feedback

Final report

112

Glove

Final report

113

Final report

114

Vest

Final report

115

Final report

116

[Storyboard]

Step1: insert coins

step2: Choose Game type

Step3: Wear gaming gears

T GH

FI step4: face to the main console

step5: the 3D images & background generated

step6: ready to fight!!

Final report

117

7. Design Implementation (Final Design) Final report

118

[Main Console Refinement]

Due to the professional feedback and the aesthetics concern. The main consoleâ&#x20AC;&#x2122;s background part need to be re-design to cooperate with the 3D display system in the front and the design language should be the same. The other part needs to be refine is the sub control cabinet. Itâ&#x20AC;&#x2122;s should be designed more easy for user to use and the direction should face to the place that userâ&#x20AC;&#x2122;s playing area.

Final report

119

[Ideation Sketch]

Final report

120

Final report

121

[Quick 3D Rendering Study]

Final report

122

[UI Design] [Task Analysis] Human Factors Sequential Task Analysis (4D Arcade Boxing Game Machine) Key to disposition codes (Symbols indicated in column at far right if the tables) D

= Design considerations to be evaluated for incorporation into future design changes for this product or system R = Include in Product Requirements S = Include in Product Specifications LR = Design Consideration to be incorporated into the Labeling* Requirements for this product or system LS = Design Consideration to be incorporated into the Labeling* Specifications for this product or system A = Issues concerning “Accessories” to consider during specification and design of this product or system N = No relevant information or disposition identified N/A = Not addressed in this analysis I = Insufficient information available to address * the term “labeling ” includes all labels, Directions for Use(DFU), Instructions for Use(IFU) and other information materials to be supplied with the product(including media such as CD ROMs, DVDs and etc.)

Final report

123

TASK ANALYSIS:;User Application Process Ref#

SEQUENTIAL TASKS

POTENTIAL ISSUES

DESIGN CONSIDERATIONS

DISPOSTION

User insert coins to start the 4D arcade boxing game machine

User may not find where is the slot machine

The device must be designed to find the slot machine easily

S,R

User stands in front of the sub monitor device and the device will show the welcome page before the main menu.

User may wait too long for the device to respond

The user interface may be designed to respond quickly when the coins triggers the main menu.

S,R

Device appears on screen with the menu page

User may be confused what is appearing on the screens with different buttons

The scan screen must be designed to have easy button access for next movement

N/A

Device appears the “1P vs COM” button on the top and “1P vs 2P” button at the bottom of the menu screen

User may need to understand the meaning of the buttons from the beginning when using the device

User should be familiar with the “1P vs COM” and “1P vs 2P” buttons “1P vs COM” and “1P vs 2P” buttons should be designed to see easily and used effectively

LR/LS

User (1) will push the “1P vs 2P ” button on the menu screen

The screen may have difficulty detecting the user’s fingers due to its sensitivity

The device should be designed LS/LR with good sensitivity when user pushes the button on screen

The device continues with the next page appearing on top of the screen written “Choose Your Characters” and in the middle of the screen, it will show the characters below with the twinkling frame on it. There will be 10 thumbnail buttons below the screen showing different characters and the button at the bottom of the screen saying “back to menu”

User may not know the difference between the two buttons for the first time User may be confused in choosing characters on the device

The device must be designed to S, R,LR/LS show which character has been chosen and the twinkling frame should be clear It should have timer to countdown when choosing the characters

Final report

124

Ref#

SEQUENTIAL TASKS

If user double tap one of the “character” button

The device will continue to the next step

On top of the screen, it will appear the header: “Enter Your Gamer Tag Name”. There will be a blank column for user to enter information under the selected column on the blue highlighted row and a keyboard below. The buttons at the bottom of the screen will show ”Next” and “Back to character menu”

If user (1) push the “Next” button

The device will continue to the next step

On the top of the screen, it will show the header: “Choose Online Boxer” following with image columns showing different online player’s gamer tag and location. The highlighted twinkling frame will show one the first gamer tag to notify user where to choose and the buttons at the bottom of screen will show “Next page”, “previous page” and “back to menu”

POTENTIAL ISSUES

DESIGN CONSIDERATIONS

DISPOSTION

The button should be designed with an easy identifying icon and large caption of “name of character” for easy comprehension

N/A

User may need to wait at a maximum of 1 second for the screen to load

User interface must be designed for quick access and loading of each page

N/A

User should be aware of typing their gamer tag name otherwise user should return back to character’s menu User may hit the wrong button while typing their gamer tag name

User interface must be designed to easily and clearly identify each keyboard for user to push The “Next” and “back to character menu” buttons should be easily identified

LR/LS

The button should be designed with a large caption of “Next” to easily comprehend

LR/LS

User may need to wait at maximum of 1 second for the screen to load

User interface must be designed for quick access and loading in each page

N/A

User should be aware of each button’s purpose of device otherwise user should return back to menu User may hit the wrong button

User interface must be designed to easily and clearly identify each button for user to push The device must be designed to show which gamer has been chosen and the twinkling frame should be clear The “next page”, “previous page” and “back to menu” buttons should be easily identified

S, R,LR/LS

Ref#

SEQUENTIAL TASKS

POTENTIAL ISSUES

DESIGN CONSIDERATIONS

DISPOSTION

If user double tap one of the “character” button

The button should be designed with an easy identifying icon and a large caption of “name of online gamer” below to easily comprehend

N/A

The device will continue to the next step

The button should be designed with User interface must be designed an easy identifying icon and a large caption for quick access and loading of each page of “name of online gamer” below to easily comprehend

N/A

User may need to wait at maximum The device will show a loading bar saying “conof 10 seconds for the screen to connect necting…” and the chosen online gamer tag will appear on the top of the loading bar

User interface must be designed for quick access and loading steps User interface must be designed to have better internet speed

LR/LS

After connecting User might need to wait for a maxiwith the online gamer, the mum of 3 seconds of the device to load screen will show the animation of the character chosen by the user on the left with character’s name, user’s gamer tag name and location. The online gamer’s character will appear on the right with his/her character’s info. In the middle of the screen, it will show”V.S.” (Versus).

User interface must be designed for quick access and loading step

LR/LS

The screen will apUser may not know how to flip the pear on top of the screen coin on the screen written “Flip Coin to Decide Who Is Selected for the Stage” and the images will show at the bottom are the two gammers tag and which face of the coin is selected to.

User interface must be designed to easily and clearly identify the flip coin movement for user to push User interface must be designed to have instructions on how to flip the coin

N/A

The screen will show the animation of the flipping coin movement

User interface should be designed N/A easily and clearly to see the animation of the flipped coin

Final report

126

Ref#

SEQUENTIAL TASKS

POTENTIAL ISSUES

DESIGN CONSIDERATIONS

The screen will appear the result of the flipped coin movement with the gamer tag name being selected to win for the stage. The button at the bottom of the screen will say “Next”

N/A

stage

N/A

On the top of the screen, it appears: “Choose the Stage” header and in the middle of the screen, it will show the stage below with the twinkling frame on it. There will be 10 thumbnail buttons below the screen showing different stages

If user double tap one of the “stage” thumbnail button

User chooses the The device must be designed to show which stage has been chosen and the twinkling frame should be clear It should have timer to countdown for the user when choosing the stages

LR/LS

User interface must be designed to easily and clearly identify each button for user to push

N/A

Device continues User may not understand the anithe next page appearing mation of the wearing process for the gam“Put The Gaming Device ing device On” header and showing the animation of human figure putting on the gaming device

User interface must be designed for quick access and loading step User interface must be designed to easily and clearly identify how to wear the gaming device

N/A

After step 23, on top of the screen appearing “Push The Button When You Are Ready” header and the button will say “Go!” showing with twinkling red light

User should spend some time to wear the gaming device correctly at the first time User may accidently hit the button

User interface must be designed N/A for quick access and loading step User interface must be designed for easy and clear buttons for user to push The “Go!” button should be easily identified

The “Go!” button should be easily N/A identified after the user hit it

If user double tap one of the “Go!” button, the button color will turn to green

User may not know the difference of the buttons for the first time User may be confused on which stages to choose on the device

DISPOSTION

User may push the wrong button

User may accidently hit the button

Final report

127

Ref#

SEQUENTIAL TASKS

Device appears on screen with the countdown number starting from 10 and in the middle of the screen, it will appear “Please Face To The Main Console Screen” and the animation of human figure turns and faces to the main console screen

User may not know where is the main console screen User should be aware of not hitting the main console 3D images in the front while they are turning

User interface must be designed for quick access and loading step User interface must be designed to easily and clearly identify each button for user to push The main console screen should be designed to turn on while the sub touchscreen shows the information of “Please Face To The Main Console Screen”

LR/LS

If user turns to the main console screen

User should be aware of hitting the main console 3D images device in the front while they are turning

User interface must be designed to show the images on the main console screen

LR/LS

User might need to wait for a maxiDevice appears on screen with loading bar and mum of 10 seconds for the device to load a “Creating Images…” footer below and the column at the bottom written “Please Wait” The main console screen will show the same information as the sub touchscreen

User interface must be designed for quick access and loading step User interface must be designed to easily and clearly identify each button for user to push

LR/LS

Device will appear a animation written “Ready” then “Go” to start the game

User interface must be designed for quick access and loading step User interface must be designed to have a sound to notify user that the game is started

N/A

The main console screen will generate the stage screen and the 3D images device will generate the 3D images of online gamer character in the front and the columns at the top of main console screen will show a energy bar of both gammers and how many rounds of the game icons below

User should be aware of each button’s purpose of device otherwise user should return back to menu User may hit the wrong button

Final report

128

POTENTIAL ISSUES

User may wait too long

DESIGN CONSIDERATIONS

DISPOSTION

User interface must be designed N/A the energy bar should be clearly and easily to read The 3D image in the front should be designed to be more vivid and clearly for user to see it

Ref#

SEQUENTIAL TASKS

POTENTIAL ISSUES

If user wins the game ends

DESIGN CONSIDERATIONS

User may need to wait at a maxiThe main console screen will show the user box- mum of 1 second for the screen to load ing statistics and the online gamer’s statistics

User interface must be designed for quick access and loading of each page

N/A

The main console User may not know which way to turn and find the sub touchscreen when usscreen will appear the animation written “Congratula- ing the device for the first time tion” and “Turn to Sub Touchscreen and Choose next fight” below

User interface should be designed with a clear animation showing where is the sub touchscreen

LR/LS

User interface should be designed with a clear animation showing where is the sub touchscreen

User may hit the wrong button

User interface must be designed to easily and clearly identify each button for user to push

LR/LS

If user double tap the “Choose next fight” button

User may hit the wrong button

User interface must be designed to easily and clearly identify each button for user to push

LR/LS

Device will appears the Step 4 on the screen showing the “1P vs COM” button on the top and “1P vs 2P” button at the bottom of the menu screen

N/A

Repeat the step 5 – step 30

N/A

game

The main console screen will show the user’s boxing statistics and the online gamer’s boxing statistics

If the user lose the

ends

User should feel tired after the game

DISPOSTION N/A

User should feel tired after the game

User may need to wait at a maximum of 1 second for the screen to load

N/A

User interface must be designed for quick access and the loading of each page

N/A

Final report

129

Ref#

SEQUENTIAL TASKS

POTENTIAL ISSUES

The main console screen will appear the animation of a countdown from 30 seconds and written “Lost” and “ Face to the Sub Touchscreen and Continue?” below

User may not know which way to turn and find the sub touchscreen when using the device for the first time

User interface should be designed with a clear animation showing where is the sub touchscreen

LR/LS

The screen will appear back to the page with the top of the screen showing countdown animation written “insert coin to continue ” and 2 different buttons below showing on screen “Give Up” and “Continue”

User may hit the wrong button

User interface should be designed the animation shows where is the sub touchscreen

N/A

If user hit “Give Up” button

User may hit the wrong button

User interface should be designed the animation showing where is the sub touchscreen

N/A

Device will appear on the screen written “Game Over” and back to the game demo animation

Final report

130

DESIGN CONSIDERATIONS

DISPOSTION

N/A

[Storyboard]

Final report

131

Final report

132

Final report

133

Final report

134

[Wire frame] VO: Welcome to the Boxing Battle Zone! Select your boxing game mode Choose Your Characters Double Tap to Select

LOGO

4D Boxing Arcade Insert 4 coins

LOGO

MAIN MENU

Choose Your Characters Double Tap to Select

Speed Strength Defence

IP VS 2P

1P VS COM

Double Tap to Select

Flashing

Name of the character

Flashing

Choose Your Characters

Enter Your Gamer Tag Name

Double Tap to Select

Name of the character

Flashing

Name of the character

Country Flag

Name of the character

Speed Strength Defence

Enter Your Gamer Tag Name

USA, California

Brian Ou Yang

DF XC

ASDZ

Flashing

Country Flag

Name of the character

space

caps

ASDZ

123

XC space

VB caps

123

Flashing

Final report

135

Enter Your Gamer Tag Name

Choose Online Boxer

Double Tap to Select

Choose Online Boxer Double Tap to Select

Country Flag

Name of the character

Gamer Tag

USA, California

Location

Gamer Tag

Location

Gamer Tag

Location

Gamer Tag

Location

Gamer Tag

Location

Gamer Tag

Location

Brian Ou Yang

Gamer Tag

Location

caps

123

space

LOGO

Choose Online Boxer

LOGO

Name of the character

Double Tap to Select

Gamer Tag

Location

Gamer Tag Location

Location

Gamer Tag

Location

Connecting ...

LOGO

Name of the character

Gamer Tag Gamer Tag

Final report

136

Flip the coin to decide who choose the stage

Gamer Tag Gamer Tag

LOGO

Gamer Tag

Double Tap to Select

10 10

10 Gamer Tag

Choose Stage

Flip the coin to decide who choose the stage

Gamer Tag

Gamer Tag Win

Stage’s Name

10 Gamer Tag

Gamer Tag

VO: Stage’s Name Choose Stage Double Tap to Select

Stage’s Name

Choose Stage Double Tap to Select

Stage’s Name

Choose Stage Double Tap to Select

Stage’s Name

Prepare to Fight!!

Final report

137

Put The Gaming Device On

Dubble Tap the button when you are ready

READY

READY waiting for other boxer

Gamer Tag

READY

READY VO: Countdown Number

Dubble Tap the button when you are ready

Doubble tap to start

READY

GO!

Pease Face to the main screen and 3D display

waiting for other boxer

Gamer Tag

READY

Final report

10 Creating Images.....

138

gamer tag

VO: Countdown Number

Creating Images.....

gamer tag

Stage Background 3D hologram

gamer tag

Stage Background 3D hologram

Ready

GO!

You Win!

gamer tag

Stage Background 3D hologram

Total Hits: 18 Combo Hits: 2 Block Hits: 8 Damage: 80% total Scores: 16890 Ranking

Final report

139

[Final 3D Rendering]

Final report

140

Main Console

Final report

141

Final report

142

Final report

143

Glove

Final report

144

Final report

145

Helmet

Final report

146

Final report

147

Vest

Final report

148

Final report

149

[Product Environment]

Final report

150

Final report

151

Final report

152

Final report

153

Final report

154

Final report

155

6. Design Implementation (Manufacturing)

[Material & Process]

[Materials]

1. Gloves: Polyurethane, PVC,TPU,EVA 2. Interaction vest: PVC,TPU, EVA 3. Voltage: 110V/220V (Based on current electronic usage) 4. Game Machine Parts (According to Cheer Jingle Taiwan) A. M-14 Anti-theft iron cabinet case B. M-19 Shelf for coin selector C. M-08 Plastic coin tray D. M-22 Iron coin refund slide course E. M-23 Cabinet foot (L, U, Triangle-shape) 5. Game Machine Wires 6. Game Security Device A. Anti-interference Device 6 in 1 B. Circuit Breaker 7. Push Button : sillicon rubber 8. Switch Locks/Cam Locks: Stianless, ABS cover 9. Videogame Speaker/Stereo: wood, PVC, PU 10. 3D projector: Optical lens(Silicon dioxide,glass) 11. 3D projector holer: PVC 12. Cabinet (Materials according to Andamiro http:// www.andamiro.com) A. ABS Material (Acrylonitrile butadiene styrene) for outer cover B. Angle iron for inner frame structure C. Sheet metal or SECC â&#x20AC;&#x201D; Steel, Electrogalvanized, Cold rolled, Coil for circuit board holder Final report

157

[Manufacturing Process]

Process

Pros

Cons

•Shape complexity is •Good for produce large products in low limited to medium volume production runs •Surface finish is good •Produces durable parts with moderate tolerances

Roational Molding

Cost

Concern

•Medium cost tooling •Low to medium unit cost

Could be used on outer frame and cases

•High tooling costs •Low unit price

Could be used on Gloves , Vest and Helmet hard covers, and inner cases

Injection Molding •Vast range of shapes •High tolerances possible •Fast production rates •Details can be molded in

•Generally require extra finishing processes •Requires long lead time

Tube and Section •Quality is high Bending •No tooling costs •one-off to high volume production •Rapid cycle time

•machine setup time •No tooling can be long costs •Low to medium unit cost

Final report

158

Could use for main console surround tube

Process

Pros

Roll Forming an •Gives environmental Angle impacts

Arc Welding

•Low quality

•The complexity of •Not tool costs •High quality of joining the parts will effect materials the speed of welding •Assembling conplex metals without expensive tooling costs

Water Jet Cutting •Good quality •The result can be pretty accurate

Foam Molding

Cons

•Cycle time will be slow

•Versatile in scale and •Generally only application suitable for thicker •Colorful, soft, walls lightweight •Colors and details can be molded in •Can produce large, solid forms

Cost

Concern

•Medium tooling costs

Could use for main console inner structure frame

•No tooling costs •Low unit price

Could be used on main console inner structure frame joining

•Not tool costs •Medium unit costs

Could be used on the main console 3D projector upper cover glass

•High tooling costs •Low unit price

Could use for many parts of the device cases or containers

Final report

159

[Orthographic views]

Main console

34.17 inch

50.25 inch

34.17 inch

42.52 inch

7.97 inch A C

A 13.92 inch SECTION A-A SCALE 1 : 10

Final report

160

inc

33.13 inch

DETAIL B SCALE 1 : 5

30.60 inch

36.14 inch

39.32 inch

DETAIL A SCALE 1 : 5

18.68 inch

96.54 inch

DETAIL C SCALE 1 : 5

1.18

4.72

2.00

2.20

Glove

4.72

8.44

3.24

A SECTION A-A SCALE 1 : 2

1.14

Final report

161

Helmet

SECTION B-B SCALE 1 : 2

B E B

DETAIL E SCALE 1 : 1 8.87

7.62

Final report

162

1.51

SECTION A-A SCALE 1 : 2

3.24

5.47

1.94

Vest

5.26

inc

7.48 inch

DETAIL B SCALE 2 : 5

17.20 inch A

C SECTION A-A SCALE 1 : 5

7.46 inch

21.52 inch

9.58 inch

14.25 inch

DETAIL C SCALE 2 : 5

Final report

163

3D projector glass cover

[Exploded views and Part Lists] Main console

Motion sensor lens gla 3D special optical fun

Background cover Background inner project sheet

Motion sensor Background projector Smell printer cover Smell printer

Inner structure frame

Background main holder Background right angle foot

Base bottom frame Final report

164

Inner circuit board sheet metal holde

asses nnel

ds and fans ers

Outer top cover Circle protect tube LED screen glass LED touch screen Outer bottom cover Protect tube cushion covers Side cabinet Side cabinet back door

Smell printer cover

Coin machine coin box Coin machine Right protect tube Side cabinet lock 3D mini projectors X150 3D mini projector holders X150 Power supply box Protect tube holders Main console base and special optical funnel holder Left protect tube Main console angle foots X4 Final report

165

Glove

Front palm strip

Front inner cushion Circuit board Inner box cover

Inner component box Front glove cover

Final report

166

ERM

Top strip

Back glove cover

Inner component box

ERM

Circuit board

Inner box cover Back inner cover cushion

Back wrist cushion

Back wrist strip

Final report

167

Head strip

Helmet Front Inner cover cushion

Forehead inner cover

Speaker plate & net cover mylar plate holder

Forehead cushion

Cushion

Neodymium magnet Magnesium

Mylar plate

Right ear outer cover

Cheek Cushion Cheek pad cover Cheek pad outer cover Final report

168

Right ear slider holder

Forehead outer cover

Final report

169

Vest

Chest cushion

Upper woofer cover Woofer cushion

Chest outer cover

3â&#x20AC;? woofer Upper woofer holder

Lower inner cushion

Lower woofer cover

Final report

170

Lower woofer decoration pad

Lower 4 woofer frame Lower CORDURA cover

Lower woofer cushio

Shoulder outer cover

Shoulder strip

Shoulder cushion

Back outer cover Waist CORDURA cover

Back cover Circuit board

Back inner cover

on Waist snap pad Velcro Final report

171

[Bibliography ] 1. University of Southern California Institute for Creative Technologies http://ict.usc.edu/projects/3d_teleconferencing/ 2. Iroboticist http://iroboticist.com/ 3. IAAPA http://www.iaapa.org 4. FvisiOn http://mmc.nict.go.jp/people/shun/fVisiOn/fVisiOn.html 5. AKIHABARA NEWS http://en.akihabaranews.com/85119/gaming/aou-2011%E2%80%A6-the-japanese-arcade-game-show-isstill-kicking-hard 6. CCAC arcade game show http://www.ccagshow.com/ 7. PCMAG.com http://www.pcmag.com/article2/0,2817,2372244,00.asp 8. Wired.com http://www.wired.com/gadgetlab/2010/11/tonights-release-xbox-kinect-how-does-it-work/ 9. BMI GAMING COMPANY http://www.bmigaming.com/ 10. ProjectorPeople.com http://www.projectorpeople.com/resources/short-throw.asp 11. TN Games http://tngames.com/ 12. Touchable holography http://www.alab.t.u-tokyo.ac.jp/~siggraph/09/TouchableHolography/SIGGRAPH09-TH.html 13. Virtualworldlets.net http://www.virtualworldlets.net/Resources/Hosted/Resource.php?Name=HapticUltrasound

Final report

172

14. FPQ http://www.freepatentsonline.com/6906860.html 15. ERM http://www.precisionmicrodrives.com/application-notes-technical-guides/application-bulletins/ab-004understanding-erm-characteristics-for-vibration-applications 16. Arcade heros http://arcadeheroes.com 17. SMELLIT technology http://www.behance.net/gallery/SMELLIT--TASTE-YOUR-MOVIES-LIKE-YOU-NEVER-HAVE/141582 http://www.nunoteixeiraindustrialdesign.com 18. CNET ASIA http://asia.cnet.com/crave/rs1-xtreme-m3-brings-racing-games-to-the-next-level-62108407.htm 19. Virtual Cocoon http://www.nbcwashington.com/news/weird/Virtual-Reality-Helmet-Mimics-All-Five-Senses.html 20. Materials and Design The Art and Science of Material Selection in Product Design Mike Ashby and Kara Johnson 21. Manufacturing Processes for Design Thames & Hudson 22. Gizmag http://www.gizmag.com/device-emits-odors-on-cue/18985/ 23. UCSD Jacobs http://www.jacobsschool.ucsd.edu/news/news_releases/release.sfe?id=1082 24. Carnegie Mellon http://www.cs.cmu.edu/~claytronics/index.html

Final report

173

7. Portfolio

Final report

174

[Resume] JUNG OU YANG (BRIAN)

EXPERIENCE

EDUCATION

May 2008 – Sept 2008 Information Technology Mitsubishi Sevrin Panasonic

•

Academy of Art University San Francisco, CA Master of Industrial Design in Fine Arts Graduation estimation: May 2012 Major: Industrial Design Chinese Culture University Master of Fine Arts Graduation Date: May 2006 Major: Fine Arts Chinese Culture University Fine Arts Graduation Date: May 2003 Major: Fine Arts

Taipei, Taiwan

AWARDS 2001 2000

1999 1996

Guo-Tai Life Insurance New Century Art Show Potential Artist’s Award in Taiwan Teachers and Students Art Showcase Honorary Awards in Taiwan Chinese Culture University Graduation Show case First Place in Taiwan Teachers and Students Art Showcase Honor able Mention in Taiwan Tao-Yuan County’s Carps Asso. 2nd Annual Sketch Competition First Place in High School Division in Taiwan

Taipei, Taiwan Taipei, Taiwan Taipei, Taiwan

Portrait Sketcher • Monthly showcase for live portrait sketch May 2007 – Aug 2007 Taipei, Taiwan Illustrator • Developed and coordinated illustrations for children’s books, textbooks, and novels • Performed and analyzed project performance in TV commercial script illustration Aug 2006 – May 2007 Taipei, Taiwan Modeling • Professional modeling for TV commercials, music videos, advertisements in magazines SKILLS • Languages – Fluent: English/Mandarin •

Basic Computer Programs – MAC, WINDOWS, Mi crosoft Word, Excel and Power Point

•

Computer Design Programs – CS Adobe Photo shop CS4, Adobe Illustrator, Indesign, Painter, Alias Studio Tools, Alias showcase, Solidworks

•

Design Skills – Design problem solving, material and process, research and development, quick sketching, oil painting and water color, digital painting, 3D modeling

Final report

175

[Portfolio]

Design Drawing 3 Final report

176

Nike Shox2 Concept

Use new technology and based on orignal shox system to design new suspension system and tracking ball system that can provide more functional and powerful shox system.

Final report

177

Design Drawing 4

Star War Drawing Copy

Original Drawing

Final report

178

Copy

Product Drawing Using Star War Drawing Technique

Design Drawing 4

Product Drawing using Star War Drawing Technique Final report 179

Final report

180

Final report

181

Slim Flash Light Orthographic

Slim Flash light concept Final report

182

Model Making

Section View Exploded View

SolidWorks

Final report

183

4D ARCADE MACHINE

4 senses interactive device