380169392@163.com
Education
Main curriculum
Bachelor of Engineering in Digital Media Technology Jiangnan University(JNU), China From 09.2012 to 07.2016 GPA:3.63/4 (3/124)
Exchange Student，Digital Media Design Ming Chuan University, Taiwan From 09.2014 to 01.2015 GPA:91.6/100
Program Design（C Language） Human-Computer Interaction Object-Oriented Programming Video Analysis and Interaction Techniques Script Programming Techonology（JavaScript+CSS） Computer Graphics
Professional skills English: proficient, IELTS 7.0 Computer Skill: C++, jQuery, HTML, Arduino, Processing
Experience Intern Web Developer Jue Culture Co., Ltd., (Shanghai, China) From 07.2014 to 08.2014 Applied knowledge in web frontend (JavaScript &jQuery ) and backend (PHP 5.x) technology in interactive design
Group Leader & Programmer
Research Field: Human Computer Interaction (User experience, I/O psychology)
Award & Scholarship National Scholarship (2013 to 2014), (6/900) Merit Student of Wuxi City (2013 to 2014), (3/900) Merit Student of Jiangnan University (2013 to 2014)and(2012 to 2013), (6/900)
China and Netherlands Cultural Workshop From 05.2015 to 06.2015 Demonstrated in Wuxi International Industrial Expo
Group Leader & Programmer “Huafei Aviation” Cup Cultural Creativity Contest 06.2015 Best Creative Award(1/11)
First Prize of Fly High Scholarship for Overseas Study (12/2014), (Top 15) Jiangnan University First-class Academic Scholarship (2013 to 2014), (4/124) Jiangnan University Second-class Academic Scholarship (2012 to 2013), (8/124)
City Public Space Interaction Design
01 Solos Interaction Device
10 Smart Night Light 17 Let Bullets Fly Motion Sending Game
23 THe Last of the Chivalrous Man Programing
29 Dangcing Transportation Light 32 MFC Music Player
SOLOS means that life and nature consist of individuals with their unique responsibilities and abilities.
OVERVIEW This project created an outstanding installation named SOLOS in Chinese-Dutch international workshop in May 2015. The goal of our project is to provide a playful, thought-provoking and functional product for modern people. At most of time,individuals will find that they get lost in routine works, which definitely does harm to social and human development.We made a 60*60*60cm box to illustrate the relationship between groups and individuals.In order to connect environment with human-beings,we not only used sand to imitate a contour line system but also decorated it by crops like colorful beans.Then it also features advanced technology like infrared sensor used for detecting
Leader Brainstorming Concept development Sketch Detail design Programming 3D modelling Video and poster Modelling Presentation
-2-
un gy
qu
en
Xi
Zh n
M
uo
n Fa
n
la Zi
va
en
n
Ch
Q
n
Yi
Ru be
iu
DI
ng
o gt
n
JK
distance. Therefore, it is able to provide real-time responses for the user’s behavior.
BRAINSTORMING
LIMITATION
ANT COURAGE COOPERATION STRENGTH
CHARACTER
NATURE ELEMENTS
ANALYSIS
PLANT ANIMAL INSECT FIRE
SUN WATER METAL SOIL
BRAINSTORM
NATURE BOX PHENOMENA OBSERVATION
ABSTRACT ELEMENTS
RELATIONSHIP BETWEEN GROUPS INDIVIDUALS
TIME RELATIONSHIP
COMBINE ALL CONDITION AND SEARCH FOR DEEPER THINKING BRAINSTORM
Concept NO.1
Concept NO.2
There is an old saying: ＂ A chopstick is easily broken while a dozen of chopsticks are hardly broken. ＂ Both cooperation and self-contribution should be emphasised in our normal life. Ohly when people are Individuals
willing to express their unique thinking and provide specialty,societies and economies can be flourishing in future.
Positive
Conclution
Negative
Through interacting with our device,we would
Time can be partly compared to water,as they are flowing
like to encourage people to focus on their roles in
continuously with the steady speed.
families,jobs and daily lives.
However,in humans’subjectivity viewpoint,the speed of
A group
time flowing can be influenced by human’s moods.When we feel happy,the loss of time is unable to be sensed. Meanwhile,if we are sad by something,we will complain that nothing could help us pass the time.
-3-
PROCESS OF DESIGN When we had two division of concept, one was the research that how to use nature
Relationship
to reveal the secrets of humans' moods. The other was analysis of the relationship
Social Need
between social animals including humans, animals and insects.
Self Satisfaction
Case Analysis
Feeling Hearing
employers, lovers, competitors, cooperators
Touching
cooperation, resources, energy
Seeing happy, sad, disturbed, peaceful,grateful,upset
We were able to make a conclusion that the moods of individuals are latent factors to influence the relationships between people, like lovers, families, peers and
Pillow Talk: an interactive product aimed at bringing long distance lovers together
teammates etc.
How can we utilise our abilities and techniques for a brighter and more livable future?
Keywords of design
The process of thinking pattern
-4-
INTERACTION METHOD Target user:
Group Activity After analysing these characteristics, it reminded me that there are three types of
Piling up sand is an efficient way to encourage children, adolescents and young
games popular among divers age groups.
people to build an object according to their imagination.
But what can be combined with the limitation(the fixed size of container and
Chinese jump rope helps people break the levels step by step by phycially practises and psychological constuction.
relating to natural elements)?
Puzzle is a good way to develop kids’observation abilities and patience,appealing different age groups.
After heated discussion in team,we decided to choose sand as the interaction medium of our device for the reason that there is not limitation about the number of users at the same
Digital Contour Line Box
time and sand is a perfect material for light projection.
-5-
3D MODELS AND INTERACTION METHOD
High
Kinect can detect the depth between sands and itself.
Different colours stand for different depth.
Low
When the depth of sands is lower than horizontal level, water will appear
-6-
PROGRAMMING
At first, I searched the source from Internet about how to use Kinect to extract some depth information from images.Then it showed me that an open library,SimpleOpenNI,provides some packaged entrances for developer to connect the Kinect with processing.I imported SimpleOpenNI into the library of processing under the development envrionment of Kinect.There is an example named DepthImage in the SimpleOpenNI,explaining the use of depthMap.
depthMap generation
camera image generation
Switching the color to fill image according to the depth Actually, depthMap uses Gray Scale Image to show the depth in the space.But I wanted to substitute colorful bits for those gray bits,like green, dark blue and yellow etc.Except from brightness, Gray Scale Image doesn' equip other useful information. Therefore,according to a series of brightness ranges of the pixels in the depthMap,I defined a function named changeColor, using customised colors to fill the pixels in the screen.
depthMap
camera image
color-depth image
-7-
MODELING These sand stand for the earth’s surface which is waiting for audience to re-build by hands or tools.
The box was decorated by four types of beans（ ormosia, mung beans, black rice and millet respecively）,which aims to imitate the earth’s mantle.
-8-
EXHIBITION AND DEMONSTRATION We built an installation to provide a sand box full of smooth, soft and colorless sand. It is a perfect carrier to inspire audience to touch them.Then they can not help gathering sand for mountains or digging them for holes as kids. Through a four-day Wuxi International Industrial Expo, the installation successfully attracted hundreds of people to participate in interaction with the sand box including children and professional staffs. After changing the shape of surface of box, as the images show, kinect will utilise the embedded infrared rays sensor to dect relative height of sand hills.These data are transfered to Processing program in order to change colors projected directly to sands by projector. Thanks to program coded by myself as well as hardwares, the installation is able to run automatically and show the inviting performance. The concept video of solos:https://youtu.be/R2uQSCEQC1w
-9-
Using light projection,I aimed to create an inviting space for people to enjoy a relaxing time before falling deeply into sleep.
OVERVIEW This project aims to provide an interesting product with educational funchions according to the requirement of Highfly China Competition. Compared to traditional electronic devices, I decided to design a night light with interaction functions. We finished the prototype in June 2015, which also won the best idea award in this competition.My responsibilities were the design of interactive method as well as progamming.
- 11 -
CONCEPT DEVELOPMENT It is widely considered that most of helicopters are used for military matters like
As the images show, original sketchs are too simple to apply into the design of
ensuring the safety of national airspace, emergency activities and fighting etc.
prototype while modern one is bulky compared to the first one. As a consequence,
Therefore, I would like to introduce different but widely-used functions provided
I refered to the ＂ Bear 47 ＂ as a sample to design the appearance of product.
by helicopters. In order to attract childen as well as adults to focus on the area of helicopters, I did some researches about the history of helicopter development.
Considering ＂ Minimalism ＂ , I removed the rotor wing for it will destroy the balance ＂ Zhu Qingting ＂ -- ＂竹蜻蜓＂ designed by ancient Chinese
The original helicopter idea from western civilization
The first plane of modern society named ＂ Bear 47 ＂
The most normal type of helicopter
of the light.
- 12 -
MARKETING RESEARCH When I do the marketing research, I could find that most of the night light just use peaceful colors such as yellow and pink to create a ralaxing space. Then they also
Decoration
provide some simple interactions with users like detecting light strength or detecting sound changing as switches. In my imagination, there can be more inviting interactions for users because the competition required us to add educational functions. Consequently, apart from appearance of helicopters, I also considered to apply light Lighting
projection.
Traditional light
Insteresting, vivid, unfamiliar Well-designed, functional, usable Elegant, simple, user-friendly
LIKE A APE FL H YIN S G
HE LIC OPTER
- 13 -
PROJECTION DESIGN
INSPIRATION a space with flying helicopters. the shapes of projections
APPLICATION
the source of helicopters’projection
- 14 -
the source of air full of stars
INTERACTION DESIGN
8cm
It provides two types of interaction based on two stepping motors, two curly slips of paper and two LED light. The whole interactions are controlled by Arduino,which
INTERACTION 2
means that it could run automatically with 9V electric
Three embedded capacitor plates
prower because I did some programs and uploadded
provides the chance for user to change
into Arduino.
shape of helicopters’projection.
INTERACTION 1 Star will move continually, but its speed will change according to program. Embedded ultrasonic wave sensor detects the distance between hands and
Paper used for helicopters
the light and data will be deliver into Arduino.
SLOW
changing the speed of flying star
FAST
FAR
Distance between hands and light
CLOSE
LED Light
Paper used for star
- 15 -
Stepping Motor
INTERACTION DESIGN
8cm the field of detecting distance
7.5cm
https://youtu.be/6uTWSgArJ-g
9cm
The interaction video of smart night light:
the field of helicopters’ projections
the field of stars’ projections
ultrasonic wave sensor
Arduino
30cm
capacitor plates
USB for power
- 16 -
Making a piece of fitness equipment with interaction functions substitute for keyboard.
OVERVIEW The idea of this prototype is based on a problem that people are reluctant to do exercises after classes or work.Consequently, it combines games with physical exercises, which means that users are able to play computer games by motions rather than clicking keyboards. The image shows the interface of my project's game in computer named shooting enemy planes,which is controlled by users' motions. I finished the prototype in December 2014 acting as assignment of the course named Interaction Technology of Mingchuan University in Taiwan.
- 18 -
BACKGROUND What they will do after job?
＂ I would like to spend an hour for yoga after finishing my work.
＂ I could not describ how wonderful it is when I am enjoying
It really helps me release my tiredness. ＂
playing computer games. It must be the most helpful recipe
--Lily
to forget those disturbing things in my life. ＂ --Jack
People’s entertainment choices in leisure time
The trend of game industry development(million Yuan) 1945.7
Fitness Playing game Surfing the Internet Reading
2000
37.4%
1596.6
52.7%
1311.5
1500
64.7%
1072.4 891.6
1000
37.9%
538.6
Traveling Other
20.1%
670.9
500
41.4%
0
- 19 -
2011
2012
2013
2014
2015
2016
2017
CONCEPT DEVELOPMENT Therefore, if the experience combines games with exercies, there will be an improvement of user experience, compared to separating them respectively.
The 5 Senses Graph x-axis: the five senses
More and more devices focus on how to combine fitness with games, while there
y-axis: intensity of a particular
was an fitness equipment lying in my teacher’s office quite a long time.
experience on each sense The red area: mind-blowing results
Playing games
Jogging
Obivouslly, these games based on pc have become a popular research filed.
Combination Theory fromďźš Jinsop Lee: Design for all 5 senses | Talk Video | TED http://www.ted.com/talks/jinsop_lee_design_for_all_5_senses
Data from:Global Revenue Per Screen | 2013E by newzoo www.newzoo.com
- 20 -
CONCEPT DEVELOPMENT There is a button used for controling the direcrtion of airplane.
Players can trigger this button when they control the petal straightly pressing it. Then the airplane in computer will shoot bullets.
I chose Arduino to act as the signals transportation centre for its convenience. When users press these buttons in both handrail and pedal by hands or feet, the electrical signals will be transformed by Arduino and become digital signals. These digital signals are boolean algebra acting the role as switches to control the motion of the airplane in game.
- 21 -
PROTOTYPE
Signal-flow graph
Computer
Device
Player
User's story After I go back home, I would like to do nothing but play computer games or watch TV. At the moment,the special fitness equipment grasps my attention. After connecting it with computer through USB,it greets me with red light reminding airplane waiting to fly. I stand on it and push the button to control flying directions. It is definitely a challenge for me to move the airplane with shooting targets by opening legs and closing them continually, which is a series of energy-consuming montions.
- 22 -
Combining Parkour with traditional Chinese element to produce a computer game using Kinect
OVERVIEW Considering the heated development of motion sensing games, my team made a decision to code a game based on kinect 1.0 and unity by ourselves.We also combined the most popular genre of games——Parkour with Chinese interface for introducing the excellent cultures of China. It was a project aimed to participate in Imagine Cup 2015 in January 2015.
- 24 -
MARKET RESEARCH
4% 100
36% 32%
80
$66.3Bn 60
40
28%
20
0
$70.4Bn
$75.2Bn 21.9%
$80.5Bn
$86.1Bn
22.3%
22.7% 5.8%
19.8%
21.2%
9.8% 3.2% 10.6%
8.6% 5.3% 12.1%
13.6%
15.0%
7.3%
6.1%
5.1%
36.7%
36.1%
34.8%
33.5%
32.4%
10.2%
9.4%
8.6%
7.9%
7.3%
9.8%
7.5% 7.5%
6.6% 9.6%
11.6% 16.2% 3.9%
Asia and other growth regions will take 51% of the global
The computer screen will continue to lead other screens
market in 2017.
with a market share of 35.8% totalling $30.9bn in 2016.
As a consequence, we chose a well- known Chinese element——Kungfu to act as the main design style in our game.
Therefore, a game based on computer is the suitable choice for us.
Conclusion from： CASUAL GAMES SECTOR REPORT Towards The Global Games Market in 2017 A broad look at market growth by screen & region
Conclusion from： The Global Games Market Key Facts & Insights On the Global Games Market 2012-2016
- 25 -
PROGRAMMING We used unity for creating the interface and basic functions of “The Last of The Chivalrous Man”with adding Kinect for motion sensing.
- 26 -
CHARACTER AND SCENE DESIGN
Chapter
Interaction
JUMP
ATTACK MODE 1
ATTACK MODE 2
Kill them in order to get highter scores
Enemy
Coins Touch them to get a higher score
The interaction video of project: https://youtu.be/_V5SPyJCQzo
- 27 -
Mastering all of these program languages appearing in the image
- 29 -
CONCEPT DEVELOPMENT AND As psychologists pointed out that the most disturbing thing is waiting,some artists established an installation to improve the situation. Then I used OpenCV imitated the video and created a “Dangcing People”in December 2014.
OpenCV (Open Source Computer Vision) is a library of programming functions mainly
I utilised“Segmentation”, one of the functions of OpenCV(Open Source Computer
aimed at real-time computer vision.There are hundreds of funcitons provided by
Vision ), in the system created by me.
OpenCV.
- 30 -
PROGRAMMING The flow of processing Open camera Capture frames from real-time video Divide objects from background Dissolve noise Shapten the target Fill the target by red
Application: Acting as the main character of Dancing games
Replace the color block by dots
Search the object and replace the background
Use red to fill the figure of object
- 31 -
Change images as red dots
PROGRAMMING
Select music
Y
The Relationship between Windows MFC and Win32 API Programming
The workflow of player
The framework of MFC Music Player - 33 -
N
THANK YOU