Jiachun Du Portfolio 2016
Zhejiang University Hangzhou, China Industrial Design, Bachelor 2012.8 - 2016.7
excellence
Eindhoven University of Technology Eindhoven, the Netherlands Industrial Design Engineering, Master 2015.8 - 2017.7
education
Singapore University of Technology and Design Singapore Product Design Engineering, Exchange 2013.9 - 2013.12
Agency for Science, Technology and Research
ACM
Reddot Concept 2014
Innovation for Health 2016
IDEA Finalist 2014, 2016
CN Chair Design Award Bronze in 2015
A’ Design Award Silver in 2016
Challeng Cup 2nd Prize 2015
Dutch Design Week 8 Best in 2500
Excellent Graduate Zhejiang University
Dubai Design Week 2016
National Scholorship 2013
HCII Conference poster accepted
You are Hired TV Show 2015
Pervasive Health 17 full paper accepted
15 Patents in China Including in appliaction
Arduino Circuit Prototyping
Matlab Machine Learning
Eagle PCB layout
SPSS Data Analysis
Processing Java-based
Rhinoceros 3D Modeling
Eindhoven, the Netherlands Startup Co-founder in Accelerator
Soldering Circuit Prototyping
Keyshot Rendering
TEI Conference 16
Crafting 3D Print, Laser Cut...
Adobes Graphic Design
Singapore Intern Researcher
read me
Innomake Tech Hangzhou, China Intern Designer
HIGH TECH
XL
HighTech XL
Eindhoven, the Netherlands Participant
expertise extracurricular
PROJECTS 2015 - 2016
UMA-P
Smart bikelight that smiles to you
ZUOZI
Posture monitoring for your shoulder
TPSurgery
Control the surgery information in the air
Hugsy
Simulate a parent’s hug for neonatal
Earlier
HygieneL
Detect the indoor air quality
VISI
Make driving easier
Hiccup
Help kids to collect toys
C-tranf
Improve the transfusion experience
UMA-P
Interactive Bikelight with Machine Personality Excellent Graduation Design 2 Patents Approved A Design Award
BIKE LIGHT WITH FACIAL EXPRESSIONS
Brief Introduction
UMA-P is a smart bike light that performs different facial expressions and eye movements to the biker based on its own machine personality. We are trying to add machine learning and theory of emotional intelligence into a commerical interaction prodcut. Meanwhile we are trying to build up not only human-machine interaction but even machine-machine, environment-machine interaction.
DIFFERENT BIKING DIFFERENT LIGHTING
disturbing
irritated noisy environment Bachelor
slow biker
Bachelor
fast biker Bachelor
quiet environment dull
energetic
MACHINE PERSONALITY A framework combines user habit, environment and companion
-1
1
5 3
-1 -1 0 0 2 0 -1 2 1 The influence of environment and user feedback with have a decreasing weight overtime.
machine personality A
machine personality B
3
1 -1
user habit
environment
companion
Q learning is used for selecting next action based on previous user feedbacks.
action 1
interaction A1
action 2
interaction A2
action 3
interaction A3
action 1
interaction B1
action 2
interaction B2
action 3
interaction B3
interactions
XX
The relationship between machine personality, actions and concrete light sets. One machine personality can have a few actions.
The smart product forms its own interaction mode, machine personality, based on user’s habits and environment variables during use. This mode will be applied to human-machine interaction and machine-machine interaction with a few actions that meets the user’s preference and collect feedback for improving the user’s experience.
HOW IT WORKS As the system starts, it will collect data of environment variables and user habits, which influence the forming of machine personality. -1
1
5 3
-1 -1 0 0 2 0 -1 2 1
3
?
read data from envrionment variable sensor + user habit sensor
machine personality selected
read data from companion sensor
1 -1
-1
2 3
-1 -1 0 0 2 0 -1 2 1
action selected and performed
1
3
1 -1
user feedback collected
The system will pick up a machine personality to be performed later by judging the historical average data of environment variables and user habits. Next it will seek for companions nearby with the companion sensor. After that an action under the certain machine personality will be selected and performed according to historical data of user feedback and companion number. Finally user feedback for this action will be collected and the next loop starts.
PROTOTYPE translucent plastic frosted plastic LED ring printed circuit board
metallic paint plastic
support structure Integrated Design in UMA-P The circuit prototype of UMA-P had accelerometer, WIFI and sound sensor as input, LED pixles and rings as output. We designed a printed circuit board so it could be well implemented as a commerical product prototype.
plastic base
sillicon ring
The enclosure of UMA-P had metallic painted plastic as the main body and frosted acrylic to form a transparent light atmosphere. Also sillicon rings were made to fix the prototype on the bike handles.
ZUOZI
Feedback of Postures for Shoulder Pain Treatment with Wearable
ACM17 ACM Pervasive Conference Full Paper
BEHAVIOR CHANGE WITH WEARABLE sensors
Sitting Posture and Shoulder Pain
Smart Vest
r rfo reas rm e ta like rg lin et es be s ha vio
The research is based on B.J. Fogg’s model of behavior change. By trying to give motivation, action and trigger to the user we would like to see the user to have a better sitting posture.
trigger
to
pe
inc
Behavior Model
low
motivation
high
The occurrence of shoulder pain can be related to improper sitting posture and limited exercise for the shoulder joint; it may already afflict people during early adulthood. As such, correcting inappropriate sitting posture is part of musculoskeletal shoulder rehabilitation programs.
low
ability
high
ZISHI integrates smart textiles and wearable electronics for detecting postures. When the system works three sets of data were collected to tell the angle of torso and shoulder of the user. Users could read the data and correct their posture with the guidance on the application.
bluetooth
EXPLORATION ON FEEDBACK STRATEGY Userability Test 17 participants, students and staff with ages 18 to 30 were invited to a usability test that focused on how able they were to learn to use it first time. Overall the system was rated positively.The question “I would imagine that most people would learn to use this system very quickly” was rated the highest. It meant that users thought the system was easy to learn. The question with lowest score is “I need to learn a lot of things before I could get going with this system”. The result showed that the effort of minimizing the learning cost was successful.
Feedback Strategy Optic fibre was the first idea of giving tangible feedback on the vest however it was abandoned due to the high learning cost. The haptic feedback on the vest is built on the vibrator near the shoulder. To improve the user experience a threshold delay of 10 seconds for error indication was introduced. The duration of the vibration was set to three seconds. This meant that if the posture was wrong for longer than 10 seconds vibration would be performed. Also it would just vibrate once before the user would sit in the correct posture again.
Subtle Vibration
Instant Feedback
Motional Exercise Guidance
Insights Gained
From this first user test it was noted how users mentioned effort or as they called it the ‘energy’ that they spend every day in order to change or maintain desirable behaviors in their daily lives. They would not be prepared to put much effort into adapting to a new system. Rather than fascinating and engaging feedback, subtle unobtrusive and even minimalist feedback would be more preferred. Last, every effort that minimizes the learning cost for users counts for higher acceptance.
Summary Feedback Error!
30
20
10
09:00
09:30
10:00
10:30
11:00
11:30
12:00
12:30
FINAL SYSTEM DESIGN
Haptic Feedback If the user is in a wrong posture the system will start calculating the error duration. If the duration is longer than 10 seconds the application will send a signal for vibration to the vest with Bluetooth.
Visual Feedback The application ZUOZI provides instant feedback for the posture angel and self-exercise guidance. If the user is in a correct posture the ring will be in green with the words “Keep on!” If the user is in a wrong posture the ring will become red with the words telling “Sit straight!”. The self-exercise tutorial instructs users how to perform shoulder training exercises independently. If the user does the certain shoulder exercise correctly the black circle is expected to fall into the correct range.
Experiment Design It was a baseline-treatment-withdrawal design. The first 2 hours participants were not allowed to look at the application. No vibration would be triggered either. The next 4 hours participants could check the application for their performance. Also if they were sitting in an incorrect posture longer than 10 seconds vibration would be triggered. Finally 2 hours Participants were not allowed to look at the application and no haptic feedback was provided.
2 hour
4 hour
2 hour
DATA ANALYSIS AND CONCLUSION 40%
Quantitative
30%
The average occurrences of poor posture of the baseline stage is 24.91%, of the treatment stage is 17.40%, and of the withdrawal stage is 33.24%. A large drop was observed in the average of occurrences of poor posture in the treatment stage. Then it rose higher in the withdrawal stage.
20%
10%
Baseline
Treatment
Withdrawal
0% 1 hr
2 hr
baseline
3 hr
4 hr
5 hr
treatment
6 hr
7 hr
8 hr
withdrawal
positive feeling
Qualitative For those who reported positive feeling during the treatment stage, they claimed that the vibration brought them quite nice feeling. They felt like they were doing something to improve their postures.
negative feeling
Conclusion The wearable system for posture monitoring and correction has been evaluated positively for usability, which provided sufficient encouragement to try it out in a single day field experiment. As a field trial the study was successful showing that the system could be worn, and could track posture and provide feedback to its users.
TPSurgery Surgery Assist System with Gesture Control Global Grad Show in Dubai Design Week Silver A’ Design Award Innovation for Health Exhibition 2016 HCI Interational 2017 Conference Poster
WHY IN SURGERY Problem in Surgery During surgery a lot of information is in need. Information needs to be displayed in a proper way. A tangible screen or button needs sterilization in the surgery room. It’s not possible for doctor to take off the glove for controlling. Thus we need gesture control for a more hygienic and convenient control. Also when the surgery light needs adjusting it's more convenient to control by gestures. By adding a tangible user interface in addition to graphical user interface, we developed a new method of providing feed forwards and feedbacks within the gesture control system.
?
Control the Information System TPSurgery is an interactive surgery assist system that helps showing information of patient, such as BPM, blood pressure and VOCs with non-touch control.
With TPSurgery
Adjust the Surgery Light When surgeons need to change the surgery light, they can adjust it in 3 dimensions with gestures with the indications of both graphical user interface and tangible user interface.
HOW IT WORK
pinch and move to control or zoom
just yaw to recover to start point
Detection Range
warning when out of sensor detection
PROTOTYPING
First Prototype The first prototype consisted arduino, LED pixels and Leap Motion in a wood box. The software is programmed with Processing.
New Prototype The new prototype used only one usb 3.0 cable for everything in the circuit. Also the interface are redesigned for better visual feedback.
MAKING SENSE OF SENSING SYSTEM Mirror-Perception-Cognition-Action Model for promoting the performance of complex sensing system
Action
Cognition
HUMAN
PHYSICAL WORLD
Control
Perception
PHYSICAL WORLD
SYSTEM
-1
1
5 3
-1 -1 0 0 2 0 -1 2 1
3
1 -1
Model
Display
Hugsy Connecting Mother and Premature Babies Best of Dutch Design Week 2016 Finalist of Industrial Design Excellence Award 2016 Global Grad Show in Dubai Design Week A’ Design Award Innovation for Health Exhibition 2016
SEPERATION OF PARENTS AND PRETERM INFANTS
Kangaroo Care and Difficulties When a mother spends time with her newborn, her baby is laid onto her chest, soothed by the sound of her heartbeat and the familiar smell of her skin. This special bonding moment between a parent and child is known as kangaroo care. Strengthening the connection between a mother and baby leads to healthier and happier babies, who are ready to come home sooner. Unfortunately, it is not always possible for parents to be in the hospital with their little one. There is a time when mom needs to leave, the baby needs to go back into the incubator, and again, they are separated.
Neonatal Intensive Care Unit For babies born too early, our world is a dangerous place. From the protected and nurturing environment of their mother’s womb, they are suddenly exposed to a world they have not yet grown ready for. The basic needs of premature babies are warmth and nutrition, to grow to a stage where they can leave the hospital. But they also need the comforting presence of their mother. A vital element for a baby’s developing brain.
COMFORTING AND CARE FOR BABIES What Makes Baby Feel Comfortable? Within smell, aromatherapy using sweet or familiar smells was identified as important for the newborn for bonding, healthy development and healing, and pain and stress management. Low frequency, patterned and biologically familiar sounds, particularly mother’s heartbeat and voice are also crucial for the three main beneficial areas of Kangaroo Mother Care as mentioned above. Touch can encompass a variety of areas involving pain, temperature, pressure, texture, positioning and more - all of which can potentially play an important role in bonding and healthy development & healing.
smell from mother
maternal heartbeat
feeling of support
Prototyping Our main focus was on covering three proven beneficial stimuli: Sound, smell and touch (feedback from kicking). These three stimuli translated in physical triggers: positioning, facilitating the heartbeat and aromatherapy. From the beginning we took into consideration the parents feelings - watching their newborn child with all these different tubes and medical devices - probably not as fluffy and soft as they think their baby should be. To give them an adorable feeling we introduced the soft fabric, the shape of an animal and fluffy ears. During the iteration process the shape gradually transformed from a mattress into a swaddling blanket. A swaddling blanket facilitating and stimulating KMC inside the incubator as well as outside the incubator.
FINAL PRODUCT Multifunctional Blanket facilitates and simulates Kangaroo Care
Hugsy the Blanket
hoody wire fixing loops heartbeat actuator
positioning pillow
positioning pillow heartbeat sensor
positioning pillow
hugsy heartbeat module
Hugsy is a swaddling blanket that is made for neonatal intensive care units that simulates and facilitates kangaroo care. The Hugsy blanket facilitates kangaroo care by reducing the stress experienced by babies during transfers to and from the incubator for kangaroo care sessions. This reduces stress for babies by maintaining body temperature, and making the transfer easier for nurses by securing the wires in the Hugsy. The Hugsy also aids in holding the baby in place on mother’s chest during a kangaroo care session for more comfort. Positioning bags help properly position the baby to bring comfort to the baby’s mind and body. Finally the mother’s heartbeat is recorded during kangaroo caresessions, and her scent is absorbed into the hugsy fabric. When the baby is back in the incubator with the hugsy, the mother’s heartbeat is played back to the baby, while he can feel comforted by his mother’s scent.
HOW TO USE
Transfer the Baby to the Mother
Position the Baby Inside the Incubator
Heartbeat Recorded and Maternal Smell Absorbed
The Baby Feels the Heartbeat and the Smell Again
DESIGN IMPACT Global Impact
The Hugsy was invited to design exhibitions all around the world in 2016 such as Dutch Design Week in Eindhoven, the Netherlands and Global Grad Show in Dubai. It was higly praised by the Queen Máxima of the Netherlands. Also it was reported by a few press such as the Guardian. The Hugsy also got the Best of Dutch Design Week 2016. Only 16 projects out of 430 had the honor.
Clinical Test
The Hugsy is now going through the clinical test in Máxima Medisch Centrum, Veldhoven, the Netherlands. Approximately 20 preterm infants will go through a test procedure ‘using heartbeat module of Hugsy - not using heartbeat module of Hugsy’. Up till now the test goes well and parents really love the product.
A High Tech Startup The Hugsy has been accepted by the accelerometer Hight Tech XL in Eindhoven, the Netherlands to build a start up for helping more premature babies and their parents around the world.
HygeineL Indoor Environment Quality Monitoring System Bronze A’ Design Award 2 patents in application
FOR CLEANER INDOOR ENVIRONMENT
bad indoor environment quality
Brief Introduction People spend 90% of their time indoor. However, the indoor air can be much more polluted than the outdoor. This will lead to sick-building syndrome, which includes asthma and other respiratory diseases. In daily administration we need a better way of showing the overall hygiene level.So we designed HygieneL system which contains the hardware and software part. We design this shell-like sensor node for deploying. This circuit system is able to detect VOCs, CO2, RH and temperature which can be analysis in the server.Based on java we make a visualization program system for the administrator to monitor the hygiene level of the whole building.
detect and send data
IEQ of different rooms revealed
Research For developing a combination of sensors to detect bacteria inside a room, we first tried to find bacteria sensor directly. Soon we knew that the only method of detecting bacteria indoor is sampling which costs a lot of time. So we made another attempt of detecting organic gas generated by bacteria. But all related papers are about herd feeding and harmful gas monitoring. We had to try sensors by ourselves. After applying SVM method we successfully drew out a set of sensors to detect bacteria effectively. Then we applied these set of sensors in HygieneL. We did data collection and data training in SUTD campus.
proper cleaning is done
cleaner indoor environment
VISI
Vihecle Information System with Multi-sense Feedback 2015 National Challenge Cup 2nd Prize of Zhejiang Province 1 patent approved
Car from left behind!
EASIER DRIVING WITH MULTIPLE INPUTS voice prompt new display
vibration
intensive visual input in driving
Brief Introduction Traditional information transmission is based on visual senses. However, vision expression has its drawbacks when it comes to in-car interactions. Drivers should not spare too much attention for visual information while driving, such as looking at the dashboard to know whether they are speeding. VISI , a multiple sense driving indication system, helps drivers have a better "communication" with their cars. VISI is based on both vision and tactile so as to vary the way of human-vehicle interaction and change traditional driving experience.
fatigue driving leads to accident
multi-sense feedback for traffic
User Test 10 participants were asked to drive for 30 min on a driving simulator. We recorded their driving behaviours by two camera from both front and back and quantified their behaviours afterwards. The same 10 participants drove for another 30 min for controlled test. This time we added the touching instruction module so drivers would know when there was a car approaching from left-behind or right-behind. Also we would give vibration hints when there were obstacle ahead or when the car was overspeed. Moreover, we did eye tracking experiment for validity check of our vision instruction system on HUD.
eaiser driving with VISI
Hiccup
InteractiveToy Box for Helping Kids Collecting Toys A’ Design Award 1 patent in application
BEHAVIOR CHANGE FOR TOY COLLECTION
hiccup
kids love leaving around toys
Brief Introduction Children like playing toys. However, they don't like collecting them. Thus parents often find their kids leaving toys everywhere in the room. We wanted to change children's collecting behaviour through design. When the kid put a toy into Hiccup, Hiccuo will react immediately with blinking and the sounds of hiccup. By the evening, a small flower will appear from Hiccup’s head, which is actually a projector lamp. Once the user put enough toys into Hiccup, the flower will grow into a higher level,from a seedling to a blooming flower, it will take 7 days to completely grow up.
Hiccup helps them collect
it hiccups when toys are put in
flower grows if toys are collected
behavior change is achieved
User Research
We first focused on how to combine the idea of 'growth' and 'good behaviour'. Through talks with parents and obseravtions we knew that children were intersted in instant feedback interaction. However, they would soon be bored. We wanted children have some growth in long term. Then we came up with the idea of projection light. What if the projection itself would grow? We got inspiration of traditional revolving shadow lights in China. The projection would change everyday if children collected toys correctly. Thus everyday they would see a new, growing projection. This would continuously give them new feeling of their collection behaviour. With this way children could change their collection behaviour day by day.
C-tranf C-tranf
Transfusion Chair Solution for Chinese Hospital
Transfusion Chair Solution for Chinese Hospital 2014 ChinaChair ChairDesign Design Award 2014 Bronze Bronze China Award
IMPROVING PATIENT EXPERIENCE
Brief Introduction Demand for medical care is increasing in China. However, the medical care environment is absolutlely bad in China. Part of this is the transfusion environment. Chinese transfusefor billions of times each year, but we still can’t sit in a suitable chair while transfusing. Due to ergonomic data we design C-tranf & Lazy, brand new transfusion chairs. The amazing apperance distinguish themselves from traditional transfusion chair. The cover on the top near the ears can greatly reduce noise and cross infection. More comfort, less bearing.
Insights from Field Study We could improve these through designing new transfusion chair and mechanical assistance. We got the insight that we should design different sizes for different ages, including consideration for the ratio of head and body and legs as well as the thickness of cushion. The design should be easy for cleaning and help patients to do more when they have just one hand. Meanwhile It should provide a quieter space for the patients. Meanwhile aerial infection protection should be exterminated.
Pervasive Health 2017 Conference, ZUOZI Barcelona, Spain
Dutch Design Week, Hugsy Eindhoven, the Netherlands
Global Grad Show, Hugsy and TPSurgery Dubai, United Arab Emirates
Nova APEC Innovation, HygieneL Shenzhen, China
show the read me world my vision
You are Hired TV Show Beijing, China
Excellent Graduation Design for G20, UMA-P Hangzhou, China
contact me jiachun_du@foxmail.com dupig.me +86 18868110080