Youtube Link
https://youtu.be/Mw2_bmulPj8
SERVICE DESIGN RESEARCH: USING SOUND INTERACTION TO REDUCE SCREEN DEPENDENCY AMONG USERS 2020.03-2020.06 Sound Yoga combines the elements of sound interaction and yoga, aiming to achieve light physical movement through auditory guidance, reduce screen usage before bedtime, and alleviate mental and physical stress. Through Sound Yoga, users can engage in gentle physical movement, meditation, and relaxation without relying on screens. This provides a healthier and calmer option for bedtime preparation by integrating sound interaction with mental and physical well-being, offering a positive impact for individuals.
Individual Project Supervisors
Shuxin Cheng, Congliang Li, Lian Dai
01 BACKGROUND
02 PROBLEM DISCOVERY Environment
Causes of insomnia
3
1
shift work Screen addiction
blue light screen Social media
3,100,100,100
jet lag drug side effects
social media pressure
Psychology
62%
stream media
sleeping pills
alcohol
7/15
caffeine
Physiology sleep disorder
don’t relax
2
Adult
Population
high pressure
Disease
pregnant About 62% of adults worldwide do not get enough sleep.
About 3,100,000,000 people in the world lack sleep.
Seven of the 15 leading causes of death are related to insomnia.
Pressure
Individual
Conclusion There are many reasons for insufficient sleep, from the perspective of information input, screen addiction is a significant influencing factor.
03 PERSONA
04 USER JOURNEY MAP 7:00 PM
Yudi Wang 27 years old
Designer at Tencent
8:00 PM
Stages
Arrive home
Actions
Transportation
9:00 PM
10:00 PM
11:00 PM
12:00 AM
1:00 AM
Before sleep
2:00 AM
3:00 AM
4:00 AM
Insomnia
Dinner
Work
Exercise
Sleep
Phone
Social media
Stream media
Insomnia
Moderate exercise
Attempt to sleep
Surf the internet
Check social media
Browse streaming media
Gradually fall asleep
Fall asleep as soon as possible
Reduce browsing
Reduce socializing
Reduce browsing Go to bed early
Activities Feelings Happy
Introduction Yudi Wang is a 27-year- old individual working at Tencent. Due to the high-intensity nature of her job, she often experiences insomnia.
Motivation
Confusion
She hopes to reduce her insomnia by decreasing her screen usage.
Unhappy
Sad
Experience
Complex commuting
Convenient fast food
Computer office work
Expectation
Comfortable commuting
Delicious food
Reduce workload Increase physical activity
She can’t fall asleep and ends up looking at screens.
Expectation She hopes to reduce her screen usage by engaging other senses.
Opportunities
Weaknesses
Weaknesses
Weaknesses
Weaknesses
Commute comfort
High-intensity work and ordinary life.
Frequent screen usage, browsing various media.
Endless recommendations from streaming media can easily lead to screen addiction.
05 SOUND INTERACTION
06 INTERACTIVE SYSTEM 1
Screen addiction
hearing
Lack sleep
decompress
Step 1
Hardware
Preset action
3d sound feedback
Speaker
3d sound guidance
3d sound guidance
motion capture
motion capture Infra-red projector
2
Sound A
Step 2
Sound A
Sound B
Sound B Infrared camera
1
Sound
2 Sound
Sound interaction
Follow sound signal
Sound direction
Exercise
Moderate exercise 3
Sound interactions reduce screen usage and alleviate both physical and mental stress.
Moderate exercise can relax both the body and mind. Yoga
Step 3
3d sound feedback
1
audiovisual
left / right
2
volume
up / down
3
reverb
far / close
Conclusion The hardware system uses speakers to provide sound feedback and an infrared projector to capture motion for sound interaction.
07 PRODUCT DESIGN
08 HARDWARE SYSTEM
Sound system
1
Motivation
Depth sensor
Rear Sound
IR Camera
2
Side Sound
Ergonomic
Hardware Using a hardware system to capture motion and provide sound feedback.
Sound Yoga is an intelligent hardware and sof t ware plat form based on three - dimensional sound- guided movements.
IR Projector Center Sound
2
The goal of Sound Yoga is to use auditory guidance for light exercise, thereby reducing pre-sleep screen usage and alleviating pre-sleep mental and physical stress.
1
Clip-on
Motion capture
3
Sound feedback
Infrared camera
Sound Input
Speaker
2
Infra-red projector
Speaker
Lower jaw A
Sub Sound
Insomnia
Front Sound 3
7.1 surround sound
Sound
1
Gentle sound
Sound A
Sound A
B Yoga motion
Sound B
Sleep
Sound interaction To alleviate insomnia, gentle sounds are used to assist in falling asleep quickly. Users are guided through movement using stereophonic sound A, and upon reaching the correct position, it triggers the appropriate sound B.
3
Conclusion Sound B
Motion direction is guided and feedback is provided t h r o u g h s o un d i ma g i n g, volume, and reverberation.
09 EXPERIMENT
01
10 PROGRAMMING
02
1
03
C# Script
2
Unity
3
Application
The application, based on the integration of Unity and Oculus, allows the import of Unity programs into Oculus to achieve three-dimensional interaction.
Simulation Sound
Experiment in Bed
Action Record
Way_Point Left_Hand_Guide
Q: How to simulate sound?
Q: Why experiment while in bed?
Right_Hand_Guide
Q: How to record trajectories? Left hand
A: Simulating stereo sound using two mobile phones.
A: Creating a pre-sleep yoga routine tailored for high-stress single women.
A: Using time-lapse photography to capture light trails.
Q: How to provide feedback?
Q: How is the experience?
Q: Can it alleviate stress?
A: Using harmonizing tracks for feedback.
A: Resting the eyes to prepare for sleep.
A: Imagining brings a special sensation, stabilizing emotions.
Conclusion
It can relax the body and mind, but the sound clarity is lower.
Conclusion
Guided by feedback sounds, pleasing the senses.
Conclusion
Relieving the anxiety and discomfort of not exercising throughout the day.
Sound A
Right hand
Sound B
Using the Oculus left and right hand controllers, you can record the movement trajectories of the left and right hands.
Set sound position
Conclusion
Creating a 3D spatial audio trajectory using Unity’s waypoints. Setting relevant sound trajectories based on the reach of the left and right hands.
Implementing three-dimensional sound interaction through Unity and capturing motion trajectories using Oculus for providing feedback.
11 USER INTERACTION
12 USER EXPERIENCE
Sound interaction Users can edit soundtracks to achieve three-dimensional sound interaction.
1
Sound
Choose music Users can freely choose sounds and instruments to distribute across different audio tracks.
Select music
Select motion track
2
Excersice
Choose action Users can select the specific body parts they want to exercise.
Select action
Follow the movement
The audio tracks can change the s o un d d ire c t i o n ba s e d o n t h e relevant exercise route, allowing for targeted workout of different body parts.