PORTFOLIO. DANHONG ZHU
01
02
03
04
BreaThink A Breath-Visualisation Installation
Echo Mater An Echolocation Assisted Training Device
That’s My Girl! A Serious Game for ASD Adolescent Females
EzyPark Automatic Parking System Design
INTRODUCTION
BreaThink
A Breath-Visualisation Installation
Based on research conducted over the years, breathwork therapy have shown to promote both psychological and physical benefits.This interactive installation integrated art therapy and gesture recognition into breathwork to enhance users' ability to resonate with their own breathing.The target users encompass a wide range, from professional practitioners of breath meditation to amateur enthusiasts of breathwork therapy, with no age restrictions.
Breathwork Therapy
Breathwork(slow breathing/breath-control/conscious breathing)enhances mental, physical, and spiritual well-being through deliberate breathing pattern adjustments, promoting relaxation and increased energy.
Mechanisms of Action
The core belief in breathwork is that deliberate alterations in breathing can directly influence the autonomic nervous system,respiratory system,cardiovascular,cardiopulmonary. Activate the parasympathetic nervous system (PNS) associated with the rest-and-digest, calm response. Deactivate the sympathetic nervous system (SNS) responsible for the fight-orflight reaction. Minimise work done by the heart.
personal project
DATE 2023 Sep-Nov
Increase efficiency of gas exchange in the lungs.
Enhance diaphragmatic excursion. Enhance ventilatory efficiency and arterial oxygenation.
Art Therapy
Art therapy, as a non-pharmacological medical complementary that uses art media as its primary mode of communication, has been used as one of medical interventions with good clinical effects on mental disorders.
The underlying concepts are that in expressive arts therapies, people gain new perspectives on their emotions and thoughts, and that artistic expression is good for mental health. We become more self-aware. Our main goal is self expression.
Increase HRV and blood pressure fluctuation.
We get better at coping in the future.
Improve blood oxygen and lower blood pressure.
We become more psychologically resilient.
Increased neural connectivity in the area of the brain that deals with introspection,memory,and self-monitoring We have increased positive perspectives. Our brain are very dynamic when engaged in producing art.
Application Areas enhance mood and reduce physiological arousa asthm respiratory and circulatory disease PTSD
breathwork therapy
stress management Depression Disorders and Anxiety Alzheimer’s Disease Cognitive Impairment, and Dementia Autism spectrum disorder
Schizophreni strengthen emotional expression strengthen self-esteem, self-awarenes sequela of cerebral palsy (CP)
art therapy
The application areas of breathwork therapy and art therapy have many aspects overlaped which makes the integration of these two therapies possible.
History
Pranayama first introduced to the West
--1800s pranayam
Alternate Nostril Breathin abdominal breathin forceful breathin vocalised (chanting) breathing
1950s
Breath control for the purpose of restoring or enhancing health has been practiced in Eastern cultures for thousands of years.
The Buteyko method It was originally developed by physiologist Konstantin Buteyko in Russia, then part of the Soviet Union.
Experiments
1
Reflections for improvement
2
In 2001, at the University of Pavia, Italy, the experiment asked 20+ test subjects to pray two prayers using slow breathing of 6s exhalation and inhalation: the Buddhist True Word and the Latin Chant of the Virgin Mary. Results showed fostering overall bodily harmony, with the heart, circulatory, and nervous systems operating efficiently. Returning to normal breathing led to a gradual loss of harmony.
A
Buteyko began treating patients with respiratory and circulatory diseases using breathing retraining
participant in an experiment
NY professors Patricia Gilbarger and Richard Brown use resonant breathing to treat anxiety and depression. Starting with 3s inhalation and exhalation, gradually increase to 5.5 breaths/min for 5-10 mins daily. This method aided 9/11 survivors with lung issues, reducing coughing and chest pains within two months through daily slow breathing. It's efficient, adaptable, private.
Mindful art therapy--draw your breath
ntroduction to the experiment
I
This experiment had two phases.
01 we went about our daily routine with our nasal passages closed. We ate, exercised, slept, and did everything as normal except for simply breathing through our mouths.
02 we still ate, exercised, and slept as normal as in the first phase, but our breathing passages were switched to our noses, and we had to practice a series of breathing techniques every day.
Breathing in Tai Chi
In martial arts: exhale when gathering, inhale when releasing energy For form: exhale when opening, inhale when closing For body: exhale when descending, inhale when ascending For forward: exhale when advancing, inhale when retreating.
esult
R
its popularity rose
1960 s
1990s
Symptom snoring
nders Olsen
A
Buteyko has made its way across several continents
Types of breathwork exercise
There are various types of methods,videos,classes you can find online to regulate your breathing. Box, or Square, Breathing 4-7-8 Breathin Three-Part Breat Bellows Breath
Stockholm, Sweden
NOWADAYS
RESERCH
Phase1
49 Breath Therapist
Phase2
a successful breathwork
snored half the night never happened
pause for breath 53
CO2 level in exhaled breath
times a night 5%
never happened
cholesterol
126
mmHg
heart rate
oxygen saturation
around
75beats/min
Consistently
at 97 %
around
raised up to 25% 119 mmHg
dropped by 5 % 65beats/min in 1min
Based on the reviewed studie, “autonomically optimised respiration” would appear to be in the band of 6–10 breaths per min, with an increased tidal volume that is achieved by diaphragmatic activation. breathing through your nose (to inhale oxygen efficiently diaphragmatically (expanding the belly to reach deep lung areas during inhalation rhythmically (not too deep nor too shallow with open posture (optimizing ear-to-shoulder space or converging shoulder blades)
Breathing with conductor’s gestures Singers favor abdominal breathing with gesture B, while pros link gesture A to costal breathing.Notably, singers interpret these two preparatory gestures differently, even though they are considered equivalent and should trigger inhalation.
gesture+breath
estures are very effective in influencing and guiding people's breathing behaviour since can be seen as a movement of our bodies.”The ego uses its experience of breathing as a bridge to move safely in and out of the body.” G
IDEATION
DESIGN INSIGHT breathwork therapy+art therapy Visualise the breathing process and reinforce its visual guidance. breathwork+gesture Enhance the perception of autonomous attunement. breathwork+digital visual art Reduce the cost of art therapy and the stress involved in creating art.
the position of breathing ball
a circle of one breath
Mind Map situated in the palm of one's hand
at the mid-point of two palms
inhale process
the breathing ball will change its size and shape by following upward or downward tendency of gesture the breathing ball will change its coordinate by following user’s hand position
using gestures of hand-up and hand-down to guide user’s breathing process
what’s on screen
Sketches interaction while breathing with others
1
2
3
exhale process
ccoommbibinneethese these two twosscche hemmes es
one breathing ball for per person that represents one’s breathing statement in real time
Particles representing air in space
using vision sensors like kinect or leap motion to recognize gestures,then map the statement to corresponding visual feedback
DEVELOPMENT
TESTING
Structure
Tool
Hand movements to guide breathing rhythm
Hand tracking&Software processing
Screen feedback affecting breathing behaviour
Processing Development Progress 1 Defining visual art sketches in Processing through coding noisecircle
circle motion effect
Interactive visual effects
Development Environment:
PDE Hardware Sensor:
LeapMotion Programming Language:
JAVA
In the initial state，the breathing bubble is changing its shape randomly under the control of the noise function, being surrounded by floating moving slowly particles
2 Using LeapMotion API to get hand data from hardware sensors
As the hand rises, the breathing bubble draws in the surrounding particles and grows larger. As the hand drops, it releases particles and becomes smaller.
particle system
particle motion effect
3 Programming based on gesture interaction effects
By monitoring the hand position in real time through the leapmotion, the breathing bubble will change its position by following the hand up and down, left and right movements.
FINAL OUTCOME
FEEDBACK The teacher provided some feedback on the technique improvement. Meanwhile the rest of the group provided information on how they felt when working with the slow breathing pattern, which had a positive effect on breathing adjustments.
I projected the visual art onto a multimedia projector and invited one hardware teacher and some students to experience this breath-visualisation installation.Then I received some feedback from them.
The experience divided into two parts.
Technology
“ “
There is a delay in the projected image compared to the computer image.
” ”
The shape of the main body is not varied enough, and perhaps the noise function needs to be adjusted.
Feeling
are not told that they need to work with the 01 Initialy,Users breathing method and just use it freely.
“ “
the user was asked to feel the breath in relation to the 02 Secondly, gesture and the picture, to experience the rhythm of it.
When I realised that my gestures were guiding my breathing, I unconsciously slowed my breathing to the rhythm of the screen.
”
After knowing to add slow breathing, I can relax myself through this device.
Future Development
”
multi-user mode I d like to add an interactive effect of multiple breathing bubbles moving at the same time in the future, in order to achieve people communicating with others through breathing.
’
improvement in visual art
1
There is still a lot of room for improvement in visual art, such as more conducive to decompression and more vivid kinetic effects; smaller delays.
2
INTRODUCTION It shows that approximately 2.85 billion people live with some forms of vision impairment
2,850,000,000 39,000,000
globally of which 39 million are totally blind.
Echo Master
VISION IMPAIRMENT totally blind
The statistics from the World Health
An Echolocation Assisted Training Device
Organisation WHO) (
Vision impairment poses an enormous global financial burdenon those affected, their
Through research, it has been found that echo location significantly enhances the subjective
Assistive
Device for Blind People
B W
hite
(Since
(S
C e
S
B k
ince 96 )
raille
loc
1
5
4
3
diagnoses, and treatment, with the annual global cost of productivity estimated to be
mart (
an
World War Ⅱ)
caregivers, and society, particularly with regard to medical expenses from hospitalization,
initiative and mobility of visually impaired individuals in their daily outdoor activities.It has
S
Assistive technologies can assist visually impaired people with obstacle detection, visualization, navigation, and recognition in a real-world scenario.Depending on the device, the user could perceive either sound or vibration, or both of these sensations.
(
C e
6
an
Present
)
US$ 411 billion.
the potential to greatly develop the auditory senses of visually impaired individuals.The
411,000,000,000
design of this device aims to assist in active echo location training for the blind, while also
reducing costs related to facilities, professional personnel, and tools, thus improving the convenience of training.
er
(Since
Navigation of Blind People personal project
F
)
7
1
g
H
oopl
e
)
(Since 1990
World War Ⅰ)
H
e
uman Assistanc
(Since the dawn of mankind)
Being blind does not mean losing the independence of getting to and from places whenever we wanted. They can travel independently daily with personalized means.
DATE 2023 Sep-Nov
ice Do
ered can
5
2 S v
w e
Present- uture
olar po
one of the biggest challenges to independence for people who are visually impaired is
Assistive technology focuses on external aids rather than developing the potential of the visually impaired person's own senses other than vision, and lacks a certain degree of proactivity.
associated with safe and efficient navigation.
ll
There are different other cha enges which are usual in navigation.
A Blind
Navigation Case Daniel Kish, President of World Access for the Blind, who lost his eyes before 13 months v vocal click-based echolocation, known as "flash sonar." He hails the palate click as ideal for echolocation, generating a unique frequency in a short burst, allowing experts to discern object contours over a range from feet to yards. K ish, blind yet adept at echolocation, engages in activities like mountain biking and tactile-free object identification. due to eye cancer, de eloped
pit in front of the path
hanging obstacles
traffic junctions
stairs
what is echolocation?
wet floor indoors
signposts on the pavement
How it works for blind persons?
greased or slippery outdoor paths
Bineeth Kuriakose, Raju Shrestha & Frode Eika Sandnes (2022) Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review, IETE Technical Review, 39:1, 3-18, DOI: 10.1080/02564602.2020.1819893
2.Maisha Mashiata, Tasmia Ali, Prangon Das, Zinat Tasneem, Md. Faisal Rahman Badal, Subrata Kumar Sarker, Md. Mehedi Hasan, Sarafat Hussain Abhi, Md. Robiul Islam, Md. Firoj Ali, Md. Hafiz Ahamed, Md. Manirul Islam, Sajal Kumar Das,
: A review on current status and future prospects,Biosensors and Bioelectronics: X,Volume 12, 2022, 100265, ISSN 2590-1370, https://doi.org/10.1016/j.biosx.2022.100265.
Towards assisting visually impaired individuals
INTERVIEW
RESEARCH
Basic information about the interviewee
Animal Echolocation
Human Echolocation
Bats and dolphins are well known for their ability to use
Human echolocation is the ability of humans to detect objects and their characteristics through sound
echolocation. They emit bursts of sounds and listen to the
waves reflected off these objects. It is similar to the echolocation used by some animals like bats and
Benefits:
got fever that led to hydrocephalus and subsequent optic nerve injury during childhoo
a learnable skill that can be
echoes that bounce back to perceive their environment.
dolphins to navigate and locate prey.
not totally blind, with a little bit vision and light-sensitive
acquired by human,about
female blind masseu
20-30% of the blind learn
For example, bats use echolocation when they're hunting. You can call it a "feeding buzz," and it works like this: When a bat detects an insect it wants to eat, it produces a rapid
1
Soun
echolocation at some point in
d Emission
series of calls to pin-point the exact location of its prey, the
The illustration shows a mouth-
swoops in, and GULP! - dinner.
click waveform which larger
their lives Three months after training, blind participants reported also reporting enhanced well-
sound.It shows that the sound
amplitude
(FM chirp)
being and independence in
more intense in front of the
daily life
echolocator than at the side or
What's bother you most in daily travel
not strongly limited by age or
back,resembling the distribution broadband:
What is the daily mode of travel?
“
Usually don't use a cane, and for me guide dogs are hard to own. Usually if say someone can see a little they will take another.
“
the level of vision
of a flashlight beam.
timing of rehabilitative
1 ms
interventions for children and click
young people with vision loss.
Are your senses
[1] https://www.webmd.com/eye-health/how-blind-
sharper than the
people-can-use-echolocation
[2]https://doi.org/10.36866/pn.126.20
bat
echolocation
2
Soun
”
“Yes, for example, cars bursting through when crossing a zebra crossing.” “The most troublesome things in life are the things that come out of nowhere, and the trouble of stepping out of the air acci entall . There are potholes and heights, and if you step out of the way, sometimes you can dream of that kind of shadow, and you feel insecure. When I first came out of the society, I was afraid to walk on the stairs but frozen there”
d
y
“Like we do things we just have to check things over and over again more than normal, it's more detailed, but it's slow.”
may have applications for the
Hz
20-105 k
”
Like when we take the metro,the highspeed rail or the train, there will be staff to take, he has to register, I feel that this society is warm.
improved mobility, with 83%
waves indicate more intense transmitted sound
Q&A
average person's?
“Hearing, is what they call echo, when there is no obstacle in front of you will be very smooth. But mainly afraid of sudden, smooth will be better.” (Did a little experiment in the middle，put my hands around her and it did point out where the hands were.) “My sense of touch is also stronger. For example, I can feel the difference between my usual dishes and touching household items.”
d Reflection
Sound waves then bounce off
objects in the environment and return an echo which is different due to varying materials and
3
amplitude
echo
Perception
Areas highlighted in warm colours show an increase in brain activity when the “Visual”
time
Brain area
person listened to echolocation sounds. The expert showed a relative increase in the primary “visual” cortex.
distances.
rely on human
be afraid of
usually have
than on assistive
unexpected
stronger sense of
devices
situations
listening
IDEATION
DESIGN PROCESS
Analysis
System Map
pain points It is more difficult for visually impaired people to cope with unexpected situations such as speeding vehicles even with the use of current assistive devices such as walking sticks.
Tongue click
actile Input Device
irtual sound maze
on screen visual feedback
Recording and feedback of results
imulate life scenes more realistically and set difficulty levels.
recording results
with braille confirmation
↑↓-select ←-return →-enter
review mode
handheld
keypad
arrow
menu
mode select
←→-pan left-right ↑↓-forward/backward
Obstacle size judgement
training mode
alate Click
P
training mode
User’s click sound is a positive signal for the device.
FUNCTIONAL PROTOTYPE Unit Experiment
To construct a sound spatial experience, such as a virtual sound maze, for the visually impaired, a plan is underway to implement a directional sound emitter. principle
correct rate response time comparison with previous 3D radar chart Obstacle orientation judgement
Ambient Sound S
task tips accuracy feedback feedback of review mode
basic composition
imulate various terrain conditions for different training modes. V
for blind audio feedback
Emit echoes directionally
wearable
device
S
T
cycle unit
feedback
Calculate the required echo
Concept Touch facilitates the operation of the visually impaired.
User receive and react
Receive sound signals
design aim A kit to assist visually impaired people in echolocation training for unexpected situations. kit features orientation discriminatio distance recognitio design requirements reaction speed trainin interference settin Rapid respond trainin tactile inpu Active echolocatio audio and visual output Interactive interface for blind
Sketches
Face the right way
(confirmation) Compare multi-object
(confirmation)
basic training Obstacle distance judgement
Move to required distance
(↑↓)
Static maze
Find the exit
(↑↓←→)
synthesis training
Dynamic dodgeball
Dodge required number of balls
(↑↓←→)
Development
According to the schematic diagram, I conducted the circuit connection and soldering. Using a 12V external power supply, I utilized the L298N driver module to drive and provide a 5V logic power supply. In the end, successful verification on the oscilloscope confirmed the waveform adjustment to 40kHz, and the speaker achieved directional sound waves, with sound audible only from the front and not from other directions.
schematic With a 5V regulator for the logic parts.
1 The circuit construction and soldering process.
2 The validation and testing process.
It's fed into an amplifier to drive the speaker array.
The higher the frequency,the more focused the beam is. live audio playback and exported the audio, the results indicate that, except for directly in front, the volume at 3 Recorded other angles is nearly approaching 0dB. The audio comes in here with a simple high-pass filter to get rid of DC offset. It's powerd by a 12V power supply for the speaker. The big issue if we need to utilise this principle in sound is that the frenquencies needed to get sound focused are actually in the ultra sound range.But we can encode audible sounds by modulating them with an ultrasound carrier wave which is same as how FM radio works.
Modulating a 40kHz square wave by a standard 555 timer.
Now that the core directional sound emitting device has been successfully developed, the next step is to integrate it into a product.
RENDERING
WEARABLE PROTOTYPE
Primary
Multi-view
development
wearable device
Ring-shaped player Used to play echoes from objects at different directions,
distances, and materials, simulating realistic echo effects.
Head-worn While fixing the device on the user's head, it integrates modules
assistive screen
such as the catapult receiver and sound signal processing.
Terminal Used for receiving sound signals,
processing them, and calculating and confirming corresponding echoes for users.
Details
handheld keypad
USAGE
1
Cindy is a visually impaired individual Echolocation training was her weekly routine.
5
FEEDBACK
Due to a lack of channels to connect with visually impaired individuals, I invited some sighted individuals to try out the prototype of this device by closing their eyes. I received some feedback from them.
They generally felt that by listening to the clicks they emitted and the echoes they received, they could perceive differences in direction and variations in distance and size. However, they noted significant discrepancies compared to real-life echoes, with more distortions, possibly due to frequency modulation.
Simultaneously, for sighted individuals, the novelty of recognizing direction by listening to echoes was quite intriguing. This is because they actively emit sounds, unlike the typical scenario in daily life where they passively rely on sound cues for orientation.
2
Cindy found her training kit.
During the training,Cindy did the click and listened the echo the device reflected carefully.According to the echo,she moved herself by the keypad so that she can get out of the virtual sound maze set up by the system.
3
6
Cindy put the device on her head and started it.
After the training,the device reported her performance for this session.
4
7
She chose the static maze mode to increase difficulty by keypad.
Due to echolocation training, Cindy can recognize obstacles more quickly and effectively when she is out.
Future Improvement
“
However, perhaps due to the high frequency of the echo, it sounds a bit uncomfortable.
“
I click, then listen very carefully, and notice the echo coming from the left, as if there's something on my left. I subconsciously my head.
” ”
It’s be supposed to improve the quality of the echo, making it closer to real-life scenarios.
It would be ideal to obtain feedback from visually impaired individuals, as it would be more beneficial for the development of this device.
INTRODUCTION Background
Autism is a developmental disorder marked by mental function deficits like social interaction, communication issues, narrow interests, and repetitive behavior. It also involves the ability to hyper-focus on details. The dilemma being suffered by ASD females often-cited male-to-female autism ratio of 4:
Reasons
ender Bias in ASD Diagnosis: Gender disparities in ASD criteria, and stereotypes linked to male prevalence ASC Gender Differences: en - e ternali ing issues (ADHD, behavior), Women - internali ing issues (an iety, depression), posing diagnostic challenges Camouflaging in Women: Women with ASD more likely to spontaneously camouflage, challenging parental detection. Conditions and Risks Associated with ASD Female Camouflaging: Can fool parents but not peers, especially same-age women (SAW) vulnerable to childhood isolation and bullying due to differences Communication Challenges: Difficulty with neurotypicals, reading body language, and grasping others' words. Camouflage and lack of ASD diagnosis, especially in women, lead to deception, bad relationships, and vulnerability to abuse hausting Pretense: A ta ing task for most ASD individuals, endured since childhood. hey seek understanding, tolerance, and care from neurotypicals Late Diagnosis Impact: Delayed diagnosis in women with ASD leads to internali ed issues, co-occurring disorders, and a feedback loop e acerbating depression and an iety. G
M
1
cCrossin s (2 22) mathematical pro ections, which take into consideration diagnostic bias, suggest the true male-to-female ratio is :4 ’
M
0
j
3
80
%
Ex
autistic girls remaining undiagnosed by the age of . 18
Developmental Trajectories of ASD Females Toddlerhood (2–5 Years)
Infancy (0–24 Months) Females with
autism e hibit superior language skills but e perience more prominent motor delays than males with autism. x
A Serious Game for ASD Adolescent Females
Currently, one in four diagnosed males is diagnosed with Asperger's or autism in females.However,Intervention treatments focused on helping adolescent females with ASD adapt to the physical and social changes that come with growing up are still somewhat lacking. his pro ect produced a serious game that teaches about hair care and menstrual care to address the developmental needs of ASD females. T
x
j
SC: Females with autism reach early language milestones (first words and phrases) earlier than diagnosed males RRBs: females with autism e hibit more gender-typical play interests (e.g.dolls, animals) and engage in different parent-reported behaviors (e.g. less 'non-functional' play, more collecting), possibly leading to undiagnosed of their RRBs at this age.
x
z
z
x
T
z
x
x
Childhood and Adolescence (6–17 Years)
x
x
Adulthood (18 + Years)
SC:Women with autism often have difficulty with steady obs and are more likely than men to choose not to work. hey also tend to live with their children instead of their families, which suggests differences in adult social e periences and relationships between males and females with autism RRBs: he behaviours diminish with age.
SC: Autistic females play similarly to RRBs:Females with ASD non-autistic peers - closer pro imity, have different interests more talking, vivid gestures, and face than males. hey often engagement, revealing a female prefer social topics, like camouflage effect people and animals, while Co-occurring Conditions: In some focus on collecting adolescence, autistic females share 'random' items. Some girls typical female trends - higher risks of with ASD are really into an iety, depression, sleep problems, music or numbers, eating disorders, and suicide compared according to their parents. to males.
j
x
T
T
x
x
T
DA :2 2 ay-Aug
personal pro ect TE
0
3 M j
*SC=Social Communication RRBs=restricted interests/repetitive behaviors
cFayden, T.C., Putnam, O., Grzadzinski, R. et al. Sex Differences in the Developmental Trajectories of Autism Spectrum Disorder. Curr Dev Disord Rep 10, 80–91 (2023). https://doi.org/10.1007/s40474-023-00270-y
oung H, Oreve MJ, Speranza M. Clinical characteristics and problems diagnosing autism spectrum disorder in girls. Arch Pediatr. 2018 Aug;25(6):399-403. doi: 10.1016/j.arcped.2018.06.008. Epub 2018 Aug 22. PMID: 30143373.
[1]M [2]Y
disorder, a treatment program should begin immediately. Evidence over the last 15 years indicates that intensive early intervention for at least 2 years during the preschool years results in improved outcomes in most young children with autism. This is because the brain is most able to change when young.
Characteristics of Intervention on ASD
Change in severity by nonverbal I and treatment history Q
imitation
.
.5
0
T
T
0
.4
0
Percent Change in Severity
Comprehensive Course
o reatment Any reatment N
0
communication
.
0 30
.2
0
activity
0
.
0 00
-
<70
70 89
N
-
90 110
onverbal I score
>110
Q
Gamification
Refers to the use of game elements in a non-game conte t. In the case of autism interventions, a software (etc.) may not be considered a game as a whole, but integrates e.g. levels 2 (typical game elements) in therapeutic e ercises with the aim of increasing en oyment and motivation x
[1
x
3]
·Sensitivity ·Sensitivitytotodevelopmental developmentalsequences;
sequences;
·supported, evidence-based instructional ·supported, evidence-based instructional strategies strategies(eg, (eg,ABA);
ABA);
·behavioral strategies ·behavioral strategiestotoreduce reducedisruptive disruptive behavior;
behavior;
·parental ·parentalinvolvement;
involvement;
·gradual transition ·gradual transitiontotoaamore morenatural naturalenvironment;
environment;
·Well-trained staff;
·Well-trained staff;
·Supervision ·Supervisionand andreview reviewmechanism;
mechanism;
·Intensive treatment activities ·Intensive treatment activities(25 (25hours/week hours/weekfor for atatleast 2 years);
least 2 years);
·Best ·Beststarted startedatat22toto44years yearsold. old.
adaptation
Examples of Intervention Program
.
0 10
j
game
language
Play Therapy & Serious Game
Cognitive Behavioral Therapy(CBT) Applied Behavioral Analysis(ABA)
EXAMPLE the “A-B-Cs” –Antecedent, Behavior, Consequence CBT focuses on the connection between thoughts, Antecedent: The teacher says “It’s time to clean up your toys” at day's end feelings, and behaviors.
Behavior: The student yells “no! Research shows that this therapy helps people with Consequence: The teacher removes the toys and says “Okay, toys are all some types of ASD deal with anxiety. It can also help done.”
some people with autism cope with social situations How could ABA help the student learn a more appropriate behavior in this and better recognize emotions. situation Antecedent: The teacher says “time to clean up” at the end of the day Behavior: The student is reminded to ask, “Can I have 5 more minutes? Consequence: The teacher says, “Of course you can have 5 more minutes!”
Play therapy helps children with autism to engage in play activities of their interest, express themselves in comfortable ways, and change their self-expression from unwanted behavior to more non-injurious expressive behavior. There are different forms of play therapy,such as Clown therapy、Integrated play groups、Art-play therapy、Tele-play therapy,in which serious game is what this project focus to.
Stages of play therapy Stage
Pre-therapy family and child interview and assessment 0:
;
→
Once a child has been diagnosed with an autism spectrum
Improvement
LITERATURE REVIEW
Stage 1 The first part in blue is the :
exploratory or Initiation stage, followed by testing for protection part in pink (
4
3
);
0
pressing needs Consolidating the goals 2 and achievements
1
Ex
Building the trust
Stage 2 Resistance phase, negative :
reaction, or aggressive stage
Stage 3 The growing or work phase :
ime line
Withdrawal of support
T
Stage 4 The termination phase.
;
:
;
The technological basis of serious games and the way they work: Visualisation:
Improving motional Recognitio Role modellin Scene creation E
Limitations: Game variety: Challenges in designing games for autism kids with SPD to enhance imagination and teach first aid with little research on RRBs
Virtual proxy:
Emerging technology: nhanced causal understandin Improve resilience and social skill ouch interaction technolog Incarnation technolog Collaborative Virtual nvironment Wearable technology and motion capture technology E
T
E
Intervention Effectiveness: Gameplay: Challenges in applying learned social ost studies prioriti e therapeutic skills in daily life. Often, pre- and ob ectives, overlooking game post-treatment assessments focus accessibility and en oyment. on specific skills addressed. M
z
j
j
GAME THEORY
There five core principles of serious game design which have
CONCEPT
been successfully employed in health and education domains.
This includes primary end-goals (game completion) and short
goals for challenges and progress tracking. Medium-term goals may involve story-driven objectives or earning enough points to complete a level. Feedback and Rewards Shape Learning Serious games, unlike entertainment games, prioritize feedback on long-term goals and boost intrinsic motivation for learning by updating players on their progress toward primary and incremental learning goals.
Increasing Levels of Difficulty and Individuation Serious games should strike a balance, not being too difficult to frustrate players or too easy to hinder skill development. Personalizing game-based training may include individualized starting points and gradually increasing difficulty as new skills are mastered.
Provision of Choice
hair care(6-12)
Setting the background of the storyline in daily life scenes can reduce the strangeness of ASD females and help them directly
Integrated narratives boost enjoyment, immersion, and motivation for goal learning. Stories help individuals engage with content in meaningful ways.
task list
GAME NAME
//life scene
Storylines Enhance Motivation and Contextualize Learning
Goals Direct Learning Around Targeted Skills
GAME FLOW game selection menu appears
apply the skills and knowledge learned in serious games to real life.
user selects theme & tasks
game starts
//flow
the use of immediate and appropriate feedback in a gamebased learning experience, can lead to the state of total immersion and engagement, defined as flow.This is crucial in designing SG for individuals with ASD to reduce boredom and distraction. Achieving flow involves using audio-visual feedback and rewards.
//audio-visual feedback
Considering the sensitivity of children with ASD, the feedback needs to avoid being too stimulating and violent. Reduce negative
task appears user provides an answer yes
correct answer?
positive feedback
no correction feedback
feedback and increase positive feedback.
no
last task? yes
//tutor
Set up a tutor character who will accompany the player throughout the game. This increases the ASD girls' sense of security and companionship, so that they can devote more energy to their
game ends
studies and less to distractions of adaptation.
back
Providing choices is crucial for fostering intrinsic motivation
and enjoyment in serious games, enabling learners to retain autonomy and control over their learning experience.
GAME DEVELOPMENT AI Application
Using AI software to generate background images to enrich the game interface
site by https://skybox.blockadelabs.com/
Low-Fidelity Wireframe prompt
Home
beautiful scenery of blue sky and white clouds in a pink vibe
Menu a cute little girl's bedroom
Main
Body
a cute wathet toilet with a dressing table
back/reapeat
part1 My hair Using a social story to teach user the reasons of “why I have to take care of my hair everyday” and the benefits in social life and physical health of having a well hair care. part2 How to take care of my hair Including 6 steps(each step has its details tasks):
(a)Shampooing
(b)Conditioning (optional)
(c)Detangling
(d)Drying
(e)Styling
(f)Regular Trims
repeat
period hygiene skills (12-17)
part1 My period Using a social story to teach user the reasons of “why I have a period when I grow up” and the necessities of taking good care of period. part2 How to take care of my period Including 11 steps:
(a) grasp “dirty” pad
(b) remove “dirty pad”
(c) fold in half and wrap “dirty pad”
(d) place pad in trash receptacle
(e) pick up clean pad
(f) take pad out of package
(g) grasp strip on back of pad
(h) remove strip
(i ) place clean pad on underpants
(j) pull up underpants
(k) wash hands.
FEATURES
The settings interface can be customised to set the user name, background volume, voice volume and language to suit the individual needs of autism girls.
SETTING PAGE MENU HOME PAGE A simple and kid-friendly main interface of the serious game, so that the target user(ASD adolescent females) can easily "start the game", "settings" and other operations.
Divided into two themes to suit the age of the user——My Hair,My Period.
Every theme is decomposed into several small tasks desperately including three main parts:Teaching of small tasks that have been broken down; teaching of the whole process;additional teaching such as social stories and daily management.
TASK PAGE Specific task teaching interfaces, that have other types in addition to display pages. The main distribution is the answer section, todolist, background music switch key. There is sound and screen feedback during the gameplay.
EzyPark
Automatic Parking System Design
To address the increasing number of private cars in China and the growing demand for parking spaces, along with the severe shortage of parking spaces, the design of this Intelligent Parking System aims to enhance the interactive interface and system management. It is intended to help people easily and safely navigate the entire parking process, from finding a parking space to retrieving their vehicle. Recognizing the widespread adoption of autonomous driving technology as a future trend, the system incorporates automatic parking, significantly reducing the difficulty and time involved in parking.
personal project
DATE 2023 Nov-Dec
INTRODUCTION
RESERCH
The Dilemma in China
Background
For cities with a planned population exceeding 500,000 people, the total supply of parking spaces should be controlled between 1.1 to 1.3 times the number of motor vehicles in possession.
A parking lot refers to a facility designated for parking vehicles. The primary purpose of a parking lot is to provide a space for parking vehicles and collect parking fees.
However, the current ratio of motor vehicle ownership to
In the past in China, parking in parking lots required manual payment, and in some shopping malls, one even had to go to the service center for payment. Sometimes, there was a need to queue for exit, resulting in high time costs. Now, with the investment in technology, these issues have been greatly improved. However, there are still some pain points.
: P
Current situation
The demand for urban parking spaces is directly correlated with the number of motor vehicles. According to data from the Ministry of Public Security, as of the end of September 2023, the total number of motor vehicles in the country reached 430 million, including 330 million automobiles and 18.21 million new energy vehicles. There are 520 million motor vehicle drivers, including 480 million automobile drivers.
China's car ownership (100 million units) 3.02
3 2.6
3.3
2.81
2.4
2.5 1.95
2 1.5 1
0.5
3.19
0.5
0.57
0.65
0.76
0.91
1.06
1.2
1.4
1.54
parking spaces in Chinese cities is much smaller than the ratio.
2.17
1.75
:
1：1.1
1：0.8
supposed ratio
normal Chinese cities
2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023
1：0.5
medium-sized cities
W What hatccaauuses sesChina China's's severe shortage severe shortageofofcar car parking space supply parking space supply??
Some reasons
Outdated Urban Planning
and Construction
Land Constraints
Uneven Parking Space Distribution
Poor Parking Space Management
Existing Solution Case
Vertical Circulating Stereo Parking Garage in SHENZHEN
Mobile Appointment Garage Identification
Pulling into a parking space Confirmation of Completion Real-time Monitoring Mobile phone bill payment
0
:
Scan QR code & Pick-up
BENEFITS
Significantly increase space utilisation Can accommodate more vehicles Save the time of searching for a parking space Surveillance and security systems to secure the parking area
LIMITATIONS
High construction and maintenance costs Restriction on vehicle type Restriction on vehicle size User experience during vehicle access Higher energy consumption
RESEARCH
Parking behavior task analysis a parking space 1 Find Users need to find available parking spaces, which may involve searching
Driver's Top Concerns View of car park 62%
Car park availability
46%
Walking distance to final destination
After arriving at the parking lot, users need to exit their vehicles. The parking system scans the license plate and sends a parking confirmation notification to the user. The user confirms the parking via a terminal or mobile phone, allowing the vehicle to be released and avoiding conflicts.
for a suitable location within a car park or on a city street.
2
Select a parking space
Once an available parking space is found, the user needs to decide whether or not to choose that space, with considerations that may include location, cost, security, etc.
⑥Self-parking Intelligent Car Park The intelligent parking lot is designed in a vertical form to save space and offers various types of parking spaces to meet different needs. For example, mechanical-assisted spaces are provided for regular vehicles, and charging station spaces are designated for electric vehicles. Simultaneously, an internal interconnected network system and monitoring system are established to facilitate the daily management and maintenance of the parking facility.
a parking space 3 EThenter user needs to drive the vehicle safely into the chosen parking space,
37%
Vehicle Security
SYSTEM DESIGN ② Enter the parking lot
which may require precise vehicle control and adjustment.
for car parking 4 PIf ay the car park needs to be paid for, the user will need to pay accordingly. at home
office location
shopping
pick up kids at school
leisure
Search habits for parking information
Willing to pay for services for in-car parking data Willing the access to parking information via apps or in-car navigation systems Desire for dynamic parking information Have used a mobile phone or car navigation to find a parking space
>40 %
Users may use mobile phone apps or other means to record where they parked their car so that it can be easily located later.
① Find a parking space
⑦ Pick up the car and leave
location, start the vehicle, and safely exit the parking space.
77%
82%
95%
Concept
Vehicles will exit their parking spaces in advance based on the reserved time. The vehicle can only leave the parking facility after the user confirms the retrieval through the terminal.
Users can use mobile applications to locate nearby parking lots and available parking spaces, gather detailed parking information, and make advance reservations for parking spots.
Motor vehicle
Service targets: mainly electric self-driving vehicles, transitioning some conventional vehicles Feedback before, during and after the car enters the automatic parking state Feedback to: drivers, front and rear vehicles
Parking Payments Now and Demand of participants have activated parking fast payments
Record the parking position
up the car and leave 6 PAtick the end of the parking time, the user will need to return to the vehicle
65%
40%
5
86%
86%) were positive
Most of them( about this feature
75% Guaranteed availability of car parking spaces 74% Saving time 55% Reliable service Factors driving car owners to use parking reservation services
Parking lot
Functional transition: with or without automatic parkin Vertical circulating spatial distributio Supporting facilities: payment, management, monitorin Types of parking spaces: general, members, charging piles etc.
Users
Mobile terminal: recommended car parks, parking space information, reservation of parking spaces, dynamic information when parking, monitoring of vehicle conditions, car pick-up appointments, paymen Car park terminal: user completes drop-off confirmation; transition - selects parking space, pays, picks up car;
③ Enter a parking space After autonomous vehicles follow the reserved route and park in the designated space, users will receive detailed information such as parking time and route to confirm the safe parking of the vehicle. Regular vehicles are assisted in parking by mechanical devices.
④ Monitor the car park situation ⑤ Pay for car parking Users can check the real-time status of their vehicles in the parking facility through the software to ensure their safety and reduce potential disputes. The management can also use the monitoring system to identify and address malfunctions, ensuring the smooth daily operation of the parking facility.
Users can complete parking fee payments and schedule pick-up times on their smartphones, avoiding peak times and saving time during vehicle retrieval.
EXPERIMENT In order to better understand the relationship between automatic parking and parking lot construction in autonomous
driving, I designed and conducted experiments on the automatic obstacle avoidance and precise positioning technology of a microcontroller-based smart car. The aim is to enhance the technical aspects of the parking system design for the parking lot.
Keys
T
I
Core Board
Microcontroller
Display Digital Tube
keystroke reduction
Buzzer
Setting ositioning Distance P
Two buttons standing for , can reset the value of positioning distance. “+” ”-”
LED Display
During operating
I
no
ultrasonic distance measurement module distance=avg of 3 dist measurements
imer Display
T
Display the operating time on the rightmost 3 digit display.
ADC readout of photosensitive sensor modules
internal timing interrupt is in charge of timing
positioning distance setting module
Before running
-bit digital tubes display
Soft are Design dea w
OUTCOME
DC Motor
Internal Timing Interrupt
Ultrasonic Sensor
iming nterrupt
Main
--8
System Block Diagram Photosensitive Sensor
CODE
-
nter ange
E
<20
yes smart car start shift module;
start timer "distance" reach target range yes stop operation; stop the timer
Upon reaching the positioning distance, cease movement, and initiate a blinking display of the travel time.
Confirm "distance" 3 times in a row
Light
yes
"distance" reach target range no no
. cm
<0 5
?
yes sound & light alarm module activate;
backward
R
no
all modules stop
ositioning
P
--dynamic scanning --audio-visual alarm
move forward
void bstacles
A
DC data processing --positioning distance setting module --A
--motor shift module -- udgement mechanism j
O
Manually change the obstacle distance; the car autonomously moves to ad ust to the positioning distance. j
M control
--PW