Portable and low-cost device designed for dementia recovery
App designed for non-local students in Hong Kong to find suitable storage services
Portable device via Bluetooth connection designed for preventing sports injury among cricket bowlers
4
31-33
13-22
2
3
23-30
03-12
1
Other works include PCB soldering work and travel or daily vlogs
03
Internship Project Team Work: XU Jingzhi / ZHOU Guanglei Personal Contribution: Software design and coding, hardware circuit design Handance is a portable and low-cost device combined a hand-gesture recognition glove with a music game. Using a rhythm game to guide the elderly with dementia to accomplish some tasks and using the glove to recognize and identify whether the elderly is doing the right things or not. Meanwhile, we added some functions to let the elderly to cooperate with each other. We hope that those elderlies can use Handance to exercise their fingers along with brains and recover.
—Dementia is a tough problem human-being now facing
Social
46 million people
Sex Distribution
are suffering dementia worldwide. This number will increase to 132
million by 2050
Female 47%
10%
In Hong Kong, 10% of the elderlies
aged above 65 get dementia
Problems I found from research
01
76
Male 53%
There are only 76 rehabilitation centers all over Hong Kong.
Limited Resources There are limited rehabilitation centers for the elderlies with dementia in Hong Kong
02 Distance Many elderlies have to travel a long distance to the nearest rehabilitation center
05
Policy
Surveys (70 samples)
Question
How do you go to rehabilitation center How long would it Take you from home to the center H ow often do you go to the center
Prevalence of Dementia in different areas (percentage) 30.1
Travel Time
HongKong
24.8
Europe 19.7 12.2 12.8 5.9 3.6 3.4 3.3 2 0.90.8 1.51.7
North America
9.2 8.1 6 6.5
03
⚫ ⚫
04
Convenience
Price
Most devices for rehabilitation are made of several components
Current mobile devices designed for recover purpose are not affordable for most families
Less than 10 mins(14.29%) ⚫ 10-30mins(42.86%) ⚫
30-50mins(35.71%) More than 50mins(7.14%)
Frequency (per week)
17 ◼ ◼ ◼ ◼
26
24
Travel Method
3
Less than 2 times 2 – 4 times 4 – 6 times Everyday
◼ ◼ ◼ ◼
Shuttle bus (center) Drops off by family Public Transportation Walk
WONG Slight dementia
Interview (8 samples)
1) How do you feel during everyday trip to rehabilitation centers? 2) How do think about rehabilitation activities?
Demographics
Behaviors
Age: 65 Situation:
• • •
Lives alone communication
Goals Pain:
• • •
Expectations:
• •
boring tired lonely
interesting Remote done at home
06
Persona
Pain Points
07
Brainstorm
Inspiration
Stick
Inspired by the hand exercise game in MLC, we got the idea to develop a game for Primary Dementia Elderly. The game which played in MLC is a hand switch game. The OT will ask the elderly to first show “2” on their left hand and “5” in right hand, then switch.
Glove Kinect Watch Wearable
Music
Holdable EMG-sensors
Beat
Hardware
Rhythm
Low-cost Sensors
Low-cost Clear Instructions
Device
DIY
Portable
Software
Game
Small-size
Command
Succinct
Observations
Music Game
Great difficulty
Lack of interaction
Switch gesture
Effective exercise
Observations indicate that this exercise can be changed into a game with slow speed and some easy gestures and interaction which will help them train themselves in their daily life.
Tatsujin
Switch Gesture
Interaction
08
Sketches
4.3cm
Idea Iteration
6.5cm 4.6cm
1.6cm
4.3cm
1.6cm
1cm
Final Idea
1cm 7.8cm
09
Concept Key Words
Glove
Succinct
Interaction
Hardware : A glove and Two 3D-printed boxes
Components
Flex Sensor Total 3 sensors sewed inside the glove. In index finger middle finger, ring finger
Music Game
Sensor
Flex Sensor
Software : A music game based on PC Sprite The target users of Handance are mainly the elderly .The whole game interface should be succinct and easy to follow So, the background is set as draft papers, which are clear enough for players. We also chose some cute patterns to make the game lovelier and more relaxing
Bluetooth Module – BT05 Insert on Arduino Nano and transmit data collected from flex sensors transmitted to PC
Arduino Nano
Infrared Sensor
Data collected from flex sensors transmitted to here
To support interaction mode by identifying hand moving direction
Music
Easy Breeze Old Thread
We choose 2 relaxing and dynamic songs. And their rhythms are easy to recognize and easy to follow, which makes them suitable for Handance
10
Hardware Prototype
01
02
03
04
05
06
Process 1. Hardware prototyping 2. Bluetooth connection 3. 3D-printing
4. Software prototyping 5. Testing 6. Final model
11
Software Prototype
Step 1
Choose which music to play
Step 2
Choose mode (Easy or Medium)
02
01
Step 3
Go to Tutorial mode and learn basic operations
Step 4
03
04
Follow the rhythm. And pose the displayed gesture in the upper lane. The lower lane is for someone who plays the game along with the player. He/she should wave arms upwards or to the right as arrow shows
Step 5
05
Finish the game. Check your score before finishes on the top left corner. And choose to start again or quit in this interface
Exhibition
• The story of Handance
Video Link:
12
Video
HK InnoCarnival 2018 @ HKSTP 2018.11.3-11.11
https://youtu.be/UBariL1NRtc
Awards •
TEDY 2018- Best Prototype
•
Best of the best awards 2018 - Best Business Idea
TEDY x WOW @ City University of Hong Kong 2019.1.1-1.24
13 Internship Project Team Work: Sports Technology Institute, Loughborough University Personal Contribution: App UI design and coding, Hardware design Cricket is a famous sports among many countries. Pocket coach aims at providing real-time inspection on Euler-angles of lateral flexion during cricket bowling ,and it enables the coach to keep track of cricket bowlers’ data during training and competitions in case of further sports injuries.
14
15
Main Reason for cricket injury
40%
Injuries in cricket results from fast bowling
Main types of injury
General injury type • Lower limb injuries • Back and trunk injuries • Others
Detailed injury type • Spondylolysis • Spondylolisthesis • Pars Interarticularis • Others
16% Bowlers missed 16% of their playing time due to potential injury
5% Other players missed less than 5%
Reference 1. Johnson, M., et al., Lumbar vertebral stress injuries in fast bowlers: A review of prevalence and risk factors, Physical Therapy in Sport (2011), doi:10.1016/j.ptsp.2011.01.002
16 mixed action
Unobtrusive Devices front-on to the batter
89%
shoulders face
89% of players diagnosed with a bony stress injury bowled with a mixed action.
Mobile App
Hardware
Markerless Camera
I Measure U Sensor
Vicon
•
•
•
•
•
•
•
•
High Complexity Low Battery Endurance Limited Remote Measurement Capabilities
Developing Goals
18 Block Diagram
“Real-time”
“Unobtrusive”
Hardware Prototype
11cm
Software
Pocket Coach
History Activity Display
Three Dimension Data
20 Start Page
Home Page
Graph
Statistics
22
23
Personal Project Individual Work Due to limited bed places and crowded living condition. Non-local students have to pack their stuff and store them every year. But they find it difficult to contact storage services due to language barrier and many other factors. EasyBox aims at offering help to nonlocal students in Hong Kong to find suitable company. It also provides service such as comparing price.
Me too! I have lots of things to store this year as well. But the company I chose last year did not provide good service. My stuff got moldy after 3 months. So I don’t know what to do this year
There are over
non-local students in Hong Kong
Hum Hong
Jackson, Year 3
Susan, Year 3
Semester break is coming! I have to move to another room for next academic year! But I have so many stuff, I don’t know which storage company I should choose this year
Kowloon Tong
HKU
） Number of boxes needed
Due to limited bed place in student residence of most Hong Kong Universities, students are required to change dormitory on a year basis. Bringing all stuff back to home is impossible for most nonlocal students. For things like quilt, pillows, clothes and shoes, they are of great possibility to be used in next academic year. In this case, many nonlocal students have to find storage company in Hong Kong to store this kind of stuff
•
1 box
12%
•
2 boxes
30%
•
3 boxes
25%
•
4 boxes
13.5%
•
5 boxes
5.5%
•
5+ boxes
11%
Ways to contact storage companies
•
Online advertisement
•
Other’s recommendation
•
Advertisement on campus
•
Others
• individually •
comparison
supports
3.17
Average 3.17 boxes needed per person to store their stuff.
25
（
26
Provide comparison
Clear display of all details
Succinct information page
Start Page
Sign Up
Home Page
Box Page
Box Type
Swipe to view different storage companies View Box details Add to Cart
Log In
Home Page
Box Detail Page
Search Page
Cart Page
Box Detail Page Number of boxes ordered
Cart Page
Storage Period
Check box details
Search key words
Check items in cart
View results in details
Proceed to payment
Box Detail Page
Payment Page
Payment Page
Check basic information and edit if necessary (addresses, name and phone number)
Profile Page
Edit Profile History Orders Addresses
Check history orders information
Add addresses and set default address
Credit cards(Payment Method)
Change card information
Succinctness /səkˈsɪŋkt.nəs/
Clear Details, Less Confuse
Easy Edit, Easy Buy
27
Company
After Log in Start Page
Sign Up
Search
After Log in
Box
After Log in
Box Details
Cart
29
Profile
Addresses
Proceed to pay
Payment Method
History Orders
History Order Details
30
31 I enjoy cooking, video editing and reading history books when I am free. My major is electrical engineering, so soldering and PCB design are my necessary lab skills. In this part, I will present one of my lab training project and several daily or travel vlogs.
32 Product of engineering training course. The PCB layout is drawn by me and the music player is soldered by me. It supports USB connection, Bluetooth connection and radio signal receiving
Main Box
Speakers
33 I love recording small pieces of videos and editing them afterwards. There are 6 vlogs I made showing my travelling and daily life. https://www.youtube.com/channel/UCd0H-J4FtIVYjp7H2zn0EQw?view_as=subscriber
Vlog 02
Vlog 01
The trip to Helsinki
One day in Stockholm
Vlog 04 Stunning scenes in Switzerland
Vlog 03
Vlog 05
Spending one week in Germany
Vlog 06 My December, 2018
February, 2019
XU Jingzhi