GRADUATION PROJECT VISUAL COMMUNICATION (MASTER OF DESIGN)
Vol. 1 of 1
Project Title:
Mobile application design for learning sign language Name:
Rohan Vyas ( UA1719043 ) Project Mentor:
Rahul Bhattacharya
2019
The Graduation Project Evaluation Jury recommends ROHAN VYAS from Visual Communication for the Master’s Graduation Degree of Unitedworld Institute of Design, Karnavati University, Gandhinagar, India herewith, for the project titled Sign Language. The project is c omplete in every aspect in accordance to the guidelines set by the institution.
Chairperson
Members
Signature
Name
Organization
Signature
Name
Organization
Signature
Name
Organization
Signature
Name
Organization
*Subsequent remarks regarding fulfilling the requirements
Rohan Vyas | Graduation Project 2019
COPYRIGHT Š 2019
Student document publication, meant for private circulation only. All rights reserved. No part of this document will be reproduced or transmitted in any form or by any means including photocopying, xerography, photography and videography recording without written permission from the publisher, Rohan Vyas and Unitedworld Institute of Design. All Illustrations and photographs in this document are Copyright Š 2018 by respective people and organizations. Written and designed by Rohan Vyas, under the guidance of Rahul Bhattacharya. Printed digitally in Chaap, Ahmedabad December, 2019.
4
Mobile application for sign language
ORIGINALITY STATEMENT
COPYRIGHT STATEMENT
I hereby declare that this submission is my own work and it contains no full or substantial copy of previously published material, or it does not even contain substantial proportions of material which have been accepted for the award of any other degree or diploma of any other educational institution, except where due acknowledgment is made in this degree project. Moreover I also declare that none of the concepts are borrowed or copied without due acknowledgment. I further declare that the intellectual content of this degree project is the product of my own work, except to the extent that assistance from others in the project’s design and conception or in style, presentation and linguistic expression is acknowledged. This degree project (or part of it) was not and will not be submitted as assessed work in any other academic course.
I hereby grant the Unitedworld Institute of Design the right to archive and to make available my degree project/thesis/dissertation in whole or in part in the Institutes’s Knowledge Management Centre in all forms of media, now or hereafter known, subject to the provisions of the Copyright Act. I have neither used any substantial portions of copyright material in any document nor have I obtained permission to use copyright material. Student Name in Full: Date:
Student Name in Full: Signature: Date:
5
Rohan Vyas | Graduation Project 2019
6
Mobile application for sign language
Mobile application design for learning
Sign Language
7
Rohan Vyas | Graduation Project 2019
INDEX
01.
02.
INTRODUCTION
RESEARCH
About UID About Mentor About Me Timeline Proposal
8
14 18 19 20 21
Pre research Primary research Secondry research
24 34 48
Mobile application for sign language
03.
04.
ANALYSIS & SYNTHESIS Problem analysis Gamification Problem synthesis Concepts
05.
REDEFINED BRIEF 58 61 78 82
Defining the user UX design Visual design
DESIGN 94 113 126
User flows Mockup Epilogue
152 158 168
9
Rohan Vyas | Graduation Project 2019
Acknowledgement This project marks the end of my journey in Master’s in Designing. And I want to take a moment to express my gratitude towards everyone who have made it possible for me to come this far. Being an engineering student it was difficult for me to change my stream and start again. It was only possible because of the support from my parents. It was the belief of my mother and father that gave me strength in difficult times and strengthened my belief in myself. A special thanks to Snigdha ma’am, Sudhanya ma’am and Sambit sir for always being there. For teaching me about art, writing and life. And helped me become a gentler and a truer person. I extend my gratitude towards my mentor, Mr Rahul Bhattacharya for his valuable inputs and time-to-time feedbacks. I thank Ms Lolita Dutta , Head of Department, Visual Communication, Unitedworld Institute of Design and my other
10
faculty members for providing valuable feedback during the project. Their contribution has been effective in all respects of the projects. I want to that the Deaf mute school in Ahmedabad and the Deaf enabled foundation to let me research with them and providing me with the necessary help for the project development. And finally, the great friends who have been there throught this journey, who have seen the highs and lows together. Satyam, Nandita, Snehal, Padmaja, B11 people, to name a few. This journey would not have been memorable without you.
Mobile application for sign language
Why this project Purpose of design education is to develop sensitivity amonst students. And the design curriculam in UID is made in such a way so we learn to see the issues faced by people around us and also to provide solutions to the problems. One such issue I saw my friend facing is inablity to connect with other people. My friend, Arpit Gupta, is dignosed with deficiency in hearing and speaking in an early age. He uses hearing aid and was trained by vocal trainers so that he can communicate effectively. But even after all the measures, I see him facing the issue of social connectivity. And that inspired me for taking this project and designing my graduation project. An Ideal society should be one which accepts everyone and is ready to change/ learn in order to mae the people comfortable. So with this project I aim to research and learn about deaf people and their culture. And look for a way to reduce the gap between the society and the people
11
Rohan Vyas | Graduation Project 2019
“Design is a not for philosophy it’s for life ” ~Issey Miyake
12
Mobile application for sign language
01
INTRODUCTION About UID About Mentor About Me Timeline Proposal
14 18 19 20 21
Unitedworld Institute of Design
13
Rohan Vyas | Graduation Project 2019
About UID Unitedworld Institute of Design is one of the premier design institutes of India. It was found in 2012 as a constituent college of Karnavati University. It has been built on a strong foundation of teaching, learning, innovation and research excellence in design education. UID aims to create globally sought - after professionals who can exibit their creativity and trigger novel trends. It offers a diverse range of UG & PG courses through various departments; Visual Communication (Graphic design), Animation and Motion Graphics, Fashion Design, Lifestyle and Accessory Design, Textile Design, Interior Design, Industrial Design and Automobile and Transportation Design.
14
Mobile application for sign language
15
Rohan Vyas | Graduation Project 2019
16
Mobile application for sign language
About the batch Post graduate batch of Visual communication 2017-2019 is more than a classroom. The experiences, initiatives and the conflicts have seen both highs and lows amongst this group of people. Coming from such diverse work and education background brought a unique taste to this mixture. We were more than just sixteen people studying together, we were sixteen different minds and hearts working in harmony to create a memorable journey. This space is not enough to describe the amount of talent the class holds. Although coming from such different walks of life we all bonded so well that all the hardships and challenges felt like fun activity. The best modules were the ones which we faced as groups. Everyone with their saperate skillsets and interests completed everything.
I feel extremely grateful to have an opportunity to learn from everyone. Product designers, fine artist, contemporary artists, engineers, to meantion a few. Developing skills from sketching then foundation for design, every part of process would not have been possible without the ever ready support from the dear classmates. Making magzines, directing plays, creating packaging, researching food and may other group activities, with these people will always be the best part of my experience in the design journey.
17
Rohan Vyas | Graduation Project 2019
About mentor Rahul Bhattacharya is an educationist, art historian and a curator; currently Associate Professor at the Department of Visual Communication. He has been pursuing independent writing, curating exhibitions, art education spaces and large scale public art projects. Over the last 15 years, he has been associated in teaching in various capacities in institutions such as GNLU, NIIFT, MS University of Baroda, Pearl Academy, WUD amongst others. He has also been designing communications for events, exhibitions, and artworks as well as consulting private collections. He was the Managing Editor of Art&Deal Magazine and the founding Conveyor MATI. Co founder of ‘Regional Arts .Performance and Events’ Since 2014 he is a part of the NINE Schools of Art collective working towards developing workshop based teaching methods for art. He has written extensively various journals and publication. He maintains his blog http:// theblackyellowarrow.blogspot.in/.
18
Previous position held: · Asssociate Professor - School of Visual Arts , World University of Design Curator | Director Public Outreach – Designed the outreach program, implemented media tie partnerships, built partnerships with local artist. · Conveyor MATI (Management of Art Treasures of India) , January 2013- June2013. Was responsible for setting up the NGO, drawing its Charter and curating the nature of programming. Also looked after MATI fund raising show and was focused on building in financial sustainability within the programming structure. · Managing Editor - Art&Deal magazine. Since October 2009-November 2011.Was responsible for repositioning the magazine as a quarterly and then in order to rebrand the magazine for the advertisers, was responsible for their conceptualising, redesigning and launch of India’s first monthly art magazine. January2006 - May 2006: ‘Critic in Residence’ at KHOJ International Artist’s organization
Mobile application for sign language
About me I feel fortunate for getting the opportunity to learn from so many people around me. I studied IT engineering for my bachelor’s and worked two years as a software developer before realising my true potential lies in problem solving. Design education made me a gentler person. I learned about art and poetry. I did plays and learned about acting as a craft. I started writing for expressing myself and learned how less means more both in design and in life If I have to give a metaphor to explain who I believe myself to be, I’d say a dandilion. I want to share my talents and gifts to world and want to see the world becoming a even better place. And as a professional, I believe in strong work ethics. And with all the experience and knowledge I have, I aim to provide valuable service and to touch people’s lives with my work. I like to read and write soemtimes. Hindi is a language that makes me want to write. And someday I want to publish a book of my own.
Unitedworld Institute of Design
19
Rohan Vyas | Graduation Project 2019
Timeline
17th
Aug
Research Conceptulisation Visualisation Prototyping Testing/Feedback Documentation
20
10th
Sept
13th
Oct
12th
Nov
10th
Dec
Mobile application for sign language
Proposal Project Background
Project Brief
Phase 3: Design
In India the population of deaf and dumb people is more than 10 carore and we have very less sign language interpretors.
The aim of the project was to make usage of Sign Language a part of regular communication within everyone.
Turning the concept into a tangible design. With a consistent visual identity.
The deaf-dumb people faces diffuclty on every phase of life, may it be education or job or simple conversations. The situations is worse in some places where other people refuses to use sign language even for communicating basic information.
Phase 1: Research
Project Context
Phase 2: Concept
The target area is to create awareness for sign language and provide a medium through which interested people or any laymen can learn Sign Language
Try to understand the mindset of the deaf-dumb person and the people who are associated to them. And research about existing institutions for them.
Based on my reaserch I want to create a design/ plan that can help people to know about sign language and learn it if they want to. And provinding a overview of lives of deaf-dumb
Phase 4: Prototype I would then create a working prototype that explains how the whole system would look when function
Phase 5: Testing/Feedback I will approach the targeted users and understand their iews on the system.
Phase 6: Documentation
The whole process from the research to the final design will them be compiled to a single document to show the process.
Unitedworld Institute of Design
21
Rohan Vyas | Graduation Project 2019
“Knowledge is love and light and vision.” ~Helen Keller
22
Mobile application for sign language
02
RESEARCH Pre Research Primary Research Secondary Research
24 34 48
Unitedworld Institute of Design
23
Rohan Vyas | Graduation Project 2019
Pre-research Deaf Hearing loss, also known as hearing impairment, is a partial or total inability to hear. A deaf person has little to no hearing. Hearing loss may occur in one or both ears. In children, hearing problems can affect the ability to learn spoken language and in adults it can create difficulties with social interaction and at work. In some people, particularly older people, hearing loss can result in loneliness. Hearing loss can be temporary or permanent.
Hearing loss may be caused by a number of factors, including: genetics, ageing, exposure to noise, some infections, birth complications, trauma to the ear, and certain medications or toxins. A common condition that results in hearing loss is chronic ear infections. Certain
24
infections during pregnancy, such as cytomegalovirus, syphilis and rubella, may also cause hearing loss in the child. Hearing loss is diagnosed when hearing testing finds that a person is unable to hear 25 decibels in at least one ear. Testing for poor hearing is recommended for all newborns. Hearing loss can be categorized as mild (25 to 40 dB), moderate (41 to 55 dB), moderate-severe (56 to 70 dB), severe (71 to 90 dB), or profound (greater than 90 dB).
Source : https://en.wikipedia.org/ wiki/Hearing_loss
Mobile application for sign language
Source : https://en.wikipedia.org/wiki/Hearing_loss
25
Rohan Vyas | Graduation Project 2019
Key Facts
6.7 million could benefit from hearing aids but only about 2 million people use them.
26
Around 466 million people worldwide have disabling hearing loss, and 34 million of these are children.
It is estimated that by 2050 over 900 million people will have disabling hearing loss.
Mobile application for sign language
Hearing loss may result from genetic causes, complications at birth, certain infectious diseases, chronic ear infections, the use of particular drugs, exposure to excessive noise, and ageing.
60% of childhood hearing loss is due to preventable causes.
1.1 billion young people (aged between 12–35 years) are at risk of hearing loss due to exposure to noise in recreational settings.
27
Rohan Vyas | Graduation Project 2019
Solution and Tech inovations
28
Source : https://en.wikipedia.org/wiki/Sign_language
Source : https://en.wikipedia.org/wiki/Hearing_loss
Sign languages
Sign language gloves
(also known as signed languages are languages that use the visual manual modality to convey meaning. Sign languages are expressed through manual articulations in combination with nonmanual elements. Sign languages are full-fledged natural languages with their own lexicon
Roy Allela, a 25-year old engineer and inventor from Kenya, has found the ultimate solution to bridging the communication barrier between deaf and hearing people. He has invented the Sign-IO gloves that can translate signed hand movements to audible speech so deaf people can “talk” even to those who don’t understand sign.
Mobile application for sign language
Google’s Sign language AI
Samsungs’ Good vibes
The ability to perceive the shape and motion of hands can be a vital component in improving the user experience across a variety of technological platforms.
The Good Vibes app uses Morse code to convert vibrations into text or voice and vice-versa.
Image source : https://www.bbc.com/news/ technology-49410945
Image source : https://www.samsung.com/in/microsite/goodvibes/
29
Rohan Vyas | Graduation Project 2019
Situation in India In India, there is no officially recognised sign language system. As a result, 99 percent of hearing-impaired people are either uneducated or drop out after Class VI or VII, because they are not able to cope. There are hardly any people with hearing impairment who have cleared Class X. One reason is the tremendous shortage of sign language interpreters and trained teachers. India has no captions on television, instructions or signage in public spaces, TTY (accessible telephone), instruction through sign language in schools and no specialised college or university. Even on railway stations there is no signage in sign language to help deaf people. All the announcements are audio based. According to government’s law, no institution can deny admission to a student on basis of hearing disability. But teachers are not trained to teach Image source : https://www.bbc.com/news/technology-49410945
30
Mobile application for sign language
Indian Organisations to support deaf people National Association of the Deaf (New Delhi) Ali Yavar Jung National Institute for the Hearing Handicapped (Mumbai) All India Federation of the Deaf (New Delhi) Bihar Association of the Deaf (Patna) Deaf Can Association (Bhopal) Delhi Association of the Deaf (New Delhi) Delhi Foundation for Deaf Women (New Delhi) West Bengal Society for the Deaf (Kolkata) Madras Association of the Deaf (Chennai) Tamil Nadu State Federation of the Deaf (Chennai) All India Sports Council of the Deaf (New Delhi)
31
Rohan Vyas | Graduation Project 2019
Society for the Education of the Deaf and Blind (Andras Pradesh) Welfare Centre for Hearing and Speech Handicapped (Haryana) Central Society for the Education of the Deaf (Maharashtra) Education Audiology and Research Society (Maharashtra) Aural Education for the Hearing Impaired (Maharashtra) Shri Swami Samarth Special Teacher Training Institute (Maharashtra) Badhit Bal Vikas Kendra (Rajasthan) Deaf Relief Association of Calicut (Kerala) Helen Keller Institute for Deaf and Deafblind (Maharashtra) Multipurpose Training Center for the Deaf Delhi) Deaf and Dumb Industrial Institute of Latur (Maharashtra)
32
Mobile application for sign language
33
Rohan Vyas | Graduation Project 2019
Primary research
Deaf Mute school, Ahmedabad Established in the year 1908 by Late Shri Pranshankar Lallubhai Desai, this institute took the initiative of training and educating students with Hearing and Visual Impairment. With the aim of empowering Persons with Disabilities, the School for the Deaf-Mutes Society caters to the educational needs of Students with Disabilities, followed by vocational needs as well, Thus, education along with generation of employment opportunities is focused upon.
34
Mobile application for sign language
Image source : http://www.deafmuteschool.com/history/
35
Rohan Vyas | Graduation Project 2019
Education and boarding facilities are made available, free of cost and emphasis is laid on early identification of disability and training
They have various initiatives: School for the Deaf School for the Blind Kalpana Balmandir ITI Training Centres Training College for the Teachers of the Deaf Training College for the Teachers of the Blind Physiotherapy College for Persons with Visual Impairment
36
Mobile application for sign language
History The school initially catered to the educational needs of Students with Hearing Impairment only. The School for the Blind was started in the year 1945, and was inaugurated by the then Chief Minister, Morarjibhai Desai in 1952. Eventually, Teacher Training Colleges were started for educating and training teachers as Special Educators along with setting up of vocational training centres for Persons with Disabilities as well. In the past 43 years, 1974 to 2017, a total number of 28,095 students have received education from our institute. The institute has a strength of more than 600 students, hailing from different parts of the state, and education, boarding and lodging facilities are provided free of cost.
37
Rohan Vyas | Graduation Project 2019
Image source : http://def.org.in/
38
Mobile application for sign language
Deaf Enabled Foundation (DEF) Hyderabad Deaf Enabled Foundation is one of the indian organisations that provides the course for sign language interpretor. In India there are 18 million hearing impaired population and only 400 interpretors. DEF has centres in Chennai, Hyderabad, Indore and Pondicherry. They provide basic sign language courses which anyone can learn. Courses are of 1 month and 3 month duration. The interpretor course is 1 year to 1.5 year long and then the person can opt for the interpretor They focus on teaching Indian Sign Language and one of three intitutes that provides a diplom. Since sign language is not common throught the country. Its only 75% that is common and other part gets influenced by region and religion.
39
Rohan Vyas | Graduation Project 2019
Case studies (Qualitative research) 1. Arpit Gupta Arpit was born with hearing impairment but was raised ike a normal kid. Arpit was born and brought up in Delhi. He was not responding to any sounds when he was born and at the age of two his parents got him checked and realised that he can’t hear. His parents worked hard to educate him and make him self sustainable. He went through rigorous vocal training and hardships in order to be a part of speaking society. He completed his school education while living in a bording school. He did his bachelor’s in designing from Symbiosis institute of design, Pune. And currently pursuing his master’s in designing from UID Ahmedabad. At an early age he realised that he needs to work hard in order to develop. He does not feel
40
himself to be infirior to anyone and is always ready to help other people in whatever way he can. Arpit is my classmate and has been my friend since the first day of college. Because of his friendly and helpful nature he is liked by everyone. He has a good knowlege of graphic designing and is proficient in every industry used designing software. We have worked together on many projects and we also did a play which we performed in front of whole college. Arpit’s confidence over his skills and awareness about his weaknesses made him a good designer and also a good friend.
Mobile application for sign language
2. Rakesh Chandra Gupta Mr Rakesh is a father of a hearing impaired child. He shares his experience of educating him He is the father of Arpit. His son was 2 years old when he realised that his son has hearing deficiencies. he shared his experiences of raising his son and making him self sufficient. He, as a father, wanted the best for hi son but the nature has not given him the gift of hearing. But Mr Devendra Gupta didnt take this as a weekness, he realised their familie’s life will be diffcult but not any less than the best.
big task as most school did not take him because of his deficiencies. So he took help from different government officials to make it possible. As according to supreme court’s orders no institute in india can deny admission to any kid on basis of their deficiencies. Arpit was very comfortable in his home and was not developing much, so he sent him to a bording school so that he can learn to live with other kids. It was a difficult phase of his life as he is not able to commnicate with his son. But because of his efforts Arpit has become a responsible and confident man and is serious about his career.
He made the decision that Arpit will be raised like a normal kid and refused to teach him sign language and lip reading. He provided Arpit with best hearing machines available in the market and there were two vocal trainers to prepare his speech. Arpit’s admission in schools was also a
41
Rohan Vyas | Graduation Project 2019
3. Pooja Sharma Pooja’s parents can’t hear or speak. She learned sign language to communicate with them. She was born in a family of deaf parents. She shared her experience of her upbringing with me. She was aware about usage of sign language from her childhood and can recognise signs. Her education was mostly done by her teachers. Her education went well, she is an architect now. She has also started her organisation to teach sign language to people and spread awareness about.
42
Mobile application for sign language
4. Swati Sohoni Swati was born with hearing impairment. And was educated in a deaf institute. She’s currently a board member of deaf enabled foundation. Her family supported her at every step to grow as a person. Her sister told that when she was a kid she was very attached to her family and made her brother and sister learn sign language to communicate with her. She has studied till 10th std and then she joined with DEF foundation and currently she is one of the board members of DEF, she takes care of the executive board. Her sister told that she was in a bad state when her husband passed away but her friends from the deaf community supported her. She is ssociated with the foundation and the social work they do their and that keeps her occupied.
Question: Do you know sign language? Where did you learn it Answer: Yes I know sign language, I am deaf and I have known it since childhood Question: How long was the course? Answer: For normal people it takes around 3 months to 1 year Question: Do you think other people can learn basic sign language quickly Answer: Anyone can learn sign language from Deaf Enabled Foundation Question: Would it be helpful for you if everyone knows a little bit of sign language? Answer: It will be helpful for me as I will be able to communicate to more people. It is the mother tongue of deaf community
43
Rohan Vyas | Graduation Project 2019
5. Radhika Chandratrey Radhika is a normal child. She learned basic sign language to commnicate with kid’s of deaf institute. She is a student of designing, pursuing masters in UID. She has had an experience of working with NGOs and doing social works. She has an experience with sign language as she needed to learn sign language to help hearing impaired kids on an NGO. She shares her experience with sign language saying that it is easy to learn and comminicate with signs. Basic sign language can be taught and learned over few weeks and everyone can learn it.
44
Mobile application for sign language
Survey (Quantitative research)
45
Rohan Vyas | Graduation Project 2019
46
Mobile application for sign language
“They should be given more support from anyone around them” “Sometimes it’s good talking to them in there sign language...” “Sympathetic but couldn’t empathize clearly” “I think they are more talented than people with hearing and speaking disability as far as I observe” “They should be treated equally and their sign language must be mandatorily known by all” “No views...I think they have a different way of doing things but are perfectly normal” “I feel I won’t be able to talk to them due to language barrier “ “They are special ppl but in india we dont utilise their speciality U need patience to be with them”
47
Rohan Vyas | Graduation Project 2019
Secondry research Indian Sign Language William Tomkins Plains Indians from different tribes speaking different languages were nevertheless able to communicate facts and feelings of considerable complexity when they met. They used a language composed of gestures made almost entirely with the hands and fingers, probably the most highly developed gesture language to be found in any part of the world. Convey the meaning of over 870 common words — hungry, camp, evening, angry, fire, laugh, owl, cat, many times, brave, cold, heart, rain, spotted, together, river, etc. The words are then used in sample sentences.
48
This is a book for anyone who wants to learn or teach Indian sign language — scouts, school teachers, camp counselors, scout leaders, parents, linguists, and students of Indian culture.
Mobile application for sign language
49
Rohan Vyas | Graduation Project 2019
Mother Father Deaf Paul Preston Almost 90% of the children born to life-long profoundly deaf parents are hearing. Within this extraordinary family setting, hearing children of deaf parents are exposed to and interact with two differing cultural, social and linguistic systems: that of their deaf parents and the Deaf community, and that of hearing peers and adults.
This book focuses on cultural identity and affiliation of hearing children of deaf parents--a population whose lives incorporate the paradox of being culturally ‘Deaf’ and yet functionally hearing. Data reported here are primarily based on interviews and life histories with 150 adult hearing children of deaf parents throughout the United States. The informants in this study provide an opportunity to explore the parameters and norms of Deaf culture as it contrasts and conflicts with those of Hearing culture.
Image source : https://www.goodreads.com/
50
Mobile application for sign language
What is Sign Language Poetry? Sutton-Spence, Rachel
“It is almost impossible to define poetry without assuming that the reader already has an idea what it is. Given this, the question then arises that ow we know that something is a poem, and the most useful answer is that the text itself signals that it is. In this book we will be looking at details at what those signals are, where sign language poetry shares them with spoken language poetry and where sign language invents its own signals.�
Image source : https://www.goodreads.com/
51
Rohan Vyas | Graduation Project 2019
Sign Language poetry example Five Senses
Composed and performed by Paul Scott Excuse me, but who are you? Who am I? Come with me and see. Feel your arms tingle at my embrace. Reach out - oh, that’s cold! Reach out - oh, that’s hot! So, now you know me. Excuse me, but who are you? Who am I? Come with me and see. A lick of ice-cream - mmm A scoop of that - yuck! A scoop of this - yum! So, now you know me. Excuse me, but who are you? Who am I? Come with me and see. Pick a flower and sniff - lovely! Take some cheese from the fridge - whiffy! Pop this tasty morsel in your mouth, Yes, and it smells good too.
52
Mobile application for sign language
Sign Language is my superpower Austin Vaday is a 21-year-old software engineer, innovator, and entrepreneur. After becoming deaf at the age of 3 , Austin has proved to the world that disabilities are super-powers, not disadvantages. https://www.youtube.com/ watch?v=OFlZdH2xEe8
Image source : https://www.youtube.com/watch?v=OFlZdH2xEe8&t=97s
53
Rohan Vyas | Graduation Project 2019
Situation in India Healthissuesindia.com
Yourstory.com
Youthkiawaaz.com
“There are just 388 schools for the deaf in India and the absence of sign language interpreters in many classrooms highlights how much of a struggle schooling can be for deaf children. Consequently…99 percent of hearing-impaired people are either uneducated or drop out”
In India, there is no officially recognised sign language system. As a result, 99 percent of hearing-impaired people are either uneducated or drop out after Class VI or VII, because they are not able to cope. There are hardly any people with hearing impairment who have cleared Class X. One reason is the tremendous shortage of sign language interpreters and trained teachers.
Our society conditions us to be uncomfortable around disabilities, anything that is beyond the pale of ‘normal’. I, myself, grapple with the prejudiced misconceptions I’ve picked up from others over the years.
Yourstory.com There is a misconception that children born to the deaf also suffer hearing impairment. On the contrary, 90 percent of those born to such disabled parents have perfect hearing while the remaining are amenable to treatment.
54
Mobile application for sign language
Image source : https://yourstory.com/tag/deaf-culture
55
Rohan Vyas | Graduation Project 2019
“Design is a plan designing is planning a designer is a planner� ~Unknown
56
Mobile application for sign language
03
ANALYSIS & SYNTHESIS Problem analysis Gamification Problem synthesis Concepts
58 61 78 82
57
Rohan Vyas | Graduation Project 2019
Problem analysis Main problems identified in the research: • There is a belief that deaf people are not accepted in the society. • Education system does not do much to develop sensititvity amonsts students for deaf people • Education is difficult for deaf-dumb people as there are not much teachers trained to teach them • There is no-updated online platform to teach people sign language
58
Mobile application for sign language
59
Rohan Vyas | Graduation Project 2019
Solutions
1. Visual campaign
Spread awareness in society for showing sensitivity towards deaf people
Pros: • Easily communicated to the people • People can be educated how to treat hearing impared people • Awareness can be spread
Provide a free learning platform for people who are interested in Sign language An entertainment platform that awares people about deaf people.
Design Ideas
Cons: • Sign language can’t be taught through still images • Mere awarenes can’t solve the issue • Any education medium is needed
1. Visual campaign to spread awareness 2. Entertainmement game that makes people learn Sign language 3. Mobile application that gives lesson on sign language
60
2. Entertainment game Pros: • People can be hooked through a game • Teaching can be made uncouncious • Awareness can be spread via ads
Cons: • Primary aspect is fun not education • Game needs to be very well designed to balance fun and education
Mobile application for sign language
Gamification
Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience
61
Rohan Vyas | Graduation Project 2019
Simply put, gamification is the application of game-like thought and game-mechanics to contexts that have not traditionally been gamedriven. That’s not to say that we as designers should set out to trivialise the more serious aspects of life, however. The idea rings truer of making those serious aspects more inviting so that users may be more likely to engage with what otherwise would involve their resigning themselves to mind-numbing but important tasks.
Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience
62
Mobile application for sign language
What do You Need from Gamification? Gamification, the process of incorporating aspects of games into more mundane tasks, is an exciting field. In fact, it’s so exciting that people’s expectations of
the gamification process can become unreasonable or unrealistic.
Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience
63
Rohan Vyas | Graduation Project 2019
Popular Myths
1. Yes, but Games Aren’t Work Are They? That’s the last thing a business wants – lazy people slacking off on their time. Yet, the truth is that gamers are often the most highly motivated people Image source : https://www.interaction-design.org/
64
Mobile application for sign language
2. Gaming is for Kids, not Business People
3. But Games are For Men Only, Right?
4. Work is Work and Play is Play
Its survey in 2012 showed that the average computer gamer is nearly 30 years old and has been playing computer games for the last 12 years. Nearly 70% of gamers are older than 18. Teenagers and children are—in fact—the minority of gamers – not the majority.
The same ESA survey shows that just under half of all gamers are women. The fastest growing segment in gaming is women over the age of 18. Social games such as Farmville and Candy Crush are very popular with women—and they make up the majority of users in many social games.
Gamification’s purpose in the enterprise environment is to make work more fun and engaging, not to distract from work.
65
Rohan Vyas | Graduation Project 2019
Player centred design Player-centred design acknowledges that a game is to be played and looks at the key ingredients of making a game work for the player User-centred design uses the yardsticks of efficiency, effectiveness and satisfaction to evaluate designs. Player-centred design adds engagement to this list. While user-centred design asks the question, “Can the user use the product efficiently, effectively and satisfactorily?”, playercentred design asks, “Do they want to use it in the first place?”.
Image source : https://www.interaction-design.org/courses/
66
Mobile application for sign language
Player types for Gamification There are four player types according to Bartle: Socializers, Explorers, Achievers and Killers. A gamification environment may consist of all or any combination of these types. Careful player research helps to understand which player types dominate the environment and thus help define how to cater to their needs.
Image source : https://www.interaction-design.org/courses/
67
Rohan Vyas | Graduation Project 2019
SMART missions A Specific, Measurable, Actionable, Realistic and Time-bound (SMART) mission offers us the ability to show that we have achieved (or not achieved) what we set out to do. If we haven’t achieved our mission, it enables us to see how close we came to achieving it. If we have overachieved, it lets us see by how much.
“Because it is there.” — George Mallory, English mountaineer (on being asked why he wanted to climb Mount Everest)
68
Image source : https://www.interaction-design.org/courses/
Mobile application for sign language
The Four Basic Principles of Fun in a Game 1. 2. 3. 4.
Goals Rules Feedback Voluntary Participation
Goals give a game a sense of purpose and
enable us to feel pleased when we succeed – an essential component of fun. Achieving them empowers us with a feeling of accomplishment, while giving closure to the story of the challenge we accepted while playing the game
Feedback. We also need to know how well
we’re doing within the context of the rules and the goals. In Tic-Tac-Toe, feedback comes quickly – a game lasts barely a few seconds.
Rules restrict the means to achieving our goals. Rules help us become creative in the way that we play a game, and creativity makes a game fun.
Voluntary participation. It’s no fun if
you’re made to do something. That’s work. Games are fun because we choose to play together, we choose to agree to the goals and rules and because we enjoy the feedback from our choices.
69
Rohan Vyas | Graduation Project 2019
Four types of Fun need to keep in mind that gamification must be fun. If the output of our designs isn’t fun, then we will have failed in our objectives. Games are fun. Game-like elements must be fun in order to be “game like”.
“Never, ever underestimate the importance of having fun.” —Randy Pausch, Professor of Computer Science and Human-Computer Interaction
70
Type 1 : Hard fun This type of fun requires some work. The feeling of accomplishment marathon runners experience when they finally run their first marathon is going to be hard to beat.
Mobile application for sign language
Type 2 – Easy Fun
Type 3 – Serious Fun
Type 4 – People Fun
it’s the kind of fun that each of us values in dayto-day life. could be more or less passive activities we can look forward to on a small scale such as catching your favourite TV show at a certain time.
This is the kind of fun that pushes us to create something substantial for ourselves and others. It inspires us to think, behave or feel differently and try to make a meaningful difference in the world.
People fun involves the joy of interacting with others. It’s what drives us to hang out with friends, family, coworkers, etc. People fun can be lasting and enduring, or momentary and fleeting. It is some really good times to memory
71
Rohan Vyas | Graduation Project 2019
Game mechanics Gamification offers you as the designer a huge array of game mechanics that one can employ in order to make your gamified features fun and exciting for your players. However, it’s important to choose a mix of features so as to support the mission of the business, and in a careful way— paying attention the exact needs and nature of what is involved—whilst ensuring that players aren’t overwhelmed because of too many features.
72
• • • • • • • • • • • •
Leaderboards Journey Relationship Quests Loss Aversion Progression Badges Rewards Narrative Levels Urgent Optimism Challenge
• • • • • • • • • • • •
Epic Meaning Blissful Productivity Reward Schedules Countdowns Discovery Virality Game Mechanics Free Lunch Community Collaboration Points Achievements Emotions
Mobile application for sign language
Real time Gamification solution Speeding cars present a great risk to pedestrians in built-up areas. Modern cars are well designed to withstand impacts, but people are not. Here’s what Volkswagen found when they looked at the problem: The Current Scenario: Drivers often drive above the posted speed limits. The Objective: To get drivers to adhere to the posted speed limits. Mission: To get as many drivers to drive at or below the speed limit as possible and to make it fun and rewarding to do so. The Solution: Set up a speed camera with a display that tells drivers their speeds and gives them positive reinforcement for obeying the limit. We suspect that this works particularly well for drivers with young children‌ Image source : https://www.interaction-design.org/courses/
73
Rohan Vyas | Graduation Project 2019
Semiotics
Based on “semiosis,” the relationship between a sign, an object, and a meaning. The sign represents the object, or referent, in the mind of an interpreter. “Interpretant” refers to a sign that serves as the representation of an object. Signs can be verbal (words) or nonverbal. (from C.S. Pierce, Selected Writings, 1958). Image source : https://www.wikipedia.com
74
Mobile application for sign language
Semiotics - Signs and Meanings Human action involves signs and meanings in three ways: • The perception stage - the person becomes aware of a sign. • The manipulation stage - the person interprets the sign and decides how to respond to it. • The consummation stage - the person responds.
Signs have three factors that guide interpretation: The DESIGNATIVE aspect directs to interpreter to a particular object. The APPRAISIVE aspect highlights object qualities, enabling evaluation. The PRESCRIPTIVE aspect directs one to respond in specific ways.
75
Rohan Vyas | Graduation Project 2019
Problem Synthesis
Ideas for solution AIM: To design a game that enables people to learn sign language and make players familiar with the deaf culture
76
Mobile application for sign language
Stakeholders Mapping
77
Rohan Vyas | Graduation Project 2019
Existing mobile learning games Image 1 : This game wants players to make the correct sentence from words Image 2 : A language learning app that is a form of game and has levels to complete Image 3 : Its a story based game in which player has to break from the jail and for that he has to complete sentences Image 4 : Its a simple game where player has to identify the words in letters Image 5 : An app that uses gamification for langugae teaching
78
Mobile application for sign language
79
Rohan Vyas | Graduation Project 2019
Apps using Gamification Habitica This app uses pixel graphics and reward point system and its purpose ti to make habits Headspace This app is used for medetation and used graphics and validation to make better user experience Luminosity It is an awarawd winning app on playstore. It uses puzzles and diiferent mind games to engage players and make them think Cake Its an english language learning app. It uses puzzles and pop culture resources to teach Fabulous This app hels in making better lifestyle by using point based system
80
Mobile application for sign language
81
Rohan Vyas | Graduation Project 2019
Game concepts Concept 1: Dots “ A line is a dot out for a walk” ~ Paul Klee Inspired from the above quote, the concept ‘dots’ is made. In this world we all humans are like dots wanting to connect to each other so we made languages, media and art in order to do that. Sign language is also one such innovation by mankind to achieve connection. Design idea is a mobile application/game in which the main characteris a dot and it goes on a journey to make a line. • Target audience: students, office going people • Expected usage: people in metro or while waiting in lines
82
Mobile application for sign language
START
Structure LOGIN
MAP
POINTS
SETTINGS STANDINGS
PROFILE PLAY
83
Rohan Vyas | Graduation Project 2019
In all the application will have 3 parts 1. onboarding, signin, signup 2. Map 3. Challenge - Map will provide overall journey and goals for the players -Players have to clear the chelanges in order to unlock th map and discover more from the game
different themes for every level. and for every theme the UI will have sign languge terms for every elements
-Challenge is a simple line game where players have to connect different color dots to make lines Intention: in the map the player sees
rough map structure
84
Mobile application for sign language
User Flows
85
Rohan Vyas | Graduation Project 2019
Sign Language Research According to game concept, every level of the game have a different theme and there are SIGN LANGUAGE clues in every level according to the theme. So, for the 1st theme; ‘school’, the following keywords are generated for SIGN LANGUAGE clue. For the above keywords their following Signs are collected
Game Character Since the concept for the game is based on dots, the characters are also inspired from dot or circle
86
Mobile application for sign language
Why this concept does not work 1. The concept became too informative for the players, and not much of player centric design. 2. The game is not fun to play 3. More like a less learning and it feels sign language is imposed on it
87
Rohan Vyas | Graduation Project 2019
Concept 2: Monsters A mobile game. Concept is developed to make the gaming experience fun for the players. And on the same time players learn few important signs from the Sign Language • Target audience: students, office going people • Expected usage: people in metro or while waiting in lines
Narrative: Monsters have taken over everthing and the main character has to kill monsters in order to go to next level. In order to kill monsters player has to collect elements. which can be done via two things, 1 quest, 2 deal.
88
Mobile application for sign language
Problems with concept 1. Quest: player has to connect sign of same words in given time. to collect elements 2. deal exchange elements to collect other elements
1. Idea is becoming too complex. 2. players will immediately leave it if they were not able to understand it 3. Application of Sign Language feels imposed on the experience
89
Rohan Vyas | Graduation Project 2019
Concept 3 :Learning app A mobile application that gives people all the necessary required resources for learning and information and links to organisations associated. Enculcating the gamification in the experience via different mediums • Target audience: people who are interested in learning the Sign Language • Expected usage: quite places, where people can learn
90
Functionalities to include: 1. translation of words and senteces 2. sign language quiz to practice 3. daily quotes and text in sign language 4. dictionary, resources, important links
Mobile application for sign language
91
Rohan Vyas | Graduation Project 2019
“A problem well stated is a problem half solved.� ~Charles Kettering
92
Mobile application for sign language
04
REDEFINED BRIEF Defining the user UX design Visual design
94 113 126
93
Rohan Vyas | Graduation Project 2019
Defining the user The application maily focuses on providing service to the people who are interested and are willing to learn about Sign Language.
Functionalities
The targeted users are maily three types of people:
2. Links and information about different organisations
1. Differentlly abled people, wanting to learn the language. 2. People related to people with different abilities. Like the parents of a deaf person who wants to learn the language to ommunicate with their child 3. Sign language teachers, who want resources to teach their students about the deaf culture. 4. Regular people who are interested to know about the deaf culture.
94
1. Sign language teaching
3. Translation
Mobile application for sign language
User Personas
95
Rohan Vyas | Graduation Project 2019
1. Neelam Sharma Motivation Age 22
Incentive
Occupation IT Engineer
Growth
Location Pune Impatient
Power
Focussed
Extrovert
Sensing
Intutive
Thinking
Feeling
Judging
Social
Goals She wants to be a successful person A community that support everyone To see herself financially stable
Frustrations Negligence amongst people Competative culture
96
Introvert
Achievement
Status Single
Ambitious
Fear
Personality
Technology IT and internet Software Mobile Apps Social Networks
Perciving
Mobile application for sign language
Empathy map
Neelam Sharma
Helping other people
Software developer
Age 22
Want to able to commnicate with the deaf people
Wants to be successful
Career related problems
Learning new skills
Think and feel Its difficult to communicate with differently abled people
A social gap between people with different abilities
Hear
See
Learning a language is difficlut
Sign language is mostly intutive and easy to learn
Deaf people are unapprochable
Say and do Says she wants to learn sign language
Deaf people are very nice and helpful
Says that she wants to do social work
Mostly stays busy with the office work and dindnt get time to learn sign language
97
Rohan Vyas | Graduation Project 2019
User journey map
Aware
Research
1st communication
User Goals
To be able to commnunicate with everyone
To learn Sign language
To learn Sign language
Needs
Social connectivity
A medium that can teach sign language
Organised and engaging resources
Shes realises that there are differently abled people and wants to support them
She looks on the internet to find the solution
She couldnt find resources where she can learn quickly. Content is confusing and unorganised
Opportunity
Networks can be developed
Networks can be developed
To provide people with useful resources
Pain point
Inabilty to connect
Inabilty to connect
Bad user experience
Images
Process
Experience
98
Mobile application for sign language
Use
Feedback
Closure
User Goals
To learn sign language
To learn Sign language
To feel good
Needs
Trustable resource
Good user experience
Any medium to teach betterv
She installs few apps and signs up for onlline courses
She is not able to learn anything as there are too many options but not organised.
After failing to learn she gives up. She blames herself and believes its her inability to learn
Opportunity
Interactive interface can be developed
To develop a user friendly intutive platform
Make user feel good
Pain point
Confusing user interface
Inabilty to learn
Bad user experience
Images
Process
Experience
99
Rohan Vyas | Graduation Project 2019
2. Arpan Walia Age 18 Occupation Student Status Single Location Baroda
Motivation Incentive Fear
Introvert
Growth
Sensing
Intutive
Thinking
Feeling
Judging
Social
Goals Wants to fill his family’s needs To be healthy
Technology IT and internet Software Mobile Apps
Frustrations Unhelpful people
100
Extrovert
Achievement
Power
Deaf-Dumb
Personality
Social Networks
Perciving
Mobile application for sign language
Empathy map
Arpan Walia
Wants to learn how society works
Student/ Deaf and dumb Age 18
Often feels a need for companionship
Wants to be useful
Thinks his family gets trouble brcause of him
Thankful for his teachers
Think and feel His parents and teachers often tells him that he can do anything and his different ability can be used differently
He sees people talking and playing
Hear
See Peopple making frinds and celebrating
Say and do Works hard and never complains
Other people wants to talk to him but not able to
Always ready to help anyone
obeys his parents and techers
101
Rohan Vyas | Graduation Project 2019
User journey map
Aware
Research
1st communication
User Goals
To complete his education
To complete his education
To omplete his education
Needs
Learning resources
Friends
Doubt clearence
Arpan uses hearing machine and reads lip to understand. He goes to school and wants to be a photographer
He has friends who understands him and support him
He sometimes gets confused while learning and needs help regarding studies
Images
Process
Experience
Opportunity Pain point
102
To provide people with useful resources
Mobile application for sign language
Use
Feedback
Closure
User Goals
To learn
To understand
To ommunicate
Needs
Doubt clearence
A common medium of communication
A common languge which everyone understands
His friends and family tries to explain him and clear his doubts
But due to his inabily to hear they are unable to communicate to him and dont know sign language
Friends use google to find hand signs to explain him but couldnt find them quickly
Interactive medium
An interactive medium where people can learn basic sign language quickly
A medium that quickly provides user with hand signs for communication
Un awareness about sign language
Bad user experience of other mediums
Images
Process
Experience
Opportunity Pain point
103
Rohan Vyas | Graduation Project 2019
Devendra Gupta Motivation
Age 62
Incentive
Occupation Farmer
Fear
Status Married
Introvert
Growth Power
Loving
Sensing
Intutive
Thinking
Feeling
Judging
Social
Goals Wants to fill his family’s needs To be healthy
Technology IT and internet Software Mobile Apps
Frustrations Unhelpful people
104
Extrovert
Achievement
Location Jaipur Father of a deaf girl
Personality
Social Networks
Perciving
Mobile application for sign language
Empathy map
Devendra Gupta
Saving money for the daughter’s future
Father of deaf girl Age 62
Daughter’s marrige
Daughter’s education
Doens’t want her daughter to feel weak
Feels scared
What other people think about his daughter
Village’s openion about his daughter
Think and feel He hears from people that deaf kids dont have future and no body marries a deaf girl
He sees people judging his daughter
Hear
See Some people are willing to help him educate his daughter
He hears that govenrmnent is providing good education for deaf kids and can be self stable
Say and do He always motivates his daughter to work hard
Organisations are there to support and teach his daughter
He sends her to an institute to learn sign language
He listens to his daughter’s teachers about how to talk to her
105
Rohan Vyas | Graduation Project 2019
User journey map
Aware
Research
1st communication
User Goals
Daughter to be happy and educated
Daughter to be happy and educated
To learn sign language
Needs
To be able to communicate with his daughter
To be able to communicate with his daughter
Resources for better understanding
He learns sign language on his on on his free time
He takes help from local people who hels him
He often gets confused while learning sign language by himself
Images
Process
Experience
Opportunity Pain point
106
To provide people with useful resources
Mobile application for sign language
Use
Feedback
Closure
User Goals
To learn sign language
To earn sign language
To help her daughter
Needs
Better resources
Ability to understand mobile apps
To learn basic sign language and about deaf culture
Other people tells him he can find resources on internet to learn basics
But he does not know how to use internet or smartphone
He is not able to learn well and feels sad for not being able to help her daughter
An easy to user intutive UI that anyone can undestand
An interactive medium where people can learn basic sign language quickly
A medium that quickly provides user with hand signs for communication
Complicated user interface of different apps
Bad user experience of other mediums
Images
Process
Experience
Opportunity Pain point
107
Rohan Vyas | Graduation Project 2019
Existing apps Android and IOS playstore is filled with plenty of applications which can help anyone to learn the Indian Sign Languages. American Sign Language, British Sign Language apps are there mostly. Some Indian Sign Language learning apps are also there
108
Mobile application for sign language
DEF-ISL Deaf enabled foundation has released its mobile application for Indian sign language. The application provides a dictionary and serch option so anyone can find any sign easily. The sign is shown in form of a small video where the users can see and learn the sign language
109
Rohan Vyas | Graduation Project 2019
Spread the sign Its an application that provides translation Sign language from any word. It includes not only ISL but also all other existing sign language in translation
110
Mobile application for sign language
Indian signs It is an application that provides the ISL dictionary and contains all important signs along with conversation and basic communication.
111
Rohan Vyas | Graduation Project 2019
Problems with the existing apps
Solutions
1. Apps provide the sign language translation but not a systematic learning
. Application that has systematic and organised course for learning sign language
2. The videos translate the word in signs but not teach how language is constructed
2. Application also have other content regarding deaf culture
3. Its difficualt to learn from videos
3. Learning process can be gamified.
4. UI does not encourage people to learn more
4. simple to understand UI and user flows
112
Mobile application for sign language
UX design of the app UX inspiration: Let me hear again Let me hear agian is an award winning application that uses voice recognition to enable deaf people to do basic daily tasks The app was awarded ‘App of the Month’ from MIT-App Inventor, USA and Dr Sharon Baisil is the second Indian to receive this award! Dr Sharon Baisil has developed the app solely on Google App Inventor, maintained by Massachusetts Institute of Technology. The app was a result of Dr Baisil’s passion for technology and his empathy towards the hearing impaired who cannot afford costly mediums as a remedy for their disabilities.
The app enables the impaired to Hear 71 Languages by live voice recognition and translation. Dr Baisil says that most people with hearing disabilities are well versed in sign language and have issues communicating only with people who can hear normally. The common usage of Whatsapp among such people is what sparked the idea for a mobile app for them. The prototype had only one feature of face to face chat for the hearing impaired to communicate with normal people. Later on more features such as Virtual Notes, which is a Virtual Interpreter & Note Taker; Call Companion, which converts phone calls to text in real time; Quake Awake Alarm for Deaf; and Guardian Angel, which alerts the user during emergencies were added to the application and the environment.
113
Rohan Vyas | Graduation Project 2019
Information architecture Card sorting: Card sorting is a method of developing the information architecture of a system. It is simply based on arranging all the functionalities and content depending on how the user expects to see it
Functionalities and content: 1.Login/signup 2.User personal details 3.User learning details 4.Details about organisations 5.Details about deaf culture 6.Language learning details 7.Language course structure 8.Categories of sign language 9. Sign language lesson
114
10. Test 11. Points 12. Reward 13. Sign language chat 14. Sign search 15. Sign translate 16. Conversation course 17. Saving signs for use 18. grouping saved signs 19. daily practice signs 20. news update regarding deaf 21. important articles 22. deaf movies 23. recommended videos 24. notification for new resource 25. Profile changes 25. settings 26. personal information
27. voice search 28. dictionary 29. word of the day 30. motivation quote 31. review the course
Mobile application for sign language
App architecture development
115
Rohan Vyas | Graduation Project 2019
Architecture
116
Mobile application for sign language
117
Rohan Vyas | Graduation Project 2019
Wireframing
118
Mobile application for sign language
119
Rohan Vyas | Graduation Project 2019
Low fidelity wireframes
120
Mobile application for sign language
Wireframing
1. Home page 2. Category page
121
Rohan Vyas | Graduation Project 2019
1. Categories page 2. Sign page
122
Mobile application for sign language
Navigation menu iterations
123
Rohan Vyas | Graduation Project 2019
High fidelity wireframes
1. Home page 2. Categories page 3. Sub categories page 4. Sign page 5. Library page
124
Mobile application for sign language
125
Rohan Vyas | Graduation Project 2019
Visual design of the app Visual inspirations 1. Duolingo. Duolingo is a good implementation of language learning gamification. Rewards, leaderboards and colorful UI are the elements which makes it a successful learning application. 2. Cake Cake is an english learning app. The home page design for cake is a good inspiration of all round language learning
126
Mobile application for sign language
4. Bolo from Google This app is a perfect example of a learning app. Provides just the required fuctionalities and makes learning fun by use of sound and animation. It makes the whole process fun. 3. Two dots Two dots is a mobile game where player has to connect similar color dots. The map in the game is desgined to attract visual attention
127
Rohan Vyas | Graduation Project 2019
UI layout 250 px A grid is like invisible glue that holds a design together. Even when elements are physically separated from each other, something invisible connects them together.
16 px
8 px
48 px
128
Mobile application for sign language
Layout 360 px (iPhone 6/7/8) 4 column grid 1 Gutter width 10pt
1 2
3
2 Column width 68 pt 3. Left/Right margin 36pt
129
Rohan Vyas | Graduation Project 2019
UI iterations for the design language 1. Images
UI created using stock images as references for the user guiding Problems: This UI design language does not work as too many colors are seen and it creates a cognitive overload for the users
1. Image as background
UI created using stock images as background
Problems: This too does not work as the image distracts the users from their task
130
Mobile application for sign language
1. Abstract shapes
Abstract shapes used to create interest and to navigate the users Problems: Does not work as the possible users are also the rural people who do not understand the abstract concepts and can frustrate them
1. Using gradient
Light gradient is used to make the apllication trendy and visually appealing. Roundness in shape is used to make it feel less visually loading
131
Rohan Vyas | Graduation Project 2019
Home page design using blue gradient
132
Mobile application for sign language
Problems: Blue color gives a professional feeling to the process. Also too much gradient makes it look like a commercial app rather than a learning app.
133
Rohan Vyas | Graduation Project 2019
Visual design final Color selection Color accessibility The most common types of color blindness are due to the loss or limited function of red or green cone photopigments. This type of color blindness is commonly referred to as red-green color blindness
Measures taken to make it accessible by color blind people: 1.Color is not used to convey a message 2. Color palette is limited to 2 colors. 3. Texture and patterns are used to show contrast. 4. Contrasting colors and shades
134
Mobile application for sign language
Selected colors: 1. Orange Orange combines the energy of red and the happiness of yellow. It is associated with joy, sunshine, and the tropics. Orange represents enthusiasm, fascination, happiness, creativity, determination, attraction, success, encouragement, and stimulation.
F5AB35 R:245 G:171 B:53 C:2 M:36 Y:91 K:0 FFFFFF R:255 G:255 B:255 C:0 M:0 Y:0 K:0 6D6D6D R:109 G:109 B:109 C:58 M:49 Y:49 K:16
135
Rohan Vyas | Graduation Project 2019
Iconograpgy
iconography is a visual language used to represent features, functionality, or content. icons are meant to be simple, visual elements that are recognized and understood immediately. Inage source: TheNounProject
136
Mobile application for sign language
Typography
Lato 14 Bold Lato 14 Medium
Lato 18 Bold Calibri 12 Light
Calibri 16 Regular Open Sans 9 Light
Open Sans 16 Light
137
Rohan Vyas | Graduation Project 2019
UI elements
138
Mobile application for sign language
139
Rohan Vyas | Graduation Project 2019
User interface design 1. Home page UI design 2. Learn page UI design
140
Mobile application for sign language
Navigation with five pages is creating the fat finger problem. Icons looks small and text is not redable and it creates frustration. So the navigation is changes to three pages and the other pages are merged with the home page
141
Rohan Vyas | Graduation Project 2019
Daily learning page (Home page) UI Home page contains reosurces to under stand deaf culture, resources like deaf movies, videos and articles. It also contains sign lanaguage elements to create interest.
142
Mobile application for sign language
143
Rohan Vyas | Graduation Project 2019
Tools page (Home page) UI This page contains the saved signs from the dictionary. User can group signs and make a folder. Further addtion to tools are planned in the next phases of the app design.
144
Mobile application for sign language
Resource page (Home page) UI Resources page is made to provide users with credible and helpful content on or related to deaf issues. This is for the people who want to learn about the culture. It gets regularly updated so the users gets new content on a regular basis.
145
Rohan Vyas | Graduation Project 2019
Learn page
Learn page is designed for people who wants to systematically learn the sign language. It provides a colorful and animated UI to make the experince playful. The learning process is gamified so the user gets points for right answers and loses heard for wrong. And with points users can buy sign lagauge merchendise.
146
Mobile application for sign language
Dictionary UI
Dictionary provides access to all the existing signs and it is organised in categories so that users can find them easily. The sign page can be saved for further references. And is found in the ‘tools’ page.
147
Rohan Vyas | Graduation Project 2019
148
Mobile application for sign language
149
Rohan Vyas | Graduation Project 2019
“Accessible design is good design.” ~ Steve Ballmer
150
Mobile application for sign language
05
FINAL DESIGN User flows Mockups Epilogue
152 158 168
151
Rohan Vyas | Graduation Project 2019
User flow
152
Mobile application for sign language
Searching a sign
153
Rohan Vyas | Graduation Project 2019
Learn
154
Mobile application for sign language
Others
Home page contains: daily learning tools games resources notification Profile Hamburger menu
155
Rohan Vyas | Graduation Project 2019
User testing
156
Mobile application for sign language
Techniques for user testing
Testing process and outcomes
Observable data
1. Thinking aloud. • Testing the interface not the user • Asking user to say their thoughts and feelings • Verifying research mental model • Taking notes • Capturing videos
User testing will be done in a natural user setting. and different user types will be 1. Student 2. Village person 3. Teacher
1. Quantitative data. • time on task • success/ failure rates • efforts
Techniques and inadequecies • • • •
Focus groups: What they say Phone survey: What they want to hear Web surveys: Closed ended questions Self reporting: Users don’t know if its “broken”
Testing will be low fidelity and users will be encouraged to speak out loud what they are feeling.
1. Qualitative data. • stress responses • subjective satisfaction • percieved efforts or difficulty
The user test cases are following: 1. user wants to change settings 2. user wants to complete a course 3. user wants to search a word
157
Rohan Vyas | Graduation Project 2019
1st user test (Satyam kumar) student
2nd user test (Hetal ben) villager
3rd user test (Jagdeesh Dixit) professional
Outcomes Pros • attractive design • fun to see the sign language Cons • difficulty in understanding the flow Suggestion • less user of words and more use of colors and signs for direction. or maybe regional language Outcomes Pros • intutive interface • simple to understand Cons • difficulty in learning Suggestion • some feature can be added just for deaf people
158
Outcomes Pros • intutive and simple UI Cons • need more learning content Suggestion • more focussed learning and all flows should direct towards learning sign language
Mobile application for sign language
A final look
159
Rohan Vyas | Graduation Project 2019
160
Mobile application for sign language
161
Rohan Vyas | Graduation Project 2019
162
Mobile application for sign language
163
Rohan Vyas | Graduation Project 2019
164
Mobile application for sign language
165
Rohan Vyas | Graduation Project 2019
166
Mobile application for sign language
Future developments The further plan for the application is to add functionalities that helps deaf users to communicate. Such functionalities will go under the ‘tools’ tabs and the functionalities will be as follows: 1. Hear 2. Notes 3. Video call
1. Make notes
1. Hear
1. Video call
This feature enables people to record sounds and the google’s voice recognition AI will translate sounds in to texts which the deaf user can read easily or copy paste them somewhere else.
This feature translates the voice in the video call and provides them as the subtitles for the call.
This feature enables people to translate the pre recorded voices. This feature can be used in class rooms to record long speeches and translates them all in a paragraph. Google AI can tanslate Indian regional languages as well.
167
Rohan Vyas | Graduation Project 2019
Epilogue Closure
Reflection
The project was an introspection followed by efforts in creatively visualising an idea that would throw light on all intended aspects of the project. The project brings up intresting provocations and starting points for conversation in and around society. The technology advancements provides a massive ability to develop and that the shared fututre will beb more impartial for people in the society. The internet and subcultures have massively evolved shaping how we humans have been communicating. So as social media helping people connect on shared interest.
I belong to a middle class family living in the city Jaipur. I was a science student in school and later became an IT engineer. Design thinking didn’t come naturally to me. However, it reflected in whatever I learned. Problems comes with solutions, was the gist of my engineering teaching and later when I decided to become a designer this approch helped me understand problem solving. As I developed design sensitivity I started seeing problems which we choose to ignore on daily basis and that lead to the birth of this project. It was an approch to solve problems of hearing impaired people and people who are associated to them.
Altough this project ends in speculation it could be implemented, if not in entirety but surely in its essence.
My project was in a way, my means of emulating a certain design process, yet it was personalised and exciting.
168
Mobile application for sign language
Citation
Colophone
All content in the publication belongs to the author. Images depicted are either clicked or sources via the internet. The respective authors have been credited in the refrences.
The document has been designed and written by Rohan Vyas. It has been printed at XYZ. The document has been set in Lato is a humanist sans-serif typeface designed by Ĺ ukasz Dziedzic. It was released in 2015 Palatino is the name of an old-style serif typeface designed by Hermann Zapf, initially released in 1949 Open Sans, Open Sans is a humanist sansserif typeface designed by Steve Matteson and commissioned by Google
169
Rohan Vyas | Graduation Project 2019
Refrences
Interactiondesign.org https://www.interaction-design.org/courses/ gamification-creating-addictive-userexperience?r=rohan-vyas Interactiondesign.org https://www.interaction-design.org/courses/ conducting-usability-testing/lessons/2.1 Yourstory.com https://yourstory.com/tag/deaf-culture Yourstory.com https://yourstory.com/2014/11/app-fridays-madeindia-app-recognised-mit-helps-deaf-hear-speak
170
Youtube.com https://www.youtube.com/ watch?v=OFlZdH2xEe8&t=97s
ISLRTC syllabus http://www.rehabcouncil.nic.in/writereaddata/ DISLI-SyllabusJ18.pdf
Deaf Mute School http://www.deafmuteschool.com/history
Usabilla: How to Design for Color Blindness https://usabilla.com/blog/how-to-design-for-colorblindness/
Indian Sign Language Research and Training Centre http://www.islrtc.nic.in/ National Association of Deaf http://nadindia.org/ BBC:Google sign language AI turns hand gestures into speech https://www.bbc.com/news/technology49410945technology-49410945
Hearing loss causes and prevention https://verywellhealth.com/deaf-causes Apps to decode sign language https://ahmedabadmirror.indiatimes.com/ ahmedabad/cover-story Sense India https://senseiniindia.org
Mobile application for sign language
Deaf culture http://en.wikipedia.org/wiki/Deaf_culture
Bal bandhit vikas kendra http://www.bbvk.org
Sign language basics http://www.enabledacademy.org.
Sign language colleges information https://indiatoday.in/education-today
Rehabilitation council of India https://rehabcouncil.nic.in
Information reagarding deaf employment https://def.org.in
SEDBVZM https://sedbvzm.org
Deaf film festival https://iidff.org
CSED Mumbai https://csedmumbai.org
International deaf summit https://enabled.in/wp
Education audiology https://leodesigns.com/ear
Sign language alphabets https://thepontychaddhafoundation.org
Haryana welfare society https://hwspshi.org
Sign language usage https://sesignlanguage.com
171
Rohan Vyas | Graduation Project 2019
Contact info
Rohan Vyas B-62, Yash path, Tilak nagar, Jaipur. 302004 vyasrohan1993@gmail.com
172
Mobile application for sign language
Mobile application design for learning
Sign Language
173