8 minute read

Phone Translation Software & Artificial Itelligence Tools Transforming the Life of a Rochester Engineer

By Daniel Rodriguez, Site/Civil CAD Technician Sean Phelan, Associate AIA.

Daniel Rodriguez, the article's author and a High Falls based HUNT engineer, approached this writing project with the same energy he brings to his solar, wastewater, and K-12 efforts, as well as a willingness to entertain the questions we had about American Sign Language (ASL). Specifically, we wanted to explore ASL’s viability and future in the face of the increasingly sophisticated, translation software available now for the Deaf on phones, computers, and networks

But first, what he really wanted to talk about was how to become a better engineer and more fully utilize the Engineering BS degree he had received from RIT in 2022.

A Site/Civil engineer charged with developing design site plans on HUNT’s clients’ behalf, Daniel is a New York City native married to Andrea, a Coloradoan who remotely works for the Washington, DC-based, Federal Deposit Insurance Corporation (FDIC) from their Henrietta home office.

Both Daniel and Andrea have been deaf since birth, and while they communicate entirely in sign language at home, we drafted this article together with a combination of pen-to-paper and Daniel and Andrea’s ASL exchanges and phone translation software outside Lovin Cup Cafe on a rainy summer day.

A Day in the Life

Daniel and his site design engineer and inspector colleagues spend a large part of the working week in the field assisting HUNT clients (including most recently Rochester’s Charlotte High School) with construction and stormwater permitting efforts prompted by land development projects.

For example, “to protect and safeguard the general health, safety, and welfare of the public residing within its watersheds”, the City of Rochester has established a “set of water quality and quantity policies to provide reasonable guidance for the regulation of stormwater runoff and safeguard persons, protect property, prevent environmental damage….and comply with the NYSDEC state pollutant discharge elimination system (SPDES) general permit for stormwater discharges…for the purpose of protecting local water resources from degradation”.

It is within that setting and with those goals that Daniel and his High Falls colleagues regularly operate

ASL Translation Software: Overcoming Communication Challenges in the Field & at the Office

The engineering world thrives on clear and efficient communication, and phone translation technology, particularly speech-to-text conversion, is significantly improving communication accessibility for deaf engineers.

For his part, Daniel urges the use of call-in numbers at all meetings. They allow him to use VRS Video Relay Service (VRS) to connect to the meetings and interpret everything that is said in the meeting. VRS services are further enhanced by Video Remote Interpreter (VRI) software. VRS allows him to use ASL which VRI can interpret on a camera and internet as text on the screen (essentially subtitling Daniel’s input)

According to Daniel, beyond the difficulty of learning and incorporating CAD software into his daily skillset, his “most obvious work challenge is choosing the appropriate communication method”.

“Most of the time I use phone speech-to-text. Still, in the best-case scenario, I would prefer to use an ASL interpreter for any communication because interpreters can translate fully and clearly in 10 minutes what it still takes phone translation software about an hour”

“It’s important to remember that ASL is a completely different language from English, so it takes time to translate terms and phrases at the accuracy level I need for the job.”

In the Office

In HUNT’s office, Daniel’s ability to shorten his learning curve and fulfill his professional demands has been dramatically accelerated by his relationship with Dillon Taylor, EIT, another HUNT Site/Civil Engineer and friend. Dillon’s son Jacob is Deaf, and consequently Dillon has become “well-versed” in ASL, although he insisted we make clear that his skills were “functional not fluent.” Daniel and Dillon’s collegial interactions are further improved by having their desks side-by-side.

At the same time, Daniel is sensitive to overtaxing Dillon and thinks that the presumption by others that Dillon can act as interpreter limits their willingness to approach him directly. He attributes his arguably more robust interactions with colleagues at other HUNT offices to both their unawareness of Dillon’s availability and a genuine desire to aid his successes.

It took us several months to embarrassedly realize that we had positioned Daniel’s desk poorly, aiming him toward a screen that placed his back to an aisle and colleagues moving about the office At one point he quietly resorted to using a mirror to improve his ties to coworkers.

HUNT’s Office Manager Kym Finkle sought to address these obstacles recently by repositioning Daniel’s desk so he both looks directly out at coworkers in a heavily trafficked hallway and has a clear view-line to Dillon. Kym coordinates HUNT’s on-boarding process and developed an ASL tutorial schedule that welcomed all Rochester office personnel to get a sense of Daniel’s communication style and needs.

Pros & Cons of Translation Software: Dilemmas for Engineers and General Population

Specific advantages of digital translation platforms include increased independence and access to information

Deaf engineers can directly conduct phone conversations without relying on sign language interpreters. This empowers them to manage appointments, handle client and colleagues’ project inquiries, and make calls independently. Realtime text transcription allows deaf individuals to follow phone conversations and participate actively in various settings like meetings, classrooms, and public service calls.

This active participation is particularly important to engineers as technical discussions often involve complex terminology and rapid back-and-forth. Phone translation software allows Deaf engineers to follow conversations in realtime, ask clarifying questions on the spot, and contribute their expertise effectively. This speeds up problem-solving processes and ensures they are fully on board with project developments.

As noted earlier, for Daniel and other young engineers the software has increased his confidence and independence. He doesn’t need to rely on Dillon and other colleagues to schedule calls or interpret conversations. This newfound independence empowers him to take ownership of communication and actively manage his professional interactions

Outside of the office the “accessibility on the go” nature of the translation tools is heightened by their increasing mobile friendliness. Thus, allowing Daniel to take calls and participate in discussions while on-site or traveling for work. This flexibility ensures he can remain connected and informed, regardless of their location.

Translation Tools as a Supplement not an ASL Replacement

A profound and reoccurring theme in the conversations surrounding this article was the importance of the Deaf culture in and of itself, and inherently the ASL language. A core aspect of Deaf identity and community, Daniel and others underlined that sign language is not just a means of communication; it is a vibrant cultural expression.

They concurred with assertions that the focus “should be on improving accessibility features like captioned phones and video calling options, ensuring deaf individuals can use phones with their preferred mode of communication. Translation tools should be supplementary, not a replacement for established methods like sign language interpreters and relay services.”

Consequently, while advancements in phone translation technology offer a glimmer of hope for independent phone use by the Deaf community, it is crucial to acknowledge that these tools come with limitations that shouldn't sideline other established communication methods.

According to researchers, current shortfalls and concerns included the following: 1) accuracy -speech recognition technology is imperfect, especially with accents, background noise, or rapid speech. Misinterpretations during phone conversations can lead to misunderstandings and frustration for deaf users; 2) loss of nuance - phone translation tools primarily focus on converting words, failing to capture the subtleties of spoken communication like tone, sarcasm, or humor This can lead to missed messages and a transactional feel to conversations; 3) limited sign language integration - while some tools aim for sign language output, the technology is still nascent.

Current options might not encompass the full breadth and complexity of sign language, hindering clear communication; and 4) privacy issues - speech recognition often relies on cloud-based processing, raising privacy concerns for sensitive conversations. Deaf users might be apprehensive about their conversations being stored or accessed by third parties.

AI Tools

For his part, Daniel expressed a reluctance to utilize the still fledgling AI tools, asserting further that Google Glasses-type devices are still a way off, and arguing that AI still probably does not catch all sentences and often misses the meaning of words. Human interpreters can still explain words and meanings much more clearly in sign language ”The current products – both AI and devices -- fail to catch the variety of expressions, ‘hand accents,’ and gestures that a human interpreter would,”, Daniel asserted.

Moreover, for a professional engineer AI solutions often rely on cloud-based processing, raising concerns about the privacy of sensitive conversations and the potential for data breaches. Let alone, the simple ‘pleasures’ of human interactions that we naturally take for granted, i.e., AI translation still struggles with sarcasm, humor, and cultural references, leading to a loss of the richness and depth inherent in human communication.

While phone translation software isn't a perfect solution for Deaf engineers, its benefits are undeniable. By removing communication barriers, it empowers Daniel and others to excel in their fields, fostering a more inclusive and dynamic engineering environment.

Overall, phone translation technology is a significant advancement towards a more equitable and accessible communication landscape for the deaf community. Thankfully, advancements in phone translation software are transforming how Daniel navigates the professional landscape.

By Daniel Rodriguez, Site/Civil CAD Technician Sean Phelan, Associate AIA.
This article is from: