Sign-Speak Pilot is here!
From November 1 to December 16, Syracuse University will pilot Sign-Speak, a cutting-edge, AI-based sign-to-speech and speech-to-sign web tool. The tool will be available for use across main campus locations during this period.
We encourage anyone who may benefit from this technology to try it and share their experiences. Your feedback will help us better understand how this tool can support communication on campus and can be directed to accessibleIT@syr.edu.
Wait, what is Sign-Speak?
Sign-Speak is a visual and audio-interpreting service designed to enhance real-time communication between Deaf/Hard of Hearing individuals and hearing individuals. Using only a camera, Sign-Speak translates American Sign Language (ASL) to spoken or written English and turns speech or text into lifelike signing via a digital avatar.
Sign-Speak is a Deaf-owned company created out of the National Technical Institute for the Deaf (NTID) at Rochester Institute of Technology (RIT). Developed in close collaboration with the Deaf Community, Sign-Speak combines cutting-edge automated artificial intelligence with on-demand access to human ASL interpreters. The platform serves individuals, organizations, and developers who need accessible communication solutions for everyday conversations, events, and digital content.
The following video shows an ASL signer and a verbal communicator conversing through the AI agent. The speaker greets the signer, the AI agent signs the question, and the signer replies. The AI agent then displays the signed response via text and voices it aloud. During this video, you may notice highlighted yellow text. This allows the signer to verify what they have signed and what has been signed back as accurate. This allows the AI to improve the recognition of ASL for other users in the future.
How Can Sign-Speak Help Me?
Sign-Speak is designed to make it easier for Deaf, Hard of Hearing, and hearing students to communicate naturally in class, study sessions, or in everyday conversations. An interpreter is not always available outside the classroom, so Sign Speaks allows you to bridge the language barrier between the hearing and the Deaf/Hard-of-Hearing worlds. It is important to know that this tool is helpful in many situations such as classroom participation, but in events on campus, student clubs, hanging out with your friends or ordering food at the dining hall.
How Do I Use Sign-Speak?
All you need is a device with a camera and internet connection.
Open Sign-Speak on your device via the Sign-Speak Homepage or by scanning the following QR code:
Select “Get Started,” then “Let’s get started” after reading the terms and conditions.
Enable Camera access and you’re ready to start.
As verbal communicator, you can begin speaking and the AI avatar will perform voice-to-sign interpretation.
As an ASL signer, you can select the Video button and begin signing, then select Stop to end the recording and perform sign-to-text interpretation. Verify your message for accuracy and make edits or select Submit if correct. Your message will then be narrated by the app. You can use it on your computer, tablet, or phone.
FAQ
Interpreters are limited in the City of Syracuse. Allowing on demand access to communication for members of the campus will eliminate the worry of a last-minute request. Most requests for interpreters must be made by roughly two weeks prior to an event. If you decide to participate in an event that you want to attend last minute or meet a new friend, this program enables just-in-time support, bridging the gap between the hearing and Deaf/Hard of Hearing world.
Sign-Speak is not intended to replace, but rather to supplement live ASL interpretation on campus. Where live ASL is still required for events as per the Guidelines for CART and ASL Interpreting page, Sign-Speak is intended to be used as personal, just-in-time communication support technology for everyday conversations between signers and non-signers.
No, it does not save your conversations. It only gets solicits approval from the user on if the signs or captions are accurate, then wipes the content shared once a conversation is terminated.
No, this tool is for anyone who could benefit from AI interpretation between ASL signers and non-signers on campus.
The Syracuse University Sign-Speak access areas include main campus locations, North Campus, South Campus, and downtown Syracuse properties. When connecting with Sign-Speak at these locations, use of the service is free for students, faculty, staff, alumni, and visitors. Sign-Speak is available 24 hours a day, seven days a week.
Sign-speak performs best when it has clear and well-lit view of the signer. If signing with one hand (such as when holding a mobile device with the other), either place or hold the phone far enough away for the camera to capture your full sign.
Personalized signs, such as for sign names, are not currently available but Sign-Speak is working on developing this functionality.
Additional Questions? Contact the ITS Digital Accessibility Services team at accessibleIT@syr.edu, or visit our Digital Accessibility Office Hours.