Coming Soon: Sign-Speak Pilot
From November 1 to December 16, Syracuse University will pilot Sign-Speak, a cutting-edge, AI-based sign-to-speech and speech-to-sign web tool. The tool will be available for use across main campus locations during this period.
We encourage anyone who may benefit from this technology to try it and share their experiences. Your feedback will help us better understand how this tool can support communication on campus and can be directed to accessibleIT@syr.edu.
Wait, what is Sign-Speak?
Sign-Speak is a visual and audio-interpreting service designed to enhance real-time communication between Deaf/Hard of Hearing individuals and hearing individuals. Using only a camera, Sign-Speak translates American Sign Language (ASL) to spoken or written English and turns speech or text into lifelike signing via a digital avatar.
Sign-Speak is a Deaf-owned company created out of the National Technical Institute for the Deaf (NTID) at Rochester Institute of Technology (RIT). Developed in close collaboration with the Deaf Community, Sign-Speak combines cutting-edge automated artificial intelligence with on-demand access to human ASL interpreters. The platform serves individuals, organizations, and developers who need accessible communication solutions for everyday conversations, events, and digital content.
The following video shows an ASL signer and a verbal communicator conversing through the AI agent. The speaker greets the signer, the AI agent signs the question, and the signer replies. The AI agent then displays the signed response via text and voices it aloud. During this video, you may notice highlighted yellow text. This allows the signer to verify what they have signed and what has been signed back as accurate. This allows the AI to improve the recognition of ASL for other users in the future.
How Can Sign-Speak Help Me?
Sign-Speak is designed to make it easier for Deaf, Hard of Hearing, and hearing students to communicate naturally in class, study sessions, or in everyday conversations. An interpreter is not always available outside the classroom, so Sign Speaks allows you to bridge the language barrier between the hearing and the Deaf/Hard-of-Hearing worlds. It is important to know that this tool is helpful in many situations such as classroom participation, but in events on campus, student clubs, hanging out with your friends or ordering food at the dining hall.
How Do I Use Sign-Speak?
All you need is a device with a camera and internet connection. Open Sign-Speak on your device, choose whether you want to sign, speak, or type, and the app will translate your communication in real time. You can use it on your computer, tablet, or phone.
FAQ
Interpreters are limited in the City of Syracuse. Allowing on demand access to communication for members of the campus will eliminate the worry of a last-minute request. Most requests for interpreters are usually two weeks before. If you decide to participate in an event that you want to attend last minute or meet a new friend, this program bridges the gap between the hearing and deaf/hard of hearing world.
No, it does not harvest your conversations. It only gets accurate approval from the user on if the signs or captions are accurate.
No this is for anyone who would benefit from it on campus.
The Syracuse University Sign-Speak access areas include main campus locations, North Campus, South Campus, and downtown Syracuse properties. When connecting with Sign-Speak at these locations, use of the service is free for students, faculty, staff, alumni, and visitors. Sign-Speak is available 24 hours a day, seven days a week.