Researchers at the University of Rochester are pioneering AI-powered tools to assist parents of deaf children in learning sign language, aiming to improve communication and educational outcomes.
In an innovative endeavour to integrate artificial intelligence (AI) with child development and learning, researchers at the University of Rochester, led by Assistant Professor of Computer Science Zhen Bai, are experimenting with AI-powered tools such as the Tabletop Interactive Play System (TIPS). This system, designed to assist parents of deaf and hard-of-hearing (DHH) children in learning American Sign Language (ASL), represents a pioneering effort to bridge communication gaps and enhance developmental outcomes for children. The project emerged from a collaboration between Bai and Wyatte Hall, a Deaf assistant professor at the University of Rochester Medical Center.
The genesis of the TIPS project can be traced back to a new faculty orientation breakfast where Bai and Hall discussed the developmental challenges faced by young DHH children. Hall highlighted that over 90 percent of DHH children are born to hearing parents who often lack initial experience with sign language, resulting in potential language deprivation. This is further complicated by the limitations of technological aids like cochlear implants and hearing aids. Recognising the neurocritical period in early childhood where language acquisition is crucial, Bai seized upon the potential of technology to improve communication between parents and their DHH children.
Uniquely positioned geographically, Rochester is reported to have the largest per capita DHH population in the United States, making it an ideal hub for such developmental research. The TIPS device uses a camera and microphone setup to monitor interactions between the parent and child, supplemented by a projector that displays ASL video content sourced through AI from various libraries. Bai’s team, comprising students from diverse backgrounds such as computer science, data science, and neuroscience, is expanding the technology’s reach by developing adaptations for tablets, smartwatches, and smart glasses.
Bai’s research extends beyond ASL, involving endeavours to demystify machine learning for younger audiences. Through funding from the National Science Foundation’s prestigious CAREER award, Bai is collaborating with University colleagues to create educational tools that enable K–12 students to understand and engage with AI and machine learning. GroupIt, a tool developed for teachers and students alike, allows users to interact with data without needing complex programming skills. Bai’s efforts underscore the significance of equipping students to comprehend AI, which is increasingly prevalent in everyday life, from book recommendations to determining viewing preferences.
Additionally, Bai’s team has developed BeeTrap, an augmented reality game designed to elucidate the decision-making processes behind AI recommendation systems. The game uses bee-pollination to symbolise preference selection, demonstrating how choosing certain actions can influence outcomes and variability—a metaphor for personal choices guiding AI-driven recommendations.
For further grounding in practical applications, Bai’s team also created OptiDot, a tangible device demonstrating how AI might tailor food recommendations based on flavour preferences. These tools aim at increasing students’ understanding of AI’s role and impact, particularly among marginalised groups often affected by biases inherent in AI systems.
The collective goal of these initiatives is to increase AI literacy among children and educators, ensuring that the next generation is better informed about the technology that shapes modern life. Through this multifaceted approach, Bai satisfies her commitment to using AI as a powerful, positive force in education. Her initiatives highlight the potential for AI to address educational disparities and equip children from varied backgrounds with essential skills for the future.
Source: Noah Wire Services
- https://medicalxpress.com/visualstories/2024-11-ai-advance-child.amp – This article explains Zhen Bai’s research on using AI to help parents of deaf and hard-of-hearing children learn American Sign Language (ASL) and her development of the Tabletop Interactive Play System (TIPS).
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This article details the collaboration between Zhen Bai and Wyatte Hall, the development of TIPS, and its adaptations for various devices to assist in learning ASL.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This source provides information on the geographical advantage of Rochester for this research due to its large per capita DHH population and the expansion of TIPS technology.
- https://medicalxpress.com/visualstories/2024-11-ai-advance-child.amp – This article discusses Bai’s efforts to demystify machine learning for younger audiences, including the development of educational tools and the BeeTrap augmented reality game.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This source describes the BeeTrap game and its purpose in explaining AI recommendation systems to K–12 students.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This article mentions the development of OptiDot, a device demonstrating how AI tailors recommendations, and its role in increasing AI literacy among students.
- https://medicalxpress.com/visualstories/2024-11-ai-advance-child.amp – This source highlights the importance of equipping students to comprehend AI and its impact, especially among marginalized groups affected by biases in AI systems.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This article emphasizes the collective goal of increasing AI literacy among children and educators through Bai’s multifaceted approach.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This source underscores Bai’s commitment to using AI as a positive force in education and addressing educational disparities.
- https://medicalxpress.com/visualstories/2024-11-ai-advance-child.amp – This article discusses the significance of preparing the next generation to understand and use AI, including its ethical implications.
- https://www.rochester.edu/newscenter/ai-deaf-and-hard-of-hearing-children-development-learning-627882/ – This source details the collaboration with other researchers and students from diverse backgrounds in developing these AI-powered educational tools.
