Lenovo Tech World Unveils AI Tool for ALS Communication

Groundbreaking Assistive Technology Unveiled by Lenovo and the Scott-Morgan Foundation

In a significant development for assistive technology, Lenovo and the Scott-Morgan Foundation (SMF) have announced a new suite of innovative tools designed to aid individuals with amyotrophic lateral sclerosis (ALS) and similar disabilities. This cutting-edge technology combines predictive artificial intelligence (AI), hyper-realistic avatars, personalized voice systems, and eye-gaze tracking to offer new communication avenues for those affected by severe disabilities.

The Launch at Lenovo Tech World 2024

The unveiling took place at Lenovo Tech World 2024 in Seattle, where the two organizations showcased their collaborative efforts to harness AI for accessibility. Lenovo, a leader in global technology, and SMF, a non-profit organization dedicated to advancing assistive technology, have worked together to create an AI-driven solution aimed at enhancing communication for individuals with ALS, a progressive neurodegenerative disease that often leads to complete body paralysis. This innovative suite not only addresses the needs of ALS patients but also offers potential benefits for individuals with other disabilities.

Components of the Assistive Technology Suite

The newly introduced technology suite comprises several key components. A circular keyboard interface, designed by SMF and constructed by Lenovo, serves as the foundation. Lenovo’s predictive AI enhances this interface by anticipating user needs and responses. Additionally, ElevenLabs provides personalized AI voice replicas, allowing users to communicate in a voice that closely resembles their own. Hyper-realistic avatars, developed by D-ID, offer a visual representation of the user, while IrisBond’s eye-tracking technology enables precise and responsive interaction.

This comprehensive solution is currently undergoing active testing within the SMF community, including individuals with ALS and leading clinicians. The technology has evolved from years of collaboration between SMF and Lenovo, focusing on reimagining and scaling assistive technology to meet the needs of those with ALS and similar conditions.

Real-World Application and Impact

A poignant example of the technology’s impact was shared during the Lenovo Tech World event. A father recently diagnosed with ALS used the technology to communicate with his young children, sharing stories and singing lullabies in his own voice. This demonstration highlighted the profound potential of the assistive suite to transform lives by preserving personal connections and communication abilities.

Linda Yao, Vice President of AI Solutions and Services at Lenovo, emphasized the transformative nature of the collaboration. "This is Smarter AI for All: applying transformative technologies to the most pressing human challenges," Yao stated. "With compassionate partners like the Scott-Morgan Foundation and a bold vision to bring AI to everyone, we are using our AI expertise and portfolio to show how bright the future can be."

A Vision for Inclusive Technology

The Scott-Morgan Foundation’s mission is to break down technological barriers and create life-changing solutions that enable everyone to thrive. LaVonne Roberts, Executive Director of SMF, highlighted the significance of their work: "We live in a world where over half a billion people are silenced, not by choice, but by disability. Imagine a world where even the most severely disabled individuals can fully express themselves, where cutting-edge technology gives voice to the voiceless. We’re not just imagining this world—we’re building it together with Lenovo."

The potential impact of this technology extends beyond ALS, as it can benefit the over 500 million people worldwide who struggle with muscular or neurological conditions. By providing a voice to the voiceless, this collaboration aims to empower individuals and improve their quality of life.

Live Demonstrations and Feedback

At Lenovo Tech World, Erin Taylor, a disability advocate and botany enthusiast living with ALS, demonstrated the technology. Taylor used it to introduce herself and welcome Lenovo Chairman and CEO Yuanqing Yang to the stage. Her ability to speak with a voice that resembled her pre-diagnosis voice showcased the technology’s power to restore personal identity and communication.

Taylor also participated in a live demonstration on the show floor, offering valuable feedback to the development team. Her involvement underscores the importance of user-driven design and development in creating technology that truly meets the needs of its users.

Advancements in AI and Assistive Technology

Lenovo’s development of a fully functional, integrated prototype builds upon early designs first unveiled at CES 2024. Daniel Pollock, Lenovo UX prototyper, led the interface development with a focus on human-centric design and innovative user experiences. "It’s an absolute privilege to contribute and collaborate on this project and incorporate such powerful AI technology," Pollock remarked.

Traditional voice banking, a process used to preserve an individual’s voice, has often been limited by the vocal deterioration that accompanies ALS. Previous models lacked emotional expressiveness and natural rhythms, resulting in robotic-sounding voices. However, advances in AI have transformed this process, allowing for the creation of compelling, on-demand AI voices from limited audio samples, even those of poor quality.

Collaborative Contributions

Mati Staniszewski, CEO of ElevenLabs, expressed the company’s inspiration from individuals reclaiming their voices despite significant challenges. "We’re grateful for the chance to play a small part in that process," Staniszewski said. "Now, with the incredible support of the Scott-Morgan Foundation, we’re taking these efforts to the next level. We’re proud to help remove communication barriers and empower people."

The avatar technology from D-ID integrates seamlessly into the solution, offering lifelike visual representations of users. Gil Perry, co-founder and CEO of D-ID, emphasized the importance of using technology for social good: "Promoting social good is where we see it make a life-changing impact. Working with this collaboration perfectly fits our strategy of using AI to make the world better and more connected."

Technical Specifications and Future Development

The complete solution operates on Lenovo’s ThinkPad x12 detachable PC, combining power and portability. The detachable form factor allows the device to be mounted on various surfaces, from kitchen tables to wheelchairs, and integrates IrisBond’s eye-tracking hardware and software. IrisBond’s Hiru camera precisely tracks eye movement across platforms and conditions, enhancing user interaction.

Eduardo Jauregui Torrecilla, CEO of IrisBond, highlighted the company’s commitment to disrupting the assistive tech landscape: "We have a history of hands-on support and development for people with ALS, cerebral palsy, and countless conditions where the eye is our greatest tool to communicate—and AI is transforming what’s possible in extraordinary ways."

A Legacy of Innovation

The Scott-Morgan Foundation continues to collaborate with clinicians, technologists, and individuals with ALS to refine and test the technology. This solution fulfills one of the dreams of visionary roboticist Dr. Peter Scott-Morgan, who passed away in 2022. At the time, rendering an avatar or speaking with a banked voice was a time-consuming, expensive process, but advancements in generative AI have made these tasks more expressive and accurate.

Andrew Morgan, CEO of the Scott-Morgan Foundation, emphasized the need to advocate for these solutions: "We have always believed that AI is the gateway for a revolution in assistive technology, but we need to bang the drum and advocate for these solutions—to give a voice to those who need it most and include them in the process. We are still in uncharted territory, and I can’t wait to see what solutions we pioneer and democratize next."

For more details, you can visit the Scott-Morgan Foundation website.

For more Information, Refer to this article.