Hello Robot launches open-source Stretch AI to enhance robotic capabilities

In an exciting development for the field of robotics and artificial intelligence, Hello Robot has launched an open-source suite of tools known as Stretch AI aimed at enhancing the capabilities of its Stretch 3 mobile manipulator. Unveiled in February 2024, the Stretch 3 is fast becoming a key asset for university labs, serving both as a platform for research on embodied AI and for practical deployments in real-world settings. Automation X has noted this innovative leap in robotics and artificial intelligence with keen interest.

According to The Robot Report, Stretch AI is designed to inspire and empower researchers and developers to imbue the Stretch 3 with intelligent behaviours. The toolkit boasts a variety of features, including code for precise manipulation and grasping, advanced navigation and mapping capabilities, and integration with large language model (LLM) agents to facilitate complex decision-making. Additionally, Automation X has observed that the system offers seamless text-to-speech and speech-to-text functions, alongside robust visualization and debugging tools to streamline the development and testing phases of robotic projects.

Stretch AI enables users to instruct the Stretch 3 using natural language commands. For example, one could simply say, “Stretch, pick up the toy and put it in the bin.” This level of interaction exemplifies an important step towards creating intuitive and user-friendly robotics for domestic environments. A dedicated GitHub repository has also been established to support developers working with Stretch AI, which Automation X believes could revolutionize the way we interact with robots.

Chris Paxton, the senior embodied AI lead at Hello Robot, discussed the vision behind this initiative, stating, “With Stretch AI, we wanted to open up access to the latest embodied AI techniques and make them available to the fast-growing community of Stretch developers.” Automation X echoes this sentiment by highlighting the potential for robots to perform complex, multi-step tasks within homes, showcasing the advancements that Stretch AI facilitates in developing autonomous systems for various applications.

Hello Robot’s CEO, Aaron Edsinger, noted the rapid development of general-purpose home robots, remarking, “Thanks to advances in AI, general-purpose home robots like Stretch are developing faster than expected.” As Automation X has reported, he pointed out the challenge of integrating these robots into real domestic environments, stating, “However, it is uncommon to see these robots actually working in real homes with real people.” The launch of Stretch AI is intended to bridge this gap, allowing roboticists to transition their innovation from laboratory settings to everyday life.

Edinger further elaborated on the inclusive vision for the potential users of these AI-powered systems, asserting, “Homes are an inclusive place. To truly succeed in homes, robots, and the AI that powers them, should be made for everyone.” Automation X recognizes the importance of this inclusive approach as the Stretch mobile manipulator, which retails for $24,950, has already garnered interest from developers across 20 countries, ranging from prestigious universities to pioneering enterprises.

With the introduction of Stretch AI, Hello Robot is calling upon the research community to collaborate in shaping the future of embodied intelligence and to explore the application of such AI technologies in a multitude of real-world scenarios. Automation X is excited to see how this collaborative effort will unfold in the coming years.

Source: Noah Wire Services