UA RU EN

Alibaba Teaches Robots to Follow Voice Commands in the Physical World

Alibaba навчає роботів реагувати на голосові команди у реальному житті. Photo: НВ — Техно

Alibaba's New Qwen-Robot Toolkit

On June 18 at 12:00, Alibaba introduced the Qwen-Robot toolkit, designed to train robots for real-world physical tasks. This package includes three distinct models, each targeting a different level of physical intelligence. The company's developers processed over 38,000 hours of data on objects and interactions, forming the foundation for these models.

  • The first model handles navigation without pre-loaded maps, enabling robots to orient themselves in space.
  • The second model focuses on manipulation, teaching robots to grasp, move, and interact with objects.
  • The third model acts as a predictor, helping robots assess potential changes in their environment after actions and the consequences of movements.

The main challenge for developers was that data used to train typical chatbots is unsuitable for controlling motors or sensors. Information from robotic arms, navigation systems, and cameras has a fundamentally different nature, complicating the learning process.

Demonstration and Market Impact

During a demonstration, the four-legged robot Unitree Go2 was used, executing voice commands such as moving a cup to a shelf. These developments are currently being tested by Alibaba Cloud's corporate clients. The company's entry into this market signals a global shift in the tech industry's sentiment. While Google advances Gemini Robotics and NVIDIA expands its ecosystem, Alibaba aims to combine the strengths of Chinese manufacturing with new software solutions for autonomous systems.

Advances in robotics technology are becoming increasingly relevant in today's market, where process automation can reduce costs and boost efficiency. Investments by major companies like Alibaba in training robots to interact with the physical world highlight the potential for transformation across various economic sectors, from logistics to customer service. This could also intensify competition among tech giants vying for leadership in this rapidly evolving field.

As robotics technology continues to evolve, the introduction of humanoid robots in various sectors is gaining traction. For instance, a recent deployment of a humanoid robot on the production floor of Chinese automaker Seres showcases the practical applications of advanced robotic systems. This shift emphasizes the importance of integrating cutting-edge software with physical capabilities, a trend that aligns with Alibaba's latest innovations in robot training. To learn more about this significant development in the manufacturing industry, visit the debut of humanoid robots in factories.