In the bustling city of Las Vegas, the T-Mobile Arena is not just a hub for thrilling hockey games by the Golden Knights, but also a window into the future of technology in hospitality. This is where ADAM, a sophisticated robot developed with NVIDIA Isaac libraries, is captivating visitors by pouring drinks and showcasing the marvels of modern robotics.
### Introducing ADAM: The Automated Dual Arm Mixologist
ADAM, which stands for Automated Dual Arm Mixologist, is a creation of Richtech Robotics, a company based in Las Vegas. This robot isn’t just a flashy gimmick; it’s a real-world solution addressing significant challenges faced by the hospitality sector, such as labor shortages and the ever-growing demand for unique and memorable customer experiences.
Matt Casella, the president of Richtech Robotics, explains, “The hospitality industry faces significant labor challenges, and ADAM is our answer to meeting those needs while elevating the customer experience. With NVIDIA’s Isaac platform, we’ve developed a solution that’s scalable, consistent, and frankly, creates memorable moments for fans. The response at T-Mobile Arena has been phenomenal—people love interacting with ADAM.”
### Learning to Serve: Training in a Virtual Environment
Before ADAM made its debut at the arena, it underwent extensive training in a virtual setting. Richtech Robotics utilized NVIDIA Isaac Sim, an open-source robotic simulation framework built on NVIDIA Omniverse, to create a detailed and realistic digital version of ADAM’s workspace. This virtual environment included all the elements ADAM would encounter, such as cups, utensils, and varying lighting conditions.
The team also generated synthetic data to help ADAM learn how to recognize objects even under challenging conditions like glare or reflection. This training in a virtual bar was crucial for honing ADAM’s skills in pouring and shaking drinks. By using Isaac Lab, NVIDIA’s open-source robot learning framework, ADAM was equipped not just to follow instructions, but to adapt seamlessly to its environment with remarkable precision.
### Real-Time Performance with NVIDIA Jetson
ADAM operates using the NVIDIA Jetson AGX Orin, a powerful edge AI platform capable of delivering 275 trillion operations per second (TOPS) of computing power. By leveraging Isaac ROS 2 libraries, ADAM processes camera feeds, detects objects, and calibrates its workspace in real time. This capability is further enhanced by ADAM’s perception stack, built with TAO Toolkit and optimized with TensorRT, allowing it to identify cups, measure liquid levels, and adjust its movements with extraordinary speed and accuracy. This ensures that ADAM can, for instance, spot a misplaced cup, detect when foam reaches the rim, and adjust its pour without missing a beat.
### Expanding Horizons: Introducing Dex in Industrial Automation
While ADAM is busy serving drinks at Golden Knights games, Richtech Robotics is also making significant advancements in industrial automation. They have introduced Dex, a new mobile humanoid robot designed for factory and warehouse settings. Showcased at GTC DC, Dex combines the mobility of an autonomous wheeled platform with the precision and dexterity of dual-arm robotic technology. It’s crafted to perform light-to-medium industrial tasks like operating machinery, sorting parts, handling materials, and packaging, all while being flexible enough to adapt to various tools and workflows.
Dex operates on NVIDIA Jetson Thor, a next-generation robotics processor that enables real-time sensor processing and AI reasoning in dynamic industrial environments. Dex’s training involved a combination of real-world and synthetic data generated from Isaac Sim, which prepared Dex to handle a wide range of scenarios effectively.
### The Future of Robotics in Hospitality and Industry
The introduction of ADAM and Dex signifies a transformative moment in both the hospitality and industrial sectors. The use of advanced robotics powered by NVIDIA’s technology illustrates how automation can not only address workforce challenges but also enhance customer engagement and operational efficiency. For businesses and consumers alike, these innovations represent a glimpse into a future where technology and human experience are more closely intertwined than ever before.
The T-Mobile Arena’s embrace of ADAM is a testament to the growing trend of integrating robotics in everyday settings, offering a peek into how these technologies might soon become a regular part of our lives. As we witness such advancements, it’s clear that the potential applications of robotics in various industries are vast and full of possibilities. For those interested in the technical aspects or seeking further insights into NVIDIA’s cutting-edge robotics platforms, exploring resources like the NVIDIA Isaac libraries and Jetson platforms can provide valuable information and inspiration.
For more Information, Refer to this article.
