RBR50 Spotlight: TRI builds large behavior models to teach robots – The Robot Report

Listen to this article

Voiced by Amazon Polly


Organization: Toyota Research Institute
Country: U.S.
Website: https://www.tri.global
Year Founded: 2015
Number of Employees: 201-500
Innovation Class: Technology, Product & Services


Generative AI garnered a lot of attention in 2023, but developers have only just started applying it to robotics. In September 2023, Toyota Research Institute (TRI) announced what it said was a “breakthrough” approach based on Diffusion Policy to quickly teach robots new skills.

rbr50 banner logo.The artificial intelligence advancement was a step toward building large behavior models (LBMs), which promise to do for robots what large language models (LLMs) have done for conversational AI, said TRI. “Our research in robotics is aimed at amplifying people rather than replacing them,” said Gill Pratt, CEO of TRI and chief scientist at parent company Toyota Motor Corp. “This new teaching technique is both very efficient and produces very high-performing behaviors, enabling robots to much more effectively amplify people in many ways.”

Previous AI approaches had limitations such as narrowly defined tasks and the need for numerous time-consuming iterative cycles, according to TRI, which has offices in Los Altos, Calif., and Cambridge, Mass.

In TRI’s approach, a teacher instructed a custom two-armed robot with haptic demonstrations, and the system then uses Diffusion Policy to learn the skill. It can do so with dozens of demonstrations in days rather than the weeks spent coding and testing, the company added.

The Drake model-based design provided TRI with a toolbox and realistic simulation platform. The optimization framework began as an internal model and has since been released as open-source.

TRI said it has taught robots to do more than 60 tasks such as pouring liquids, using tools, and manipulating soft objects by supplying them with new images and tactile sensing data rather than by writing code. TRI said it hopes to reach 1,000 skills by the end of 2024.

By enabling robots to interact with the world in more varied ways, Toyota Research Institute said it is making them better able to support people in everyday, unstructured environments.


SITE AD for the 2024 RoboBusiness registration now open. Register now and save.


Explore the RBR50 Robotics Innovation Awards 2024.

Toyota Research Institute robot with a gripper with RBR50 banner.


RBR50 Robotics Innovation Awards 2024

Organization Innovation
ABB Robotics Modular industrial robot arms offer flexibility
Advanced Construction Robotics IronBOT makes rebar installation faster, safer
Agility Robotics Digit humanoid gets feet wet with logistics work
Amazon Robotics Amazon strengthens portfolio with heavy-duty AGV
Ambi Robotics AmbiSort uses real-world data to improve picking
Apptronik Apollo humanoid features bespoke linear actuators
Boston Dynamics Atlas shows off unique skills for humanoid
Brightpick Autopicker applies mobile manipulation, AI to warehouses
Capra Robotics Hircus AMR bridges gap between indoor, outdoor logistics
Dexterity Dexterity stacks robotics and AI for truck loading
Disney Disney brings beloved characters to life through robotics
Doosan App-like Dart-Suite eases cobot programming
Electric Sheep Vertical integration positions landscaping startup for success
Exotec Skypod ASRS scales to serve automotive supplier
FANUC FANUC ships one-millionth industrial robot
Figure Startup builds working humanoid within one year
Fraunhofer Institute for Material Flow and Logistics evoBot features unique mobile manipulator design
Gardarika Tres Develops de-mining robot for Ukraine
Geek+ Upgrades PopPick goods-to-person system
Glidance Provides independence to visually impaired individuals
Harvard University Exoskeleton improves walking for people with Parkinson’s disease
ifm efector Obstacle Detection System simplifies mobile robot development
igus ReBeL cobot gets low-cost, human-like hand
Instock Instock turns fulfillment processes upside down with ASRS
Kodama Systems Startup uses robotics to prevent wildfires
Kodiak Robotics Autonomous pickup truck to enhance U.S. military operations
KUKA Robotic arm leader doubles down on mobile robots for logistics
Locus Robotics Mobile robot leader surpasses 2 billion picks
MassRobotics Accelerator Equity-free accelerator positions startups for success
Mecademic MCS500 SCARA robot accelerates micro-automation
MIT Robotic ventricle advances understanding of heart disease
Mujin TruckBot accelerates automated truck unloading
Mushiny Intelligent 3D sorter ramps up throughput, flexibility
NASA MOXIE completes historic oxygen-making mission on Mars
Neya Systems Development of cybersecurity standards harden AGVs
NVIDIA Nova Carter gives mobile robots all-around sight
Olive Robotics EdgeROS eases robotics development process
OpenAI LLMs enable embedded AI to flourish
Opteran Applies insect intelligence to mobile robot navigation
Renovate Robotics Rufus robot automates installation of roof shingles
Robel Automates railway repairs to overcome labor shortage
Robust AI Carter AMR joins DHL’s impressive robotics portfolio
Rockwell Automation Adds OTTO Motors mobile robots to manufacturing lineup
Sereact PickGPT harnesses power of generative AI for robotics
Simbe Robotics Scales inventory robotics deal with BJ’s Wholesale Club
Slip Robotics Simplifies trailer loading/unloading with heavy-duty AMR
Symbotic Walmart-backed company rides wave of logistics automation demand
Toyota Research Institute Builds large behavior models for fast robot teaching
ULC Technologies Cable Splicing Machine improve safety, power grid reliability
Universal Robots Cobot leader strengthens lineup with UR30