(Credit: Figure)
A new demo gives an early look at how OpenAI’s ChatGPT tech can power humanoid robots, giving them the ability to have full conversations with humans.
The demo comes from the startup Figure, which is developing a general purpose robot that promises to one day replace what it calls “unsafe and undesirable” human jobs. Last month, the startup announced a partnership with OpenAI to use its AI models to expand the machine’s ability to perceive, reason, and interact.
On Wednesday, Figure posted a video that demonstrated some of the early results. By tapping OpenAI’s models, the bot is able to speak and interpret its surroundings.
In the demo, the robot—dubbed Figure 01—uses the abilities to see that a red apple has been placed in its field of view. The machine then gives the apple to the human user after he asks, “Can I have something to eat?”
“Sure thing,” Figure 01 replies. What’s interesting about the demo is how the machine can understand general commands from the human user, without needing to know all the specifics. For example, Figure 01 explains it gave the apple to the human user because “it was the only edible item I could provide you with.”
The machine is also able to pick up some trash and place it in a nearby bin when the human command is merely “pick up this trash.” In addition, Figure 01 is smart enough to know that an empty dish and cup placed in front of it should eventually be moved to a drying rack nearby. The robot then uses its metal hands to move the dish and cup to the rack.
“I think I did pretty well,” Figure 01 says when asked about its performance. “The apple found its new owner, the trash is gone, and the tableware is right where it belongs.” That said, the robot did need a moment to process each human command.
There’s no word on when the robot will officially launch. But Figure is partnering with OpenAI in the hopes it’ll speed up the “commercial deployment” of its robots.