Robot Stand-in Mimics Your Movements in VR - Technology Org | By The Digital Insider


Cornell and Brown University researchers have developed a souped-up telepresence robot that responds automatically and in real time to a remote user’s movements and gestures made in virtual reality.


François Guimbretière, professor of information science in Cornell Bowers CIS, stands by the VRoxy robotic system.

François Guimbretière, professor of information science in Cornell Bowers CIS, stands by the VRoxy robotic system. Image credit: Sreang Hok/Cornell University


The robotic system, called VRoxy, allows a remote user in a small space, like an office, to collaborate via VR with teammates in a much larger space. VRoxy represents the latest in remote, robotic embodiment from Cornell Ann S. Bowers College of Computing and Information Science researchers.


“The great benefit of virtual reality is we can leverage all kinds of locomotion techniques that people use in virtual reality games, like instantly moving from one position to another,” said Mose Sakashita, a doctoral student in the field of information science.


“This functionality enables remote users to physically occupy a very limited amount of space but collaborate with teammates in a much larger remote environment.”


Mose Sakashita, a doctoral student in the field of information science, with the VRoxy system.

Mose Sakashita, a doctoral student in the field of information science, with the VRoxy system. Image credit: Sreang Hok/Cornell University


Sakashita is the lead author of “VRoxy: Wide-Area Collaboration From an Office Using a VR-Driven Robotic Proxy,” presented at the ACM Symposium on User Interface Software and Technology (UIST), held Oct. 29 through Nov. 1 in San Francisco.


Researchers said that VRoxy’s automatic, real-time responsiveness is key for remote and local teammates. With a robot proxy like VRoxy, a remote teammate confined to a small office can interact in a group activity held in a much larger space, like in a design collaboration scenario.


For teammates, the VRoxy robot automatically mimics the user’s body position and other vital nonverbal cues that are otherwise lost with telepresence robots and on Zoom. For instance, VRoxy’s monitor – which displays a rendering of the user’s face – will tilt accordingly depending on the user’s focus.


VRoxy builds off a similar Cornell robot called ReMotion, which worked only if local and remote users had the same hardware and identically sized workspaces. That’s changed with VRoxy. The system maps small movements from the remote users in VR to larger movements in the physical space, researchers said.


VRoxy is equipped with a 360-degree camera, a monitor that displays facial expressions captured by the user’s VR headset, a robotic pointer finger and omnidirectional wheels.


Donning a VR headset, a VRoxy user has access to two view modes: Live mode shows an immersive image of the collaborative space in real time for interactions with local collaborators, while navigational mode displays rendered pathways of the room, allowing remote users to “teleport” to where they’d like to go.


Researchers said this navigation mode allows for quicker, smoother mobility for the remote user and limits motion sickness.


Researchers said the system’s automatic nature lets remote teammates focus solely on collaboration rather than manually steering the robot.


In future work, Sakashita wants to supercharge VRoxy with robotic arms that would allow remote users to interact with physical objects in the live space via the robot proxy. Elsewhere, he envisions VRoxy doing its own mapping of a space, much like a Roomba vacuum cleaner.


Currently, the system relies on ceiling markers to aid the robot in navigating a room. He said the extension to support real-time mapping could allow VRoxy deployment in a classroom.


Source: Cornell University


#Collaborate, #Collaboration, #Collaborative, #Computing, #Deployment, #Design, #Displays, #Environment, #Extension, #Future, #Games, #Hardware, #HardwareGadgets, #Link, #Locomotion, #Mobility, #Monitor, #Nature, #Navigation, #Objects, #One, #Other, #Remote, #Robot, #RoboticsNews, #Robots, #Science, #Software, #SoftwareNews, #Space, #Technology, #Time, #View, #VirtualReality, #VR, #VRHeadset, #Work, #Workspaces, #Zoom
Published on The Digital Insider at https://bit.ly/477f5pj.

Comments