TY - GEN
T1 - Demo
T2 - 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2022
AU - Meursing, Emory
AU - Deng, Zeyu
AU - Fogg, Jordan
AU - Huang, Long
AU - Wang, Huaxia
AU - Wang, Chen
N1 - Publisher Copyright: © 2022 Owner/Author.
PY - 2023/4/24
Y1 - 2023/4/24
N2 - With the rapidly growing virtual reality (VR) technologies, maturing motion tracking applications, and the advancement in robotics, physically interacting with the remote world via a robot while the user is observing the scene through a VR headset seems to be one solution to the substantial need for telepresence. This work presents a first-person viewing hand motion controlled robotic arm framework that provides an immersive robot control experience. In particular, we developed a platform with an off-the-shelf 360° camera, a robotic arm, and a VR headset to allow for live 360° video streaming, hand tracking, and robotic arm control. Demo activities with three types of robot operation tasks (i.e., in-air drawing, object collection, and line tracing) show that our platform enables an enhanced first-person vision presence and a smooth robot teleoperation.
AB - With the rapidly growing virtual reality (VR) technologies, maturing motion tracking applications, and the advancement in robotics, physically interacting with the remote world via a robot while the user is observing the scene through a VR headset seems to be one solution to the substantial need for telepresence. This work presents a first-person viewing hand motion controlled robotic arm framework that provides an immersive robot control experience. In particular, we developed a platform with an off-the-shelf 360° camera, a robotic arm, and a VR headset to allow for live 360° video streaming, hand tracking, and robotic arm control. Demo activities with three types of robot operation tasks (i.e., in-air drawing, object collection, and line tracing) show that our platform enables an enhanced first-person vision presence and a smooth robot teleoperation.
UR - http://www.scopus.com/inward/record.url?scp=85158963692&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85158963692&partnerID=8YFLogxK
U2 - 10.1145/3544793.3560328
DO - 10.1145/3544793.3560328
M3 - Conference contribution
T3 - UbiComp/ISWC 2022 Adjunct - Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2022 ACM International Symposium on Wearable Computers
SP - 85
EP - 87
BT - UbiComp/ISWC 2022 Adjunct - Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2022 ACM International Symposium on Wearable Computers
PB - Association for Computing Machinery, Inc
Y2 - 11 September 2022 through 15 September 2022
ER -