TY - GEN
T1 - RF-FSO Dual-Path UAV Network for High Fidelity Multi-Viewpoint Scalable 360° Video Streaming
AU - Khan, Mahmudur
AU - Chakareski, Jacob
AU - Gupta, Sabyasachi
N1 - Publisher Copyright: © 2020 IEEE.
PY - 2020/9/21
Y1 - 2020/9/21
N2 - We explore a novel RF-FSO dual-path UAV net-work for remote scene aerial scalable 360° video capture and streaming, to enable future virtual human teleportation. One UAV captures the 360° video viewpoint and constructs a scalable tiling representation of the data comprising a base layer and an enhancement layer. The base layer is sent by the UAV to a ground-based remote server using a direct RF link. The enhancement layer is relayed by the UAV to the server over a multi-hop path comprising directed UAV to UAV FSO links. The viewport-specific content from the two layers is then integrated at the server to construct high fidelity content to stream to a remote VR user. The dual-path connectivity ensures both reliability and high fidelity remote immersion. We formulate an optimization problem to maximize the delivered immersion fidelity which depends on the content capture rate, FSO and RF link rates, effective routing path selection, and fast UAV deployment. The problem is mixed integer programming and we formulate an optimization framework that captures the optimal solution at lower complexity. Our experimental results demonstrate an up to 6 dB gain in delivered immersion fidelity over a state-of-the-art method and for the first time enable 12K-120fps 360° video streaming at high fidelity.
AB - We explore a novel RF-FSO dual-path UAV net-work for remote scene aerial scalable 360° video capture and streaming, to enable future virtual human teleportation. One UAV captures the 360° video viewpoint and constructs a scalable tiling representation of the data comprising a base layer and an enhancement layer. The base layer is sent by the UAV to a ground-based remote server using a direct RF link. The enhancement layer is relayed by the UAV to the server over a multi-hop path comprising directed UAV to UAV FSO links. The viewport-specific content from the two layers is then integrated at the server to construct high fidelity content to stream to a remote VR user. The dual-path connectivity ensures both reliability and high fidelity remote immersion. We formulate an optimization problem to maximize the delivered immersion fidelity which depends on the content capture rate, FSO and RF link rates, effective routing path selection, and fast UAV deployment. The problem is mixed integer programming and we formulate an optimization framework that captures the optimal solution at lower complexity. Our experimental results demonstrate an up to 6 dB gain in delivered immersion fidelity over a state-of-the-art method and for the first time enable 12K-120fps 360° video streaming at high fidelity.
UR - http://www.scopus.com/inward/record.url?scp=85099225065&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85099225065&partnerID=8YFLogxK
U2 - 10.1109/MMSP48831.2020.9287140
DO - 10.1109/MMSP48831.2020.9287140
M3 - Conference contribution
T3 - IEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020
BT - IEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 22nd IEEE International Workshop on Multimedia Signal Processing, MMSP 2020
Y2 - 21 September 2020 through 24 September 2020
ER -