Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks

Liudong Zuo, Michelle M. Zhu, Chase Wu, Aiqin Hou

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Many scientific applications are generating extremely large amounts of data at a high speed, which must be transferred to remote collaborating sites for storage and analysis. Such high- demanding data transfer has been increasingly supported by bandwidth reservation services in high-performance networks (HPNs). For each bandwidth reservation request (BRR), most existing scheduling algorithms return either the best-case reservation option or a reject message if the BRR cannot be satisfied. To perform intelligent scheduling, we provide two alternative reservation options in the latter case: schedule the BRR within the closest time intervals before and after the user-specified time interval. We consider two different types of BRRs and for each, we design a flexible bandwidth scheduling algorithm with a rigorous optimality proof to compute both the best and alternative reservation options. For comparison, we also design two heuristics adapted from existing bandwidth scheduling algorithms. Extensive simulations show that the proposed algorithms have superior performance to those in comparison.

Original languageEnglish (US)
Title of host publication2018 IEEE International Conference on Communications, ICC 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Volume2018-May
ISBN (Print)9781538631805
DOIs
StatePublished - Jul 27 2018
Event2018 IEEE International Conference on Communications, ICC 2018 - Kansas City, United States
Duration: May 20 2018May 24 2018

Other

Other2018 IEEE International Conference on Communications, ICC 2018
CountryUnited States
CityKansas City
Period5/20/185/24/18

Fingerprint

Data transfer
Network performance
Bandwidth
Scheduling algorithms
Big data
Scheduling

Cite this

Zuo, L., Zhu, M. M., Wu, C., & Hou, A. (2018). Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks. In 2018 IEEE International Conference on Communications, ICC 2018 - Proceedings (Vol. 2018-May). [8422601] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICC.2018.8422601
Zuo, Liudong ; Zhu, Michelle M. ; Wu, Chase ; Hou, Aiqin. / Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks. 2018 IEEE International Conference on Communications, ICC 2018 - Proceedings. Vol. 2018-May Institute of Electrical and Electronics Engineers Inc., 2018.
@inproceedings{c28693626cbb45948ac31c11da6acd40,
title = "Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks",
abstract = "Many scientific applications are generating extremely large amounts of data at a high speed, which must be transferred to remote collaborating sites for storage and analysis. Such high- demanding data transfer has been increasingly supported by bandwidth reservation services in high-performance networks (HPNs). For each bandwidth reservation request (BRR), most existing scheduling algorithms return either the best-case reservation option or a reject message if the BRR cannot be satisfied. To perform intelligent scheduling, we provide two alternative reservation options in the latter case: schedule the BRR within the closest time intervals before and after the user-specified time interval. We consider two different types of BRRs and for each, we design a flexible bandwidth scheduling algorithm with a rigorous optimality proof to compute both the best and alternative reservation options. For comparison, we also design two heuristics adapted from existing bandwidth scheduling algorithms. Extensive simulations show that the proposed algorithms have superior performance to those in comparison.",
author = "Liudong Zuo and Zhu, {Michelle M.} and Chase Wu and Aiqin Hou",
year = "2018",
month = "7",
day = "27",
doi = "https://doi.org/10.1109/ICC.2018.8422601",
language = "English (US)",
isbn = "9781538631805",
volume = "2018-May",
booktitle = "2018 IEEE International Conference on Communications, ICC 2018 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Zuo, L, Zhu, MM, Wu, C & Hou, A 2018, Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks. in 2018 IEEE International Conference on Communications, ICC 2018 - Proceedings. vol. 2018-May, 8422601, Institute of Electrical and Electronics Engineers Inc., 2018 IEEE International Conference on Communications, ICC 2018, Kansas City, United States, 5/20/18. https://doi.org/10.1109/ICC.2018.8422601

Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks. / Zuo, Liudong; Zhu, Michelle M.; Wu, Chase; Hou, Aiqin.

2018 IEEE International Conference on Communications, ICC 2018 - Proceedings. Vol. 2018-May Institute of Electrical and Electronics Engineers Inc., 2018. 8422601.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks

AU - Zuo, Liudong

AU - Zhu, Michelle M.

AU - Wu, Chase

AU - Hou, Aiqin

PY - 2018/7/27

Y1 - 2018/7/27

N2 - Many scientific applications are generating extremely large amounts of data at a high speed, which must be transferred to remote collaborating sites for storage and analysis. Such high- demanding data transfer has been increasingly supported by bandwidth reservation services in high-performance networks (HPNs). For each bandwidth reservation request (BRR), most existing scheduling algorithms return either the best-case reservation option or a reject message if the BRR cannot be satisfied. To perform intelligent scheduling, we provide two alternative reservation options in the latter case: schedule the BRR within the closest time intervals before and after the user-specified time interval. We consider two different types of BRRs and for each, we design a flexible bandwidth scheduling algorithm with a rigorous optimality proof to compute both the best and alternative reservation options. For comparison, we also design two heuristics adapted from existing bandwidth scheduling algorithms. Extensive simulations show that the proposed algorithms have superior performance to those in comparison.

AB - Many scientific applications are generating extremely large amounts of data at a high speed, which must be transferred to remote collaborating sites for storage and analysis. Such high- demanding data transfer has been increasingly supported by bandwidth reservation services in high-performance networks (HPNs). For each bandwidth reservation request (BRR), most existing scheduling algorithms return either the best-case reservation option or a reject message if the BRR cannot be satisfied. To perform intelligent scheduling, we provide two alternative reservation options in the latter case: schedule the BRR within the closest time intervals before and after the user-specified time interval. We consider two different types of BRRs and for each, we design a flexible bandwidth scheduling algorithm with a rigorous optimality proof to compute both the best and alternative reservation options. For comparison, we also design two heuristics adapted from existing bandwidth scheduling algorithms. Extensive simulations show that the proposed algorithms have superior performance to those in comparison.

UR - http://www.scopus.com/inward/record.url?scp=85051435333&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051435333&partnerID=8YFLogxK

U2 - https://doi.org/10.1109/ICC.2018.8422601

DO - https://doi.org/10.1109/ICC.2018.8422601

M3 - Conference contribution

SN - 9781538631805

VL - 2018-May

BT - 2018 IEEE International Conference on Communications, ICC 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Zuo L, Zhu MM, Wu C, Hou A. Intelligent Bandwidth Reservation for Big Data Transfer in High-Performance Networks. In 2018 IEEE International Conference on Communications, ICC 2018 - Proceedings. Vol. 2018-May. Institute of Electrical and Electronics Engineers Inc. 2018. 8422601 https://doi.org/10.1109/ICC.2018.8422601