Distributed Application Runtime Environment (DARE): A Standards-based Middleware Framework for Science-Gateways

TY - JOUR

T1 - Distributed Application Runtime Environment (DARE)

T2 - A Standards-based Middleware Framework for Science-Gateways

AU - Maddineni, Sharath

AU - Kim, Joohyun

AU - El-Khamra, Yaakoub

AU - Jha, Shantenu

N1 - Funding Information: Acknowledgements This work is funded by NSF CHE-1125332 (Cyber-enabled Discovery and Innovation), HP-COPS NSF-OCI 0710874 award, NSF-ExTENCI (OCI-1007115). Important funding for SAGA has been provided by the UK EPSRC grant number GR/D0766171/1 (via OMII-UK) and the Cybertools project (PI Jha) NSF/LEQSF (2007-10)-CyberRII-01, NSF EPSCoR Co-operative Agreement No. EPS-1003897 (with additional support from the Louisiana Board of Regents) and Grant Number P20RR016456 from the NIH National Center For Research Resources. SJ acknowledges the e-Science Institute, Edinburgh for supporting the research theme. “Distributed Programming Abstractions” & 3DPAS. This work has also been made possible thanks to computer resources provided by TeraGrid TRAC award TG-MCB090174 (Jha). This document was developed with support from the US NSF under Grant No. 0910812 to Indiana University for “FutureGrid: An Experimental, High-Performance Grid Test-bed”. We thank FutureGrid support, in particular Fugang Wang for exceptional support. We thank our fellow Radical members for their support and input, and in particular Ashley Zebrowski for providing detailed feedback, Ole Weidner for a constructive criticism of this manuscript and Andre Merzky for the information about SAGA CSA deployment. Last, but not least, we would like to thank one of the anonymous reviewers for exceptionally useful and insightful comments, which have greatly improved the paper.

PY - 2012/12

Y1 - 2012/12

N2 - Gateways have been able to provide efficient and simplified access to distributed and high-performance computing resources. Gateways have been shown to support many common and advanced requirements, as well as proving successful as a shared access mode to production cyberinfrastructure such as the TG/XSEDE. There are two primary challenges in the design of effective and broadly-usable gateways: the first revolves around the creation of interfaces that catpure existing and future usage modes so as to support desired scientific investigation. The second challenge and the focus of this paper, is concerned about the requirement to integrate the user-interfaces with computational resources and specialized cyberinfrastructure in an interoperable, extensible and scalable fashion. Currently, there does not exist a commonly usable middleware to that enables seamless integration of different gateways to a range of distributed and high-performance infrastructures. The development of multiple similar gateways that can work over a range of production cyberinfrastructures, usage modes and application requirements is not scalable without a effective and extensible middleware. Some of the challenges that make using production cyberinfrastructure as a collective resource difficult are also responsible for the absence of middleware that enables multiple gateways to utilize the collective capabilities. We introduce the SAGA-based, Distributed Application Runtime Environment (DARE) framework, using which gateways that seamlessly and effectively utilize scalable distributed infrastructure can be built. We discuss the architecture of DARE-based gateways, and show using several different prototypes-DARE-HTHP, DARE-NGS, how gateways can be constructed by utilizing the DARE middleware framework.

AB - Gateways have been able to provide efficient and simplified access to distributed and high-performance computing resources. Gateways have been shown to support many common and advanced requirements, as well as proving successful as a shared access mode to production cyberinfrastructure such as the TG/XSEDE. There are two primary challenges in the design of effective and broadly-usable gateways: the first revolves around the creation of interfaces that catpure existing and future usage modes so as to support desired scientific investigation. The second challenge and the focus of this paper, is concerned about the requirement to integrate the user-interfaces with computational resources and specialized cyberinfrastructure in an interoperable, extensible and scalable fashion. Currently, there does not exist a commonly usable middleware to that enables seamless integration of different gateways to a range of distributed and high-performance infrastructures. The development of multiple similar gateways that can work over a range of production cyberinfrastructures, usage modes and application requirements is not scalable without a effective and extensible middleware. Some of the challenges that make using production cyberinfrastructure as a collective resource difficult are also responsible for the absence of middleware that enables multiple gateways to utilize the collective capabilities. We introduce the SAGA-based, Distributed Application Runtime Environment (DARE) framework, using which gateways that seamlessly and effectively utilize scalable distributed infrastructure can be built. We discuss the architecture of DARE-based gateways, and show using several different prototypes-DARE-HTHP, DARE-NGS, how gateways can be constructed by utilizing the DARE middleware framework.

KW - Clouds

KW - DARE

KW - EGI

KW - Grids

KW - Interoperability

KW - Middleware

KW - Pilot Jobs

KW - SAGA

KW - Science gateways

KW - Standards

KW - XSEDE

UR - http://www.scopus.com/inward/record.url?scp=84871654113&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871654113&partnerID=8YFLogxK

U2 - 10.1007/s10723-012-9244-1

DO - 10.1007/s10723-012-9244-1

M3 - Article

SN - 1570-7873

VL - 10

SP - 647

EP - 664

JO - Journal of Grid Computing

JF - Journal of Grid Computing

IS - 4

ER -