Exploring the Optimal Strategy for Large-Scale Data Movement in High-Performance Networks
Document Type
Conference Proceeding
Publication Date
12-1-2012
Abstract
Advanced networking technologies and services have been rapidly developed and deployed to facilitate bulk data transfer so as to support next-generation eScience applications. However, these technologies and services have not been fully utilized due to the knowledge lack of scientific domain experts. By leveraging the functionalities of an existing data movement advising utility, we propose a new Workflow-based Intelligent Network Data Movement Advisor (WINDMA) with end-to-end performance optimization. WINDMA provides a web interface and interacts with existing data/space management and discovery services such as Storage Resource Management, transport methods such as GridFTP and GlobusOnline, and network resource provisioning brokers such as ION and OSCARS. Efficacy of WINDMA has been demonstrated in several use cases based on its implementation and deployment in wide-area networks.
DOI
10.1109/PCCC.2012.6407676
Montclair State University Digital Commons Citation
Brown, Patrick; Zhu, Michelle; Wu, Qishi; Yun, Daqing; and Zurawski, Jason, "Exploring the Optimal Strategy for Large-Scale Data Movement in High-Performance Networks" (2012). Department of Computer Science Faculty Scholarship and Creative Works. 278.
https://digitalcommons.montclair.edu/compusci-facpubs/278