GridTorrent framework: A High-performance data transfer and data sharing framework for scientific computing

Show full item record

Title: GridTorrent framework: A High-performance data transfer and data sharing framework for scientific computing
Author: Kaplan, Ali; Geoffrey, Fox; von Laszewski, Gregor
Abstract: Large amount of data that is often stored in many thousands of files is created as part of today’s geographically distributed scientific computation and collaboration environments. Managing and transferring large volumes of data sets present a significant challenge and are often a bottleneck in the scientific computing community. In this paper, we introduce an architecture to manage data distributions in a collaborative fashion through a GridTorrent Framework (GTF) whose data transfer mechanism inspired by Bittorrent. We present performance experiment data that compares our framework to parallel TCP (PTCP) and Bittorrent. Experimental results conducted suggest that using GridTorrent for large data set has significant advantages over parallel TCP in LAN and WAN type of computer networks.
Description: "GridTorrent framework: A High-performance data transfer and data sharing framework for scientific computing," Proceedings of the Grid Computing Environments (GCE) workshop. Held at the Reno Convention Center: Reno, Nevada: 11-12 November 2007.
Record URI: http://hdl.handle.net/1850/9682
Date: 2007

Files in this item

Files Size Format View Description
GvonLaszewskiConfProc11-11-2007.pdf 408.9Kb PDF View/Open PDF
GvonLaszewskiPPt11-11-2007.ppt 397.3Kb Microsoft PowerPoint View/Open PPT

The following license files are associated with this item:

This item appears in the following Collection(s)

Show full item record

Search RIT DML


Advanced Search

Browse