Structured peer-to-peer resource discovery for computational grids

Abstract

Existing resource discovery and monitoring systems, such as Globus GRAM/MDS, are based on a central point of control. This paper proposes a decentralized multilayered resource discovery system implemented over a peer-to-peer structure to address shortcomings associated with current resource discovery systems. Our approach segments Grid nodes into various overlays, with each overlay (namely, layer) made up of nodes contributing the same resource attributes and connected by at least one gateway to allow nodes in the layer to communicate with other layers, to support queries for multiple resource types. This unique logical structure permits fast and effective searches for a given set of resources needed by an incoming job. Our approach disseminates resource information to nodes proximity-close to the distribution node, exhibiting a substantial reduction in traffic overhead of over 35%, without compromising its success rate in resource discovery. It supports queries for multiple resource types efficiently, often without searching associated multiple layers separately.