News

SDSC Data Middleware Selected as Core Component of UK Data Grid

Published November 12, 2001

The San Diego Supercomputer Center (SDSC) has announced that its popular data management tool, the SDSC Storage Resource Broker (SRB), has been chosen as a core component of the UK data grid architecture. The SRB is included on a CD-ROM with the Grid Starter Kit being distributed to the UK academic community. Because of the size of the deployment, a UK Grid Support Centre will provide support for SRB users in the UK.

"With the adoption of the SDSC SRB for use in the UK data grid, the broad impact of SDSC's infrastructure contributions goes beyond the national community to include the growing international grid community as well," said Fran Berman, director of SDSC and NPACI.

Scientific data sets are growing exponentially in size. In traveling from sensors or simulations to computer applications, storage systems, and digital libraries, these data sets must be moved and reorganized many times. The SDSC SRB has been developed to efficiently manage this burgeoning information over its life cycle. Initially released four years ago, the software has proven valuable for research, with more than 200 registered users at some 50 different sites. In the UK data grid, the SRB will be used to manage data among users in a grid with more than 10 sites, the largest single grid deployment yet.

"The use of the SDSC SRB in the UK data grid shows the value of the SRB system as well as the growth of data grids worldwide," said Chaitan Baru, co-director of SDSC's Data and Knowledge Systems program.

To support the development of grid computing in the UK, the Central Laboratory of the Research Councils (CLRC) for the UK has established an e-Science Centre to make its facilities "grid aware."

"The UK e-Science Grid will be as much about data as computation," said Tony Hey, UK e-Science core technology director. "The SDSC SRB is useful for our Grid because it offers support for database users as well as files, which we see as a key area for Grid middleware in the future."

The CLRC e-Science Centre has also established a UK Grid Support Centre. The CD-ROM Grid Starter Kit that the Centre is distributing contains quick guides and installation software for basic deployment of the software being used in the grid. "The choice to include the SRB in the UK Grid Starter Kit is the clearest indicator to date that the SRB has moved from research prototype to production tool," said SDSC researcher Arcot Rajasekar, leader of the SRB project.

In addition to the SDSC SRB, other software in the initial UK data grid effort includes Globus Grid middleware for underlying grid services including job management and security, and Condor for local resource management and task farming for high-throughput distributed computing. "The central challenge is how to make all the parts interoperate or work together so that the systems are no longer stand-alone but form a single, virtual system," said Reagan Moore, SDSC distinguished scientist and adjunct professor in UCSD's Computer Science and Engineering Department.

The UK Grid Support Centre will also provide support for SRB users throughout the UK data grid community. "This is a first, and it's an important step to enable large-scale production use," said Rajasekar. "Previously, all SRB support was provided by our SDSC staff."

Initial use of the SRB in the UK will be in a test bed for the Earth science community. One national and eight Regional e-Science Centres have been set up with grid test bed projects ranging from high-energy physics and structure-property mapping using combinatorial chemistry to bioscience microarray data. "The aim of the CLRC e-Science effort is to integrate all our experimental, computational, and data resources, connect them to other sites, and make them easily available to our user community," said Kerstin Kleese van Dam, CLRC-Daresbury Laboratory, e-Science Centre.

The SRB includes powerful metadata capabilities, support for security, and flexible access control for sharing data with colleagues. The SRB system runs on UNIX; Windows 98, NT, Me, and 2000; Red Hat Linux (6.2), and Macintosh OS X platforms. Fully functioning SRB demo versions for Windows 98, NT, and 2000 are available on a free CD-ROM, which may be obtained by sending e-mail to srb@sdsc.edu.

About SDSC

The San Diego Supercomputer Center (SDSC) is an organized research unit of UCSD and the leading-edge site of the National Partnership for Advanced Computational Infrastructure (NPACI). SDSC's mission is to develop and use technology to advance science, and SDSC provides leadership both nationally and internationally in computing, data management, biosciences, and other areas. As a national laboratory for computational science and engineering, SDSC is funded by the National Science Foundation through NPACI and other federal agencies, the State and University of California, and private organizations. For more information, see www.sdsc.edu or contact David L. Hart, SDSC Communications, 858-534-8314, dhart@sdsc.edu.


Contact: David L. Hart, SDSC Communications, 858-534-8314, dhart@sdsc.edu

Archive

Related Links

Useful URLs:

CLRC e-Science Centre - www.e-science.clrc.ac.uk

UK Grid Support Centre - www.grid-support.ac.uk/

SDSC SRB - www.npaci.edu/DICE/SRB/

Globus - www.globus.org/

Condor - http://www.cs.wisc.edu/condor/

Back to top