Jump to content

DiaGrid (distributed computing network)

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by M.boli (talk | contribs) at 14:58, 29 April 2009 (Undid revision 286857737 by M.boli (talk): should have read hatnote usage guidelines first). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

DiaGrid is a large high-throughput distributed research computing network utilizing the Condor system and centered at Purdue University in West Lafayette, Indiana.

The grid, a partnership with Indiana University, Indiana State University, the University of Notre Dame, Purdue's Calumet and North Central campuses, and Indiana University-Purdue University Fort Wayne, is designed to accommodate computers at other campuses across the nation as new members join. At the end of 2008, it included more than 20,000 processors. The Purdue portion of the pool, named BoilerGrid, is the largest academic system of its kind. BoilerGrid alone processed 10 million hours of research computation in 2007.

Through Condor, developed at the University of Wisconsin, DiaGrid harvests and manages computing cycles from idle or underused high performance computing cluster nodes, machines in campus computer and other labs and office computers. Whenever a local user or scheduled job needs a given machine, the Condor job is stopped and sent to another Condor node as soon as possible. While this model limits the ability to do parallel processing and communications, the Condor pool can provide smaller, serial jobs vast numbers of cycles in a very short amount of time. Condor—and by extension, DiaGrid—is designed for high-throughput computing and is excellent for parameter sweeps, Monte Carlo simulation, or nearly any serial application. Some classes of parallel jobs (master-worker) may be run effectively via Condor as well.

DiaGrid is managed by Information Technology at Purdue (ITaP), the central information technology organization at Purdue's West Lafayette campus, through the Rosen Center for Advanced Computing, ITaP's research and discovery arm, which also operate the Steele and Coates supercomputers. To pool computational resources spread around the state, the grid takes advantage of I-Light, the high-speed fiber-optic state network connecting Indiana campuses to each other, the Internet and national research networks such as the Internet2 and National LambdaRail.

DiaGrid and BoilerGrid have been used by researchers at Purdue and elsewhere for a variety of purposes, such as imaging the structure of viruses at near-atomic resolutions, simulating the early stages of the Solar System's formation, projecting the reliability of Indiana's electrical supply, modeling the spread of water pollutants, and identifying millions of potential new forms of zeolites, silicate minerals widely used to catalyze chemical reactions on an industrial scale. DiaGrid provides computational resources to researchers on both the Open Science Grid and the TeraGrid.