DiaGrid (distributed computing network)

DiaGrid is a large high-throughput distributed research computing network utilizing the Condor system and centered at Purdue University in West Lafayette, Indiana. In 2012, it includes nearly 43,000 processors representing 301 teraflops of computing power. DiaGrid received a 2009 Campus Technology Innovators award from Campus Technology magazine and was employed at the SC09 supercomputing conference in Portland, Ore., to capture nearly 150 days of compute time for science jobs.

The grid, a partnership with Indiana University, Indiana State University, the University of Notre Dame, the University of Louisville, the University of Nebraska, the University of Wisconsin, Purdue's Calumet and North Central campuses, and Indiana University-Purdue University Fort Wayne, is designed to accommodate computers at other campuses as new members join. The Purdue portion of the pool, named BoilerGrid, is the largest academic system of its kind.

Through Condor, developed at the University of Wisconsin, DiaGrid harvests and manages computing cycles from idle or underused high-performance computing cluster nodes, machines in campus computer and other labs and office computers. Whenever a local user or scheduled job needs a given machine, the Condor job is stopped and automatically sent to another Condor node as soon as possible. While this "opportunistic" model limits the ability to do parallel processing and communications, a Condor pool can provide smaller, serial jobs vast numbers of cycles in a very short amount of time. Condor—and by extension, DiaGrid—is designed for high-throughput computing and is excellent for parameter sweeps, Monte Carlo simulation, or nearly any serial application. Some classes of parallel jobs (master-worker) may be run effectively via Condor as well.

DiaGrid is managed by Information Technology at Purdue (ITaP), the central information technology organization at Purdue's West Lafayette campus, which also operates the Steele and Coates supercomputers. To pool computational resources spread around the state, the grid takes advantage of I-Light, the high-speed fiber-optic state network connecting Indiana campuses to each other, the Internet and national research networks such as the Internet2 and National LambdaRail.

DiaGrid and BoilerGrid have been used by researchers at Purdue and elsewhere for a variety of purposes, such as imaging the structure of viruses at near-atomic resolutions, simulating the early stages of the Solar System's formation, projecting the reliability of Indiana's electrical supply, modeling the spread of water pollutants, and identifying millions of potential new forms of zeolites, silicate minerals widely used to catalyze chemical reactions on an industrial scale. DiaGrid provides computational resources to researchers on both the Open Science Grid and the U.S. National Science Foundation's XSEDE system.

External links

• http://www.dia-grid.org
• http://campustechnology.com/articles/2009/07/22/campus-technology-innovators-awards-2009-high-performance-computing.aspx
• http://markets.hpcwire.com/taborcomm.hpcwire/?GUID=10770002&Page=MediaViewer&ChannelID=3198
• http://cloudcomputing.sys-con.com/node/1185883
• http://www.itap.purdue.edu/newsroom/detail.cfm?NewsID=2054
• http://news.uns.purdue.edu/x/2008b/081118McCartneyPool.html
• http://www.rcac.purdue.edu/boilergrid/index.cfm
• http://www.cs.wisc.edu/condor/
• http://www.itap.purdue.edu/