Slurm Used on the Fastest of the TOP500 Supercomputers

Slurm Workload Manager is used on 5 of the 15 fastest supercomputers in the world

Salt Lake City, UT, November 15, 2012

Based on this week’s release of the TOP500 List — a ranking of the world’s fastest computers — Slurm Workload Manager continued to be the most widely used on the fastest of the fast: 33% of the top 15 supercomputers use Slurm.

Slurm — an open source workload manager designed for the most demanding HPC environments, originated at Lawrence Livermore National Laboratory (LLNL) ten years ago and evolved over time with the contributions of more than 100 developers. Slurm remains an important workload manager at LLNL, providing scheduling and other functionality to their Sequoia supercomputer, currently #2 in the TOP500 and ranked the fastest in the previous TOP500 List.

The other supercomputers in the 15 fastest supercomputers using Slurm are Stampede at TACC; Tianhe-1A in China; Curie at the CEA in France; and Helios at Japan’s International Fusion Energy Research Centre. Beyond the top 15 systems, SchedMD, the organization overseeing the code base for Slurm, estimates that as many as 30% of the supercomputers in the TOP500 list are using the open source workload manager.

“We built Slurm to efficiently schedule resources for the world’s biggest systems and through simulation have proven its scalability to an order of magnitude higher than the currently largest systems,” said Moe Jette, CTO of SchedMD. “It’s now one of the most widely used workload managers in the Top500. As we move to Exascale computing requirements, Slurm is the workload manager best positioned to schedule jobs at that scale.”

Outside of the large supercomputer centers, Slurm is gathering momentum. HPC computer manufacturers Bull and Cray frequently provide Slurm as part of their solutions, and Bright Computing now offers Slurm as the default workload manager in Bright Cluster Manager.  In addition, a number of Slurm users and technology providers joined forces to support the growth of the Slurm community, including SchedMD, NVIDIA, Lawrence Livermore National Laboratory, Intel, Greenplum/EMC, CSCS, CEA, Bull and Bright Computing. The group sponsored a booth at SC12 this week in Salt Lake City, and are kicking off other initiatives to increase awareness and engagement.

Slurm information sources:

• Twitter: @SlurmWLM
• LinkedIn: http://www.linkedin.com/groups/Slurm-4501392

For more information:
pr@slurm.net

Leading HPC Organizations Combine Forces at SC12 to Support the Growing Use of Slurm Workload Manager

SchedMD, NVIDIA, Lawrence Livermore National Laboratory, Intel, Greenplum/EMC, CSCS, CEA, Bull and Bright Computing launch an initiative to promote use of the Slurm open source workload manager.

Salt Lake City, UT (PRWEB) November 07, 2012

Slurm is one of the most powerful and scalable workload managers in HPC, yet it is probably the least well known. This low profile is about to change.

The open source product has gained momentum, with many national laboratories around the world and dozens of universities relying on Slurm — but few people outside of these organizations know this fact. Now, a number of Slurm backers have come together to raise the profile of Slurm, beginning with organizing a Slurm booth at SC12 in Salt Lake City. These initial sponsors comprise Slurm users CEA (French Alternative Energies and Atomic Energy Commission), CSCS (Swiss National Supercomputer Center), and Lawrence Livermore National Laboratory (LLNL). In addition, technology providers Bright Computing, Bull Information Systems, Greenplum/EMC, Intel, NVIDIA and SchedMD are participating.

Mark Seager, Intel CTO for the HPC Ecosystem comments, “Continued innovation in the HPC ecosystem is a sign of the health, growth, and importance of the HPC market segment. It is important for HPC innovation to remain vibrant, and the Slurm activity is an exemplar.”

Slurm is an open source workload manager originally developed to schedule compute jobs at LLNL. Ten years later, it is now used on about 30% of the TOP500 systems, possibly more than any other workload manager.

Started by just a few programmers at Livermore, there are now more than 100 developers from dozens of organizations around the world who have contributed to the code. Together they are adding capabilities at high speed, working to a 6-month release cycle. The primary developers of Slurm, Moe Jette and Danny Auble, now run SchedMD, the company that oversees the code base and leads its further development, and offers commercial Level 3 support.

“We built Slurm to efficiently schedule resources for the biggest systems, and have proven this scalability to at least an order of magnitude higher than any currently available system,” said Moe Jette, CTO of SchedMD. “It’s now one of the most widely used workload managers in the Top500, including on the Sequoia supercomputer at LLNL. As we move to Exascale, Slurm is the workload manager best positioned to schedule jobs at that scale.”

Beyond organizing a booth at SC12, there are other profile-raising initiatives that have emerged, including a new logo, a Slurm group on Linkedin, Twitter accounts (@SchedMD, @SlurmWLM), Facebook and a blog. In addition, Slurm is freely available for download, along with current documentation and information, from SchedMD.

Matthijs van Leeuwen, CEO of Bright Computing, also sees the rising importance of Slurm Workload Manager. “We are seeing a strong increase in customer demand for Slurm. Although we have integration with all of the major workload managers as pre-configured options for Bright Cluster Manager, and are partners with most of their vendors, we are now including Slurm as our default workload manager. Further, we are about to launch commercial support for Slurm, to provide a one-stop solution for our customers. This initiative to support the growth of Slurm makes a lot of sense to us. It aligns with our belief that those who manage HPC clusters benefit from the ability to choose the workload manager that best fits their needs.”

Slurm presentations scheduled for SC12 Booth #3444 include:

• Introduction to Slurm Workload Manager and Roadmap (Moe Jette and Danny Auble, SchedMD)
• Bull’s Slurm Roadmap (Eric Monchalin, Bull)
• MapReduce Support in Slurm (Ralph Castain, EMC/Greenplum)
• Using Slurm for Data Aware Scheduling to the Cloud (Martijn de Vries, Bright Computing)
• Slurm on the Sequoia Supercomputer (Don Lipari, LLNL)
• Slurm at Rensselaer Polytechnic Institute (Tim Wickberg, RPI)

The Slurm BoF meeting is scheduled for 12:15 PM on 15 November, in room 155-A at the Salt Palace Convention Center in Salt Lake City.