Jump to content

OpenSFS

Add links
From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by W Nowicki (talk | contribs) at 21:42, 25 October 2016 (more work on sourcing). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
OpenSFS
Company typeConsortium
Founded2010
Headquarters
Beaverton, Oregon
,
United States
Websitewww.opensfs.org

Open Scalable File Systems, Inc. (OpenSFS) is a nonprofit organization promoting the Lustre file system. OpenSFS was founded in 2010 to ensure Lustre remains vendor-neutral, open, and free.[1]

History

The Lustre file system architecture started in 1999 as a research project by Peter J. Braam, who was on staff at Carnegie Mellon University (CMU) at the time. Braam then founded Cluster File Systems in 2001, with work from the InterMezzo file system in the Coda project at CMU.[2] Lustre was developed under the Accelerated Strategic Computing Initiative Path Forward project funded by the United States Department of Energy, which included Hewlett-Packard and Intel.[3] In September 2007, Sun Microsystems acquired the assets of Cluster File Systems Inc.[4][5] In November 2008, Braam left Sun Microsystems, and Eric Barton and Andreas Dilger took control of the project.

Lustre was deployed in computational centers including many TOP500 systems. After Oracle Corporation acquired Sun in 2010, ongoing development of Lustre was discontinued, prompting more Lustre developers to leave.[6] OpenSFS was founded in October 2010 to steward an open source software Lustre community. Original participants were Cray, DataDirect Networks, Lawrence Livermore National Laboratory, and Oak Ridge National Laboratory.[7]

In 2011, Lustre 2.1 was the first community release endorsed by OpenSFS. OpenSFS began direct funding of community releases in early 2012, focused on introducing new features and targeted every six months. Maintenance releases are targeted every three months.[8] In April 2013 Norman Morse, who had been CEO since it was founded, resigned.[9]

Timeline

2011

  • OpenSFS, and others, endorsed the release of Lustre 2.1 by the open source community. Various Lustre community entities then consolidated to create a unified, global effort to support Lustre via OpenSFS.
  • OpenSFS solicited proposals, based on community requirements, and funded a 2-year development contract for key new features, including improved Lustre metadata performance and scalability.
  • OpenSFS took on ongoing responsibility for the annual Lustre Users Group (LUG) event.

2012

  • OpenSFS took on responsibility for Lustre tree maintenance, a critical element of community based development.
  • OpenSFS began funding ongoing Lustre feature releases. Lustre 2.2 was the first OpenSFS funded release.

2013

  • OpenSFS funded releases continue, including Lustre 2.5 in October 2013 containing the much anticipated Lustre+HSM integration capability.[10][11][12][13]
  • OpenSFS established the Lustre Community Portal to support the open source community.[14] This portal supports Lustre community developers, Lustre releases (downloadable), documentation, working groups, bug tracking, and more.
  • OpenSFS solicited proposals for Lustre feature development, parallel file system tools, addressing Lustre technical debt, and parallel file system incubators.[15]
  • OpenSFS held the first annual APAC Lustre Users Group events in China and Japan, supplementing the annual U.S. based LUG event (with worldwide participation).
  • OpenSFS membership continued to grow, totaling 21 active members in 2013.

Goals

OpenSFS supports the continued evolution and success of the Lustre file system by ensuring that Lustre remains vendor-neutral, open, and free. Goals of OpenSFS investments include:[16]

  • Further the Lustre roadmap to meet the highest priority requirements defined by the community
  • Develop production quality tools to ease administration and use of open source scalable file systems
  • Address Lustre technical debt to improve the code base and documentation thereof
  • Encourage new efforts in open source scalable file systems for high performance and data intensive computing to broaden the set of solutions available to the community

Working Groups

OpenSFS Working Groups are collaborative teams of volunteers from OpenSFS Participants who contribute their expertise and ideas to the continued success of Lustre. Structured with specific group leaders, mailing list(s), and regularly scheduled teleconferences, Working Groups are designed to keep the group organized and informed no matter their location or work schedule.

Lustre Working Group[17]

  • Gather requirements from the community
  • Propose and manage development projects
  • Generate Lustre feature roadmap
  • Manage Lustre releases
  • Coordinate release roadmap for new features
  • Coordinate community development

Benchmarking Working Group[18]

  • Research I/O workloads in high performance parallel file systems configurations
  • Investigate HPC user workloads
  • Define tests to evaluate system performance

Wide Area File System Working Group[19]

  • Coordinate use cases and features for wide area Lustre

Marketing Working Group

  • Brand management: guide and direct use of OpenSFS brand footprint
  • Event marketing: promote and exhibit opportunities for OpenSFS and OpenSFS Participants

Lustre.org Working Group [20]

The Lustre.org Working Group manages the lustre.org web domain and its associated content. The lustre.org domain is a shared asset of European Open File Systems (EOFS) and Open Scalable File Systems (OpenSFS).

Events

An annual Lustre User group event is held by OpenSFS in April for discussion and seminars on open source file system technologies.[21]


Supercomputing Conference (SC): The main high performance supercomputing (HPC) event annually brings together the international supercomputing community spotlighting the most advanced scientific and technical applications in the world, as well as providing a program of technical papers, tutorials and timely research posters. OpenSFS and EOFS jointly hold an annual Lustre BoF as part of this conference.

LAD: The annual Lustre Administrators and Developers Workshop is held by EOFS in September in France. It is a great opportunity for Lustre experts and new comers alike to gather and exchange experiences, developments, tools, best practices, and more.

APAC LUG: The annual APAC LUG event is held in Asia in the fall. These meetings are primarily held in the local languages although some English talks are included. APAC LUG events help expand the global Lustre community and maintain the same mission as the annual LUG in North America by providing an event consisting of discussion and seminars to gather and share expertise and experience.

International Supercomputing Conference (ISC): ISC is an IEEE-recognized key global conference and exhibition for high performance computing, networking and storage that takes place every June in Germany. EOFS and OpenSFS jointly hold a breakfast and BoF at this event.

References

  1. ^ "About Us". OpenSFS. Retrieved 1 October 2013.
  2. ^ Peter J. Braam (August 4, 2002). "Lustre, The Inter-Galactic File System" (PDF). Presentation slides. Lawrence Livermore National Laboratory. Retrieved September 23, 2013.
  3. ^ R. Kent Koeninger (June 2003). "The Ultra-Scalable HPTC Lustre Filesystem" (PDF). Slides for presentation at Cluster World 2003. Retrieved September 23, 2013.
  4. ^ Britta Wülfing (September 13, 2007). "Sun Assimilates Lustre Filesystem". Linux Magazine. Retrieved September 23, 2013.
  5. ^ "Sun Microsystems Expands High Performance Computing Portfolio with Definitive Agreement to Acquire Assets of Cluster File Systems, Including the Lustre File System". Press release. Sun Microsystems. September 12, 2007. Archived from the original on October 2, 2007. Retrieved September 23, 2013. {{cite news}}: Unknown parameter |deadurl= ignored (|url-status= suggested) (help)
  6. ^ Rich Brueckner (January 10, 2011). "Oracle has Kicked Lustre to the Curb". Inside HPC. Retrieved October 25, 2016.
  7. ^ Rich Brueckner (October 19, 2010). "OpenSFS Forms to Help Lustre Move On From the Dark Tower". Inside HPC. Retrieved October 25, 2016.
  8. ^ "Lustre Releases". HPDD Community Wiki. Intel. Retrieved October 25, 2016.
  9. ^ Rich Brueckner (April 16, 2013). "LUG 2013 Kicks Off with Surprise Announcement from OpenSFS". Inside HPC. Retrieved October 25, 2016.
  10. ^ Prickett Morgan, Timothy. "OpenSFS Announces Availability of Lustre 2.5". EnterpriseTech.
  11. ^ Brueckner, Rich. "Video: New Lustre 2.5 Release Offers HSM Capabilities". Inside Big Data. Retrieved 11 December 2013.
  12. ^ Hemsoth, Nicole. "Lustre Gets Business Class Upgrade with HSM". HPCwire. Retrieved 11 December 2013.
  13. ^ "Lustre 2.5". Scientific Computing World. Retrieved 11 December 2013.
  14. ^ "Lustre Community Portal". OpenSFS. Retrieved 1 October 2013.
  15. ^ Brueckner, Rich. "With New RFP, OpenSFS to Invest in Critical Open Source Technologies for HPC". insideHPC. Retrieved 1 October 2013.
  16. ^ "OpenSFS Increases Investment in Open Source for HPC". HPCwire. Retrieved 2 October 2013.
  17. ^ "Lustre Working Group". OpenSFS. Retrieved 1 October 2014.
  18. ^ "Benchmarking Working Group". OpenSFS. Retrieved 1 October 2013.
  19. ^ "Wide Area Filesystem Working Group". OpenSFS. Retrieved 1 October 2013.
  20. ^ "Lustre.org Working Group". OpenSFS. Retrieved 1 February 2015.
  21. ^ "Live Report from LUG 2016 Day 3". Inside HPC. April 9, 2016. Retrieved October 25, 2016.
Retrieved from "https://en.wikipedia.org/w/index.php?title=OpenSFS&oldid=746199369"