Jump to content

WebScaleSQL

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Dsimic (talk | contribs) at 08:33, 15 August 2015 (Overview: Added a reference). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

WebScaleSQL
Developer(s)Facebook, Google, LinkedIn and Twitter
Repository
Written inC, C++, Perl and Bash
Operating systemLinux
Platformx86-64
Available inEnglish
TypeRDBMS
LicenseGPL v2
Websitewebscalesql.org

WebScaleSQL is an open-source relational database management system (RDBMS) created as a software branch of MySQL 5.6. By joining efforts of a few companies and incorporating various changes and new features into MySQL, WebScaleSQL aims toward fulfilling various needs arising from the deployment of MySQL in large-scale environments.[1][2]

Project's source code is licensed under version 2 of the GNU General Public License, and hosted on GitHub.[3][4]

Overview

Running MySQL on numerous servers with large amounts of data, at the scale of terabytes and petabytes of data, creates a set of difficulties that in many cases arise the need for implementing specific customized MySQL features, or the need for introducing functional changes to MySQL. More than a few companies have faced the same (or very similar) set of difficulties in their production environments, which used to result in the availability of multiple solutions for similar challenges.[3][5][6]

WebScaleSQL was announced on March 27, 2014 as a joint effort of Facebook, Google, LinkedIn and Twitter, aiming to provide a centralized development structure for extending MySQL with new features specific to its large-scale deployments, such as building large replicated databases running on server farms. As a result, WebScaleSQL opens a path toward deduplicating the efforts each fouding company had been putting into maintaining its own branch of MySQL, and toward bringing together more developers.[1][4][7]

WebScaleSQL is created as a branch of the MySQL's latest production-ready community release, which is version 5.6 as of March 2013. As the project aims to tightly follow new MySQL community releases, a branching path has been selected instead of becoming a software fork of MySQL. The selection of MySQL production-ready community releases for the WebScaleSQL's upstream, instead of selecting some of the available MySQL forks such as Percona Server,[8] was the result of a consensus between the four founding companies, which concluded that the features already existing in MySQL 5.6 are adequate for large-scale deployments, while additional features of the same kind are planned for MySQL 5.7.[1][3][4]

Features

The initial changes and additions that WebScaleSQL introduced to the MySQL 5.6 codebase came from the engineers employed by the four founding companies; however, the project is open to peer-reviewed community contributions.[9] As of March 27, 2014, available new features and changes include the following:[4][7][10]

  • A software framework that provides automated testing of all proposed changes
  • A customized suite of database performance tests
  • Various changes to the tests provided by the MySQL community releases
  • Performance improvements in various areas, including buffer pool flushing, execution of certain types of SQL queries, and support for NUMA architectures
  • Changes related to large-scale deployments, such as the ability to specify sub-second client timeouts

As of March 28, 2014, planned new features and changes include the following:[1][7]

  • New asynchronous MySQL client that will eliminate the client-side waiting while establishing database connections, sending queries, and receiving results
  • Availability of various table, user and compression statistics
  • Changes to the internal compression mechanisms
  • Addition of a logical read-ahead mechanism that will bring significant performance improvements for full table scans

Availability

WebScaleSQL is distributed in a source-code-only form, with no official binaries available. As of March 27, 2014, compiling the source code and running WebScaleSQL is supported only on x86-64 Linux hosts, requiring at the same time a toolchain that supports C99 and C++11 language standards.[4]

The source code is available under the GPL v2 license and hosted on GitHub.[3][4]

See also

References

  1. ^ a b c d Steven J. Vaughan-Nichols (March 28, 2013). "WebScaleSQL: MySQL for Facebook-sized databases". ZDNet. Retrieved April 1, 2014.
  2. ^ Klint Finley (March 27, 2013). "Google and Facebook Team Up to Modernize Old-School Databases". Wired. Retrieved April 1, 2014. {{cite web}}: Italic or bold markup not allowed in: |publisher= (help)
  3. ^ a b c d Jack Clark (March 27, 2013). "Forkin' 'L! Facebook, Google and friends create WebScaleSQL from MySQL 5.6". The Register. Retrieved April 1, 2014. {{cite web}}: Italic or bold markup not allowed in: |publisher= (help)
  4. ^ a b c d e f "Frequently Asked Questions". webscalesql.org. March 27, 2014. Retrieved April 1, 2014.
  5. ^ "Patches for MySQL 5 – MySQL tools released by Google". code.google.com. June 24, 2011. Retrieved April 1, 2014.
  6. ^ "facebook/mysql-5.1". github.com. June 2013. Retrieved April 1, 2014.
  7. ^ a b c Doug Henschen (March 27, 2014). "Facebook Debuts Web-Scale Variant of MySQL". informationweek.com. Retrieved August 15, 2015.
  8. ^ Laurynas Biveinis (May 22, 2014). "A technical WebScaleSQL review and comparison with Percona Server". percona.com. Retrieved August 15, 2015.
  9. ^ "Is Your Change Appropriate?". webscalesql.org. March 27, 2014. Retrieved April 1, 2014.
  10. ^ Michael Larabel (March 28, 2014). "Facebook & Others Announce WebScaleSQL". Phoronix. Retrieved April 1, 2014.