Jump to content

Apache Mesos

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Rodw (talk | contribs) at 14:27, 29 May 2025 (Disambiguating links to APPC (link changed to Container Linux by CoreOS#APPC) using DisamAssist.). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
Apache Mesos
Developer(s)Apache Software Foundation
Stable release
1.11.0 / November 24, 2020; 4 years ago (2020-11-24)[1]
RepositoryMesos Repository
Written inC++
TypeCluster management software
LicenseApache License 2.0
WebsiteOfficial website Edit this at Wikidata

Apache Mesos is an open-source project to manage computer clusters. It was developed at the University of California, Berkeley.

History

Mesos began as a research project in the UC Berkeley RAD Lab by then-PhD students Benjamin Hindman, Andy Konwinski, and Matei Zaharia, as well as professor Ion Stoica. The students started working on the project as part of a course taught by David Culler. It was originally named Nexus but due to a conflict with another university's project, was renamed to Mesos.[2]

Mesos was first presented in 2009 (while still named Nexus) by Andy Konwinski at HotCloud '09 in a talk accompanying the first paper published about the project.[3] Later in 2011, it was presented in a more mature state in a talk by Zaharia at the USENIX Symposium on Networked Systems Design and Implementation conference about the paper "Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center" by Benjamin Hindman, Andy Konwinski, Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, and Ion Stoica.[4]

On July 27, 2016, the Apache Software Foundation announced version 1.0.[5] It added the ability to centrally supply Docker, rkt, and appc instances.[6]

On April 5, 2021, it was voted to move Mesos to the Apache Attic,[7] however, the vote was cancelled two days later due to increased interest.[8]

Current status

As of 2025, Apache Mesos remains an active Apache project but with minimal development activity. The last stable release was version 1.11.0 in November 2020.[9] Since 2021, the project has had no new committers or Project Management Committee (PMC) members,[10] and development consists primarily of minor bug fixes and patches. While the project avoided being moved to the Apache Attic in 2021, it has effectively entered a maintenance-only phase with minimal community activity.

Technology

Mesos uses Linux cgroups to provide isolation for CPU, memory, I/O, and file systems.[11] Mesos is comparable to Google's Borg scheduler, a platform used internally to manage and distribute Google's services.[12]

Mesos frameworks

Apache Aurora

Apache Aurora
Developer(s)Apache Software Foundation
Final release
0.22.0 / December 12, 2019; 5 years ago (2019-12-12)[13]
RepositoryAurora Repository
Written inJava, Python
TypeMesos Framework
LicenseApache License 2.0
Websiteaurora.apache.org

Apache Aurora is a Mesos framework for both long-running services and cron jobs, originally developed by Twitter starting in 2010 and open sourced in late 2013.[14] It can scale to tens of thousands of servers and holds many similarities to Borg,[15][16] including its rich domain-specific language (DSL) for configuring services. As of February 2020, the project was retired to the Apache Attic.[17] A fork of the project was maintained by former members, hosted on GitHub under the name Aurora Scheduler.[18]

Chronos

Chronos is a distributed cron-like system which is elastic and capable of expressing dependencies between jobs.[19]

Marathon

Marathon is promoted for platform as a service or container orchestration system scaling to thousands of physical servers. It is fully REST-based and allows canary-style deployments and deployment topologies. It is written in the programming language Scala.[20]

Adoption

Several organizations have adopted Mesos for large-scale production deployments:

Twitter began using Mesos and Apache Aurora in 2010, after Hindman gave a presentation to a group of Twitter engineers.[12]

Airbnb stated in July 2013 that it uses Mesos to run data processing systems like Apache Hadoop and Apache Spark.[21]

eBay reported in April 2014 that it used Mesos to run continuous integration on a per-developer basis. They accomplish this by using a custom Mesos plugin that allows developers to launch their own private Jenkins instances.[22]

Apple announced in April 2015 that its Siri service uses its own Mesos framework called Jarvis.[23]

Verizon selected Mesosphere's DC/OS, which is based on open source Apache Mesos, for data center service orchestration in August 2015.[24]

com/2015/11/introducing-paasta-an-open-platform-as-a-service.html|title=Introducing PaaSTA: An Open, Distributed, Platform as a Service|website=Yelp Engineering Blog|access-date=2016-07-12|date=November 2015}}</ref>

Commercial support

Software startup Mesosphere, Inc. sells the Datacenter Operating System (DC/OS), a distributed operating system based on Apache Mesos.[25] In September 2015, Microsoft announced a commercial partnership with Mesosphere to build container scheduling and orchestration services for Microsoft Azure.[26] In October 2015, Oracle announced support for Mesos through Oracle Container Cloud Service.[27]

See also

References

  1. ^ "ASF Git Repos - mesos.git/tag". Retrieved 27 September 2022.
  2. ^ Zaharia, Matei. "HUG Meetup August 2010: Mesos: A Flexible Cluster Resource manager - Part 1". YouTube. Retrieved 13 January 2015.
  3. ^ "A Common Substrate for Cluster Computing" (PDF).
  4. ^ Hindman, Benjamin; Konwinski, Andy; Zaharia, Matei; Ghodsi, Ali; Joseph, Anthony; Katz, Randy; Shenker, Scott; Stoica, Ion (2011). "Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center" (PDF). NSDI. 11: 22–22. Retrieved 12 January 2015.
  5. ^ "The Apache Software Foundation Announces Apache Mesos v1.0". Press release. July 27, 2016. Retrieved February 24, 2017.
  6. ^ "Mesos 1.0 brings a new container runtime and more third party integrations". SiliconANGLE. July 27, 2016.
  7. ^ "[VOTE] Move Apache Mesos to Attic". lists.apache.org. Archived from the original on 2021-04-06. Retrieved 2021-04-07.
  8. ^ "Re: [VOTE] Move Apache Mesos to Attic". lists.apache.org. Archived from the original on 2021-04-09. Retrieved 2021-04-09.
  9. ^ "ASF Git Repos - mesos.git/tag". Retrieved 27 September 2022.
  10. ^ "Board Meeting Minutes - Mesos". Apache Whimsy. Retrieved 2025-05-29.
  11. ^ Bappalige, Sachin P. (2014-09-15). "Open-Source Datacenter Computing with Apache Mesos". OpenSource.com. Red Hat. Retrieved 2016-12-10.
  12. ^ a b Metz, Cade (March 2013). "Return of the Borg: How Twitter Rebuilt Google's Secret Weapon". Wired. Retrieved 12 January 2015.
  13. ^ "Apache Aurora Blog". Retrieved 16 March 2021.
  14. ^ "All about Apache Aurora". Twitter. 2015. Retrieved 20 May 2015.
  15. ^ "Large-scale cluster management at Google with Borg" (PDF). Retrieved 20 May 2015.
  16. ^ "Twitter's Aurora and How It Relates to Google's Borg". The New Stack. 18 February 2015. Retrieved 20 May 2015.
  17. ^ "Apache Aurora - Apache Attic". attic.apache.org. Retrieved 2021-02-18.
  18. ^ "Aurora Scheduler". GitHub. Retrieved 2023-04-02.
  19. ^ "Chronos". GitHub. GitHub. Retrieved 30 March 2015.
  20. ^ "Marathon". Mesosphere.GitHub.io. Mesosphere. 2014. Retrieved 30 March 2015.
  21. ^ Harris, Derrick (29 July 2013). "Airbnb is engineering itself into a data-driven company". Gigaom. Retrieved 12 January 2015.
  22. ^ The eBay PaaS Team (4 April 2014). "Delivering eBay's CI Solution with Apache Mesos - Part I". eBay Tech Blog. eBay. Retrieved 12 January 2015.
  23. ^ Harris, Derrick (2015-04-23). "Apple Details How It Rebuilt Siri on Mesos". Mesosphere.com. Mesosphere. Archived from the original on 2015-04-29. Retrieved 2015-04-27.
  24. ^ "Verizon selects Mesosphere DCOS as nationwide platform for data center service orchestration". Verizon. 21 August 2015. Retrieved 21 August 2015.
  25. ^ "The Mesosphere DCOS". Mesosphere.com. Retrieved 13 January 2015.
  26. ^ Mary Jo Foley (September 29, 2015). "New Azure Container Service to bring together Mesos, Docker and Azure cloud". ZDNet.
  27. ^ "Oracle Updates Oracle Cloud Infrastructure Services". Oracle.com. October 2015. Retrieved 2018-02-06.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Apache_Mesos&oldid=1292907941"