Jump to content

OpenIO

Add links
From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by FrescoBot (talk | contribs) at 03:28, 1 November 2020 (Bot: link syntax and minor changes). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
OpenIO
IndustryInformation technology, Data storage, Data processing
Founded2015
Headquarters
France
OwnerOVH
Websitewww.openio.io

OpenIO has been founded in 2015 by Laurent Denel (CEO), Jean-François Smigielski (CTO) and five other co-founders, to offer an object storage solution for building hyper-scalable IT infrastructures for a wide range of applications.[1] They have leveraged open source software, developed since 2006, which is based on a grid technology that enables dynamic behaviors and supports heterogenous hardware.[2] In October 2017 OpenIO completed a $5 million funding round.[3] In July 2020 OpenIO has been acquired by OVH.[4]

Product

OpenIO is a software-defined object storage solution that supports S3 and can be deployed on-premises, cloud-hosted or at the edge, on any hardware mix. It has been designed from the beginning for performance and cost-efficiency at any scale[5], and it has been optimized for Big Data, HPC and AI.[6]

OpenIO stores objects within in a flat structure within a massively distributed directory with indirections, this allows the data query path to be independent of the number of nodes and the performance not to be affected by the growth of the capacity. Servers are organized as a grid of nodes massively distributed, where each node takes part in directory and storage services, which ensures that there is no single point of failure and that new nodes are automatically discovered and immediately available without the need to rebalance data.[7]

The software is built on top of ConsciousGrid, a technology that ensures optimal data placement based on real-time metrics and allows the addition or removal of storage devices with automatic performance and load impact optimization.[8][9] For data protection OpenIO has synchronous and asynchronous replication with multiple copies, and an erasure coding implementation based on Reed-Solomon that can be deployed in one data center or geo-distributed or stretched clusters.[10][11]

The software has a GridForApps feature that catches all events that occur in the cluster and can pass them up in the stack or to applications running on OpenIO nodes. This enables event-driven computing directly into the storage infrastructure.[12][13]

OpenIO has native object APIs and SDKs for Python, C and Java, it integrates a HTTP REST/API and has strong compatibility with the Amazon S3 API and the OpenStack Swift API.[7] The company also offers a proprietary File System connector to access data stored in an OpenIO object store through file access methods: it is based on FUSE and presents a POSIX File System which can be shared over local networks via NFS, SMB and FTP.[14]

OpenIO is compatible with x86 and ARMv7/ARMv8 servers running Linux[15] and has low hardware requirements[16], it can be installed also on Raspberry Pis[17][18] and on storage drives with embedded server.[19][20][21]

The open source code is available on Github and it is licensed under AGPL3 for server code and LGPL3 for client code.

Performance

OpenIO claimed to have reached 1.372 Tbps write speed (171 GB/s) on a cluster of 350 physical machines.[22] The benchmark scenario, conducted under production conditions with standard hardware (commodity servers with 7200 rpm HDDs), consisted in backing up a 38 PB Hadoop datalake via the DistCp command.[23] This level of performance marks, according to analysts[24], the arrival of a new generation of object storage technologies oriented toward high performance and hyper-scalability.

See also

References

  1. ^ "OpenIO Object Storage Overview". OpenIO.{{cite news}}: CS1 maint: url-status (link)
  2. ^ Nicholas, Philippe (2016-07-15). "The History Boys: Object storage ... from the beginning". The Register.{{cite news}}: CS1 maint: url-status (link)
  3. ^ Dillet, Romain (2017-10-24). "OpenIO raises $5 million to build your own Amazon S3 on any storage device". TechCrunch.{{cite news}}: CS1 maint: url-status (link)
  4. ^ "With the acquisition of OpenIO, OVHcloud's ambition is to create the best Object Storage offer on the market". OVHcloud. 2020-07-22.{{cite web}}: CS1 maint: url-status (link)
  5. ^ Mellor, Chris (2015-12-05). "Openio's objective is opening up object storage space". The Register.{{cite news}}: CS1 maint: url-status (link)
  6. ^ "OpenIO | High Performance Object Storage for Big Data and AI". OpenIO.{{cite web}}: CS1 maint: url-status (link)
  7. ^ a b "OpenIO Core Concepts". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  8. ^ "OpenIO Object Storage for Big Data". OpenIO.{{cite news}}: CS1 maint: url-status (link)
  9. ^ "Why We Designed an Object Store with a Conscience". OpenIO Blog. 2017-07-18.{{cite web}}: CS1 maint: url-status (link)
  10. ^ "OpenIO Data Management Features". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  11. ^ "OpenIO Storage Policies". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  12. ^ Delaporte, Guillaume (2017-05-17). "Simple Metadata Indexing through Grid for Apps". OpenIO Blog.{{cite news}}: CS1 maint: url-status (link)
  13. ^ Delaporte, Guillaume (2017-06-07). "Detect patterns in pictures at scale using Tensorflow and OpenIO GridForApps". OpenIO Blog.{{cite news}}: CS1 maint: url-status (link)
  14. ^ "OpenIO File System Connector (OIO-FS) Architecture". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  15. ^ "OpenIO Supported Linux Distributions". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  16. ^ "OpenIO Sizing Guide". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  17. ^ Townsend, Keith (2017-03-14). "Raspberry Pi in the data center: A unique option for object storage and edge computing". TechRepublic.{{cite news}}: CS1 maint: url-status (link)
  18. ^ "OpenIO on a Raspberry Pi". OpenIO Documentation.{{cite web}}: CS1 maint: url-status (link)
  19. ^ Kranz, Garry (2017-02-06). "Open source object storage startup OpenIO adds hardware". SearchStorage.{{cite news}}: CS1 maint: url-status (link)
  20. ^ Mellor, Chris (2016-09-21). "OpenIO wants to turn your spinning rust into object storage nodes". The Register.{{cite news}}: CS1 maint: url-status (link)
  21. ^ Mellor, Chris (2017-10-03). "Is this the real life? Is this just fantasy? Self-processing flash drives, we'll need more capacity". The Register.{{cite news}}: CS1 maint: url-status (link)
  22. ^ Mellor, Chris (2019-10-15). "OpenIO 'solves' the problem with object storage hyperscalability". Blocks & Files.{{cite web}}: CS1 maint: url-status (link)
  23. ^ "Terabit Challenge | OpenIO Object Storage". OpenIO.{{cite web}}: CS1 maint: url-status (link)
  24. ^ Enrico, Signoretti (2019-11-08). "S3, file access and high performance… this is not your old object storage". Gigaom.{{cite web}}: CS1 maint: url-status (link)
Retrieved from "https://en.wikipedia.org/w/index.php?title=OpenIO&oldid=986480020"