OpenIO is a software-defined, open-source object storage solution ideal for Big Data and AI workloads, and as a warm tier for HPC use cases. OpenIO is a French company founded in 2015 by a team of engineers, experts in massive data storage infrastructures. Their goal was to create a solution that combines easy scalability and consistent high performance - even during scaling operations.
OpenIO has developed a distributed grid architecture and a unique self-learning ConsciousGrid™ technology that dynamically places incoming data on the most appropriate node, every single time. It even works when you add new nodes, so can you maintain consistent performance while scaling.
OpenIO is S3 compatible and can be deployed on-premises or cloud-hosted, on any possible hardware. It offers the most flexible and versatile solution to solve the scale-out challenges businesses face, beyond thousands of Petabytes. OpenIO has also integrated the ecosystem of OVHcloud (the major European hosting company) and will be available as an OVHcloud solution “hosted by OpenIO”. OpenIO has proven the effectiveness of its solution by setting a performance record on Criteo’s infrastructure, reaching 1.372 Terabits of written data per second. (= 171GB/s)
The OpenIO open source solution provides a new way to build storage clusters, from ultra-fast to huge volume, with backend services for applications, allowing companies to combine data processing and storage on a single platform.
2CRSi has been working with OpenIO for many years with the objective of offering turnkey high-performance storage solutions.
OpenIO can be deployed on any hardware. The 2CRSi consulting/engineering taskforce supports you to provide the best hardware for the best high-performance object storage.
2CRSi and OpenIO offer a tailor-made solution that has already proven itself with customers such as ICM (Paris Brain Institute, link soon to come).
Researchers at the ICM needed to quickly retrieve archived data for comparison with newly published articles. Once data has been archived, it is immutable and secure; but it’s also very difficult to retrieve. 2CRSi and OpenIO solved this problem by placing a ‘warm tier’ of high performance storage in between the parallel file system and the archives. This cluster contains nine available petabytes, is highly efficient and is compatible with their existing IT infrastructure, which will allow ICM to evolve over time.
This solution enables ICM to increase the number of analysis and the number of verifications it can perform on a daily basis, while reducing total cost of ownership.