Advanced Archiving Solution for Large Data Volumes

The ESRF produces a large and growing amount of scientific data (currently 20 PB per year, 100 TB per day, mix of large and small files) and needs to move this data to tape in orderly manner. The goal of this CFT is to purchase an archiving solution able to handle this data with user-based access control, searchable user-defined metadata, and fully manageable using a REST API. The solution must run on Linux-based infrastructure, handle various types of disk storage (including, but not limited to, GPFS and NFS), and archive data on two existing Spectra Logic TFinity tape libraries. In addition, the solution must be able to backup the disk storage to tape, handling the complexity of its structure (more than 1 billion of files and directories). Note for the manpower part: companies based outside France are subject to French Law on "Temporary posting of workers in France" (available on our e-bidding platform).