Seminarium: Systemy Rozproszone
2 października 2025, 12:15, link do ZOOM
Cezary Dubnicki



New Architecture for A Scalable Secondary Storage System with Global Deduplication



Our company 9livesdata designed and implemented HYDRAstor - one of the first in the world scalable secondary system with global deduplication. We have done this work for a Japanese IT giant NEC which sold the system world wide. Currently the system is in its 6th generation and is used by thousands of enterprise customers on four continents. Moreover, a few other successful startup companies came up with similar systems several years later reaching multibillion dollar valuations in the process.

Recently 9livesdata has started a new project to design the next generation of such a system based on lessons learnt from almost two decades of deploying HYDRAstor in the field. Besides customer input several new developments guide our new design, especially the advent of vast solid state drives supporting very large I/O rates. Unlike HYDRAstor work, this new project is in fact an internal startup of 9livesdata.

In this talk we will present a short overview of our work on HYDRAstor and later discuss the new architecture of a scalable secondary storage system with global deduplication focusing in particular on system requirements, its goals, and design challenges.

Zapraszam,
Cezary Dubnicki