May 03, 2019

#98 – Shared Storage for Scale-out Databases with Walt Hinton from Pavilion Data

17 minutes

In this third recording from Dell Technologies World 2019, Chris talks with Walt Hinton, Head of Corporate and Product Marketing at Pavilion Data Systems. The topic of conversation is the alignment of shared storage with scale-out NoSQL databases that typically place storage components on separate local disks.

As rack-scale computing becomes more widely adopted, local storage will migrate back into bottom-of-rack shared storage infrastructure. In this instance, does it make sense to put shards of databases back on the same hardware? Walt thinks it is the next logical step in optimising scale-out applications and introducing what could be classed as SAN 2.0. Shared rack-scale storage provides the capability to reduce east-west rebuild traffic and the associated risk exposure that failures introduce.

Walt also discusses performance improvements that have been seen with the introduction of release 2.2 of the software that drives the Pavilion storage platform – 90GB/s throughput at 40µs latencies. You can find out more about Pavilion Data and their NVMe-oF Storage Platform at https://paviliondata.com/.

Elapsed Time: 00:17:58

Timeline

* 00:00:00 – Intros

* 00:00:50 – What is the Pavilion Data Platform?

* 00:01:30 – How are requirements for shared storage evolving?

* 00:04:00 – Rebuild failures become a problem with scale-out architectures

* 00:06:30 – Disaggregation with NVMe enables rack-scale architectures

* 00:08:30 – Should we be reconsolidating sharded database applications?

* 00:11:30 – What are the options in rack-scale designs?

* 00:13:30 – Release 2.2 of Pavilion software delivering greater performance

* 00:15:00 – Disaggregated solutions aim to get out of the data path

* 00:17:00 – Wrap up