March 12, 2018

Database Refactoring Patterns with Pramod Sadalage - Episode 22

49 minutes

Summary

As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he reflects on the current state of affairs and how things have changed over the past 12 years.

Preamble

Hello and welcome to the Data Engineering Podcast, the show about modern data infrastructure

When you’re ready to launch your next project you’ll need somewhere to deploy it. Check out Linode at dataengineeringpodcast.com/linode and get a $20 credit to try out their fast and reliable Linux virtual servers for running your data pipelines or trying out the tools you hear about on the show.

Go to dataengineeringpodcast.com to subscribe to the show, sign up for the newsletter, read the show notes, and get in touch.

You can help support the show by checking out the Patreon page which is linked from the site.

To help other people find the show you can leave a review on iTunes, or Google Play Music, and tell your friends and co-workers

Your host is Tobias Macey and today I’m interviewing Pramod Sadalage about refactoring databases and integrating database design into an iterative development workflow

Interview

Introduction

How did you get involved in the area of data management?

You first co-authored Refactoring Databases in 2006. What was the state of software and database system development at the time and why did you find it necessary to write a book on this subject?

What are the characteristics of a database that make them more difficult to manage in an iterative context?

How does the practice of refactoring in the context of a database compare to that of software?

How has the prevalence of data abstractions such as ORMs or ODMs impacted the practice of schema design and evolution?

Is there a difference in strategy when refactoring the data layer of a system when using a non-relational storage system?

How has the DevOps movement and the increased focus on automation affected the state of the art in database versioning and evolution?

What have you found to be the most problematic aspects of databases when trying to evolve the functionality of a system?

Looking back over the past 12 years, what has changed in the areas of database design and evolution?

How has the landscape of tooling for managing and applying database versioning changed since you first wrote Refactoring Databases?

What do you see as the biggest challenges facing us over the next few years?

Contact Info

Website

pramodsadalage on GitHub

@pramodsadalage on Twitter

Parting Question

From your perspective, what is the biggest gap in the tooling or technology for data management today?

Links

Database Refactoring

Website

Book

Thoughtworks

Martin Fowler

Agile Software Development

XP (Extreme Programming)

Continuous Integration

The Book

Wikipedia

Test First Development

DDL (Data Definition Language)

DML (Data Modification Language)

DevOps

Flyway

Liquibase

DBMaintain

Hibernate

SQLAlchemy

ORM (Object Relational Mapper)

ODM (Object Document Mapper)

NoSQL

Document Database

MongoDB

OrientDB

CouchBase

CassandraDB

Neo4j

ArangoDB

Unit Testing

Integration Testing

OLAP (On-Line Analytical Processing)

OLTP (On-Line Transaction Processing)

Data Warehouse

Docker

QA==Quality Assurance

HIPAA (Health Insurance Portability and Accountability Act)

PCI DSS (Payment Card Industry Data Security Standard)

Polyglot Persistence

Toplink Java ORM

Ruby on Rails

ActiveRecord Gem

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA

Support Data Engineering Podcast

...more

View all episodes

By Tobias Macey

4.5

142142 ratings