database version control without pain - the phpnw10 version

PHPNW10 - Manchester - 9th October 2010Harrie Verveer

Database Version Control Without Pain

zaterdag 9 oktober 2010

Oh hai!

2

Harrie Verveeraka Hairy

DutchyI live in Goes, which probably sounds awkward to you

Software engineer at ibuildings since 2004Vlissingen (Flushing) office


“Yeah, don’t get bogged down in trying to be funny. Be yourself and present the info.”


9

Sorry, this talk won’t be funny


Database Version ControlWhat’s the problem?

10zaterdag 9 oktober 2010

http://www.sxc.hu/photo/1207911




http

://en

.wik

iped

ia.o

rg/w

iki/F

ile:S

TS1

20La

unch

HiR

es.jp

g




http://www.flickr.com/photos/kt/1217157/




Why Database Version Control


Simple Patching Strategy

16

The basic idea


Simple patching strategy


Example patch file

18

patch-001.sql


Simple patching strategy

20

Development

Write codeWrite DB patches

Apply patches to own DB

Update

Apply patches Commit


Fixing patches

21

patch-002.sql


Fixing patches

22

patch-003.sql


Fixing patches

22

patch-003.sql

Never modify a patch file onceit’s under version control


Undo patch files

23

undo-001.sql


http://www.freefoto.com/preview/41-07-7zaterdag 9 oktober 2010



Bonus points

Install.sql


Bonus points

Initial dummy content


Automating the processFaster & Safer


Typical patch script


Typical patch script

31

update.sh


BranchesMerge problems


Branches

33

Trunk

patch-001.sql

patch-002.sql

patch-003.sql


Trunk

patch-001.sql

patch-002.sql

patch-003.sql

create branch

patch-004.sql

patch-005.sqlpatch-004.sql

patch-005.sql

Branch A

Merge

Branches


Trunk

patch-001.sql

patch-002.sql

patch-003.sql

create branch

patch-004.sql


patch-005.sql

Branch A

Merge

Branches

34

patch-006.sql

patch-007.sql


Branches

35

Trunk

patch-001.sql

patch-002.sql

patch-003.sql

create branch

patch-004.sql

patch-005.sql

patch-004.sql

patch-005.sql

Branch B

create branch

patch-002.sql

patch-003.sql

Branch A

Merge

patch-004.sql

Merge

patch-005.sql

Merge

Merge


Separate sequence

db/patches/trunk/

patch-001.sqlpatch-002.sqlpatch-003.sql

36

db/patches/branchA/



Separate sequence

db/patches/trunk/

patch-001.sqlpatch-002.sqlpatch-003.sql

36

db/patches/branchA/


Trunk version 3BranchA version 2


Patchfile naming

37

patch_20100611_1430.sql


Patch log


There is no silver bulletWhy it can’t exist


http://www.flickr.com/photos/eschipul/4160817135/




Comparing tables

42

Table in DB 1Table in DB 1

column 1 int

column 2 varchar(255)



column 1 int




Comparing tables

43


id int

name varchar(255)

city varchar(255)


id int

name varchar(255)

website varchar(255)


Comparing tables

44


id int

firstname varchar(255)

lname varchar(255)


id int

firstname varchar(255)

lastname varchar(255)


45

To synchronize two database structures without unexpected

dataloss, communicating all steps needed to get from A to B is

inevitable.


Phing & DB Deploy


Phing & DB Deploy

47Cartoon by Oliver Widder - http://geekandpoke.typepad.com/zaterdag 9 oktober 2010

http://geekandpoke.typepad.com/

http://geekandpoke.typepad.com/

http://geekandpoke.typepad.com

http://geekandpoke.typepad.com

48

http://phing.info/


http://phing.info

http://phing.info

Phing


DB Deploy


Phing & DB Deploy


DB Deploy

53

db/patches/1-create_user_table.sql


DB Deploy

54

changelog table:


DB Deploy

55

PHP


DB Deploy

56

SQL


DB Deploy

57

Features


LiquibaseThe most complete solution I know


Liquibase

59

www.liquibase.org


http://www.liquibase.org

http://www.liquibase.org

Liquibase


Liquibase

Updating

Reverting

Tagging

Generate XML

Diff


Liquibase

Branches


Liquibase

DBMS Support


Liquibase

Documentation


Liquibase

Java


Akrabat DB Schema ManagerZend Framework specific solution


Akrabat DB Schema Manager

Zend Framework

Proposed by Rob Allen in 2006

Recently implemented

Might be in ZF in the near future

http://github.com/akrabat/Akrabat



Zend Framework

Proposed by Rob Allen in 2006

Recently implemented

Might be in ZF in the near future

Might not be in ZF in the near future as well



Writing the patch

72

scripts/migrations/001-CreateUserTable.php


Writing the patch

73

scripts/migrations/001-CreateUserTable.php



PHP Patches



Easy syntax if you know ZF



Easy to install, easy to use



Branch merging


Doctrine MigrationsDoctrine ORM specific solution


Doctrine Migrations

79

http://www.doctrine-project.org/


http://www.doctrine-project.org

http://www.doctrine-project.org

Doctrine Migrations Patch


Doctrine Migrations

81

Update-to-version

./doctrine migrate


YAML


YAML

82

./doctrine generate-migrations-diff


Doctrine Migrations


Doctrine Migrations

84

Generate patches


Doctrine Migrations

85

Useful if you’re already using Doctrine ORM


Summary


Summary

Patchfiles• Automating

• Branch merging

• Why there is no silver bullet

Phing + DB Deployhttp://phing.infohttp://dbdeploy.com

Liquibasehttp://www.liquibase.org

87

Akrabat DB Schema Managerhttp://akrabat.comhttp://github.com/akrabat/Akrabat

Doctrine Migrationshttp://www.doctrine-project.org


http://phing.info

http://phing.info

http://dbdeploy.com

http://dbdeploy.com

http://phing.info

http://phing.info

http://akrabat.com

http://akrabat.com



http://phing.info

http://phing.info

Questions ?


89

Contact me

Harrie VerveerSoftware Engineer at Ibuildings

E-mail:[email protected]

Skype:harrie-ibuildings

Twitter:@harrieverveer

http://joind.in/2056


http://twitter.com/harrieverveer

http://twitter.com/harrieverveer



database version control without pain - the phpnw10 version

Technology