harry potter and the daemons of berkeley

25
Harry Poer and the Daemons of Berkeley Alex Chistyakov, Principal Engineer at Git in Sky Jul 07 2016, PgDay, Saint-Petersburg

Upload: alex-chistyakov

Post on 09-Jan-2017

977 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Harry Potter and the Daemons of Berkeley

Harry Potter and the Daemons of Berkeley

Alex Chistyakov, Principal Engineer at Git in SkyJul 07 2016, PgDay, Saint-Petersburg

Page 2: Harry Potter and the Daemons of Berkeley

Who we are

● A small consulting company from Spb., Russia

● Elephant groomers

● Ops engineers, performance tuners

● We also walk dogs

Page 3: Harry Potter and the Daemons of Berkeley

Who are you

● People smart enough to be DBAs?

● People smart enough to be DBDs?

● People smart enough to prefer PostgrteSQL?

● MySQL users, anyone?

Page 4: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

Page 5: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

Page 6: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

Page 7: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

Page 8: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

● I prefer Linux and open source

Page 9: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

● I prefer Linux and open source

● At least I can get high and read source code a bit

Page 10: Harry Potter and the Daemons of Berkeley

Enough on me, fight!

● Ubuntu Linux (dumb as me)

● FreeBSD (a lot smarter)

● Gentoo Linux (elite stuff)

Page 11: Harry Potter and the Daemons of Berkeley

Hardware

● Dell R430

● 192Gb RAM

● PERC H730 mini

● Two Edge Boost Pro P SSDs in RAID1

● 2 x Xeon(R) CPU E5-2630 v3 @ 2.40GHz

Page 12: Harry Potter and the Daemons of Berkeley

Software

● PostgreSQL

● Minimal tuning (checkpoint-related)

● As always:

● pgbench -i -s 1000 --foreign-keys pgbench

● pgbench -T 300 -P 10 -c N -j N -r pgbench

● Synchronous commit

● Asynchronous commit

Page 13: Harry Potter and the Daemons of Berkeley

Ubuntu Linux, sync commit

● ext4, data=ordered, barrier, relatime (defaults, notuning)

● N=1, 1397 tps

● N=4, 3928 tps

● N=8, 6559 tps

● N=12, 8132 tps

Page 14: Harry Potter and the Daemons of Berkeley

Ubuntu Linux, async commit

● N=1, 1609 tps

● N=4, 5432 :) tps

● N=8, 9068 tps

● N=12, 10321 tps

Page 15: Harry Potter and the Daemons of Berkeley

FreeBSD (UFS/SU), sync commit

● N=1, 1196 (Ubuntu: 1397) tps

● N=4, 2819 (Ubuntu: 3928) tps

● N=8, 3430 (Ubuntu: 6559) tps

● N=12, 3785 (Ubuntu: 8132) tps

Page 16: Harry Potter and the Daemons of Berkeley

FreeBSD (UFS/SU), async commit

● N=1, 1614 (Ubuntu: 1609) tps

● N=4, 3783 (Ubuntu: 5432) tps

● N=8, 3981 (Ubuntu: 9068) tps

● N=12, 4791 (Ubuntu: 10321) tps

Page 17: Harry Potter and the Daemons of Berkeley

FreeBSD (ZFS), async commit

● Died under load, I lost it

Page 18: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

Page 19: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

Page 20: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

Page 21: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

Page 22: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

● Ever heard of recursion?

Page 23: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

● Ever heard of recursion?

● Yes, there is 802.3ad bonding on a switch and it’s mandatory!

Page 24: Harry Potter and the Daemons of Berkeley

Conclusions

● I’d rather stay on Ubuntu, it suits me best

● FreeBSD is effectively dead, sorry guys

● Gentoo is too elite

Page 25: Harry Potter and the Daemons of Berkeley

So long, and thanks for all the fish!

● Your questions, please?

● This was your Principal Engineer speaking

● http://gitinsky.com

[email protected]

● http://meetup.com/DevOps-40