mysql to cassandra: big data, high scale, data migration... oh my! scott bonneau, cto & evp of...

MySQL to Cassandra: Big Data, High Scale, Data Migration….Oh My!Scott Bonneau – CTO & EVP of EngineeringRC Johnson – NYC Engineering Manager

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Scott Bonneau

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

RC Johnson

Confidential and Proprietary. © 2013 Bazaarvoice, Inc. 4

Nobody reads ads.

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

How we do it

6

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

How it works

7

Over 2,500 Brands

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Scale is our middle name

9

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Technologies

10

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Bazaarvoice History

Replication

WritesWrites

ReadsReads

ApplicationServer

ApplicationServer

Slave DBSlave DB Slave DBSlave DBSolr

IndexMaster

DBMaster

DB

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Cracks in the foundation

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Goals & Chaos

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

I’ll take 4 Cassandra Rings & and Elastic Search to go.

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Breaking Emo apart

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Conditional writes & Eventual Consistency

{ "product": "Sceptre 32\" LCD", "rating": 5, "text": "Very nice TV great picture. Very Very light amazing!",}

{ "product": "Sceptre 32\" LCD", "rating": 5, "text": "Very nice TV great picture. Very Very light amazing!",}

t1

{ .., "status": "APPROVED"}

{ .., "status": "APPROVED"}

t2{ .., "facebookId": 387075234674416}

{ .., "facebookId": 387075234674416}

t3

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

SQL NoSQL

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

It was the best of times, it was the other time

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Rules engine & Vocabulary

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Gotchas we’ve found so far

Confidential and Proprietary. © 2013 Bazaarvoice, Inc.

Questions/Thoughts

Shameless plug

@bazaarvoice