mysql to cassandra: big data, high scale, data migration... oh my! scott bonneau, cto & evp of...
DESCRIPTION
http://www.DatabaseMonth.com/database/bazaarvoice-cassandra-mysqlTRANSCRIPT
MySQL to Cassandra: Big Data, High Scale, Data Migration….Oh My!Scott Bonneau – CTO & EVP of EngineeringRC Johnson – NYC Engineering Manager
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Scott Bonneau
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
RC Johnson
Confidential and Proprietary. © 2013 Bazaarvoice, Inc. 4
Nobody reads ads.
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
How we do it
6
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
How it works
7
Over 2,500 Brands
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Scale is our middle name
9
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Technologies
10
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Bazaarvoice History
Replication
WritesWrites
ReadsReads
ApplicationServer
ApplicationServer
Slave DBSlave DB Slave DBSlave DBSolr
IndexMaster
DBMaster
DB
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Cracks in the foundation
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Goals & Chaos
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
I’ll take 4 Cassandra Rings & and Elastic Search to go.
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Breaking Emo apart
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Conditional writes & Eventual Consistency
{ "product": "Sceptre 32\" LCD", "rating": 5, "text": "Very nice TV great picture. Very Very light amazing!",}
{ "product": "Sceptre 32\" LCD", "rating": 5, "text": "Very nice TV great picture. Very Very light amazing!",}
t1
{ .., "status": "APPROVED"}
{ .., "status": "APPROVED"}
t2{ .., "facebookId": 387075234674416}
{ .., "facebookId": 387075234674416}
t3
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
SQL NoSQL
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
It was the best of times, it was the other time
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Rules engine & Vocabulary
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Gotchas we’ve found so far
Confidential and Proprietary. © 2013 Bazaarvoice, Inc.
Questions/Thoughts
Shameless plug
@bazaarvoice