nosql tel aviv meetup #2: nosql at scale - architecture and common pitfalls
TRANSCRIPT
![Page 2: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/2.jpg)
Arthur Gimpell
‹ ›2
About Me
•Working with databases for 8 years
•5 years, SQL Server & .NET
•3 years with NoSQL & Python & Node.js
•2015 - Founded DataZone
![Page 3: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/3.jpg)
Arthur Gimpell
‹ ›3
DataZone | Data is our business! What’s yours?
•Consultancy & projects
•Private & public training
•Multi vendor, multi tier support with SLA
•Child unit of CloudZone, public cloud leaders
![Page 4: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/4.jpg)
NoSQL Why Not?
![Page 5: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/5.jpg)
Arthur Gimpell
‹ ›5
All the wrong reasons…
•Web Scale! Web Scale!
•Costs reduction*
•Free school for developers
Source: mongodb-is-web-scale.com
![Page 6: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/6.jpg)
Common Pitfalls
![Page 7: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/7.jpg)
Arthur Gimpell
‹ ›7
RDBMS Practices
Normalization in the low cost storage era
![Page 8: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/8.jpg)
Arthur Gimpell
‹ ›8
RDBMS Practices
Expecting the Wrong Features
Jobs
Mailing Servers
Queues
TriggersStored
Procedures
Shell
Commands
![Page 9: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/9.jpg)
Arthur Gimpell
‹ ›9
RDBMS Practices
ORM != ODM
Object Relational Mapping - Targets:
•Speeding development.
•Mapping multiple relations to Objects
•Simple Standard CRUD
Object Document Mapper - Targets:
•Managing references & embeddeds
•Typing your data
•Retries, Events, Transactions
![Page 10: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/10.jpg)
Arthur Gimpell
‹ ›10
Architecture
Commodity hardware - over distribution
Cluster 1Cluster 2
![Page 11: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/11.jpg)
Arthur Gimpell
‹ ›11
Architecture
Cluster Majority
A
Cluster 1
B
C
A
Cluster 2
B
![Page 12: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls](https://reader031.vdocuments.net/reader031/viewer/2022021813/58a993b61a28abc2518b484d/html5/thumbnails/12.jpg)
Arthur Gimpell
‹ ›12
Summary
Adjust the technology to your needs, not vice versa.
Be aware of your engine’s distribution model, plan your cluster accordingly.
Model your data by the engine’s best practices - read them.
Don’t over size, don’t under size, run performance tests on various deployments.
Databases are made for storing & efficiently manipulating data, not sending emails.
Run Backups! Replication is not a replacement for cold backups.