Download - Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!
![Page 1: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/1.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
How to Optimize Inter-DC communication
Solution Architect, ScyllaDB
Eyal Gutkind
![Page 2: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/2.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Eyal Gutkind
2
Head of Solution Architects team at ScyllaDB. Previously, held Product Management roles at Mirantis and DataStax. Prior to DataStax I spent 12 years with Mellanox Technologies in various engineering management and Product Marketing roles. I have a BSc. degree in Electrical and Computer Engineering from Ben Gurion University and an MBA from Fuqua School of Business at Duke University
![Page 3: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/3.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
What’s Inter-Datacenter Communication?
3
USA Data Center Asia Data Center
![Page 4: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/4.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
What Do You Pay for?
4
![Page 5: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/5.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
What Do You Pay for?
5
![Page 6: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/6.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
6
- Simple vs NetworkTopology Strategies
EC2MultiRegionSnitch - for AWS based deployments,
GossipingPropertyFileSnitch - for all other deployments
![Page 7: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/7.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
- Simple vs NetworkTopology StrategiesCREATE KEYSPACE myks WITH replication = {'class': 'SimpleStrategy', 'replication_factor': '7'}
7
USA Data Center Asia Data Center
![Page 8: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/8.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
- Simple vs NetworkTopology StrategiesCREATE KEYSPACE myks WITH replication = {'class': 'NetworkToplogyStrategy', 'usa’: '3', ‘asia’: ‘3’}
8
USA Data Center Asia Data Center
![Page 9: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/9.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
- Simple vs NetworkTopology Strategies
- Be Local! - Set Load balancing correctly in your clients
9
load_balancing_policy= TokenAwarePolicy(DCAwareRoundRobinPolicy(local_dc='asia'))
![Page 10: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/10.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
- Simple vs NetworkTopology Strategies
- Be Local! - Set Load balancing correctly in your clients- Set Consistency levels in your queries!
10
insert_query = SimpleStatement( "INSERT INTO myks.mytable (user_id, name, address, zip_code) VALUES (%s, %s, %s, %s)", consistency_level=ConsistencyLevel.LOCAL_QUORUM)…)
![Page 11: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/11.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Snitch, Keyspace and Client Drivers Settings
- Simple vs NetworkTopology Strategies
- Be Local! - Set Load balancing correctly in your clients- Set Consistency levels in your queries!
11
![Page 12: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/12.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Inter-Node Compression!
Default : None
Use: DC
In your Scylla.yaml file uncomment and set
internode_compression: dc
12
![Page 13: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/13.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
Summary
- As expected, you always pay :)
- Create keyspaces and tables in the regions you need them- Enable conversations between ops and dev for best use cases
- Review client geo locations and data access patterns- Who is writing? (Cheap)- Who is reading? (Expensive)
- Enable compression!
13
![Page 14: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!](https://reader031.vdocuments.net/reader031/viewer/2022021922/5a65126b7f8b9aa2548b6a29/html5/thumbnails/14.jpg)
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES
First and last namePosition, company
THANK YOU
@gutkinde
Please stay in touch
Any questions?