sqrrl november webinar: encryption and security in accumulo

42
Securely explore your data ENCRYPTION AND SECURITY IN ACCUMULO AND SQRRL Michael Allen Security Architect Sqrrl Data, Inc. [email protected]

Post on 18-Oct-2014

46 views

Category:

Data & Analytics


3 download

DESCRIPTION

Tightening Your Trusted Zone: Encryption for Accumulo. In this webinar we will provide a technical deep dive into the NoSQL database Apache Accumulo. Some of the topics that will be covered include: encryption in motion, encryption at rest, trust boundaries.

TRANSCRIPT

Page 1: Sqrrl November Webinar: Encryption and Security in Accumulo

Securely explore your data

ENCRYPTION AND SECURITY IN ACCUMULO AND SQRRL

Michael Allen Security Architect Sqrrl Data, Inc. [email protected]

Page 2: Sqrrl November Webinar: Encryption and Security in Accumulo

ISN’T ACCUMULO ALREADY SECURE?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 3: Sqrrl November Webinar: Encryption and Security in Accumulo

I MEAN, THESE SMART GALS AND GUYS MADE IT…

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

(Undisclosed location)

Sou

rce:

wik

iped

ia.o

rg.

Pub

lic d

omai

n

Page 4: Sqrrl November Webinar: Encryption and Security in Accumulo

CELL-LEVEL SECURITY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 5: Sqrrl November Webinar: Encryption and Security in Accumulo

CELL-LEVEL SECURITY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 6: Sqrrl November Webinar: Encryption and Security in Accumulo

CELL-LEVEL SECURITY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 7: Sqrrl November Webinar: Encryption and Security in Accumulo

WHAT’S THE THREAT?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 8: Sqrrl November Webinar: Encryption and Security in Accumulo

A TYPICAL DEPLOYMENT

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 9: Sqrrl November Webinar: Encryption and Security in Accumulo

A TYPICAL DEPLOYMENT

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

(…ignoring master nodes, name nodes, garbage collectors, other ephemera…)

Page 10: Sqrrl November Webinar: Encryption and Security in Accumulo

A TYPICAL CAST

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 11: Sqrrl November Webinar: Encryption and Security in Accumulo

THREATS INSIDE AND OUT

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 12: Sqrrl November Webinar: Encryption and Security in Accumulo

WHO CAN WE PUSH OUT?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 13: Sqrrl November Webinar: Encryption and Security in Accumulo

HOW?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 14: Sqrrl November Webinar: Encryption and Security in Accumulo

ENCRYPTION

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 15: Sqrrl November Webinar: Encryption and Security in Accumulo

IN MOTION AND AT REST

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 16: Sqrrl November Webinar: Encryption and Security in Accumulo

IT’S NOT…

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Sou

rce:

http

://bi

t.ly/

HqS

cSr.

Cre

ativ

e C

omm

ons,

A

ttrib

utio

n.

Page 17: Sqrrl November Webinar: Encryption and Security in Accumulo

FUNDAMENTAL QUESTIONS

What are you encrypting?

How are you encrypting it?

How are you protecting the key?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 18: Sqrrl November Webinar: Encryption and Security in Accumulo

ACCUMULO 1.6

SSL for Accumulo Clients

Encrypting data within HDFS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 19: Sqrrl November Webinar: Encryption and Security in Accumulo

SSL AND ACCUMULO

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

ACCUMULO-1009

Patch that adds configuring and using SSL certificates

Page 20: Sqrrl November Webinar: Encryption and Security in Accumulo

MAKE YOUR CERTS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 21: Sqrrl November Webinar: Encryption and Security in Accumulo

CONFIGURE YOUR SERVERS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 22: Sqrrl November Webinar: Encryption and Security in Accumulo

CONFIGURE YOUR SERVERS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 23: Sqrrl November Webinar: Encryption and Security in Accumulo

DISTRIBUTE YOUR CERTS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 24: Sqrrl November Webinar: Encryption and Security in Accumulo

DISTRIBUTE YOUR ROOTS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 25: Sqrrl November Webinar: Encryption and Security in Accumulo

ENJOY YOUR SSL

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 26: Sqrrl November Webinar: Encryption and Security in Accumulo

ENCRYPTION AT REST

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

ACCUMULO-998

Patch that adds encryption for Rfiles and WAL

Page 27: Sqrrl November Webinar: Encryption and Security in Accumulo

ENCRYPTION AT REST

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Uses Java Cryptography Extensions (JCE) for encryption

interface / engine

(Guess what? It’s pluggable.)

Page 28: Sqrrl November Webinar: Encryption and Security in Accumulo

BEHIND THE SCENES

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 29: Sqrrl November Webinar: Encryption and Security in Accumulo

BEHIND THE SCENES

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 30: Sqrrl November Webinar: Encryption and Security in Accumulo

BEHIND THE SCENES

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 31: Sqrrl November Webinar: Encryption and Security in Accumulo

BEHIND THE SCENES

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 32: Sqrrl November Webinar: Encryption and Security in Accumulo

WHERE DOES THAT KEY GO?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 33: Sqrrl November Webinar: Encryption and Security in Accumulo

WHERE DOES THAT KEY GO?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 34: Sqrrl November Webinar: Encryption and Security in Accumulo

WHERE DOES THAT KEY GO?

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 35: Sqrrl November Webinar: Encryption and Security in Accumulo

PLUGGABLE STRATEGY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

•  Java class that mediates access to KEK

•  Encrypts and decrypts per-file keys

•  Passes back to callers opaque ID to identify KEK used to do encryption

•  Callers should store opaque ID along with encrypted key

Page 36: Sqrrl November Webinar: Encryption and Security in Accumulo

PLUGGABLE STRATEGY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 37: Sqrrl November Webinar: Encryption and Security in Accumulo

PLUGGABLE STRATEGY

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 38: Sqrrl November Webinar: Encryption and Security in Accumulo

CONFIGURATION OPTIONS

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Property Name “Usual” Value Meaning

!"#$%&'(&)*+,'!+-../ &"0'-$-!1,'-!!*(*+&'/!&",'.,!*"2%#'!"#$%&'/3,4-*+%5"#$%&6&)*+,/

The class that creates encrypting and decrypting data streams

!"#$%&'!2$1,"'.*2%, 789:5;<:=>59?=-))2@0/ Encryption algorithm spec

!"#$%&'!2$1,"'A,#'+,@0%1 BCD/ Key length

!"#$%&'(&)*+,'!+-../ &"0'-$-!1,'-!!*(*+&'/!&",'.,!*"2%#'!"#$%&'/3,4-*+%9,!",%E>,#8@!"#$%2&@9%"-%,0#/

Class that mediates access to KEK

Page 39: Sqrrl November Webinar: Encryption and Security in Accumulo

REDUCED THREAT

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 40: Sqrrl November Webinar: Encryption and Security in Accumulo

REDUCED THREAT

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 41: Sqrrl November Webinar: Encryption and Security in Accumulo

TOWARDS THE FUTURE

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

Page 42: Sqrrl November Webinar: Encryption and Security in Accumulo

© 2013 Sqrrl | All Rights Reserved | Proprietary and Confidential

THANKS! [email protected]