april big group cloud &...

40
Cloud & DevOps April Big Group April 24, 2015 Friday 1:30-2:30 p.m. Science Center Hall E

Upload: others

Post on 25-May-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Cloud & DevOpsApril Big Group

April 24, 2015 Friday 1:30-2:30 p.m. Science Center Hall E

Page 2: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

2

Agenda

• Program Update — Megan Parmar (10 min)

– News and Announcements– Cloud & DevOps Open House: The Results

• Network 1.0 — Jefferson Burson (20 min)

• Security 1.0 — Bill Knox (20 min)– High-Level Responsibilities– Means to an End– How to Do This in the Cloud?

• Q&A (10 min)

Page 3: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Program Update: News and Announcements

3

• Since our last meeting, the Cloud & DevOps team has been building the foundation to enable Wave 1 migrations:

– Designing and building DevOps Platform v1.0– Creating application server patterns and refining the toolset used to

orchestrate and deploy applications to AWS

• We have also spent time refining and rethinking our approach for onboarding applications into the migration process:

– Preparing to pilot a more Agile approach for engagement that leverages Scaled Agile principles

• We continue to work with application teams on migrations, but not at the pace originally planned

– Continued progress with QlikView and IAM migrations– Working to re-baseline the schedule for Wave 1 migrations

Page 4: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Program Update: News and Announcements

4

• Lesson: It’s important to focus on training– Piloted AWS DevOps class built around our program needs — and we

will be opening the class to HUIT as a whole– Dedicated time to building our Python development skills

• Lesson: We need more transition time to support ongoing operational work and provide the right level of support for migrated applications

• Plus: Our team is growing!– Joel Fanton, Director of DevOps Platform– Magnus Bjorkman, Director of Solution Architecture (embedded)– Tom Vachon, Senior Cloud Architect

• Soon: Focus on Wave 2 transition planning based on what we’ve learned from Wave 1

Page 5: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Cloud & DevOps Open House: The Results

5

• Thank you for attending our Open House! – 125 people from across HUIT attended– Generated excellent feedback for us to incorporate into our plans and

communications

• You asked, we listened:– The two key topics respondents want to learn the most about: Security

1.0 and Network 1.0– Other top results:

• Training (update at next Big Group)• Migration and transition (update at next Big Group)• Cloud architecture and its impact on software engineering• Future operational support model and its team impact

Page 6: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

NetworkJefferson Burson

Page 7: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Hi!

Page 8: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

8

Page 9: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

9

Agenda

• Network 1.0

– Direct Connect– VPC Architecture– IP Addressing– Integrated Monitoring

• Toward Network 2.0– Automation– NFV

Page 10: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Network 1.0

Page 11: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

It’s All About Integration

Page 12: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Until Recently ...

12

If you wanted to connect to Harvard, you either did it over the open Internet, had HUIT build you a VPN tunnel, or did something weird on your own.

Page 13: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

VPN tunnel to Amazon

13

Page 14: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Many VPN tunnels to Amazon

14

Page 15: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Many VPN tunnels to Amazon

15

Page 16: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

AWS Direct ConnectDedicated 2x10GB Fiber Connection to AWS

Page 17: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

17

Page 18: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

What’s Next for Direct Connect?

18

Add the rest of the Wave 1 VPCs

Establish as formal service offering for multiple Schools and affiliates

Billing and cost recovery

Ensure scalability

Expand to include more customers Technology roadmap

Improve redundancy with a second dual-path circuit

Increase automation

Page 19: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

AWS VPC

Page 20: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

What is a VPC?

Page 21: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

It’s a Virtual Private Cloud(That’s Not Very Helpful)

Page 22: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

A Network Boundary

22

The network inside the VPC can be visible to all virtual machines or segments within the VPC. However, you can selectively choose what addresses and services are seen from outside the VPC.

Page 23: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

A Trust Zone

23

We can bind identities and roles of administrators and developers to the VPC. Thus, if an entity has rights in one part of the VPC, he or she will likely have those rights in all of the VPC.

Page 24: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

A Functional Boundary

24

My team is different than your team.My applications are different than your applications.

Page 25: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

VPC Design Patterns

25

Cloud Ops, the Architecture Decision Group, and Network Services are all working together on this.

Page 26: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

IP Addresses at AWS

26

Services at Amazon need IP addresses just like everything else. HUIT is centrally managing IP addresses for our use of AWS.

Page 27: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Harvard Routable Addresses

27

Why should you use Harvard routable addresses?

Can’t connect back to the rest

of Harvard if you’re using

someone else’s IP address

Connecting back to Harvard

Can’t have two VPCs with the

same IP addresses

connect together

Connecting to other VPCs

Unique IP addressing improves

logging and traceability

Network security

Page 28: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Don’t Screw This Up, Because ...

28

You can’t re-address an AWS VPC.You have to delete it and start over.

Page 29: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

So, the Moral of the Story is:

29

Get an IP address assignment from HUIT Network Services before you create your VPC.

Page 30: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Seriously:

30

Get an IP address assignment from HUIT Network Services before you create your VPC.

Page 31: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Integrated Monitoring

31

A common approach to monitoring networks, systems, and services in the cloud and on-premise. A HUIT Top 40 goal.

Page 32: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Integrated Monitoring at Harvard

32

“Best-of-breed” configuration management and orchestration:

vCenter SCOM

PuppetContinuous Integration

Git

NetMRIFortinetInfoblox

Other

CloudFormation/Code Deploy

Integrated Monitoring System:Discovery, Monitoring, Performance, Alerting

ServiceNow CMDB

Page 33: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Due by June 30

33

Complete Comparative Analysis

Product Selection

Staffing Proposal

Budget Model

Final Recommendation

Page 34: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Toward Network 2.0Iterate, Improve, Automate

Page 35: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Security 1.0Security for HUIT Wave 1 Cloud Deployment

Page 36: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

BLUF*, a.k.a. TB;DL**

• Work in progress – change is likely– Could be changes to how we do similar things– Could be changes to how we approach information security overall

• For now, implementing security in a similar fashion to the way we do it today to avoid holding things up

• Detailed read is available at http://tinyurl.com/huit-cloud-security-principles

• Feedback is both welcome and critical to everyone’s success

36

* Bottom Line Up Front** Too Boring, Didn’t Listen

Page 37: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

High-Level Responsibilities for Information Security

• Protect

• Detect

• Respond

From what?“Activities that are counter to established information protection policies and requirements”

37

Page 38: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Means to an End: 8 Requirements for Better Security

• See network traffic as it flows to and from systems (traffic insight)

• See detail of what is being done on systems (activity insight)

• Be able to associate what is observed with specific systems (traffic association)

• Know who to talk to about specific systems (owner association)

• Ability to restrict network traffic to only that which is required for the system to perform necessary business functions (traffic control)

• Gain insight and effect control through standard IT services (standard services)

• Insertion of additional inspection and control in the application layer on the network (Layer 7 controls)

• Limitation to the extent by which one party can undermine system security controls (separation of duties)

38

Page 39: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

How to Do This in the Cloud?

• Traffic insight: Virtual firewall in each VPC, logging flow information about traffic between the VPC and the Internet

• Activity insight: Centralized logging to Splunk

• Traffic association: IP address management and logging where required

• Owner association: You tell me (tagging? registration?)

• Traffic control: Virtual firewall to control Internet-facing traffic; security groups to control intra-VPC traffic

• Standard services: Deployment by HUIT of services

• Layer 7 controls: Use of web proxy for outbound web connections

• Separation of duties: Separate group (NOC?) that handles virtual firewall rules (in this model, DevOps teams can control security groups)

39

Page 40: April Big Group Cloud & DevOpscloud.huit.harvard.edu/files/hcs/files/cloud-devops-biggroup-april.pdfto perform necessary business functions (traffic control) •Gain insight and effect

Thank you!