storage foundation chapter 1

42
© 2009 EMC Corporation. All rights reserved. Information Storage and Management Mastering Real-World Storage Concepts and Technologies

Upload: rohit-kumar

Post on 25-May-2017

240 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved.

Information Storage and Management

Mastering Real-World Storage Concepts and Technologies

Page 2: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 2

Course SectionsThis course contains the following sections:

1. Introduction to Information Storage Technology

2. Storage Systems Architecture

3. Networked Storage

4. Business Continuity

5. Monitoring and Managing the Data Center

6. Securing Storage and Storage Virtualization

Page 3: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 3

ObjectivesUpon completion of this course, you will be able to:

Describe the logical and physical components of a information storage infrastructure

Evaluate storage architectures, including storage subsystems, DAS, SAN, NAS, CAS

Examine emerging technologies including IP-SAN

Define backup, recovery, disaster recovery, business continuity and replication

Identify components of managing and monitoring the data center

Define information security and identify different storage virtualization technologies

Page 4: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved.

Introduction to Information Storage Technology

Section 1 - Introduction

Page 5: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 5

Section ObjectivesUpon completion of this section, you will be able to:

Describe how data is created, the amount of data being created, and the value of information to a business

Identify challenges in information storage and management

List the solutions available for data storage

List and describe the core elements of a Data Center infrastructure

Describe the key requirements of Storage Systems

Page 6: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 6

In This Section This section contains the following modules:

Meeting Today’s Information Storage Needs

Data Center Infrastructure

Page 7: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 7

Meeting Today’s Information Storage NeedsUpon completion of this module, you will be able to:

Describe who is creating data and the amount of data being created

Describe the value of data to business

List the solutions available for data storage

Page 8: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 8

Data Creation Data is being created at an ever increasing rate

– Data creation/generation is growing at a rate in excess of 50% year over year

– The need to store the data over longer periods of time with improved accessibility is also growing

Information Technology (IT) budgets are responding– IT budgets typically have to account for expenditure on servers,

networks, storage, personnel, etc.– To keep up with data storage needs, IT expenditure on storage has

increased proportionally– It is estimated that about 40% of the IT expenditure is data storage

related

Page 9: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 9

Data Creation: Individuals What data is created by individuals

Examples include:– Photos– Documents– Spreadsheets– Video

Page 10: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 10

Data Creation: IndividualsWhere is this data stored

Storage can be in:– Cameras– MP3 players– Laptop hard drives– CDROM/DVDs– USB drives

Page 11: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 11

Data Creation: Business What data is created by a business

Examples of data created by a business include:– Product data: inventory, description, pricing, availability, sales

numbers and projections– Customer data: orders, shipping details– Account data: banking, financial services industry– Medical data: health care providers, insurance industry, hospitals

Page 12: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 12

Data Creation: BusinessWhere is this data stored

Business data can be stored on:– Employee workstations– Servers– Disk arrays– Tapes – CDROM/DVDs– Off-site libraries

Page 13: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 13

Value of Data to a Business: Information What do businesses do with the data they collect

They turn it into “information”

Examples of information include:– Buying habits and patterns of customers– Health history of patients – Locations where a credit card is used

Page 14: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 14

Value of Information to a Business Identifying new business opportunities

– Buying/spending patterns: internet stores, retail stores, supermarkets– Customer satisfaction/service: tracking shipments, and deliveries

Identifying patterns that lead to changes in existing business– Reduced cost: just-in-time inventory, eliminating over-stocking of

products, optimizing shipment and delivery– New services: security alerts for “stolen” credit card purchases– Targeted marketing campaigns: communicate to bank customers with

high checking account balances about a special savings plan

Creating a competitive advantage

Page 15: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 15

Value of Individual Data to a Business What data, created by individuals, might be valuable to a

business

Examples of business value from individuals’ data include:– On-line job search services– On-line photo storing and sharing services

Page 16: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 16

Information Availability - Downtime is ExpensiveMillions of US Dollars per Hour in Lost Revenue

6.53.6

2.82.6

2.01.61.6

1.51.3

1.21.1

Retail brokerage

Point of sale

Energy

Credit card sales authorization

Telecommunications

Call location

Manufacturing

Financial institutions

Information technology

Insurance

Retail

Source Meta Group, 2005

Page 17: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 17

Categories of Data Data can be categorized as either

structured or unstructured data

Over 80% of enterprise information is unstructured (Fulcrum Research)

What has been the traditional approach to storing all this data Structured

UnstructuredE-mail Attachments

PDFs

Checks

X-rays

PaperDocumentsRich Media

Web PagesAudio & Video

RecordsInvoices

Manuals

Claims

Contracts Instant Messages

Forms

Images

XML

Rows and Columns

Page 18: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 18

Data Storage Models: An Evolution Centralized: terminals connected to a Mainframe

computer which had connectivity to internal or external storage devices (disks, tapes)

Decentralized: With the advent of Open Systems, business units within an enterprise adopted a Client-Server model

Centralized: Networked Storage (the current “best practice” model being used in IT)

Page 19: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 19

Data Storage Models: An Evolution (continued) Centralized: terminals connected to a Mainframe

computer which had connectivity to internal or external storage devices (disks, tapes)

Decentralized: With the advent of Open Systems, business units within an enterprise adopted a Client-Server model

Centralized: Networked Storage (the current “best practice” model being used in IT)

Page 20: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 20

Common Data Storage Media and Solutions Tape Library: A collection of tape drives and tapes

Jukeboxes: A collection of optical disks and drives

Disk Arrays: A collection hard disks

Each solution addresses specific needs for data storage and management.– Tape Library – Backup/Restore; Archival of data– Jukeboxes – Typically to store non-changing content over long

periods of time– Disk Arrays – To store data that has to be immediately accessible

and on-line

Page 21: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 21

Tape Storage Systems

• Traditionally tape based storage is relatively inexpensive, compared to disk arrays.

• They served as primary storage solutions in the early days.

• Tape drives use Read/Write heads to record bits of data onto magnetic material on the tape surface.

• This technology continues to evolve, providing higher storage capacity, greater reliability, and improved performance.

Page 22: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 22

Storing Data on Tape Data is recorded sequentially from the beginning to end,

one byte after another.

Because data is stored linearly along the length of the tape, random access to specific bits of data is slow and time consuming. This severely limits tape as a medium for real-time, rapid access to data.

Tapes cannot be simultaneously shared among multiple users or applications.

Page 23: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 23

Optical Data Storage

• Popular in small, single-user computing environments.

• Frequently used by individuals to store and share data, or as backup solution.

• Also used as distribution medium for applications, or as a means of transferring small amounts of data between computers.

Page 24: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 24

Disk Based Storage

Disk based storage provides a number of advantages over tape and optical solutions:

• Data can be randomly accessed very rapidly

• Larger capacity

• Less wear and tear compared to tapes

• Simultaneous access for multiple users and applications

• Numerous options to ensure data availability

Page 25: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 25

Worldwide Information Growth

~60% Average Growth Rate

>70% in 2005

0%

40%

60%

80%

100%

120%

2001 2002 2003 2004 2005e

Annual Growth of Data Stored on Disk Arrays

Data Source: IDC

Page 26: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 26

Module SummaryKey points covered in this module:

Who is creating data and the amount of data being created

The value of data to business

The evolution of data storage models

Three common media and solutions for large scale data storage

Page 27: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 27

Data Center InfrastructureUpon completion of this module, you will be able to:

List the five core elements of a data center infrastructure

Describe the role of each element in supporting business activities

Describe the requirements of storage systems for optimally supporting business activities

Describe the challenges and activities in managing the storage systems of a data center

Page 28: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 28

The Core Elements Applications

Databases – Database Management System (DBMS) and the physical and logical storage of data

Servers/Operating systems

Networks (LAN and SAN)

Storage arrays

Page 29: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 29

Example of a Data Center Infrastructure

Consider an order processing system consisting of: Application for order entry Database Management System (DBMS) to store customer and product information Server/Operating System (OS) on which the application and database programs are run Networks that provide

– Connectivity between Clients and the Application/Database Server (LAN)– Connectivity between the Server and the Storage system (SAN)

Storage Array – database is stored on physical disks in the storage array

Local AreaNetwork

Storage Area Network

Storage Array

ClientServer

Application User

InterfaceOS and DBMS

Database

Page 30: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 30

An Example - Closer Look

A customer order is entered via the Application User Interface on a client

Local AreaNetwork

Storage Area Network

ClientServer

Application User

Interface

Storage Array

OS and DBMS

Database

Page 31: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 31

An Example - Closer Look (continued)

A customer order is entered via the Application User Interface on a client

The client accesses the server over a Local Area Network

Storage Area Network

ClientServer

Storage Array

Local AreaNetwork

OS and DBMS

Database

Page 32: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 32

An Example - Closer Look (continued)

A DBMS uses the operating system on the server to read and write this data to the physical location on a disk

Storage Area Network

ClientServer

O/S and DBMS

Storage Array

Local AreaNetwork

Database

Page 33: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 33

An Example - Closer Look (continued)

A DBMS uses the operating system on the server to read and write this data to the physical location on disk

A dedicated Storage Area Network provides the communication link between the server and the storage array, and transports the read/write commands and data between the server and the storage array

Storage Area Network

ClientServer

Storage Array

Local AreaNetwork

O/S and DBMS

Database

Page 34: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 34

An Example - Closer Look (continued)

A DBMS uses the operating system on the server to read and write this data to the physical location on disk

A Network provides the communication link between the client and the server, and transports the read/write commands and data between the server and the storage array

A storage array receives the read/write commands and data from the server and performs the necessary operations to store the data on the physical disks

Storage Area Network

ClientServer

Storage Array

Local AreaNetwork

Database

Page 35: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 35

Optimal Order Processing Example The application should be optimized for fast interaction

with the DBMS The tables in the database should be constructed with

care so the number of read/write operations can be minimized

The server should have sufficient CPU and memory resources to satisfy application and DBMS needs

The different networks should provide fast communication between client and server, as well as server and storage array

The storage array should service the read/write requests from the server for optimal performance

Page 36: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 36

Final Look at Data Access - ExampleWhen the DBMS receives a request from the application:

It first searches the server memory; if data is found there, the operation takes about a millisecond

If not, it uses the operating system to request the data from the storage array

Dedicated high speed networks transport this request to the storage array

Intelligent storage arrays can deliver the requested data within a few milliseconds, and are typically configured to protect data in the event of drive failures

Page 37: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 37

Key Requirements of Information Storage Systems

Availability

Data Integrity Security

Capacity

Scalability

Performance

Manageability

Page 38: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 39

Some Constraints to Meeting the RequirementsConstraints include:

Cost

Physical environment

Maintenance and support

Compliance – regulatory and legal

Hardware and software infrastructure

Interoperability and compatibility

Page 39: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 40

Management ActivitiesData Center management activities include:

Provisioning/Capacity/Resource Planning

Monitoring

Reporting

Page 40: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 41

Module SummaryKey points covered in this module:

The five core elements of a Data Center infrastructure

The role of each element in supporting business activity was explained with an example of an order entry process

The importance of an intelligent storage array

Key requirements of storage systems to support business activities, as well as some of the constraints

Examples of key management activities in a data center operation, with focus on storage systems

Page 41: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 42

Section SummaryKey points covered in this section:

Challenges in data storage and data management

The core elements in a data center

Page 42: Storage Foundation Chapter 1

© 2009 EMC Corporation. All rights reserved. Introduction to Information Storage Technology - 43

Check Your Knowledge What are the five core technology elements of the Data

Center infrastructure?

What are the seven requirements of the information storage system?

What are the common management activities in a Data Center?