storage provisioning for enterprise information applications

Click here to load reader

Post on 12-Jun-2015

109 views

Category:

Technology

0 download

Embed Size (px)

DESCRIPTION

Storage Options and Technologies for Enterprise Information Applications.

TRANSCRIPT

  • 1. 1 Actuate Corporation 2004 Storage Provisioning for Actuate Implementations Ambareesh Kulkarni

2. Actuate Corporation Confidential Actuate Corporation 2004 Simple, No Network Deployment Actuate Server Processes (EFV) Actuate Encyclopedia on local hard disk Internal Communication Active Portal , Management Console 3. Actuate Corporation Confidential Actuate Corporation 2004 Actuate in a distributed environment Network Web Tier Storage Tier Network Application Server Tier Network Applications (Actuate) Tier Network Actuate Server Processes (EFV) Actuate Encyclopedia Communication Active Portal , Management Console 4. 4 Actuate Corporation 2004 Server Attached Storage 5. Actuate Corporation Confidential Actuate Corporation 2004 Server Attached Storage Simple Low initial cost Ease of management SCSI attached disks Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) JBOD 6. Actuate Corporation Confidential Actuate Corporation 2004 Actuate Cluster (storage) Requirements UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers CLIENTS LAN Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) Actuate Volumes can use partitions across multiple disks All nodes need access to all partitions (used by Actuate volumes) 7. Actuate Corporation Confidential Actuate Corporation 2004 Healthcare company (SAS option) Actuate iServer deployment with Server Attached Storage No common and highly available file system Need to maintain (and synchronize) multiple copies of the AcServer.xml configuration file More suitable for a non clustered but load balanced architecture Actuate servers have additional overhead of managing and sharing disks Not a recommended architecture 8. 8 Actuate Corporation 2004 File Transfer Protocols 9. Actuate Corporation Confidential Actuate Corporation 2004 Windows File Access Protocol Win Servers MS-WINDOWSCLIENTS LAN Win Servers CIFS Volume Sharing CIFS Originally known as the SMB (Server Message Block) protocol Developed jointly by IBM/3COM/Microsoft Renamed to Common Internet File System (CIFS) 10. Actuate Corporation Confidential Actuate Corporation 2004 UNIX File Access Protocol UNIX Servers UNIX CLIENTS LAN UNIX Servers NFS NFS Volume Sharing Developed by SUN More popular than SMB Has a 10 year head-start on SMB 11. Actuate Corporation Confidential Actuate Corporation 2004 Interoperability Challenges 12. Actuate Corporation Confidential Actuate Corporation 2004 Interoperability Challenges (overcoming them) Samba NFS Client NFS Client Samba 13. Actuate Corporation Confidential Actuate Corporation 2004 NFS based Storage provisioning UNIX/Win Servers CLIENTS LAN UNIX/Win Servers NFS/CIFS Server NFS/CIFS Backup Server(s) Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) Most common storage provisioning solution for Actuate implementations Low cost and ease of management Unlike SAS, provides a common storage file system Poor performance due to NFS protocol characteristics Interoperability challenges in a heterogeneous environment Mount disks onto backup server in case of server (e.g. OS) failure 14. 14 Actuate Corporation 2004 Its all about the disks 15. Actuate Corporation Confidential Actuate Corporation 2004 Optimizing Storage Utilization Fragmented Disk Utilization Consolidated Disk Utilization Applications constantly starved for storage while other systems have capacity sitting idle 16. Actuate Corporation Confidential Actuate Corporation 2004 RAID basics Data is striped across all disks of an array. Multiple hard disks used to form a logical drive RAID 1 offers the best fault tolerance to a single drive. Duplicates each I/O request to a secondary mirror drive. 17. Actuate Corporation Confidential Actuate Corporation 2004 RAID basics RAID 5 stripes data across multiple drives and adds parity for fault tolerance. RAID 5 is the predominant highly available, fault tolerant RAID level used in servers today Typical RAID Array (device) Physical disks on storage box make up a RAID-5 disk set Mirror Set Logical Disks Presented to Storage Tier Storage Controller 18. Actuate Corporation Confidential Actuate Corporation 2004 Network Attached Storage LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers UNIX/Win Server NAS TAPE LIBRARY Fast file access for multiple clients Ease of data sharing High storage capacity Redundancy Ease of drive mirroring Consolidation of disk resources Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) 19. Actuate Corporation Confidential Actuate Corporation 2004 NAS Filers Light weight kernel Run only services that are required for file servicing, security, and management are installed on the Filer (appliance) Supports NFS, CIFS & HTTP 20. Actuate Corporation Confidential Actuate Corporation 2004 Healthcare company (NAS option) Local Network b2bweb1 b2bweb2 b2bweb3 b2bweb4 Internet F5LoadBalancer Firewall Firewall Firewall mcfl1u0y mcfl1u0z mcfl1u2j mcfl1u7g iPlanet Web Server Medco Custom Prog iPlanet Web Server Medco Custom Prog iPlanet Web Server Medco Custom Prog iPlanet Web Server Medco Custom Prog Medco Custom Prog Actuate Http Service Active Portal Stunnel Medco Custom Prog Actuate Http Service Active Portal Stunnel Medco Custom Prog Actuate Http Service Active Portal Stunnel Medco Custom Prog Actuate Http Service Active Portal Stunnel Actuate Server B Actuate Server A Actuate Server C F5LoadBalancer HTTPS HTTPS HTTPS Port X Port N mcfl1u4c TeraData Report Manger Application Actuate Services M V F Stunnel Actuate Services M V F Stunnel Actuate Services M V F E NAS Actuate Architecture with Network Attached Storage Common and highly available file system Single copy of the AcServer.xml file accessible to all servers No disk management overhead on the Actuate servers Recommended architecture 21. 21 Actuate Corporation 2004 Storage Area Networks 22. Actuate Corporation Confidential Actuate Corporation 2004 Storage Attached Network Excellent for moving large blocks of data Exceptional reliability Wide availability Fault tolerance Scalability LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers TAPE LIBRARY JBOD SWITCH/HUBSWITCH/HUB Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) 23. Actuate Corporation Confidential Actuate Corporation 2004 SAN Components LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers TAPE LIBRARY JBOD SWITCH/HUBSWITCH/HUB iSCSI FCP Storage Management Applications SAN Hardware Specific 24. Actuate Corporation Confidential Actuate Corporation 2004 SAN Multi-pathing Provides redundant paths to SAN Fabric by utilizing both HBAs Balances I/O traffic across HBAs using Balancing Software such as EMC PowerPath Offers more Flexibility than Static mapping 25. Actuate Corporation Confidential Actuate Corporation 2004 SAN File System SAN LAN CLIENTS File System Metadata Servers Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) SAN FS Clients enables sharing of the same copies of files consists of a client on each server that is written especially for the operating platform used by that server simplifies and streamlines SAN management a common metadata server controls traffic in the SAN 26. Actuate Corporation Confidential Actuate Corporation 2004 Storage Management Software Protect and Store Data data replication, mirroring, snapshots, backup, virtual tape, encryption. Manage Data file serving, virtualization, data migration, capacity-on- demand, compression. 27. Actuate Corporation Confidential Actuate Corporation 2004 Actuate Deployment using a SAN File System 28. Actuate Corporation Confidential Actuate Corporation 2004 NAS vs. SAN NAS SAN Wires? Ethernet, FDDI, ATM Fibre Channel Protocols? TCP/IP, NFS, CIFS, HTTP SCSI, FCP, iFCP, IP Shares ? Files Storage Devices Managed by? NAS head Servers File Sharing? Flexible, Windows & UNIX OS dependant Backups? Slow and on files Fast, at a block level 29. 29 Actuate Corporation 2004 Backup and Replication Technologies 30. Actuate Corporation Confidential Actuate Corporation 2004 Backup Operations Resource Intensive Consumes CPU cycles effecting application performance on Server Usually scheduled off-hours 31. Actuate Corporation Confidential Actuate Corporation 2004 Traditional LAN based backup LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers TAPE LIBRARY LAN FOR BACKUPS SAN 32. Actuate Corporation Confidential Actuate Corporation 2004 LAN free Backups LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers SWITCH/HUB TAPE LIBRARY Backup path Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) 33. Actuate Corporation Confidential Actuate Corporation 2004 LAN CLIENTS UNIX/Win Servers UNIX/Win Servers UNIX/Win Servers SWITCH/HUB TAPE LIBRARY SAN/Switch (or device) level backups Backup path Application Code (Actuate Server Processes) File System (Actuate Encyclopedia) 34. Actuate Corporation Confidential Actuate Corporation 2004 Replication Technologies Snapshots (Local Point in time Copies) Image based copies of data (like taking a picture of the hard disk) Offer good protection from common failures such as accidental file deletions, viruses, software corruption) Local copies with minimal application impact Snapshots can be restored very quickly Locality A Snap 01 Snap 02 Snap 03 Snap n T1 T2 T3 Tn T1-Tn are times when Snaphots (Snap 01- Sanp n) are taken 35. Actuate Corporation Confidential Actuate Corporation 2004 Replication Technologies Remote Snapshots Replicate snapshots over the network to offsite storage Protects data from physical destruction (as snapshots are now in a different location) Supports delta transfers (most recent changes), thereby optimizing network and storage Locality A Locality B Snap 01 Snap 02 Snap 03 Snap n T1 T2 T3 Tn T1-Tn are times when Snaphots (Snap 01- Sanp n) are taken 36. Actuate Corporation Confidential Actuate Corporation 2004 Replication Technologies Continuous Replication (Remote Disk Mirroring) Every write operation on the primary site (disk) is replicated on the remote site (disk) Offers up-to-the-minute protection against physical disasters CR does not offer file protection capabilities like Snapshots Primary Site Backup Site Primary Data Backup Data Continuous Replication 37. Actuate Corporation Confidential Actuate Corporation 2004 SRDF (Symmetrix Remote Data Facility) Online (real time), host-independent, mirrored data storage solution Optimizes line bandwidth using multi-hop (mirror only data that has changed) technology. Supports data transfer between geographically distributed sites using SRDF FarPoint Enables large chunks of data to be transferred in Asynchronous mode 38. Actuate Corporation Confidential Actuate Corporation 2004 Datacenter Infrastructure Vendors (DIVs) www.snia.org