creating a cloud computing solution for nc state university
TRANSCRIPT
Creating a Cloud Computing Solution for NC State University
Mladen A. Vouk
Professor and Head of Computer Science, &Associate Vice-Provost for Information TechnologyNorth Carolina State University
[email protected]://renoir.csc.ncsu.edu/Faculty/Vouk
North Carolina State University Circa 2004 and Today Land Grant, Research University
– Colleges of: Agriculture and Life Sciences; Design; Education; Engineering; Humanities and Social Sciences; Management; Natural Resources; Physical and Mathematical Sciences; Textiles; Veterinary Medicine
In 2004– 30,000 students, 5,000 faculty and staff– About 100 computer labs, some very
specialized, with about 2500-3000 total seats operated by 12 different IT organizations. With growing need that capacity several thousand seats short then, and no place to put them.
Today – about the same or less in physical lab seats, over 5,000 more students, and considerably more IT-oriented teaching, relies on VCL to provide needed additional capacity, and more, at a fraction of the cost (at least 50% less than physical seats).
Expanding the Art of the Possible for Our Students and Faculty
20112009 2010
BEFORE Inflection FUTURE
20082006 200720052004
Unresolvable Problems•Siloed investments•Limitations in computing flexibility •Access barriers to computing resources
Germination•Solution disrupted established turf•Cultural response was resistive, sometimesproactively resistive
Core Design Principals•Simplicity•Agility•Scalability
The NC State Virtual Computing Lab
NCSU VCL
Open SourcedIBM lntell BladesApache VCL
NCSC Closes,
IBM SUR grant
VAVCL Award,
Computerworld
Honors Pgm AwardGlobal interestIBM, NCB‐Prepared
What Any Cloud Needs
Users Help Desk, Training, Education
Authentication,Authorization,Accounting
Client (End‐User)Portal
Bare‐Metal (& Virtualized)
Resources & Services
Privacy, Security,ComplianceLicenses, …
Domain Services&
Other Attributes
Reliability&
Fault Tolerance
HaaS, IaaS, PaaS, AaaS, SaaS, SECaaS, LOCaaS, CaaS…
Import, Export,Image Exchange
ProvenanceMetadataStandards
The Virtual Computing Laboratory Breakthrough
NCSU Registered users: 40,000+– All UNC System campuses have access (potential
users 250,000 students).
Value to UNC– Delivers over 200,000 service reservations per
year – Over 10.5 million+ CPU hours, including High-
Performance Computing (HPC) cycles– Costs between 3 and 30 cents per CPU hour (cost
varies depending on software, utilization, etc.)
Enabled by– 2000+ blades, 7000+ cores, maintenance support:
circa 2 FTE– About 800+ blades in General mode, about the
same in HPC mode, and several hundred in various test-beds
– 900+ service “images” or software service stacks (virtual or real), only about 20 centrally maintained
04 05 06 07 08 09 10
3K
2K
1K
0
VCL reservations per day, excluding HPC reservations
From Zero to Deploy in Thirty SecondsVCL-IBM SWG Integrated Cloud Architecture
User Interface (web portal)VCL Scheduler
User Interface (web portal)VCL Scheduler
DatabaseDatabase
Provisioning EnginesProvisioning EnginesPhysicalDeployerPhysicalDeployer
VirtualDeployer
VirtualDeployer
New DeployerModule
New DeployerModule
Management NodesVCL Daemon
Management NodesVCL Daemon
xCATxCATNew Resource Type
New Provisioning ManagerNew Provisioning Manager
NodesNodesNodesNodes
NodesNodesNodesNodes
Image LibraryImage Library
accomplishdeploymentsaccomplish
deployments
represents undifferentiated
resources
represents undifferentiated
resources
reservationsinventorymappingsprivilegesmetadata
reservationsinventorymappingsprivilegesmetadata
image filesmetadatainstall tree
profiles
image filesmetadatainstall tree
profiles
access pointauth/authselection
toolsAPI X MLRPC
access pointauth/authselection
toolsAPI X MLRPC
process requestsload nodes
reclaim nodes
process requestsload nodes
reclaim nodes
MySQL, DB2, DerbyMySQL, DB2, Derby
IBM HTTP Server (HIS)IBM HTTP Server (HIS)
TPM 7.2 ILTPM 7.2 ILw/ ITM 6.2 agentsw/ ITM 6.2 agents
TCRTCR
New NodesNew Nodes
ITUAMITUAMMariaDBMariaDB
IBM Cloud as Provisioning Node
IBM Cloud as Provisioning Node
Mirage TechnologyRuns on VCL
Mirage TechnologyRuns on VCL
IBM Director w/VSPIBM Director w/VSP
VCL runs onWebSphere CloudBurst
VCL runs onWebSphere CloudBurst
■ VCL Core ■ Tested & working ■ In progress or planned
TPMTPM
ESXiESXiKVMKVM
HSLTHSLTNew NodesNew Nodes
Knowledge Can Be Built in – the Cloud Resource “Knows”
Images are VCL’s primary currency – they are software stacks (bare-metal or virtual). They “know” who can use them, how many licenses they are allowed to use, how to defend themselves, what storage to access, etc.
Other resources (computers, schedules, user groups, etc.) are also user, role, and security conscious.
This provides security and resource interrelationships that are scalable, customizable, and flexible.
These features are coupled with system-level security (VLANs, VPNs, firewalls, traffic and load monitors, etc.).
Tomorrow’s Children - the Future of Cloud ComputingBrokering across clouds
• Virtual computing laboratory broker
• Provides involuntary vendor lock-in protection
• A lightweight local cloud that acts as a core/seed of a private cloud, and provides elastic resource services as a wide-area cloud resource broker
• Interfaces to other on-demand cloud services (cloud federations)• Master image repository, Portable images, Provides emergency backup• Import/Export and Policy assistance and protection• Auto-adaptive and scalable on-demand & Analytics sub-cloud
How Can You Get Engaged?
Please send me an email ([email protected]) if you are interested in giving the virtual computing lab a test!
You can download VCL from Apache.org