cluster scheduling

14
Presented by: Priti Lohani

Upload: marny-cain

Post on 31-Dec-2015

53 views

Category:

Documents


0 download

DESCRIPTION

Cluster scheduling. Presented by: Priti Lohani. What is cluster?. It is a group of loosely coupled computers. They are arranged in a way to improvise in a speed and reliability provided by a single computer. It allows the organizations to boost their processing power. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Cluster scheduling

Presented by: Priti Lohani

Page 2: Cluster scheduling

What is cluster?It is a group of loosely coupled computers.They are arranged in a way to improvise in a

speed and reliability provided by a single computer.

It allows the organizations to boost their processing power.

It provides expandability.

Page 3: Cluster scheduling

Classification of clusters:High -availability clustersLoad-balancing clustersHigh-Performance clustersGrid clusters

Page 4: Cluster scheduling

Clustering algorithm requirements:scalabilityBroad scopeSensitivity to compute node and interconnect

architecture Fair share capabilityCapability to integrate with standard

resource managers Fault tolerance

Page 5: Cluster scheduling

Resource management systemIt manages the processing of load by

preventing jobs from competing with each other for limited compute resources

Resource managers do basic node state monitoring, receive job submission requests and executes the requests on the computer node.

The scheduler communicates with the resource manager to obtain information about queues, loads on compute nodes, and resource availability to make scheduling decisions.

Page 6: Cluster scheduling

Cluster scheduling algorithms:There are two types of schedulers:Time sharingSpace sharingTime sharing:Local schedulingGang schedulingCommunication driven co-schedulingSpace sharing:Batch scheduling

Page 7: Cluster scheduling

Batch scheduling:FCFS (First come first serve)SJF (Shortest job first)LJF (Longest job first)Advance reservationBackfillingPreemptive backfilling

Page 8: Cluster scheduling

Classifications of clustering algorithms:Exclusive ClusteringOverlapping ClusteringHierarchical ClusteringProbabilistic Clustering

Page 9: Cluster scheduling

Maui cluster scheduler:It is an open source advanced job scheduler.It focuses on large turn around of large

parallel jobsIt is a best open source scheduler.It is capable of optimizing scheduling and

node allocation decisions.It has a 2 phase scheduling algorithm.

Page 10: Cluster scheduling

Resource managers for Maui:

PBSVersion of PBS:Open PBSProfessional PBSTorque

Page 11: Cluster scheduling

Open PBS VS TorqueTorque is better than PBS in following areas:Fault toleranceScheduling interfaceScalabilityUsability

Page 12: Cluster scheduling

Scheduling policies for MauiAdvance reservationBackfillJob prioritization

Page 13: Cluster scheduling

Backfill algorithm:

Page 14: Cluster scheduling

Thank you for listening!