job scheduling

50
• Job Scheduling https://store.theartofservice.com/the-job-scheduling- toolkit.html

Upload: milo-gaines

Post on 29-Dec-2015

218 views

Category:

Documents


2 download

TRANSCRIPT

• Job Scheduling

https://store.theartofservice.com/the-job-scheduling-toolkit.html

BMC Software 1990s

1 In 1999, BMC acquired the Israeli firm New Dimension Software (flagship product CONTROL-

M), which made application service as well as management software, for $673 million cash. New Dimension Software's products handled

such tasks as security administration, document management and multi-platform job scheduling.

In 2000, BMC bought "an Israeli maker of enterprise application management software for

mainframe computer system", named Optisystems, for $70 million.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

CA Technologies 2000s

1 Following CA's acquisition of Uccel in 1987, many of CA's customers felt

trapped, considering the company's dominance in mainframe security software, tape management and

batch job scheduling

https://store.theartofservice.com/the-job-scheduling-toolkit.html

CA Technologies 2000s

1 In 2006, CA obtained yet another well-respected, mainframe-centric,

job scheduling / workload automation product, ESP, by acquiring

Cybermation, Inc

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Apache Hadoop Architecture

1 Similarly, a standalone JobTracker server can manage

job scheduling

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Information Technology Infrastructure Library - ICT operations management

1 Operations, however should primarily work from documented processes and procedures and should be concerned

with a number of specific sub-processes, such as: output management, job

scheduling, backup and restore, network monitoring/management, system

monitoring/management, database monitoring/management storage

monitoring/management

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Scheduling (computing) - Further reading

1 Brief discussion of Job Scheduling algorithms

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Supercomputer - Operating systems

1 While in a traditional multi-user computer system job scheduling is in effect a tasking

problem for processing and peripheral resources, in a massively parallel system,

the job management system needs to manage the allocation of both

computational and communication resources, as well as gracefully dealing with

inevitable hardware failures when tens of thousands of processors are present.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Google platform - Software

1 * Borg — job scheduling and monitoring systemIntel. . See slide Proprietary Cloud

Computing Stacks.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

High-performance computing - Operating systems

1 While in a traditional multi-user computer system job scheduling is in effect a task scheduling|tasking problem for processing and peripheral resources, in a massively parallel system, the job management

system needs to manage the allocation of both computational and communication resources, as

well as gracefully dealing with inevitable hardware failures when tens of thousands of processors are

present.Open Job Management Architecture for the Blue Gene/L Supercomputer by Yariv Aridor et al in Job scheduling strategies for parallel processing by

Dror G

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Rank reversals in decision making

1 With other computational methods, for instance with a job scheduling method, one can examine a set of

different answers and then categorize the answers according to

some metric of performance (for instance, a project's completion time)

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Single-system image

1 but a single image may be presented for more limited purposes, just job scheduling

for instance, which may be achieved by means of an additional layer of software

over conventional Operating system|operating system images running on each Node (networking)|node. The interest in SSI clusters is based on the perception that they may be simpler to use and

administer than more specialized clusters.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

TomTom - History

1 TomTom Business Solutions is the business-to-business division of TomTom and has been operating since 2005. This arm of TomTom specialises in telematics;

providing vehicle tracking, navigation, two-way communications, job scheduling

and report-logging capabilities to organisations. In 2010, it announced it

was providing its service to over 125,000 vehicles operating in Europe.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Oracle Grid Engine - Add-on software

1 * JOb Scheduling Hierarchically (JOSH)

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Terracotta, Inc. - Products and Projects

1 * 'Quartz': an open source job scheduling

service

https://store.theartofservice.com/the-job-scheduling-toolkit.html

HP OpenView - HP OpenView Smart Plug-ins

1 * [ http://www.bmc.com/products/produc

t-listing/23446-1542-2214.html HP OpenView SPI for BMC CONTROL-M

Job Scheduling / Workload Automation Solution]

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Capex Corporation - Products

1 * SCHEDULER - Batch job scheduling product for mainframe OS/MVS environments. This was not the

original version of Computer Associates' job scheduling product,

CA-SCHEDULER 7.0, which was written from scratch by CA and

released in 1985 for the OS/MVS, DOS/VSE and VM/CMS Operating

Systems.https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler

1 A 'job scheduler' is a computer application for controlling unattended

background program execution (commonly called batch processing).[http://www.cs.huji.ac.il/~feit/parsche

d/jsspp00/p-00-1.pdf Effect of Job Size Characteristics on Job Scheduling Performance]

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler

1 Job scheduling should not be confused with Scheduling

(computing)|process scheduling, which is the assignment of currently

running processes to CPUs by the operating system.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - Overview

1 If software from a completely different area includes all or some of

those features, this software is considered to have job scheduling

capabilities.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - Overview

1 Web hosting services provide job scheduling capabilities through a Control panel (computer)|control

panel or a webcron|webcron solution

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - Main concepts

1 Beyond the basic, single OS instance scheduling tools there are two major

architectures that exist for Job Scheduling software.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - Main concepts

1 * Master/Agent architecture — the historic architecture for Job

Scheduling software. The Job Scheduling software is installed on a

single machine (Master), while on production machines only a very

small component (Agent) is installed that awaits commands from the

Master, executes them, then returns the exit code back to the Master.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - History

1 Job Scheduling has a long history. Job Schedulers have been one of the

major components of IT infrastructure since the early

mainframe systems. At first, stacks of punched cards were processed

one after the other, hence the term “batch processing.”

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Job scheduler - History

1 # Service Oriented job scheduling - recent developments in Service

Oriented Architecture (SOA) have seen a move towards deploying job

scheduling as a reusable IT infrastructure service that can play a

role in the integration of existing business application workload with new Web Services based real-time

applications.https://store.theartofservice.com/the-job-scheduling-toolkit.html

Platform Computing

1 'Platform Computing' was a privately held software company primarily

known for its job scheduling product, Load Sharing Facility (LSF). It was

founded in 1992 in Toronto, Ontario, Canada and headquartered in

Markham, Ontario with 11 branch offices across the United States,

Europe and Asia.[http://www.platform.com/comp

any/contact-us Contact]https://store.theartofservice.com/the-job-scheduling-toolkit.html

Computer Associates Int. Inc. v. Altai Inc. - Background of the case

1 Computer Associates (CA) created a Job scheduler|job scheduling program

called CA-SCHEDULER which sorts, runs, and controls the various tasks

given to a computer

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Uccel

1 Uccel's big-ticket item claim to fame was software called UCC-1/TMS (Tape

Management System), an IBM mainframe product for managing the tape library in an OS/MVS operating system environment. In

1980, they developed their second big hitter and most profitable product, UCC-7 (job scheduler). The UCC-1, UCC-7, UCC-11

(batch job rerun/restart add-on) suite led the market for tape management and job

scheduling.https://store.theartofservice.com/the-job-scheduling-toolkit.html

Uccel

1 In 1986, UCCEL Corporation purchased Cambridge Systems Group, Inc., which marketed

for SKK, Inc. and their market-leading ACF2 mainframe security product. In June '87, Uccel was unexpectedly bought out by its archrival, Computer Associates, which aggressively sold directly competing products CA-Dynam/TLMS

(tape management), CA-Scheduler and batch job scheduling products originally from Capex

Corporation and Value Software, plus CA-Top Secret (security / mainframe discretionary access

control).

https://store.theartofservice.com/the-job-scheduling-toolkit.html

ASG Software Solutions

1 ASG’s products are used for cloud computing, business service management,

List of job scheduler software|job scheduling, legacy data migration,

performance management, applications development, and content management.

ASG also offers business information portals and applications for identity and user access management, in addition to

consulting, implementation, and training services.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Lean IT - Implementation of Lean IT

1 Workload automation software, which helps IT organizations optimize real-time performance of complex business

workloads across diverse IT infrastructures, and other application dependency mapping

tools can be an additional help in value stream

mapping.[https://www.ca.com/files/IndustryAnalystReports/the_evolution_of_job_schedu

ling.pdf The Evolution of Job Scheduling: CA's Approach to Workload Automation]

https://store.theartofservice.com/the-job-scheduling-toolkit.html

CA-7 (software)

1 'CA-7' is a job scheduling / workflow automation software

package sold by CA Technologies (formerly CA, Inc

https://store.theartofservice.com/the-job-scheduling-toolkit.html

AutoSys - Versions

1 After r11.3, r11.5 will follow. r11.5 is discussed in IDC's The Evolution of Job Scheduling: CA's Approach to

Workload Automation by Tim Grieser.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

List of acquisitions by CA Technologies - Acquisitions

1 | Tape Management System, Job scheduling, Rerun/Restart,

Mainframe Security

https://store.theartofservice.com/the-job-scheduling-toolkit.html

JES2

1 JES3 Main Device Setup (MDS) has more control over data sets shared

between systems than JES2, and JES3 Dependent Job Control (DJC) has

more provisions for scheduling jobs with dependencies on each other

than JES2. With the widespread use of sophisticated job scheduling software, DJC has become less

important.https://store.theartofservice.com/the-job-scheduling-toolkit.html

JES2

1 HASP was developed by IBM Federal Systems Division contractors at the Johnson Space Center in Houston. It originally managed job scheduling and print and punch output for a

single OS/360 computer, such as a single 360/65. Multi Access Spool

capability was added for to let peer computers share a common job queue and print/punch output

queues.https://store.theartofservice.com/the-job-scheduling-toolkit.html

JES2 - JES3

1 Using ASP made it possible to avoid the cost of the byte multiplexor channel, and offloading the job

scheduling, print, and card handling also offloaded those functions from

the larger machines.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Double-ended queue - Applications

1 The steal-job scheduling algorithm is used by Intel's Threading Building

Blocks (TBB) library for parallel programming.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Maximum independent set - Independent sets in interval intersection graphs

1 The problem of finding maximum independent sets in interval graphs

has been studied, for example, in the context of job scheduling: given a set of jobs that has to be executed on a

computer, find a maximum set of jobs that can be executed without

interfering with each other

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Android L - Features

1 Among its changes are a new battery saver mode, job scheduling APIs

which can restrict certain tasks to only occur over Wi-Fi, and batching of tasks to reduce the overall amount of

time that internal radios are active

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Grid MP - Product features

1 Grid MP provides job scheduling with prioritization, user security

restrictions, selective application exclusion, user-activity detection,

and time-of-day execution controls.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Jem The Bee - Functions

1 Retrieved March 26th, 2014.), which involves executing one or more Job stream|

batch jobs in a sequential flow.[http://www.cs.huji.ac.il/~feit/parsched/j

sspp00/p-00-1.pdf Effect of Job Size Characteristics on Job Scheduling

Performance] The Job Entry Manager (JEM) helps receive Job stream|jobs, schedule

them for processing, and determine how job output is processed (like IBM Job Entry

Subsystem 2/3|JES2).https://store.theartofservice.com/the-job-scheduling-toolkit.html

Load Sharing Facility - LSF Extensions and integrations

1 :;HPC Profile Basic:This describes how JSDL, Basic Execution Service (BES) and existing web services

security mechanisms can be used interoperable to address batch job

scheduling use case.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

GridWay - Functionality

1 GridWay performs all the job scheduling and submission steps transparently to the end user and adapts job execution to changing Grid conditions by providing fault recovery mechanisms, dynamic

scheduling, migration on-request and opportunistic migration

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Portable Batch System

1 'Portable Batch System' (or simply 'PBS') is the name of

computer software that performs job scheduler|job scheduling. Its primary

task is to allocate computational tasks, i.e., batch jobs, among the

available computing resources. It is often used in conjunction with UNIX

computer cluster|cluster environments.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Message passing in computer clusters - Performance simulation

1 Jobs and their duration and complexity are represented with specific probability distributions

allowing various parallel job scheduling algorithms to be proposed

and experimented with

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Lollipop (operating system) - Features

1 Among its changes are a new battery saver mode, job scheduling APIs

which can restrict certain tasks to only occur over Wi-Fi, and batching of tasks to reduce the overall amount of

time that internal radios are active

https://store.theartofservice.com/the-job-scheduling-toolkit.html

Fabio Massimo Cacciatori - Written works

1 * Articles : The prospects of Artificial Intelligence in the Journal Interface n. 29, The structure of expert systems

on Interface n. 31/32, Job scheduling: overview of the main expert systems

on Interface n. 41.

https://store.theartofservice.com/the-job-scheduling-toolkit.html

PBS (disambiguation) - Computing

1 * Portable Batch System, a computer

software that performs job scheduling

https://store.theartofservice.com/the-job-scheduling-toolkit.html