cs high performance comp

8/14/2019 Cs High Performance Comp

1/14


2/14

Te

chn

icalS

eminar

Presented by : Jyotiman Prusty

HIGH PERFORMANCE COMPUTING

INTRODUCTION

Computing environment or a computer hardware system

for massive and fast computation.

Sometime referred as supercomputing or super-computer. Maximum amount of computations in a minimum amount of

time.

Used in scientific and engineering fields.

Performance more than 1gigaflop. Cost is more.


3/14

Te

chn

icalS

em

inar



PARALLEL COMPUTINGPARALLEL COMPUTING

A collection of processing elements that can communicate and

cooperate to solve large problems more quickly than a singleprocessing.

TYPE OF PARALLELISMTYPE OF PARALLELISM

Overt Parallelism is visible to the programmer May be difficult to program (correctly) Large improvements in performance

Covert Parallelism is not visible to the programmer Compiler responsible for parallelism Easy to do


4/14

Te

chn

icalS

em

inar



ARCHITECTURAL CLASSIFICATIONS SISD Machines

Conventional single processor computers.

The various circuits of the CPU are split up into functional units which are arranged into a pipeline.

Each functional unit operates on the result of the previous

functional unit during a clock cycle.

PROCESSORSPROCESSORS

GENERAL CLASSIFICATIONVector

Large rows of data are operated on simultaneously. Scalar

Data is operated in a sequential fashion.


5/14

Te

chn

icalS

em

inar



PROCESSORS(cont..)PROCESSORS(cont..)

SIMD Machines Single CPU devoted to control a large collection

of subordinate processors.

Each processor has its own local memory.

Each processor runs the same program.

Each processor processes different data streams.

Each subordinate either executes the instruction

or sits idle.


6/14

Te

chn

icalS

em

inar



PROCESSORS(cont..)PROCESSORS(cont..)

MISD MachinesMultiple instructions should act on a single stream of data. No practical machine in this class has been constructed.

MIMD Machines

Multiple processors(own or shared memory). Each processor can run the same or different programs. Each processor processes different data streams. Processors can work synchronously or asynchronously.

Processors can be either tightly or loosely coupled.There are shared-memory systems and distributed-memory systems.


7/14

Te

chn

icalS

em

inar



MEMORY ORGANIZATIONMEMORY ORGANIZATION

SHARED MEMORY One common memory block between all processorsOne common bus for all processors

Utilizes (complex) inter-connected network to connect

processors to shared memory module

Fig-1 Fig-2


8/14

Te

chn

icalS

em

inar



MEMORY ORGANIZATION(Cont..)MEMORY ORGANIZATION(Cont..)

DISTRIBUTED MEMORY Each processor has private memory. Contents of private memory can only be accessed

by that processor.

In general, machines can be scaled to thousands ofprocessors. Requires special programming techniques.

Fig-3


9/14

Te

chn

icalS

em

inar



MEMORY ORGANIZATION(Cont..)MEMORY ORGANIZATION(Cont..)

VIRTUAL SHARED MEMORY Objective is to have the scalability of distributed memory with shared memory. Global address space mapped onto physically distributed memory. Data moves between processors on demand.

Fig-4


10/14

Te

chn

icalS

em

inar



PARALLEL PROGRAMMING CONCEPTSPARALLEL PROGRAMMING CONCEPTS

A process is an instance of a program or subprogram

executing autonomously on a processor.

Processes can be considered running or blocked.

A single-program and multiple-data.

In shared memory programming processes have a parent.

In distributed memory programming message passing used.

Data parallelism- data structure is distributed among the

processes, and the individual processes execute the sameinstructions on the parts of data structure.


11/14

Te

chn

icalS

em

inar



AREAS OF HPC USEAREAS OF HPC USE

Weather forecasting Earth quake prediction River solution simulation Air pollution Aircraft simulations Gene sequencing and mapping Artificial intelligence Computer Graphics

Geophysical/Petroleum Modeling Database Applications


12/14

Te

chn

icalS

em

inar



DISADVANTAGESDISADVANTAGES

More costly More complex

Individual processor speed is not concerned. Problems of high overhead and the difficulty of writing

programs. Number of bugs Increases


13/14

Te

chn

icalS

em

inar



The present supercomputing trends indicate the supercomputer of

tomorrow will work faster, solve even more complex problems, and

provide wider access to supercomputing power . HPC played a

crucial role in the advancement of knowledge and the quality of life.

CONCLUSIONCONCLUSION


14/14

Techn

icalS

em

inar



Thank you!!!

cs high performance comp

Documents