2011 international symposium on intelligence information processing and trusted computing huanggang...

Post on 18-Jan-2018

215 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

Analyzes the Hadoop architecture and MapReduce Working principle How to write Mapper and Reducer classes, and how to use the object 3

TRANSCRIPT

2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang

The Application of MapReduce in the Cloud Computing

Speaker : Kun-Hsiang, Chang

1

• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task

2

Outline

Analyzes the Hadoop architecture and MapReduce Working principle

How to write Mapper and Reducer classes, and how to use the object

3

Abstract

NameNode

DataNode

Client

4

Hadoop-HDFS

5

Hadoop-MapReduce

6

MapReduce

MapReduce programs can be run in three modes:

Standalone Mode

Pseudo-distributed Mode

Fully-distributed Mode

7

MapReduce

Inputs division and dispatch

task configuration

task executive

Create customized Mapper and Reducer

8

MapReduce Programmed To Perform Task

Speaker : Kun-Hsiang, Chang

End…

9

top related