2011 international symposium on intelligence information processing and trusted computing huanggang...

9
2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang The Application of MapReduce in the Cloud Computing Speaker : Kun-Hsiang, Chang 1

Upload: maude-cummings

Post on 18-Jan-2018

214 views

Category:

Documents


0 download

DESCRIPTION

Analyzes the Hadoop architecture and MapReduce Working principle How to write Mapper and Reducer classes, and how to use the object 3

TRANSCRIPT

Page 1: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang

The Application of MapReduce in the Cloud Computing

Speaker : Kun-Hsiang, Chang

1

Page 2: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task

2

Outline

Page 3: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

Analyzes the Hadoop architecture and MapReduce Working principle

How to write Mapper and Reducer classes, and how to use the object

3

Abstract

Page 4: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

NameNode

DataNode

Client

4

Hadoop-HDFS

Page 5: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

5

Hadoop-MapReduce

Page 6: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

6

MapReduce

Page 7: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

MapReduce programs can be run in three modes:

Standalone Mode

Pseudo-distributed Mode

Fully-distributed Mode

7

MapReduce

Page 8: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

Inputs division and dispatch

task configuration

task executive

Create customized Mapper and Reducer

8

MapReduce Programmed To Perform Task

Page 9: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker

Speaker : Kun-Hsiang, Chang

End…

9