big data hadoop - ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. introduction to big data and hadoop...

5
BIG DATA HADOOP COURSE AGENDA LESSONS

Upload: nguyentram

Post on 31-Jul-2018

222 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: BIG DATA HADOOP - Ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. Introduction to Big Data and Hadoop What is Big Data? Why Big Data? Limitations of Big Data Hadoop Background The Hadoop

BIG DATA HADOOP

COURSE AGENDA

LESSONS

Page 2: BIG DATA HADOOP - Ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. Introduction to Big Data and Hadoop What is Big Data? Why Big Data? Limitations of Big Data Hadoop Background The Hadoop

1. Introduction to Big Data and Hadoop

What is Big Data? Why Big Data?Limitations of Big Data Hadoop BackgroundThe Hadoop Way

2. Getting Started With Hadoop

Setting up VM Hadoop EnvironmentInstalling VMware PlayerSetting up the Virtual Environment (Virtual Machine User Accounts; Running a Hadoop Job; Accessing the VM via ssh; Shutting Down the VM)

3. Hadoop Architecture

Hadoop Cluster in commodity hardwareHadoop core services and components Regular file system vs. HadoopHDFS layerHDFS operation principleHDFS 1.0 & HDFS 2.

4. Hadoop Deployment

Hadoop installationSingle node and multi node configurationHadoop Configuration in cluster environment

5. MapReduce

MapReduce conceptsHadoop MapReduce exampleHadoop MapReduce requirements Steps of Hadoop MapReduce

MapReduce user supply MapReduce frameworkBasics of MapReduce programming

6. AdvancedMapReduce

Custom Data TypesInput formats

Page 3: BIG DATA HADOOP - Ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. Introduction to Big Data and Hadoop What is Big Data? Why Big Data? Limitations of Big Data Hadoop Background The Hadoop

Output formatsCombiners and PartitionersError handling and Unit Testing

7. PIG

Introduction to PIG Why PIGComparison between PIG and SQL Installing and configuring PIG Running PIGPIG Latin

8. HIVE

Why another data warehousing systemWhat is HIVE Type SystemData Model - Tables, Partitions, Buckets, External TablesSerialization/De-serialization Hive file formatsSystem Architecture and componentsHive Query LanguageHIVE: Installing, running, and programmingDifference between Hive and PIG

9. HBase

HBase Introduction

HBase history Who uses HBase When to use HBase HBase Data Model HBase Families HBase ComponentsRow Distribution between region servers Data StorageHBase MasterHBase and ZookeeperHBase DeploymentInstallation of HBaseConfiguration of HBase

10. Cloudera

Page 4: BIG DATA HADOOP - Ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. Introduction to Big Data and Hadoop What is Big Data? Why Big Data? Limitations of Big Data Hadoop Background The Hadoop

What is ClouderaCloudera enterprise pictorial viewDownloading cloudera Quickstart VMStarting the cloudera VMExploring the Welcome pageUnderstanding HueUnderstanding Cloudera Manager

11.ZooKeeper and Sqoop

Introduction to ZooKeeperWhat is ZooKeeperChallenges faced in distributed applicationsCoordinationZooKeeper: Goals and UsesZooKeeper: Entities, Data Model, ServicesClient APIsIntroduction to Sqoop (why, what, processing, under the hood)Importing data into HiveImporting data into HBaseExporting data from Hadoop using Sqoop

Sqoop ConnectorsConnecting MongoDB (NoSQL database)

12. Hadoop Administration and Troubleshooting

Different configurations of Hadoop clusterPerformance monitoringPerformance tuningTroubleshooting and Log observation

13. YARN

OverviewYARN versus MapReduce1

14. Reporting Tool

Overview of various reporting availableImplementing Power Builder

15. Project Work

Hands on end to end Hadoop based live project

Page 5: BIG DATA HADOOP - Ssiedussiedu.in/pdf/hadoopfinal.pdf · 1. Introduction to Big Data and Hadoop What is Big Data? Why Big Data? Limitations of Big Data Hadoop Background The Hadoop

16. Technical Discussion

Extensive Interview Preparation & guidance

17. Certification

Cloudera Hadoop Developer certification overview & guidance

18. Hadoop Market

OverviewCloudera vs Hortonworks

______________________________________________________________________________Palasia Centre: 20/1, Morden Mansion, Palasia square, Indore Ph: 0731- 4268656/4066541, 4091658 Bhanwarkuan Centre: 18- Professor Colony, Wadhwani Chambers, Bhanwarkuan square, Indore. Ph 0731- 4289083/84 Email: [email protected]