install two of the following nosql big data processing...

7
CIS 612 Lab4_2 Install Two of the following NoSql Big Data Processing systems on Hadoop 1. Installing Mongodb Starting the database with the mongod command as below .

Upload: others

Post on 25-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

CIS 612 Lab4_2

Install Two of the following NoSql Big Data Processing systems on Hadoop

1. Installing Mongodb

Starting the database with the mongod command as below .

Page 2: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

Create a collection named”collection” and save the json file using mongoimport .

Run the server with mongo command and run the aggregate function on the

collection..

Db.collection.agrregate

Page 3: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

2. Hive installation :

Run ssh localhost

Go to the hadoop folder and run namenode –format command as below.

Page 4: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

Start the hadoop

Check all the nodes are working

Go to the hive directory and export the hadoop and hive paths as below

Start the hive database

Page 5: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

Starting hive created an error as above and restart the hadoop with safemode

Again error

Fixed the error with a hadoop fs =chmod 777 / temp/hive

Successfully able to create table

Page 6: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

Select *from the table amazon resulted into error

Page 7: Install Two of the following NoSql Big Data Processing ...eecs.csuohio.edu/~sschung/cis612/Lab4_2_HiveMongoDBSonal.pdf · Install Two of the following NoSql Big Data Processing systems

Create table test and show the conetents with a select statement .