how to execute a mapreduce program (wordcount.java) in...

13
How to execute a MapReduce program (WordCount.java) in Eclipse:

Upload: others

Post on 10-Oct-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce

How to execute a MapReduce program (WordCount.java) in Eclipse:

Page 2: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 3: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 4: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 5: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 6: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 7: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 8: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 9: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 10: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce

As you can see, it cannot run at the first beginning. There are three problems: (1) Could not find or load

main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Please check whether your

etc/Hadoop/mapred-site.xml contains the below configuration. This is how I fixed the problem.

(2) Container is running beyond memory limits. The following post is helpful.

http://stackoverflow.com/questions/21005643/container-is-running-beyond-memory-limits

This is how I fixed the problem.

(3) Output folder already exists. I need to delete it.

Page 11: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce

I run a second MapReduce program (MaxTempreture.java) in Eclipse:

Page 12: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce
Page 13: How to execute a MapReduce program (WordCount.java) in Eclipseeecs.csuohio.edu/~sschung/cis612/HowtoExecute... · mapreduce . Job: Running job: job 1517888776794 0001 mapreduce