Scribd
Upload
42 views

Eclipse Operation For MR Program

The document provides steps for running MapReduce programs in Eclipse, including starting Eclipse, creating a Java project, adding Hadoop jar files to the project's build path, creating Mapper, Reducer, and Job classes, and running a MapReduce job locally by specifying input and output paths.

Uploaded by

Venkat Gowda
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
42 views

Eclipse Operation For MR Program

The document provides steps for running MapReduce programs in Eclipse, including starting Eclipse, creating a Java project, adding Hadoop jar files to the project's build path, creating Mapper, Reducer, and Job classes, and running a MapReduce job locally by specifying input and output paths.

Uploaded by

Venkat Gowda
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 7

Eclipse Operations

erations for Map Reduce Program


1. To do practice on Map Reduce Programs , first we need to start the
eclipse and remaining steps follow the screen shots.
shot
2. Provide the workspace path then click on Ok button.

3. Right click on Package


ackage Explorer prompt at left side of the window.
4. Go to New select Java
J Project then provide the project name
and verify JRE
5. Click on Finish button.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
6. Hadoop Local Mode Setup follow the below steps
a. add the $HADOOP_HOME folder jar files
b. add the $HADOOP_HOME/lib
$HADOOP_HOME folder jar files
7. Right click on Project Name
N goto Properties > Java Build Path
then below screen open.
open

8. Click on Libraries tab


9. Click on Add External JARS...
JARS then below screen openopen.
10. Click on orienit folder at left side of the Window
11. Click on work folder
12. Click on hadoop-1.2.1
1.2.1 folder
13. Select the all the jars from hadoop-1.2.1 folder then click on OK
button

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
14. Repeat once again 8 step to 12 step.
15. Click on lib folder
16. Select the all the jars from lib folder then click on OK button

17. Now we are done with adding all the required jars to classpath.
18. Verify the Package Explorer screen & Expand the Project Name
by Double Clicking then
the Referenced Libraries will be displayed
displayed.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
19. Right click on src folder and goto New select package and
provide the package name then Click on Finish button.

20. Right click on package then goto New select Class, provide
the Class Name (WordCountJob) then Click on Finish button.

21. Right click on package then goto New select Class, provide
the Class Name (WordCountMapper)
(WordCount ) then Click on Finish button.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
22. Right click on package then goto New select Class, provide
the Class Name (WordCountReducer) then Click on Finish button.

23. After writing the complete code,, then we need to Run the
program follow the below steps to proceed.
24. Right Click on "WordCountJob
WordCountJob" program select Run > Run
Configurations then below window will be displayed.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
25. Double click on Java Application then main class name will be
come
26. Click on main class name (WordCountJob) and select
Arguments tab then provide the input path of the file / folder and
provide the path of the output folder.
folder
27. Click on Apply button and then Click on Run button.

28. After click on Run button, then the message will be displayed on
Console prompt see below screen shot.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345
29. After Complete
omplete the job the status will be displayed ‘‘0’ that
means Job
ob is successful otherwise not successful,, see below screen
shot.

Mr. Kalyan,, Apache Contributor, 6+ years of Big Data Exp, IIT Kharagpur, Gold Medalist
Best Spark & Hadoop Training in Hyderabad,
Hyderabad ORIEN IT @ 040-65142345,
65142345, 9703202345

You might also like