Scribd
Upload
10 views

Hadoop Installation (1)

haddop

Uploaded by

Ayush Trivedi
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
10 views

Hadoop Installation (1)

haddop

Uploaded by

Ayush Trivedi
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 6

Name-Manas Kumar Manna

24MCS105 (M.tech AI 1st sem)

AI-Lab[22-Oct-2024]
Setup single node Hadoop cluster and Apply HDFS Commands on Single
Node Hadoop Cluster.

 Prequisites

1. Java 8 runtime environment (JRE)


2. Apache Hadoop 3.3.6

1 - Download Hadoop binary package


The first step is to download Hadoop binaries from the official
website(https://hadoop.apache.org/releases.html). The binary packagesize is about 696 MB.

2 - Unpack the package


After finishing the file download, we should unpack the package using 7zip or WinRar.

3 -Java installation
Java is required to run Hadoop. If java is not installed , We have to install it. After
finishing the file download we open a new command prompt, we should unpack the package.

4 - Configure environment variables


Now we've downloaded and unpacked all the files we need to configure two important
environment variables.

We configure JAVA_HOME environment variable by adding new environment variable.


Variable name : JAVA_HOME Variable value: Java path
The same with HADOOP_HOME environment variable-

Variable name : HADOOP_HOME Variable value: C:\Hadoop\hadoop-3.3.6

 Configure PATH environment variable


Once we finish setting up the above two environment variables, we need to add the bin
folders to the PATH environment variable.
5 - Verification of Installation
Once We complete the installation, Close terminal window and open a new one and run
the following command to verify:

java -version

We can also be able to run the following command:

hadoop –version

6 - Configure Hadoop
Now we are ready to configure the most important part - Hadoop configurations which
involves Core, YARN, MapReduce, HDFS configuration
7 – Initialize HDFS
Run the following command in Command Prompt

hdfs namenode –format

8 - Start HDFS daemons


Run the following command to start HDFS daemons in Command Prompt:

start-all.cmd

Verify HDFS web portal UI through this link http://localhost:9870/dfshealth.html#tab-


overview.
9 - Start YARN daemons
Run the following command in an elevated Command Prompt window (Run as administrator)
to start YARN daemons:

%HADOOP_HOME%\sbin\start-yarn.cmd
You can verify YARN resource manager UI when all services are started successfully.

http://localhost:8088

You might also like