Scribd
Upload
13 views

Hadoop Installation (1)

haddop

Uploaded by

Ayush Trivedi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
13 views

Hadoop Installation (1)

haddop

Uploaded by

Ayush Trivedi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 6

Name-Manas Kumar Manna

24MCS105 (M.tech AI 1st sem)

AI-Lab[22-Oct-2024]
Setup single node Hadoop cluster and Apply HDFS Commands on Single
Node Hadoop Cluster.

 Prequisites

1. Java 8 runtime environment (JRE)


2. Apache Hadoop 3.3.6

1 - Download Hadoop binary package


The first step is to download Hadoop binaries from the official
website(https://hadoop.apache.org/releases.html). The binary packagesize is about 696 MB.

2 - Unpack the package


After finishing the file download, we should unpack the package using 7zip or WinRar.

3 -Java installation
Java is required to run Hadoop. If java is not installed , We have to install it. After
finishing the file download we open a new command prompt, we should unpack the package.

4 - Configure environment variables


Now we've downloaded and unpacked all the files we need to configure two important
environment variables.

We configure JAVA_HOME environment variable by adding new environment variable.


Variable name : JAVA_HOME Variable value: Java path
The same with HADOOP_HOME environment variable-

Variable name : HADOOP_HOME Variable value: C:\Hadoop\hadoop-3.3.6

 Configure PATH environment variable


Once we finish setting up the above two environment variables, we need to add the bin
folders to the PATH environment variable.
5 - Verification of Installation
Once We complete the installation, Close terminal window and open a new one and run
the following command to verify:

java -version

We can also be able to run the following command:

hadoop –version

6 - Configure Hadoop
Now we are ready to configure the most important part - Hadoop configurations which
involves Core, YARN, MapReduce, HDFS configuration
7 – Initialize HDFS
Run the following command in Command Prompt

hdfs namenode –format

8 - Start HDFS daemons


Run the following command to start HDFS daemons in Command Prompt:

start-all.cmd

Verify HDFS web portal UI through this link http://localhost:9870/dfshealth.html#tab-


overview.
9 - Start YARN daemons
Run the following command in an elevated Command Prompt window (Run as administrator)
to start YARN daemons:

%HADOOP_HOME%\sbin\start-yarn.cmd
You can verify YARN resource manager UI when all services are started successfully.

http://localhost:8088

You might also like