8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Search Write

Be part of a better internet. Get 20% off membership for a limited time

Hadoop : How to install in 5 Steps in

Windows 10
Shashank Singhal · Follow
Published in Analytics Vidhya · 7 min read · Mar 27, 2021

314 16

An easy to go guide for installing the Hadoop in Windows 10

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 1/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Image taken from Google images

1. Prerequisites
1. Hardware Requirement
* RAM — Min. 8GB, if you have SSD in your system then 4GB RAM would
also work.
* CPU — Min. Quad core, with at least 1.80GHz

2. JRE 1.8 — Offline installer for JRE

3. Java Development Kit — 1.8

4. A Software for Un-Zipping like 7Zip or Win Rar

* I will be using a 64-bit windows for the process, please check and
https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 2/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

download the version supported by your system x86 or x64 for all the
software.

5. Download Hadoop zip

* I am using Hadoop-2.9.2, you can use any other STABLE version for
hadoop.

Fig. 1:- Download Hadoop 2.9.2

Once we have Downloaded all the above software, we can proceed with next
steps in installing the Hadoop.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 3/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

2. Unzip and Install Hadoop

After Downloading the Hadoop, we need to Unzip the hadoop-2.9.2.tar.gz
file.

Fig. 2:- Extracting Hadoop Step-1

Once extracted, we would get a new file hadoop-2.9.2.tar.

Now, once again we need to extract this tar file.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 4/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 3:- Extracting Hadoop Step-2

Now we can organize our Hadoop installation, we can create a folder and
move the final extracted file in it. For Eg. :-

Fig. 4:- Hadoop Directory

Please note while creating folders, DO NOT ADD SPACES IN BETWEEN

THE FOLDER NAME.(it can cause issues later)

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 5/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

I have placed my Hadoop in D: drive you can use C: or any other drive
also.

3. Setting Up Environment Variables

Another important step in setting up a work environment is to set your
Systems environment variable.

To edit environment variables, go to Control Panel > System > click on the
“Advanced system settings” link
Alternatively, We can Right click on This PC icon and click on Properties and
click on the “Advanced system settings” link
Or, easiest way is to search for Environment Variable in search bar and there
you GO…😉

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 6/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 5:- Path for Environment Variable

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 7/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 8/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 6:- Advanced System Settings Screen

3.1 Setting JAVA_HOME

Open environment Variable and click on “New” in “User Variable”

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 9/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 10/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 7:- Adding Environment Variable

On clicking “New”, we get below screen.

Fig. 8:- Adding JAVA_HOME

Now as shown, add JAVA_HOME in variable name and path of Java(jdk)

in Variable Value.

Click OK and we are half done with setting JAVA_HOME.

3.2 Setting HADOOP_HOME

Open environment Variable and click on “New” in “User Variable”

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 11/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 12/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 9:- Adding Environment Variable

On clicking “New”, we get below screen.

Fig. 10:- Adding HADOOP_HOME

Now as shown, add HADOOP_HOME in variable name and path of

Hadoop folder in Variable Value.

Click OK and we are half done with setting HADOOP_HOME.

Note:- If you want the path to be set for all users you need to select “New” from
System Variables.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 13/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

3.3 Setting Path Variable

Last step in setting Environment variable is setting Path in System

Variable.

Fig. 11:- Setting Path Variable

Select Path variable in the system variables and click on “Edit”.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 14/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 12:- Adding Path

Now we need to add these paths to Path Variable one by one:-

* %JAVA_HOME%\bin
* %HADOOP_HOME%\bin
* %HADOOP_HOME%\sbin

Click OK and OK. & we are done with Setting Environment Variables.

3.4 Verify the Paths

Now we need to verify that what we have done is correct and reflecting.

Open a NEW Command Window

Run following commands

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 15/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

echo %JAVA_HOME%
echo %HADOOP_HOME%
echo %PATH%

4. Editing Hadoop files

Once we have configured the environment variables next step is to configure
Hadoop. It has 3 parts:-

4.1 Creating Folders

We need to create a folder data in the hadoop directory, and 2 sub folders
namenode and datanode

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 16/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 13:- Creating Data Folder

Create DATA folder in the Hadoop directory

Fig. 14:- Creating Sub-folders

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 17/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Once DATA folder is created, we need to create 2 new folders namely,

namenode and datanode inside the data folder

These folders are important because files on HDFS resides inside the
datanode.

4.2 Editing Configuration Files

Now we need to edit the following config files in hadoop for configuring it :-
(We can find these files in Hadoop -> etc -> hadoop)

* core-site.xml
* hdfs-site.xml
* mapred-site.xml
* yarn-site.xml
* hadoop-env.cmd

4.2.1 Editing core-site.xml

Right click on the file, select edit and paste the following content within
<configuration> </configuration> tags.
Note:- Below part already has the configuration tag, we need to copy only the
part inside it.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 18/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>

4.2.2 Editing hdfs-site.xml

Right click on the file, select edit and paste the following content within
<configuration></configuration>tags.
Note:- Below part already has the configuration tag, we need to copy only the
part inside it.
Also replace PATH~1 and PATH~2 with the path of namenode and datanode
folder that we created recently(step 4.1).

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>PATH~1\namenode</value>
<final>true</final>
</property>
<property>
<name>dfs.datanode.data.dir</name>
https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 19/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

<value>PATH~2\datanode</value>
<final>true</final>
</property>
</configuration>

4.2.3 Editing mapred-site.xml

Right click on the file, select edit and paste the following content within
<configuration> </configuration> tags.
Note:- Below part already has the configuration tag, we need to copy only the
part inside it.

<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>

4.2.4 Editing yarn-site.xml

Right click on the file, select edit and paste the following content within
<configuration> </configuration> tags.
Note:- Below part already has the configuration tag, we need to copy only the
part inside it.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 20/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<!-- Site specific YARN configuration properties -->
</configuration>

4.2.5 Verifying hadoop-env.cmd

Right click on the file, select edit and check if the JAVA_HOME is set
correctly or not.
We can replace the JAVA_HOME variable in the file with your actual
JAVA_HOME that we configured in the System Variable.

set JAVA_HOME=%JAVA_HOME%
OR
set JAVA_HOME="C:\Program Files\Java\jdk1.8.0_221"

4.3 Replacing bin

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 21/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Last step in configuring the hadoop is to download and replace the bin
folder.
* Go to this GitHub Repo and download the bin folder as a zip.
* Extract the zip and copy all the files present under bin folder to
%HADOOP_HOME%\bin

Note:- If you are using different version of Hadoop then please search for its
respective bin folder and download it.

5. Testing Setup
Congratulation..!!!!!
We are done with the setting up the Hadoop in our System.

Now we need to check if everything works smoothly…

5.1 Formatting Namenode

Before starting hadoop we need to format the namenode for this we need to
start a NEW Command Prompt and run below command

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 22/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

hadoop namenode -format

Fig. 15:- Formatting Namenode

Note:- This command formats all the data in namenode. So, its advisable to use
only at the start and do not use it every time while starting hadoop cluster to
avoid data loss.

5.2 Launching Hadoop

Now we need to start a new Command Prompt remember to run it as

administrator to avoid permission issues and execute below commands

start-all.cmd

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 23/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 16:- start-all.cmd

This will open 4 new cmd windows running 4 different Daemons of hadoop:-
* Namenode
* Datanode
* Resourcemanager
* Nodemanager

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 24/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 17:- Hadoop Deamons

Note:- We can verify if all the daemons are up and running using jps

command in new cmd window.

6. Running Hadoop (Verifying Web UIs)

6.1 Namenode
Open localhost:50070 in a browser tab to verify namenode health.

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 25/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Fig. 18:- Namenode Web UI

6.2 Resourcemanger
Open localhost:8088 in a browser tab to check resourcemanager details.

Fig. 19:- Resourcemanager Web UI

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 26/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

6.3 Datanode
Open localhost:50075 in a browser tab to checkout datanode.

Fig. 20:- Datanode Web UI

7. Congratulations..!!!!🎉
Congratulation! We have successfully installed Hadoop.
There are chances that some of us might have faced some issues… Don’t
worry its most likely due to some small miss or incompatible software. If you
face any such issue please visit all the steps once again carefully and verify
for the right software versions.
If you still can’t get Hadoop up and running, Don’t hesitate describe your
problem below in the comment section.

8. Special Note 🙏
https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 27/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Don’t forget to Like and share it with your friends and colleagues.
Also, don’t miss the opportunity to share your views and suggestions for this
or new articles.

You can know more About Me HERE..

Happy Learning… !!! 🙂

Big Data Hadoop Data Data Analysis Data Analytics

Written by Shashank Singhal Follow

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 28/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

197 Followers · Writer for Analytics Vidhya

Big Data & Machine Learning | https://shashank-singhal-18.github.io/Shashank-

Singhal/ | Blog — https://quickdatascienceds.blogspot.com

More from Shashank Singhal and Analytics Vidhya

Shashank Singhal in Geek Culture Kia Eisinga in Analytics Vidhya

HDFS Commands Cheat Sheet How to create a Python library

A quick guide for HDFS Commands Ever wanted to create a Python library, albeit
for your team at work or for some open…

Mar 31, 2022 208 Jan 27, 2020 2.6K 28

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 29/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Harikrishnan N B in Analytics Vidhya Shashank Singhal in Analytics Vidhya

Confusion Matrix, Accuracy, Hive — How to install in 5 Steps in

Precision, Recall, F1 Score Windows 10
Binary Classification Metric An easy to go guide for installing Hive in
Windows 10.

Dec 10, 2019 1.1K 6 Apr 17, 2021 87 4

See all from Shashank Singhal See all from Analytics Vidhya

Recommended from Medium

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 30/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Vishal Barvaliya Manish Shivanandhan

20 Real-Time Spark Scenario- PySpark for Beginners: Hands-On

Based Questions for Data… Data Processing with Apache…
Apache Spark is a powerful tool for An introduction to Pyspark, the Python API
processing large datasets in real-time. If… for handling big data and machine learning…

Jul 16 128 Jun 26 58

Lists

Practical Guides to Machine ChatGPT prompts

Learning 48 stories · 1859 saves
10 stories · 1723 saves

General Coding Knowledge data science and AI

20 stories · 1446 saves 40 stories · 206 saves

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 31/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Vishal Barvaliya Yousef Alkhanafseh in TurkNet Technology

Delta Lake 4.0: A Simple Guide Installation of Apache NiFi

Delta Lake is a popular tool for managing and Step-by-Step guide for installing Apache NiFi
processing large amounts of data, making… 1.25.0 and other essential dependencies.

Jul 24 48 Apr 2 2

Dinesh Thapa - Big Data, Analytics & AI aditya4567uk in Dev Genius

Setup Apache Spark Environment Installing Apache Spark on

on Windows 11? Step By Step Guide Linux(Ubuntu). A detailed &…

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 32/33
8/5/24, 11:03 AM Hadoop : How to install in 5 Steps in Windows 10 | by Shashank Singhal | Analytics Vidhya | Medium

Apache Spark is a powerful open-source Install Apache spark easily with step by step
distributed computing system that provides… detailed guide given with pictures to make…

Mar 9 7 Feb 9 41

See more recommendations

Help Status About Careers Press Blog Privacy Terms Text to speech Teams

https://medium.com/analytics-vidhya/hadoop-how-to-install-in-5-steps-in-windows-10-61b0e67342f8 33/33