Lecture on

Cloud Computing(Unit-1-Lecture 4)

Presented By
Dr. Himanshu Rai
Assistant Professor

Department of CSE
United College of Engg. and Research,
Prayagraj, India

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.) th

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 1 / 24
 Outline of Presentation

Introduction.
Underlying Principles of Distributed Computing.
Why Distributed Computing?
Motivations for Implementing a Distributed System.
Benefits and challenges of distributed systems.
Types of distributed systems.
References

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 2 / 24
 Underlying Principles of Distributed Computing

A Distributed computing is a model of computation that is firmly

related to Distributed Systems, refers to as multiple computer
systems located at different places linked together over a network and
use to solve higher level computation without having to use an
expensive supercomputer.
Distributed system is called, When collection of various computers
seems a single coherent system to its client, then it is called
distributed system.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 3 / 24
 Contd...

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 4 / 24
 Contd...

A distributed system is a collection of autonomous computers that are

interconnected with each other and cooperate, thereby sharing
resources such as printers and databases.
Distributed computing systems group individual computers together
and pool their associated computing resources in order to accomplish
higher level computation.
The practice of distributed computing requires that unique - and as
Leopold mentions, autonomous - computers, be networked over either
a Local Area Network (LAN) or Wide Area Network (WAN).

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 5 / 24
 Why Distributed Computing?

Deploying, maintaining and troubleshooting distributing systems can

be a complex and challenging task. The main reason behind their
increasing acceptance is perhaps necessity as they allow scaling
horizontally.
For example, traditional databases that run on a single machine
require users to upgrade the hardware to handle increasing traffic
(vertical scaling).
The biggest issue with vertical scaling is that even the best and most
expensive hardware would prove to be insufficient after a certain time.
On the other hand horizontal scaling allows managing increasing
traffic/performance demands by adding more computers instead of
constantly upgrading a single system.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 6 / 24
 Motivations for Implementing a Distributed System
These are main motivations for a distributed system
Distributed systems improve the “absolute performance” of the
computing system.
The Price to Performance ratio for the system is more favorable for a
distributed system.
Technological advantages.
Some applications are inherently distributed problems (they are solved
most easily using the means of distributed computing.
Distributed computing allows the sharing of resources - both hardware
and software.
Each piece of hardware is replaceable should it fail.
Distributed Computing allows the system to grow incrementally as
computers are added one by one.
Distributed computing allows for “scavenging.” According to Leopold,
”a lot of power is wasted, particularly during business hours.
Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)
Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 7 / 24
 Benefits and challenges of distributed systems

There are three reasons that teams generally decide to implement

distributed systems:
Horizontal Scalability — Since computing happens independently on
each node, it is easy and generally inexpensive to add additional
nodes and functionality as necessary.
Reliability — Most distributed systems are fault-tolerant as they can
be made up of hundreds of nodes that work together. The system
generally doesn’t experience any disruptions if a single machine fails.
Performance — Distributed systems are extremely efficient because
work loads can be broken up and sent to multiple machines.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 8 / 24
 Benefits and challenges of distributed systems

Three more challenges you may encounter include:

Scheduling — A distributed system has to decide which jobs need to
run, when they should run, and where they should run. Schedulers
ultimately have limitations, leading to underutilized hardware and
unpredictable runtimes.
Latency — The more widely your system is distributed, the more
latency you can experience with communications. This often leads to
teams making tradeoffs between availability, consistency, and latency.
Observability — Gathering, processing, presenting, and monitoring
hardware usage metrics for large clusters is a significant challenge.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 9 / 24
 How a Distributed System Works?

Hardware and software architectures are used to maintain a

distributed system. Everything must be interconnected — CPUs via
the network and processes via the communication system.
The most important functions of distributed computing are:
Resource sharing - whether it’s the hardware, software or data that
can be shared.
Openness - how open is the software designed to be developed and
shared with each other.
Concurrency - multiple machines can process the same function at the
same time.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 10 / 24
 Contd...

Scalability - how do the computing and processing capabilities

multiply when extended to many machines.
Fault tolerance - how easy and quickly can failures in parts of the
system be detected and recovered.
Transparency - how much access does one node have to locate and
communicate with other nodes in the system.
Modern distributed systems have evolved to include autonomous
processes that might run on the same physical machine, but interact
by exchanging messages with each other.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 11 / 24
 Types of distributed systems

Distributed systems generally fall into one of four different basic

architecture models:
Client-server — Clients contact the server for data, then format it and
display it to the end-user. The end-user can also make a change from
the client-side and commit it back to the server to make it permanent.
Three-tier — Information about the client is stored in a middle tier
rather than on the client to simplify application deployment. This
architecture model is most common for web applications.
n-tier — Generally used when an application or server needs to
forward requests to additional enterprise services on the network.
Peer-to-peer — There are no additional machines used to provide
services or manage resources. Responsibilities are uniformly
distributed among machines in the system, known as peers, which can
serve as either client or server.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 12 / 24
 Contd...

Client-server

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 13 / 24
 Contd...

Thick/Fat-client model

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 14 / 24
 Contd...

n-tier Architecture

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 15 / 24
 Contd...

3-tier Architecture

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 16 / 24
 Distributed System Architecture

Distributed systems must have a network that connects all

components (machines, hardware, or software) together so they can
transfer messages to communicate with each other.
That network could be connected with an IP address or use cables or
even on a circuit board.
The messages passed between machines contain forms of data that
the systems want to share like databases, objects, and files.
The way the messages are communicated reliably whether it’s sent,
received, acknowledged or how a node retries on failure is an
important feature of a distributed system.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 17 / 24
 Contd...

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 18 / 24
 Example of a Distributed System

Distributed systems have endless use cases, a few being electronic

banking systems, massive multiplayer online games, and sensor
networks.
StackPath utilizes a particularly large distributed system to power its
content delivery network service.
Networks: The earliest example of a distributed system happened in
the 1970s when ethernet was invented and LAN (local area networks)
were created. For the first time computers would be able to send
messages to other systems with a local IP address. Peer-to-peer
networks evolved and e-mail and then the Internet as we know it
continue to be the biggest, ever growing example of distributed
systems. As the internet changed from IPv4 to IPv6, distributed
systems have evolved from “LAN” based to “Internet” based.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 19 / 24
 Contd...

Telecommunication networks: Telephone and cellular networks are

also examples of distributed networks. As telephone networks have
evolved to VOIP (voice over IP), it continues to grow in complexity as
a distributed network.
Distributed Real-time Systems: Many industries use real-time systems
that are distributed locally and globally. Airlines use flight control
systems, Uber and Lyft use dispatch systems, manufacturing plants
use automation control systems, logistics and e-commerce companies
use real-time tracking systems.
Distributed artificial intelligence: Distributed Artificial Intelligence is a
way to use large scale computing power and parallel processing to
learn and process very large data sets using multi-agents.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 20 / 24
 Contd...

Distributed Database Systems: A distributed database is a database

that is located over multiple servers and/or physical locations. The
data can either be replicated or duplicated across systems.
Most popular applications use a distributed database and need to be
aware of the homogenous or heterogenous nature of the distributed
database system.
A homogenous distributed database means that each system has the
same database management system and data model. They are easier
to manage and scale performance by adding new nodes and locations.
Heterogenous distributed databases allow for multiple data models,
different database management systems. Gateways are used to
translate the data between nodes and usually happen as a result of
merging applications and systems.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 21 / 24
 Distributed vs. Parallel Computing

The term distributed computing is often used interchangeably with

parallel computing as both have a lot of overlap.
While there is no clear distinction between the two, parallel
computing is considered as form of distributed computing that’s more
tightly coupled.
For example, in distributed computing processors usually have their
own private or distributed memory, while processors in parallel
computing can have access to the shared memory.
There used to be a distinction between parallel computing and
distributed systems. Parallel computing was focused on how to run
software on multiple threads or processors that accessed the same
data and memory. Distributed systems meant separate machines with
their own processors and memory. With the rise of modern operating
systems, processors and cloud services these days, distributed
computing also encompasses parallel processing.
Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)
Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 22 / 24
 Refrences

Rajkumar Buyya, Christian Vecchiola, S. ThamaraiSelvi, Mastering Cloud Computing, Tata

Mcgraw Hill, 2013.
Gubbi, J., Buyya, R.(2013). Internet of Things (IoT): A vision, architectural elements, and
future directions. Future generation computer systems, 29(7), 1645-1660.
Buyya, R., Yeo, C. S. (2009). Cloud computing and emerging IT platforms: Vision, hype,
and reality for delivering computing as the 5th utility. Future Generation computer
systems, 25(6), 599-616.
Buyya, R., Yeo, C. S. (2008, September). Market-oriented cloud computing: Vision, hype,
and reality for delivering it services as computing utilities. In 2008 10th IEEE international
conference on high performance computing and communications (pp. 5-13). Ieee.
Buyya, R., Broberg, J.(2010). Cloud computing: Principles and paradigms (Vol. 87). John
Wiley Sons.
Buyya, R., Ranjan, R.(2010, May). Intercloud: Utility-oriented federation of cloud
computing environments for scaling of application services. In International Conference on
Algorithms and Architectures for Parallel Processing (pp. 13-31). Springer, Berlin,
Heidelberg.

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 23 / 24
 Queries

Thanking You

Dr. Himanshu Rai Asst. Prof. CSE Dept. (Inst.)

Lecture on Cloud Computing(Unit-1-Lecture 4) Thursday 8th August, 2024 24 / 24