17CS742 – Cloud

computing applications
Module 1
2020-2021[ODD]
 2
17CS742 –
Cloud computing applications

► Module – 1 Introduction to cloud computing, Virtualization

► Module – 2 Cloud computing architecture, Aneka
► Module – 3 Concurrent computing, high throughput computing
► Module – 4 Data Intensive Computing
► Module – 5 Cloud platforms in industry, cloud applications

*
 3
Course Outcomes

► Explain cloud computing, virtualization and classify services of cloud

computing
► Illustrate architecture and programming in cloud
► Describe the platforms for development of cloud applications and List
the application of cloud.
 4
Text Book

► Rajkumar Buyya, Christian Vecchiola, and Thamarai Selvi Mastering

Cloud. Computing McGraw Hill Education

► Reference Book:
Dan C. Marinescu, Cloud Computing Theory and Practice, Morgan
Kaufmann, Elsevier 2013.
 5
Module 1

► Introduction (Chapter 1) Environments

► Application Development
► Cloud Computing at a Glance
► Infrastructure and System Development
► The Vision of Cloud Computing
► Computing Platforms and Technologies
► Defining a Cloud
► Amazon Web Services (AWS)
► A Closer Look
► Google AppEngine
► Cloud Computing Reference Model ► Microsoft Azure
► Characteristics and Benefits ► Hadoop
► Challenges Ahead ► Force.com and Salesforce.com
► Historical Developments ► Manjrasoft Aneka
► Distributed Systems
► Virtualization
► Web 2.0
► Service-Oriented Computing
► Utility-Oriented Computing
► Building Cloud Computing
 6
Module 1

► Virtualization(Chapter 3)
► Introduction
► Characteristics of Virtualized Environments
► Taxonomy of Virtualization Techniques
► Execution Virtualization
► Other Types of Virtualization
► Virtualization and Cloud Computing
► Pros and Cons of Virtualization
► Technology Examples
► Xen: Paravirtualization,
► VMware: Full Virtualization
► Microsoft Hyper-V
 7
Introduction to Cloud Computing

► Leonard Kleinrock in 1969

► One of the chief scientists of ARPANET
► “As of now, computer networks are still in their
infancy, but as they grow up and become
sophisticated, we will probably see the spread of
„computer utilities‟ which, like present electric
and telephone utilities, will service individual
homes and offices across the country”
► https://www.internethalloffame.org/inductees/l
eonard-kleinrock
 8
Utility / Cloud computing

► computing services will be readily available on demand.

► an open environment where computing, storage, and other services are
traded as computing utilities
► users (consumers) need to pay providers only when they access the
computing services.
► consumers no longer need to invest heavily, build and maintain complex
IT infrastructure
► computing allows renting infrastructure, runtime environments, and
services on a pay- per-use basis
 9

“I don’t care where my servers are, who manages them, where my

documents are stored, or where my applications are hosted. I just
want them always available and access them from any device
connected through Internet. And I am willing to pay for this
service for as a long as I need it”

View on Cloud Computing

 10
How IT services are turned into
utilities?

► Web 2.0 technologies that turned Internet into a rich application and
service delivery platform.
► Service orientation : allows cloud computing to deliver its capabilities
with familiar abstractions.
► Virtualization : allows for necessary degree of customization.

► https://www.youtube.com/watch?v=hAau6W--iMo
 11
Why cloud computing gained
popularity?

► Flexible environment for building and deploying new applications.

► Dynamically provisioned IT resources.
► Technologies enabling cloud became consolidated and standardized.
 Vision of Cloud Computing 12

► The long-term vision of cloud computing is that IT

services are traded as utilities in an open market,
without technological and legal barriers.
► The need for ubiquitous storage and compute
power on demand
► automation of the discovery process of cloud
offering.
► defining effective standards for the unified
representation of cloud services
► concentrating the core capabilities of cloud
computing into large datacenters
► Greener IT and higher revenue because of the
consolidation model.
 13

Defining
a cloud
 14
1. Armbrust et al ―A view of cloud computing‖
https://dl.acm.org/doi/fullHtml/10.1145/1721654.1721672

► “Cloud computing refers to both the applications delivered as

services over the Internet and the hardware and system software in
the datacenters that provide those services.”
► XaaS – Anything as a services
► IT infrastructure, development platforms, databases, and so on—can be
delivered, measured, and consequently priced as a service.
 2. NIST (U.S. National Institute of 15
Standards and Technology)
Definition

► Cloud computing is a model for enabling ubiquitous, convenient, on-

demand network access to a shared pool of configurable computing
resources (e.g., networks, servers, storage, applications, and
services) that can be rapidly provisioned and released with minimal
management effort or service provider interaction.
 16
3. Paper by Reese in ―Cloud Computing
Architecture‖ book Definition

► Three criteria that determine whether a service is delivered in a cloud

computing style.
► The service is accessible via a Web browser (nonproprietary) or a Web
services application programming interface (API).
► Zero capital expenditure is necessary to get started.

► You pay only for what you use as you use it.
 17
4. Rajkumar Buyya ―Vision Hype
and Reality‖

► A cloud is a type of parallel and distributed system consisting of a

collection of interconnected and virtualized computers that are
dynamically provisioned and presented as one or more unified
computing resources based on service-level agreements (SLA)
established through negotiation between the service provider and
consumers.
 How cloud computing is helping 18
enterprises, governments, public, private
institutions, research organizations?
► Large enterprises can offload some of their activities to cloud-based systems.
► New York Times has converted its digital library of past editions into a Web-friendly format.
https://timesmachine.nytimes.com/browser/
► Small enterprises and start-ups can afford to translate their ideas into business
results more quickly, without excessive up-front costs.
► Case Study : Animoto : https://animoto.com/

► System developers can concentrate on the business logic rather than dealing with
the complexity of infrastructure management and scalability.
► Little Fluffy Toys : https://www.youtube.com/watch?v=mF47EyBWtVY

► End users can have their documents accessible from everywhere and any device.
► Icloud: https://www.youtube.com/watch?v=KTrO2wUxh0Q
Overview of Cloud Computing 19
 20
3 major models

► 1. Public clouds :
► established by a third-party service provider
► Deployed using virtualized data centers.
► available to any consumer on a subscription basis.
► users’ data and applications are deployed on cloud datacenters on the
vendor’s premises
 21
Cloud Models

► Private Cloud: Large organizations that own massive computing

infrastructures.
► Provides more efficient use of the computing facilities.
► Keeps confidential information within an organization‟s premises.
► governments and banks that have high security, privacy, and regulatory
concerns prefer enterprise/private clouds.
 22
Cloud Model

► Hybrid Cloud
► If private cloud resources are unable to meet
users’ quality-of-service requirements,
► hybrid computing systems : public cloud
resources and privately owned
infrastructures.
 23
The cloud
computing
reference model
(3 major
categories)
Infrastructure-as-a-Service(IaaS)
Platform-as-a-Service(PaaS)
Software-as-a-Service(SaaS).
 Build dynamically scalable 24
IaaS programming platforms that
require a specific software
stack.

► Deliver infrastructure on demand in the form of virtual hardware, storage,

and networking
► Virtual hardware is utilized to provide compute on-demand in the form of
VM instances.
► Created on user’s request on provider’s infrastructure.

► Users are given tools and interfaces to configure the software stack installed
in the VM.
► Pricing Model : dollars per hour depending on the characteristics of the virtual
hardware.
► Virtual Storage Space : raw disk space – for persistent storage.
► object space – high level abstraction for storing entities rather than files.

► Virtual Networking – virtual services that manage the networking among

virtual instances.
 25
Scalable programming
PaaS platforms when new systems
have to be developed.

► Deliver scalable and elastic runtime environments on demand and host

the execution of applications.
► These services are supported by a core middleware platform that helps
create the abstract platform where applications are deployed and
executed.
► Service provider focus on scalability and fault tolerance.
► User’s focus on logic of application by using provider‟s API and libraries.
► Increases level of abstraction but user is also working in a controlled
environment.
 Appropriate when an existing 26
SaaS SaaS suits a user’s need and
minimum level of customization
is required.

► Software as a service : provides application and services on demand.

► Common desktop applications : office automation, photo editing,
Customer Relationship Management(CRM) are replicated in provider’s
infrastructure.
► Made more scalable and accessible through a browser on demand.
► Interaction is shared among multiple users
► SaaS is what sustains the load based on popularity on social networking
sites.
 27
Characteristics and benefits.

► For Cloud Service Consumers (CSC) and Cloud Service Providers (CSP)

NO UP FRONT ON DEMAND ATTRACTIVE

COMMITMENTS ACCESS PRICING

EASE OF USE
SCALABILITY ENERGY OF 3RD PARTY
EFFICIENCY SERVICES
 28
Cost Benefit

► Increased economical return due to reduced maintenance and

operational costs
► Because IT assets are turned into utility costs

► Paid for as long as needed

► Not paid up-front

► Before cloud computing : organizations had to deal with capital costs

► Costs that enable business activities of organizations.

► These costs on assets have depreciable value

► Small businesses and startups do not need large investments to start up

► Can grow as the businesses grow.
► Maintenance costs are reduced because of the renting costs
► CSP’s bear the cost because of economies of scale.
 29
Agility in defining and structuring
software systems –Benefit 2

► Organizations are not constrained by capital costs for IT Assets.

► Reduced need for capacity planning
► Workload Spikes which are unplanned – add more servers

► Remove them when workload returns to normal.

► IaaS provides easy mechanism to provision additional hardware and

integrate it with existing systems.
► PaaS offers runtime models and programming models to scale
applications
► SaaS offerings can be elastically sized on demand.
 30
Benefit for end users and service
providers

► End users : Have and process data anytime, anywhere through multiple
devices.
► Processing capabilities lies in the cloud so tasks that require considerable
software investments previously is reduced
► Providers : Multitenancy allows for better utilization of shared
infrastructure.
► Consolidation in large datacenters allow for optimization in resource
allocation and energy efficiency.
 31
Other benefits

► Service orientation and on demand access : create new opportunities.

► New service offerings : can be created by putting together existing
services and concentrating on added value.

Easy to provision on demand any component of the computing stack.

Concentrate effort in the added value.

Easy to turn ideas into products with limited costs

 32
Challenges ahead

► Technical challenges in the dynamic provisioning and management of

cloud computing infrastructure: virtualization, integration or real and
virtual infrastructure
► Security: confidentiality, secrecy and protection of data.
► Organizations do not own the infrastructure.

► Cryptography secures data on transmit, but it is decrypted in memory.

► Virtualization allows capturing transparently any memory pages of an instance

► Legal issues : different geographical locations enforce various legislations

on privacy and protection of data.
► U.S. gives power to government agencies to acquire confidential data

► Europe : more restrictive

► U.S. organization using cloud services in Europe?

 • Distributed Systems 33
1

2 • Virtualization

3 • Web 2.0

4 • Service Oriented computing

5 • Utility Oriented computing

FIVE CORE HISTORICAL

TECHNOLOGIES DEVELOPMENTS IN
THE CLOUD
THE EVOLUTION OF THE CLOUD
 35
Distributed systems

► Clouds are essentially distributed systems that make their services

available to third parties on demand.
► Distributed system according to Tanenbaum1:

► A distributed system is a collection of independent computers that

appears to its users as a single coherent system.
► Independent components
► Perceived as a single entity.
1Tanenbaum AS, Van Steen M. Distributed systems: principles and paradigm. Upper Saddle River, NJ,
USA: Prentice Hall PTR; 2001.
 36
Distributed Systems

► Cloud computing is the extreme use of distributed systems

► Other properties of Distributed systems include

Heterogeneity Openness

Scalability Concurrency

Continuous
Independent Transparency Availability
failures
 3 major milestones that has lead to cloud computing 37

• Used for bulk data processing

• Low cost alternative to • Highly reliable and capable of tolerating failures transparently.
mainframes Mainframes • System shutdown is not required to replace failed components
• Can be connected via high • System works without interruption
bandwidth network. • Applications in use : online banking, airline ticket booking, etc
• Controlled by s/w tools that
manage them and make them
appear as a single system.
• Appeared in 1990’s and is an evolution of cluster computing
• Standard for parallel and high-
Clusters • Analogy of power grid
performance computing
• Access large computational power, huge storage facilities
• Contributed to evolution of tools
in Cloud computing : Condor, • Started as aggregation of geographically dispersed clusters
PVM, MPI • Grids were nation-wide or world-wide
• Advantage: computational power • Developments that lead to grids
of commodity machines can be • a) clusters became common resources
leveraged, Grids • b) underutilized
• Could be easily extended if more • c) computational requirement could not be met by a single cluster
computational power is required. • d) improvements in networking.
 38
Grid precursor to Cloud

► Cloud computing is the successor of grid computing

► Clouds have virtually infinite capacity, tolerant to failures, always on
(similar to mainframes)
► Compute nodes are commodity machines (similar to clusters)
► Pay-per-use basis (implemented the vision of Grid)
 39
Virtualization

► Core technology of cloud computing

► Abstraction of hardware, runtime environments, storage and networking
► Has been around for 40 years
► Virtual : simulate the environment that is expected by the guest.
► Hardware virtualization: VM instances
► Amazon EC2, RightScale, Vmware vCloud,
 Isolated and
customizable
► Storage and network virtualization
environments
► Process VM : replicate runtime environments for programs  Minor impact on
► Allows isolating execution of applications and programs performance
► Provides finer control on resources they access
► Used to provide a platform : Google AppEngine, Azure
 40
Web 2.0

► The transformation of the web into a rich platform for application development.
► Brings interactivity and flexibility to Web pages
► Possible by using a combination of technologies such as XML, AJAX, Web Services
► The access of services through a variety of devices : mobile phones, car
dashboards, TV sets
► These technologies require increased dynamism.
► Loose coupling : composing existing services and integrating them, providing
added value.
► Example : Google docs, Google Maps, Flickr, Facebook, Twitter, Blogger, Wikipedia.
► AJAX and RSS make the social media sites incredibly interactive
► Community websites harness collective intelligence of community
 41
Web 2.0

► Idea of Web 2.0 : coined by Darci DiNucci in 1999.

► It was fully realized in 2004
► Rich Internet Applications(RIA) fundamental in making cloud services
accessible to the wider public.
► Social Perspective: made people more accustomed to using Web 2.0
everyday.
► Opened a path to acceptance
 42
Service Oriented Computing
(SOC)

► Supports the development of rapid, low-cost, flexible, interoperable,

evolvable applications and systems
► Service : abstraction
representing a self-describing platform-
agnostic component that can perform any function.
► Loosely coupled, reusable, programming-language independent and
location transparent.
► Services are composed and aggregated into a Service Oriented
Architecture (SOA).
► A logical mechanism to organize and provide end users the services
 43
SOA : QoS and SaaS

► Quality of Service (QoS) : identifies a set of functional and non-functional

attributes to evaluate behaviour of a service
► Response time, security attributes, transactional integrity, reliability, scalability,
availability
► Established via SLA

► SaaS: term inherited from Application Service Providers(ASP)

► ASP make the service available
► Possible because of economies of scale.
► SaaS reaches full potential with SOA
 44
Web Services

► Popular expression of service orientation.

► WS : software components that expose functionalities accessible using a
method invocation pattern that goes over the HTTP.
► WSDL :
► https://www.w3.org/TR/wsdl/

► SOAP:
► https://www.w3.org/TR/soap/

► Standards and specifications of web services is controlled by W3C

 45
Utility Oriented Computing

If computers of the kind I have advocated

became the computers of the future, then
computing may someday be organized as a
public utility, just as the telephone system is a
public utility….
The computer utility could become the basis
of a new and important industry.
John McCarthy, in a speech for MIT
Centennial, 1961)
 46
Utility Oriented Computing

► Started with the mainframe era

► The idea remained during the cluster computing era.
► Computing grids introduced market orientation
► Where resources where up for bidding/sale

► E-commerce infrastructure provided the necessary support for utility

computing
► Dot com bubble increased interest in online services
► https://www.investopedia.com/terms/d/dotcom-bubble.asp

► Service Oriented Architecture - applications were distributed, composed

of services provided by different entities
► SOA enabled utility oriented computing – compute, storage, application
components.
 47
Building cloud computing environments

Application Development Infrastructure and System Computing platforms and

• Web applications of the Web 2.0 Development technologies
technologies • Distributed Computing • Amazon Web Services
• Resource-intensive applications-
data/compute intensive, scientific • Web 2.0 Technologies • Google AppEngine
computing • Virtualization • Microsoft Azure
• Cloud computing provides • Service Orientation • Hadoop
• Renting –
compute/storage/network • Dynamism, scale, volatility • Salesforce.com
• Runtime environments guide design of the systems • Manjrasoft Aneka
• Application services that mimic
desktop environments
• Developers access REST Web
services
 48
Review Questions

► Define cloud computing and identify its core features

► What is the major revolution introduced by Web 2.0?
► Briefly summarize the cloud computing reference model.
 49

Virtualization
Amazon web services
Google App Engine
Microsoft Azure
Hadoop
SalesForce.com
 50
Virtualization (Chapter 3)

► Introduction
► Characteristics of Virtualized Environments
► Taxonomy of Virtualization Techniques
► Execution Virtualization
► Other Types of Virtualization

► Virtualization and Cloud Computing

► Pros and Cons of Virtualization

► Technology Examples
► Xen: Paravirtualization
► VMware: Full Virtualization
► Microsoft Hyper-V
 Increased performance and compute capacity
Introduction • Normal PC have enough resources to host a virtual machine manager.
• Supercomputers have immense compute power and can accommodate 100’s or51
1000’s of VM’s
Underutilized hardware and software resources
• Underutilization happens because of i) increased performance/computing capacity
ii) limited/sporadic use of resources.
• Many computers are only partially used during work hours.
► virtualization technologies • 24/7/365 basis : requires a transparent environment
provide a virtual environ-
ment for not only Lack of space
executing applications • Server consolidation – brings several different applications under one server,
but also for storage, improves hardware underutilization, reduces power consumption
memory, and networking Green initiatives
► Supported by VM-based • Datacenter –requires energy to keep the servers on and also cooling them.
programming languages. • Virtualization technology provides efficient means for server consolidation.
► Java VM – applets Rise of administrative costs
► .NET Framework • Servers require administrators – h/w monitoring, replacing defective components,
server setup, updates, resource monitoring, backups.
► Google – Java and
• Cooling and administrative costs are higher than the IT equipment
Python
• Virtualization – reduces the number of servers, reduces cost of administrative
personnel.
 52
Incresed
Security

Characteristics
of Virtualized Managed
Execution
Environments

Portability
 53
Virtualization Model

► 3 components: hardware virtualization

► Guest, host, virtualization layer

► Host : original environment where

guest is managed.
► Virtualization layer : responsible for
recreating the same or different
environment.
► Network Virtualization : guest
application and users interact with
VPN(Virtual Private Network)
► Virtual environment is created by
means of a software program.
 54
Increased Security

► All operations by guest are performed by VM

► This allows for control and filter
► Resources exposed to host are hidden or protected from guest.
► Increase security is a requirement when running untrusted code.
► Sandboxed inside JVM
 55
Managed Execution

► Sharing
► Aggregation
► Emulation
► Isolation
► Another important characteristic : performance Tuning
Taxonomy of Virtualization Technologies 56