CHAPTER 6

MONITORING-ERROR
AVOIDANCE -QUALITY OF
SERVICE
THS. NGUYỄN ĐÌNH THỌ
[email protected]

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 1

CONTENTS
Monitoring System for Clouds

Monitoring Service

Service Quality Assurance in Cloud

Computing

Error Control & Reliable

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 2

 Monitoring System for Clouds

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 3

DISCUSS- ABOUT MONITORING IN CLOUD?

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 4

WHAT IS CLOUD MONITORING?

• Cloud monitoring uses manual and automated tools to

monitor, analyze and report on the availability and
performance of websites, servers, applications and other
cloud infrastructure. For example, cloud monitoring tools
enable you to test an application for speed, functionality and
reliability — to help ensure that it is performing optimally.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 5

WHAT IS CLOUD MONITORING?

• Cloud monitoring is generally performed as part of an overall

cloud management strategy, enabling IT administrators to
review the operational status of cloud-based resources. It
also provides a holistic view of cloud metrics, customer flow,
log data and more. Cloud monitoring can be provided by a
cloud service or a managed service provider such as
Rackspace. It is also available as Software as a Service
(SaaS), so you can independently monitor the cost, reliability
https://
and
CLOUD performance
COPUTING ofTHO
LECTURE- THS NGUYEN DINH your cloud infrastructure. 6
www.rackspace.com/library/what-is-cloud-monito
ring
ISSUES IN CURRENT CLOUDS?

While cloud computing holds huge promise for the future of service computing, a
number of inherent deficiencies in current offerings can be pointed out:
• Inherently limited scalability of single-provider clouds: Khả năng mở rộng giới
hạn của các đám mây đơn lẻ:
Although most infrastructure cloud providers today claim infinite scalability, in
reality it is reasonable to assume that even the largest players may start facing
scalability problems as Cloud Computing usage rate increases. In the long term,
scalability problems may be expected to aggravate as cloud providers serve an
increasing number of on-line services, each accessed by massive amounts of
global users at all times.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 7
ISSUES IN CURRENT CLOUDS?

• Lack of interoperability among cloud providers

Thiếu khả năng tương tác giữa các nhà cung cấp dịch vụ đám mây
Contemporary cloud technologies have not been designed with
interoperability in mind. This results in an inability to scale through
business partnerships across clouds providers. In addition, it
prevents small and medium cloud infrastructure providers from
entering the cloud provisioning market. Overall, this stifles
competition and locks consumers to a single vendor.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 8
ISSUES IN CURRENT CLOUDS?

• No built-in Business Service Management support: Không có hỗ trợ quản lý

dịch vụ kinh doanh tích hợp
Business Service Management (BSM) is a management strategy that allows
businesses to align their IT anagement with their high level business goals. The
key aspect of BSM is Service Level Agreement (SLA) management. Current
cloud computing solutions are not designed to support the BSM practices that
are well established in the daily management of the enterprise IT departments.
As a result, enterprises looking at transforming their IT operations to cloud-
based technologies face a non-incremental and potentially disruptive step.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 9

DISCUSS- MONITORING SYSTEMS?

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 10

ABOUT SAP(SYSTEM APPLICATION
PRODUCTS) SYSTEM

SAP is a software system that integrates internal and

external management information across an entire
organization. It embraces finance, manufacturing,
sales and service, CRM, etc. SAP automates these
activities with an integrated software application.
Purpose of SAP is to facilitate the flow of information
between all business functions inside the boundaries
of the organization and manage the connections to
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 11

outside stakeholders.
SAP MODEL

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 12

SAP MODEL

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO https:// 13

www.guru99.com/what-is-sap-definition-of-sap-e
rp-software.html
SAP ERP-ENTERPRISE RESOURCE
PLANNING

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 14

 ABOUT SAP SYSTEM
• Requests are handled by the SAP
Web dispatcher
• Multiple stateful Dialog Instances
(DIs)
• Single Central Instance (CI) that
performs central services such as
• application level locking, messaging, and
registration of DIs.

• A single Database Management

System (DBMS) serves the SAP
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 15
system.
SAP SYSTEM DEPLOYMENT

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 16

PRIMARY REQUIREMENTS
• Automated and fast deployment
–Automated provisioning of service applications
based on a formal contract specifying the
infrastructure SLAs.
–The same contract should be reused to provision
multiple instances of the same application for
different tenants with different customizations.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 17

PRIMARY REQUIREMENTS
• Dynamic elasticity(seamless): Độ đàn hồi động (liền
mạch)
- Resource allocation parameters of individual virtual
execution environments (memory, CPU, network
bandwidth, storage)
- The number of virtual execution environments.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 18

PRIMARY REQUIREMENTS

• Automated continuous optimization :Tối ưu hóa liên tục tự

động
Continuously optimize alignment of infrastructure resources
management with the high-level business goals
• Virtualization technology independence: Độc lập công
nghệ ảo hóa
Support different virtualization technologies transparently
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 19
THE RESERVOIR APPROACH
• The RESERVOIR vision is to
enable on-demand delivery of IT services at competitive
costs,
without requiring a large capital investment in
infrastructure.
• The model is inspired by a strong desire to liken the delivery
of IT services to the delivery of common utilities
EX. dynamically acquire electricity from a neighboring
facility to meet a spike in demand.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 20
THE RESERVOIR APPROACH
• That is, no single provider serves all customers at all
times,
- Next-generation cloud computing infrastructure should
support a model that Multiple independent providers
can cooperate seamlessly to maximize their benefit.
- Informally, we refer to the infrastructure that supports
this paradigm as a federated cloud.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 21

THE RESERVOIR MODEL FOR FEDERATED

• Two roles in the RESERVOIR model:

• Service providers:
• The entities that understand the needs of a particular
business
• Offer service applications to address those needs.
• Do not own the computational resources.
• Infrastructure providers:
• Operate RESERVOIR sites that own and manage the physical
infrastructure on which service applications execute.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 22
ABOUT RESERVOIR SITE

VEE: virtual
execution
environment
VEE host: The
virtualized
computational
resources, and all
the management
enablement
components.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 23
TWO MODES OF CAPACITY PROVISIONING
1- Explicit capacity requirements for sized service applications:
– The service provider conducts sizing and capacity planning studies
of the service application.
– Then, the service provider precisely specifies the capacity needs of
the application under specific workload conditions. The minimal
service configuration, and the elasticity rules.
– The infrastructure provider commits itself to an infrastructure SLA
according to the specification above.
– Charged for actual capacity usage in line with the “pay as you go”
model.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 24
TWO MODES OF CAPACITY PROVISIONING
2- Implicit capacity requirements for unsized service
applications:
– In this mode, the service provider may have only initial
sizing estimations for its service or may not have them at
all.
– The infrastructure provider commits itself to an SLA that is
formulated in terms of high-level Service Level Objectives
(SLOs). (e.g., response time, throughput, etc.)
– Charged for the actual usage of capacity.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 25

– Optional: usage reports at various level of detail, minimal

SERVICE MANIFEST

• The manifest specifies a reference to a master image

that fully captures the functionality of the each
component types. Ex: OS, middleware, applications,
data, and configuration
• The manifest contains the information and rules
necessary to automatically create, unique VEE
instances that can run simultaneously without conflicts
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 26
SERVICE MANIFEST
• The manifest also specifies:
- The grouping of components into virtual networks and/or tiers that
form the service applications.
- The capacity requirements for an explicitly sized service application.
e.g., the number of virtual CPUs, memory size, storage pool size,
and the number of network interfaces and their bandwidth.
- A set of elasticity rules
• Correlate monitored Key Performance Indicators (KPIs) and load parameters with
resource allocations
• {(response time, throughput…) , (memory, CPU, bandwidth…}
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 27
SERVICE MANIFEST

• The capacity specification also includes the minimum and

maximum number of VEEs

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 28

THE RESERVOIR ARCHITECTURE

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 29

THE RESERVOIR COMPONENTS-THE
SERVICE MANAGER
- The Service Manager is the highest level of abstraction,
interacting with the service providers to receive their Service
Manifests, negotiate pricing, and handle billing.
- Its two most complex tasks are:
(1) deploying and provisioning VEEs based on the Service
Manifest, and
(2) monitoring and enforcing SLA compliance by throttling a
service application’s capacity.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 30
THE RESERVOIR COMPONENTS-THE
SERVICE MANAGER
• Finally, the Service Manager is responsible for accounting and
billing.
- Existing cloud computing infrastructures : inflexible, usually
employing fixed-cost post-paid subscription models
- Consider both post-paid and pre-paid billing models based on
resource usage. Based on the resource utilization information
provided by the Service Manager accounting system

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 31

THE VIRTUAL EXECUTION ENVIRONMENT
MANAGER(VEEM)
• VEEM is responsible for :
- The optimal placement of VEEs into VEE hosts subject to
constraints determined by the Service Manager. The VEEM is free to
place and move VEEs anywhere, even on the remote sites as long
as the placement satisfies the constraints.
• The VEEM also provides the functionality needed to handle the
dynamic nature of the service workload, such as the ability to add
and remove VEEs from an existing VEE Group, or to change the
capacity
CLOUD of aTHSsingle
COPUTING LECTURE- VEE.
NGUYEN DINH THO 32
VEEM

• In addition to serving local requests (from the local

Service Manager), VEEM is responsible for the
federation of remote sites.
–By taking the role of a Service Manager toward
the remote VEEM in all cross-site interactions.
–The primary VEEM does not get involved in the
internal placement decisions on the remote site,
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 33

as this is a concern of the remote VEEM

THE VIRTUAL EXECUTION ENVIRONMENT
HOST (VEEH)
• The VEEH is responsible for the basic control and monitoring of
VEEs and their resources
EX: creating a VEE, allocating additional resources to a VEE,
monitoring a VEE, migrating a VEE, creating a virtual network and
storage pool, etc
• Each VEEH type encapsulates a particular type of virtualization
technology, and all VEEH types expose a common interface
VEEM can issue generic commands to manage the life-cycle of VEEs
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 34
THE VIRTUAL EXECUTION ENVIRONMENT
HOST (VEEH)

• Moreover, VEEHs must support transparent VEE migration to

any compatible VEEH in a RESERVOIR cloud, regardless of
site location or network and storage configurations.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 35

LAYERS OF INTEROPERABILITY

• SMI : The Service Management Interface with its service manifest

exposes a standardized interface into the RESERVOIR Cloud for
service providers.
• VMI: The VEE Management Interface (VMI) simplifies the
introduction of different and independent IT optimization
strategies without disrupting other layers or peer VEEMs.
• VHI: The VEE Host Interface (VHI) will support plugging-in of new
virtualization platforms
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 36
 Monitoring Services

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 37

SLA-SERVICE LEVEL AGREEMENT

• A service-level agreement (SLA) is a commitment between a

service provider and a client. Particular aspects of the service
– quality, availability, responsibilities – are agreed between
the service provider and the service user. The most common
component of SLA is that the services should be provided to
the customer as agreed upon in the contract.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 38

SLA-SERVICE LEVEL AGREEMENT

• As an example, Internet service providers and telcos will

commonly include service level agreements within the terms
of their contracts with customers to define the level(s) of
service being sold in plain language terms. In this case the
SLA will typically have a technical definition in mean time
between failures (MTBF), mean time to repair or mean time
to recovery (MTTR); identifying which party is responsible for
reporting faults or paying fees; responsibility for various data
rates;
CLOUD COPUTINGthroughput; jitter;
LECTURE- THS NGUYEN DINH THO or similar measurable details.
https:// 39

en.wikipedia.org/wiki/Service-level_agreement
ARCHITECTURE FOR SLA MONITORING AND
MANAGEMENT

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 40

ARCHITECTURE FOR SLA MONITORING
AND MANAGEMENT

• The values of the SLA parameters are input for the evaluation
procedure, which can run on
- either the service user or service provider
- both the service user and service provider
- a third-party machine

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 41

SLA LIFE CYCLE

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 42

SLA LIFE CYCLE

1- Service and SLA Template Development:

This phase includes the identification of service
consumer needs, the identification of appropriate
service characteristics and parameters that can be
offered given the service execution environment, and
the preparation of standard SLA templates.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 43
SLA LIFE CYCLE

2- Negotiation: đàm phán

This phase includes the negotiation of the specific
values for the defined service parameters, the costs for
the service consumer, the costs for the service provider
when the SLA is violated, and the definition and
periodicity of reports to be provided to the service
consumer.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 44
SLA LIFE CYCLE

3- Preparation: chuẩn bị
The service (or a specific instance of it) is prepared
for consumption by the service consumer. This phase
may require the reconfiguration of the resources that
support service execution in order to meet SLA
parameters.
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 45
SLA LIFE CYCLE

4-Execution:
This phase is the actual operation of the service. It
includes service execution and monitoring, real-time
reporting, service quality validation, and real-time SLA
violation(vi phạm) processing.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 46

SLA LIFE CYCLE

5- Assessment: thẩm định, thương lượng, định giá

This phase has two parts:
a) assessment of the SLA and the QoS that is provided to
an individual consumer. QoS, consumer satisfaction,
potential improvements, and changing requirements are
reviewed periodically for each SLA.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 47

SLA LIFE CYCLE

5- Assessment: thẩm định, thương lượng, định giá

b) assessment of the overall service. This assessment can be
tied to an internal business review. Elements to be covered in
this review are the QoS provided to all consumers, the need for
the realignment of service goals and operations, the
identification of service support problems, and the
identification of the need for different service levels.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 48

SLA LIFE CYCLE

6-Termination and Decommission:

This phase deals with termination of the service for reasons
such as contract expiration or violation of contract, as well as
the ecommission of discontinued services.

https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=
8615
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 49
CLOUD PROVIDERS AND THEIR SLAS

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 50

DISCUSS- CLOUD PROVIDERS AND THEIR
SLAS

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 51

HTTPS://WWW.CLOUDENDURE.COM/BLOG/7-THINGS-TO-WATCH-OUT-FOR-CLOUD-PROVIDER-SLA/

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 52

 Service Quality Assurance in Cloud
Computing

• QUALITY OF SERVICE (QOS)

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 53

WHAT IS QUALITY OF SERVICE ?

• Quality of Service refers to the ability of networks to attain

maximum bandwidth and handle other network elements like
latency, error rate and uptime. Quality of Service include the
management of other networks resource by allocating
priorities to specific type of data (audio, video and file).

• https://
ijcsit.com/docs/Volume%208/vol8issue3/ijcsit2017080301.pdf54
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO
BASIC IMPLEMENTATION OF QOS NEED
THREE MAJOR COMPONENT

• QoS within one network element.

• QoS policy and management functions to control end-to-end
traffic across network.
• Identification techniques for coordinating QoS from end-to-
end between network elements

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 55

TECHNIQUES TO PROVIDE QOS OF CLOUD
APPLICATION:
1- Scheduling:
Cloud service scheduling categorized into two categories: user level and
system level.
- At user level scheduling deals with problems raised by service providing
between both service provider and customer. Market based and auction
based schedulers are fit for ruling the supply and demand of cloud
resources. Market based resource allocation is powerful in cloud
computing environment where resources are handed over to user as a
service
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 56
TECHNIQUES TO PROVIDE QOS OF CLOUD
APPLICATION:

- The system level scheduling handles with resource

management in datacenter. Datacenter contain many physical
machines, Million request sent from user’s side, scheduling
these requests to the physical machines done in datacenter.
This scheduling affect the performance of datacenter. Service
provisioning in cloud systems based on Service Level
Agreement (SLA)

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 57

TECHNIQUES TO PROVIDE QOS OF CLOUD
APPLICATION:
2- Admission Control:
- The main purpose of admission control is to provide strong performance
- At admission control time, the Infrastructure Provider (IP) must consider the
extra requirement along with the fundamental computational and
networking
Necessities that may be required to be added to runtime so it become flexible
- In many cases, these flexible requirements may be very large comparing it
to the normal requirements.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 58

TECHNIQUES TO PROVIDE QOS OF CLOUD
APPLICATION:
3- Resource provisioning:
- Dynamic resource provisioning is the process of assigning available
resources to the cloud application.
- Resource allocation will make services suffer if the allocation not
managed in the right way
- Resource provisioning will solve this problem by allowing the
service providers to manage the resources of modules individually

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 59

TECHNIQUES TO PROVIDE QOS OF CLOUD
APPLICATION:

• 3- Resource provisioning:
- Resource Allocation Strategy (RAS) is all about integrating
service provider services activities to allocate insufficient
resources within the limit of cloud environment so that it
meets the needs of the cloud application

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 60

CLASSIFICATION OF QOS METRICS.

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 61

https://ieeexplore.ieee.org/document/7815547/
 Error Control & Reliable

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 62

NOW- ABOUT FAILURE?

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 63

 Error Control & Reliable

• Error control is the technique of detecting and correcting

blocks of data during communication. In other words, it
checks the reliability of characters both at the bit level and
packet level. If proper error control is in place, transmitted
and received data is ensured to be identical, as in many
cases communication channels can be highly unreliable.

• https://www.techopedia.com/definition/6970/error-control-ec
CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 64
FAILURE MANAGEMENT

• A failure is defined as “when a cloud computing system fails

to perform a specific function according to its predefined
conditions”. We have identified four types of failures (service
failure, resource failure, correlated failure(thất bại tuong
quan) and independent failure(thất bại độc lập)) and
classified these failures in into two main categories: 1)
architecture based and 2) occurrence based

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 65

FAILURE MANAGEMENT
http://
www.buyya.com/papers/ReliableCloud-CiSE.pdf

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 66

TAXONOMY-PHÂN LOẠI

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 67

MODEL FOR RELIABLE CLOUD
COMPUTING

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 68

NOW- DISCUSS

CLOUD COPUTING LECTURE- THS NGUYEN DINH THO 69