![UGC NET Computer Science & Application book.pdf [Sample]](https://cdn.slidesharecdn.com/ss_thumbnails/freesampleugcnetcomputerscienceapplication5-221017120357-ff322815-thumbnail.jpg?width=560&fit=bounds)
Ad
More Related Content
What's hot (20)
Similar to Cloud Computing MODULE 1 basics of cloud computing .ppt (20)
Ad
Recently uploaded (20)
Ad
Cloud Computing MODULE 1 basics of cloud computing .ppt
- 1. CLOUD COMPUTING AND ITS APPLICATIONS Module 1 -Supritha. N, CSE,RNSIT
- 2. Cloud Computing at a Glance Cloud computing is a technological advancement that focuses on the way we design computing systems, develop applications, and leverage existing services for building software. It is based on the concept of dynamic provisioning, which is applied not only to services but also to compute capability, storage, networking, and information technology (IT) infrastructure in general. The users (consumers) need to pay providers only when they access the computing services. In addition, consumers no longer need to invest heavily or encounter difficulties in building and maintaining complex IT infrastructure. Cloud computing allows renting infrastructure, runtime environments, and services on a pay- per-use basis. Web 2.0 technologies play a central role in making cloud computing an attractive opportunity for building computing systems
- 3. The vision of cloud computing • Cloud computing allows anyone with a credit card to provision virtual hardware, runtime environments, and services. These are used for as long as needed, with no up-front commitments required. • The entire stack of a computing system is transformed into a collection of utilities, which can be provisioned and composed together to deploy systems in hours rather than days and with virtually no maintenance costs. • The long-term vision of cloud computing is that IT services are traded as utilities in an open market, without technological and legal barriers • In this cloud marketplace, cloud service providers and consumers, trading cloud services as utilities, play a central role.
- 5. Defining a cloud Definition given by Armbrust • “Cloud computing refers to both the applications delivered as services over the Internet and the hardware and system software in the datacenters that provide those services.” Definition given by U.S. National Institute of Standards and Technology (NIST): • “Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.” • It makes it possible to access online storage, rent virtual hardware, or use development platforms and pay only for their effective usage, with no or minimal up-front costs The utility-oriented nature of cloud computing is clearly expressed by Buyya: • “A cloud is a type of parallel and distributed system consisting of a collection of interconnected and virtualized computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements established through negotiation between the service provider and consumers.”
- 7. Advantages • Cloud computing is helping enterprises, governments, public and private institutions, and research organizations shape more effective and demand-driven computing systems • Large enterprises can offload some of their activities to cloud- based systems. • Small enterprises and start-ups can afford to translate their ideas into business results more quickly, without excessive up- front costs • System developers can concentrate on the business logic rather than dealing with the complexity of infrastructure management and scalability. • End users can have their documents accessible from everywhere and any device.
- 10. The three major models for deploying and accessing cloud computing environments are public clouds, private/enterprise clouds, and hybrid clouds Public clouds are the most common deployment models in which necessary IT infrastructure (e.g., virtualized datacenters) is established by a third-party service provider that makes it available to any consumer on a subscription basis. Private clouds : In 2010, the U.S. federal government, one of the world’s largest consumers of IT spending (around $76 billion on more than10,000 systems) started a cloud computing initiative aimed at providing government agencies with a more efficient use of their computing facilities. Governments and banks that have high security, privacy, and regulatory concerns prefer to build and use their own private or enterprise clouds. Whenever private cloud resources are unable to meet users’ quality-of-service requirements, hybrid computing systems, partially composed of public cloud resources and privately owned infrastructures, are created to serve the organization’s needs. These are often referred as hybrid clouds.
- 11. The cloud computing reference model
- 12. The cloud computing reference model • It is possible to classify cloud computing services offerings into three major categories: Infrastructure-as-a-Service(IaaS), Platform-as-a-Service(PaaS), and Software-as-a-Service (SaaS). These categories are related to each other as described in Figure 1.5. • At the base of the stack, Infrastructure-as-a-Service solutions deliver infrastructure on demand in the form of virtual hardware, storage, and networking. • Virtual hardware is utilized to provide compute on demand in the form of virtual machine instances. • Virtual storage is delivered in the form of raw disk space or object store. • Virtual networking identifies the collection of services that manage the networking among virtual instances and their connectivity to the Internet or private networks.
- 13. • These services are backed by a core middleware platform that is responsible for creating the abstract environment where applications are deployed and executed. • At the top of the stack, Software-as-a-Service solutions provide applications and services on demand. • Most of the common functionalities of desktop applications—such as office automation, document management, photo editing, and customer relationship management (CRM) software—are replicated on the provider’s infrastructure and made more scalable and accessible through a browser on demand. • The SaaS layer is also the area of social networking Websites, which leverage cloud-based infrastructures to sustain the load generated by their popularity. • Each layer provides a different service to users.
- 14. Characteristics and benefits No upfront infrastructure investment No procuring hardware, setup, hosting, power, etc.. On demand access Lease what you need and when you need.. Efficient Resource Allocation Globally shared infrastructure, can always be kept busy by serving users from different time zones/regions... Fair Pricing Based on Usage, QoS, Supply and Demand, Loyalty, … Application Acceleration Parallelism for large-scale data analysis, what-if scenarios studies… Highly Availability, Scalable, and Energy Efficient Supports Creation of 3rd Party Services & Seamless offering Builds on infrastructure and follows similar Business model as Cloud
- 15. Challenges ahead • As any new technology develops and becomes popular, new issues have to be faced. Cloud computing is not an exception. • New, interesting problems and challenges are regularly being posed to the cloud community, including IT practitioners, managers, governments, and regulators. • In the Infrastructure-as-a-Service domain, how many resources need to be provisioned, and for how long should they be used, in order to maximize the benefit? • Technical challenges also arise for cloud service providers for the management of large computing infrastructures and the use of virtualization technologies on top of them.
- 16. Challenges ahead • Issues and challenges concerning the integration of real and virtual infrastructure need to be taken into account from different perspectives, such as security and legislation. • Security in terms of confidentiality, secrecy, and protection of data in a cloud environment is another important challenge • Legal issues may also arise: These are specifically tied to the ubiquitous nature of cloud computing, which spreads computing infrastructure across diverse geographical locations. Different legislation about privacy in different countries may potentially create disputes as to the rights that third parties (including government agencies) have to your data
- 21. Historical developments • The idea of renting computing services by leveraging large distributed computing facilities has been around for long time. • It dates back to the days of the mainframes in the early 1950s. From there on, technology has evolved and been refined. • Five core technologies that played an important role in the realization of cloud computing. • These technologies are distributed systems, virtualization, Web 2.0, service orientation, and utility computing.
- 23. Historical developments(Contd..) • Distributed Systems – Clouds are essentially large distributed computing facilities that make available their services to third parties on demand. – A distributed system is a collection of independent computers that appears to its users as a single coherent system. – The primary purpose of distributed systems is to share resources and utilize them better. – Distributed systems often exhibit other properties such as heterogeneity, openness, scalability, transparency, concurrency, continuous availability, and independent failures.
- 24. Three major milestones have led to cloud computing: mainframe computing, cluster computing, and grid computing. Mainframes: These were the first examples of large computational facilities leveraging multiple processing units. Mainframes were powerful, highly reliable computers specialized for large data movement and massive input/output (I/O) operations They were mostly used by large organizations for bulk data processing tasks such as online transactions, enterprise resource planning, and other operations involving the processing of significant amounts of data. One of the most attractive features of mainframes was the ability to be highly reliable computers that were “always on” and capable of tolerating failures transparently.
- 25. • Clusters: (HOMOGENOUS) Cluster computing started as a low-cost alternative to the use of mainframes and supercomputers. – Starting in the 1980s, clusters become the standard technology for parallel and high-performance computing. – Built by commodity machines, they were cheaper than mainframes and made high-performance computing available to a large number of groups, including universities and small research labs – Cluster technology contributed considerably to the evolution of tools and frameworks for distributed computing, including Parallel Virtual Machine (PVM), and Message Passing Interface (MPI) .
- 26. • Grids: (HETEROGENOUS) Grid computing appeared in the early 1990s as an evolution of cluster computing. In an analogy to the power grid, grid computing proposed a new approach to access large computational power, huge storage facilities and a variety of services. • Users can “consume” resources in the same way as they use other utilities such as power, gas, and water. Grids initially developed as aggregations of geographically dispersed clusters by means of Internet connections.
- 28. Virtualization • Core technology for cloud computing. • A technology that allows creation of different computing environments. • Virtualization technologies are also used to replicate runtime environments for programs • Applications in the case of process virtual machines instead of being executed by the operating system, are run by a specific program called a virtual machine. • Ex: JVM
- 29. • Process virtual machines offer a higher level of abstraction with respect to hardware virtualization, since the guest is only constituted by an application. • This approach is used in cloud computing to provide a platform for scaling applications on demand, such as Google AppEngine and Windows Azure.
- 31. Web 2.0 • The Web is the primary interface through which cloud computing delivers its services. • At present, the Web encompasses a set of technologies and services that facilitate interactive information sharing, collaboration, user-centered design, and application composition. • Web 2.0 brings interactivity and flexibility into Web pages, providing enhanced user experience by gaining Web-based access to all the functions that are normally found in desktop applications. • Examples of Web 2.0 applications are Google Documents, Google Maps, Flickr, Facebook, Twitter, YouTube • In particular, social networking Websites take the biggest advantage of Web 2.0.
- 32. Service-oriented computing Here, services are the main building blocks of application and system development. Service-oriented computing (SOC) supports the development of rapid, low-cost, flexible, interoperable, and evolvable applications and systems. A service is an abstraction representing a self-describing and platform- independent component that can perform any function—anything from a simple function to a complex business process Virtually any piece of code that performs a task can be turned into a service and expose its functionalities through a network-accessible protocol
- 33. • Service-oriented computing introduces and diffuses two important concepts, which are also fundamental to cloud computing: Quality of service (QoS) and Software-as-a- Service(SaaS). • Quality of service (QoS) identifies a set of functional and nonfunctional attributes that can be used to evaluate the behavior of a service from different perspectives. • These could be performance metrics such as response time, or security attributes, transactional integrity, reliability, scalability, and availability.
- 34. • The concept of Software-as-a-Service introduces a new delivery model for applications. • Software-as-a-Service is derived from ASP :application service providers • The SaaS approach reaches its full development with service- oriented computing (SOC), where loosely coupled software components can be exposed and priced singularly, rather than entire applications. • One of the most popular expressions of service orientation is represented by Web Services (WS): are software components that expose functionalities accessible using a method invocation pattern that uses HTTP • The standards and specifications concerning Web services are controlled by the World Wide Web Consortium (W3C).
- 35. • Web services communicate over a network through HTTP between the two systems. • Many web services are identical to SOA (Services Oriented Architecture) and mainly rely on standards such as XML-RPC and SOAP (Simple Object Access Protocol). • Suppose we have an application on mobile, one on the website and one on the desktop and all of them want to get the information of the user A, then they just need to send a request to the application A with the ID of the user they want to get the information. • When the application A receives the request, it will send back an XML response regardless of where the request is sent from and what language is used. We can see that the exchange of data between applications doesn’t rely on the language or the environment.
- 36. Utility-oriented computing Utility computing is a vision of computing that defines a service-provisioning model for compute services in which resources such as storage, compute power, applications, and infrastructure are packaged and offered on a pay- per-use basis. The idea of providing computing as a utility like natural gas, water, power, and telephone connection has a long history but has become a reality today with the advent of cloud computing.
- 37. IBM and other mainframe providers offered mainframe power to organizations such as banks and government agencies through their datacenters. From an application and system development perspective, service-oriented computing and service- oriented architectures (SOAs) introduced the idea of leveraging external services for performing a specific task within a software system
- 38. Building cloud computing environments Application development • One class of applications that takes the biggest advantage of cloud computing features is that of Web applications- Upscaling based on Demand: Workload varies as per varying user demands. • Another class of applications that can potentially gain considerable advantage by leveraging cloud computing is represented by resource-intensive applications. – These can be either data intensive or compute-intensive applications. In both cases, considerable amounts of resources are required to complete execution in a reasonable timeframe. Example: Scientific applications need huge computing power and infrastructure but not all the time
- 39. Infrastructure and system development • Distributed computing, virtualization, service orientation, Web 2.0 form the core technologies enabling the provisioning of cloud services from anywhere on the globe. • Distributed computing is a foundational model for cloud computing • The extreme dynamism of cloud systems—where new nodes and services are provisioned on demand. • Infrastructure-as-a-Service solutions provide the capabilities to add and remove resources into the cloud • Platform-as-a-Service solutions embed into their core offering algorithms and rules that control the provisioning process and the lease of resources
- 41. • Amazon web services (AWS) • Google AppEngine : PaaS • Microsoft Azure • Hadoop • Salesforce.com • Manjrasoft Aneka Computing platforms and technologies
- 43. Amazon web services (AWS) • AWS offers comprehensive cloud IaaS services ranging from virtual compute, storage and networking to complete computing stacks. • AWS is mostly known for its compute and storage-on demand services, namely Elastic Compute Cloud (EC2) and Simple Storage Service (S3) • EC2 provides users with customizable virtual hardware that can be used as the base infrastructure for deploying computing systems on the cloud.
- 44. • EC2 allows the user to configure their instances as per their requirements i.e. allocate the RAM, ROM, and storage according to the need of the current task. • Even the user can dismantle the virtual device once its task is completed and it is no more required. • EC2 also provides the capability to save a specific running instance as an image, thus allowing users to create their own templates for deploying systems • Further, these templates are stored into S3 that delivers persistent storage on demand and can be accessed from anywhere.
- 45. Google AppEngine PaaS • Google AppEngine is a scalable runtime environment devoted to executing Web applications. • AppEngine provides both a secure execution environment and a collection of services that simplify the development of scalable and high-performance Web applications. • Its services include in-memory caching, scalable data store, job queues, messaging • Developers can build and test applications on their own machines using the AppEngine software development kit (SDK), which replicates the production runtime environment and helps test and profile applications. • Once development is complete, developers can easily migrate their application to AppEngine, set quotas to contain the costs generated, and make the application available to the world
- 47. Microsoft Azure Microsoft Azure is a cloud operating system and a platform for developing applications in the cloud. It provides a scalable runtime environment for Web applications and distributed applications in general. Applications in Azure are organized around the concept of roles, which identify a distribution unit for applications and represent the application’s logic. Currently, there are three types of role: Web role, worker role, and virtual machine role. The Web role is designed to host a Web application, the worker role is a more generic container of applications and can be used to perform workload processing, and the virtual machine role provides a virtual environment in which the computing stack can be fully customized, including the operating systems
- 48. Hadoop • Apache Hadoop is an open-source framework that is suited for processing large data sets on product hardware. • Hadoop is an implementation of MapReduce, an application programming model developed by Google, which provides two fundamental operations for data processing: map and reduce. • The former transforms and synthesizes the input data provided by the user; the latter aggregates the output obtained by the map operations.
- 50. • Hadoop provides the runtime environment, and developers need only provide the input data and specify the map and reduce functions that need to be executed. • Hadoop is an integral part of the Yahoo! cloud infrastructure and supports several business processes of the company. • Currently, Yahoo! manages the largest Hadoop cluster in the world, which is also available to academic institutions.
- 51. Force.com or Salesforce.com • SalesForce.com is a cloud computing platform for developing social enterprise applications. • The platform is the basis for SalesForce.com, a Software-as-a- Service solution for customer relationship management. • Force.com allows developers to create applications by composing ready-to-use blocks; a complete set of components supporting all the activities of an enterprise are available. • The Force.com platform is completely hosted on the cloud and provides complete access to its functionalities and those implemented in the hosted applications through Web services
- 52. Manjrasoft Aneka • Manjrasoft Aneka is a cloud application platform for rapid creation of scalable applications and their deployment on various types of clouds in a seamless and elastic manner. • It supports a collection of programming abstractions for developing applications and a distributed runtime environment that can be deployed on heterogeneous hardware (clusters, networked desktop computers, and cloud resources). • Developers can choose different abstractions to design their application: tasks, distributed threads and map-reduce • These applications are then executed on the distributed service-oriented runtime environment, which can dynamically integrate additional resource on demand.
- 53. Virtualization • Virtualization technology is one of the fundamental components of cloud computing, especially in regard to infrastructure-based services • Virtualization allows the creation of a secure, customizable and isolated execution environment for running applications • For example, we can run Windows OS on top of a virtual machine, which itself is running on Linux OS/MAC OS
- 56. Factors (Virtualization) • Increased performance and computing capacity: Nowadays, the average end-user desktop PC is powerful enough to meet almost all the needs of everyday computing, with extra capacity that is rarely used. • Underutilized hardware and software resources: Hardware and software underutilization is occurring due to (1) increased performance and computing capacity, and (2) the effect of limited or irregular use of resources • Lack of space: The continuous need for additional capacity, whether storage or compute power, makes data centers grow quickly. Companies such as Google and Microsoft expand their infrastructures by building data centers as large as football fields that are able to host thousands of nodes • Greening initiatives: Recently, companies are increasingly looking for ways to reduce the amount of energy they consume and to reduce their carbon footprint. Data centers are one of the major power consumers • Rise of administrative costs: Power consumption and cooling costs have now become higher than the cost of IT equipment
- 57. Virtualization Reference Model Virtualization is a broad concept that refers to the creation of a virtual version of something, whether hardware, a software environment, storage, or a network. In a virtualized environment there are three major components: guest, host, and virtualization layer The guest represents the system component that interacts with the virtualization layer rather than with the host. The host represents the original environment where the guest is supposed to be managed. The virtualization layer is responsible for recreating the same or a different environment where the guest will operate
- 59. Virtualization Reference Model In the case of hardware virtualization, the guest is represented by a system image comprising an operating system and installed applications The applications are installed on top of virtual hardware that is controlled and managed by the virtualization layer, also called the virtual machine manager- controls and filters the activity of the guest, thus preventing some harmful operations being performed. The host is instead represented by the physical hardware, and in some cases the operating system, that defines the environment where the virtual machine manager is running
- 60. Characteristics of virtualized environments • Increased security: The ability to control the execution of a guest in a completely transparent manner opens new possibilities for delivering a secure, controlled execution environment. • For example, applets downloaded from the Internet run in a sandboxed version of the Java Virtual Machine (JVM), which provides them with limited access to the hosting operating system resources. • Both the JVM and the .NET runtime provide extensive security policies for customizing the execution environment of applications. • Hardware virtualization solutions such as VMware Desktop, VirtualBox, and Parallels provide the ability to create a virtual computer with customized virtual hardware on top of which a new operating system can be installed
- 61. • Managed execution: In particular, sharing, aggregation, emulation, and isolation are the most relevant features.
- 62. Sharing: Virtualization allows the creation of a separate computing environment within the same host. In this way it is possible to fully exploit the capabilities of a powerful guest, which would otherwise be underutilized Aggregation: Not only is it possible to share physical resource among several guests, but virtualization also allows aggregation, which is the opposite process. A group of separate hosts can be tied together and represented to guests as a single virtual host Emulation: Guest programs are executed within an environment that is controlled by the virtualization layer, which ultimately is a program. This feature becomes very useful for testing purposes, where a specific guest has to be validated against different platforms or architectures and the wide range of options is not easily accessible during development
- 63. • Isolation: Virtualization allows providing guests— whether they are operating systems, applications, or other entities—with a completely separate environment, in which they are executed • Isolation brings several benefits; for example, it allows multiple guests to run on the same host without interfering with each other • Second, it provides a separation between the host and the guest
- 64. • The concept of portability applies in different ways according to the specific type of virtualization considered. • In the case of a hardware virtualization solution, the guest is packaged into a virtual image that, in most cases, can be safely moved and executed on top of different virtual machines • In the case of programming-level virtualization, as implemented by the JVM or the .NET runtime, the binary code representing application components (jars or assemblies) can be run without any recompilation on any implementation of the corresponding virtual machine.
- 65. Taxonomy of virtualization techniques
- 66. Taxonomy of virtualization techniques • Virtualization is mainly used to emulate execution environments, storage, and networks • In particular we can divide these execution virtualization techniques into two major categories by considering the type of host they require • Process-level techniques are implemented on top of an existing operating system, which has full control of the hardware. • System-level techniques are implemented directly on hardware and do not require—or require a minimum of support from—an existing operating system
- 67. Execution virtualization techniques • Execution virtualization includes all techniques that aim to emulate an execution environment that is separate from the one hosting the virtualization layer. • All these techniques concentrate their interest on providing support for the execution of programs, whether these are the operating system, a binary specification of a program compiled against an abstract machine model, or an application.
- 68. Machine reference model Virtualizing an execution environment at different levels of the computing stack requires a reference model that defines the interfaces between the levels of abstractions, which hide implementation details. At the bottom layer, the model for the hardware is expressed in terms of the Instruction Set Architecture(ISA), which defines the instruction set for the processor, registers, memory, and interrupt management
- 70. • ISA is the interface between hardware and software, and it is important to the operating system (OS)developer (System ISA) and developers of applications that directly manage the underlying hardware (User ISA). • The application binary interface (ABI) separates the operating system layer from the applications and libraries, which are managed by the OS. • Low level data types and System calls are defined at this level. • This interface allows portability of applications and libraries across operating systems that implement the same ABI
- 71. • The highest level of abstraction is represented by the application programming interface (API), which interfaces applications to libraries and/or the underlying operating system. • For any operation to be performed in the application level API, ABI and ISA are responsible for making it happen • The machine-level resources, such as processor registers and main memory capacities, are used to perform the operation at the hardware level of the central processing unit (CPU). • This layered approach simplifies the development and implementation of computing systems and simplifies the implementation of multitasking and the coexistence of multiple executing environments
- 72. Security Rings and Privileged Mode
- 73. • Ring 0, Ring 1, Ring 2, and Ring 3; Ring 0 is in the most privileged level and Ring 3 in the least privileged level. • Ring 0 is used by the kernel of the OS, rings 1and 2 are used by the OS-level services, and Ring 3 is used by the user. • All the current systems support at least two different execution modes: supervisor mode and user mode. • The first mode denotes an execution mode in which all the instructions (privileged and nonprivileged) can be executed without any restriction. • This mode, also called master is used by the operating system to perform sensitive operations on hardware level resources.
- 75. • In user mode, there are restrictions to control the machine-level resources • Some instructions can be invoked as privileged instructions under some conditions and as nonprivileged instructions under other conditions. • The distinction between user and supervisor mode allows us to understand the role of the hypervisor . • Hypervisors are run in supervisor mode
- 76. Hardware-level virtualization • Hardware-level virtualization is a virtualization technique that provides an abstract execution environment in terms of computer hardware on top of which a guest operating system can be run. • In this model, the guest is represented by the operating system, the host by the physical computer hardware, the virtual machine by its emulation, and the virtual machine manager by the hypervisor • The hypervisor is generally a program or a combination of software and hardware that allows the abstraction of the underlying physical hardware
- 77. • Hardware-level virtualization is also called system virtualization, since it provides ISA to virtual machines, which is the representation of the hardware interface of a system. • This is to differentiate it from process virtual machines, which expose ABI to virtual machines.
- 79. Hypervisors • A fundamental element of hardware virtualization is the hypervisor, or virtual machine manager (VMM). • There are two major types of hypervisor: Type I and Type II • Type I hypervisors run directly on top of the hardware. – This type of hypervisor is also called a native virtual machine since it runs natively on hardware. • Type II hypervisors require the support of an operating system to provide virtualization services. – This type of hypervisor is also called a hosted virtual machine since it is hosted within an operating system.
- 81. Hypervisors
- 84. VMM-Design and architecture • Three main modules, dispatcher, allocator, and interpreter, coordinate their activity in order to emulate the underlying hardware. • The dispatcher constitutes the entry point of the monitor and reroutes the instructions issued by the virtual machine instance to one of the two other modules. • The allocator is responsible for deciding the system resources to be provided to the VM: whenever a virtual machine tries to execute an instruction that results in changing the machine resources associated with that VM, the allocator is invoked by the dispatcher • The interpreter module consists of interpreter routines. – These are executed whenever a virtual machine executes a privileged instruction: a trap is triggered and the corresponding routine is executed.
- 85. Virtual machine manager Three properties have to be satisfied: • Equivalence: A guest running under the control of a virtual machine manager should exhibit the same behavior as when it is executed directly on the physical host. • Resource control: The virtual machine manager should be in complete control of virtualized resources. • Efficiency: A statistically dominant fraction of the machine instructions should be executed without intervention from the virtual machine manager. • Popek and Goldberg provided a classification of the instruction set and proposed three theorems that define the properties that hardware instructions need to satisfy in order to efficiently support virtualization.
- 86. THEOREM 3.1 • For any conventional third-generation computer, a VMM may be constructed if the set of sensitive instructions for that computer is a subset of the set of privileged instructions. • This theorem establishes that all the instructions that change the configuration of the system resources should generate a trap in user mode and be executed under the control of the virtual machine manager
- 87. THEOREM 3.2 • A conventional third-generation computer is recursively virtualizable if: • It is virtualizable • A VMM without any timing dependencies can be constructed for it. Recursive virtualization is the ability to run a virtual machine manager on top of another virtual machine manager. This allows nesting hypervisors as long as the capacity of the underlying resources can accommodate that
- 89. THEOREM 3.3 • A hybrid VMM may be constructed for any conventional third-generation machine in which the set of user-sensitive instructions is a subset of the set of privileged instructions. • There is another term, hybrid virtual machine (HVM), which is less efficient than the virtual machine system. • In the case of an HVM, more instructions are interpreted rather than being executed directly.
- 90. Hardware virtualization techniques 1. Hardware-assisted virtualization: • This term refers to a scenario in which the hardware provides architectural support for building a virtual machine manager able to run a guest operating system in complete isolation. • This technique was originally introduced in the IBM System/370 • At present , examples of hardware-assisted virtualization are the extensions to the x86-64 bit architecture introduced with Intel VT (formerly known as Vanderpool) and AMD V (formerly known as Pacifica)
- 91. 2. Full virtualization Full virtualization refers to the ability to run a program, most likely an operating system, directly on top of a virtual machine and without any modification. To make this possible, virtual machine managers are required to provide a complete emulation of the entire underlying hardware. The principal advantage of full virtualization is complete isolation, which leads to enhanced security, ease of emulation of different architectures, and coexistence of different systems on the same platform. Ex: an experimental new OS can be run simultaneously along with old OS without interference. A successful and efficient implementation of full virtualization is obtained with a combination of hardware and software, not allowing potentially harmful instructions to be executed directly on the host
- 92. trapped
- 93. 3. Paravirtualization • Paravirtualization techniques expose a software interface to the virtual machine that is slightly modified from the host and as a consequence, guests OS needs to be modified before installing. • The aim is to provide the capability to demand the execution of performance-critical operations directly on the host, thus preventing performance losses. • This technique has been successfully used by Xen for providing virtualization solutions for Linux based operating systems specifically ported to run on Xen hypervisors.
- 95. 4.Partial virtualization • Partial virtualization provides a partial emulation of the underlying hardware, thus not allowing the complete execution of the guest operating system in complete isolation • Partial virtualization allows many applications to run transparently, but not all the features of the operating system can be supported, as happens with full virtualization • An example of partial virtualization is address space virtualization used in time-sharing systems; this allows multiple applications and users to run concurrently in a separate memory space, but they still share the same hardware resources (disk, processor, and network).
- 99. The Java virtual machine was originally designed for the execution of programs written in the Java language, but other languages such as Python, Pascal, Groovy, and Ruby were made available The ability to support multiple programming languages has been one of the key elements of the Common Language Infrastructure (CLI), which is the specification behind .NET Framework. Both Java and the CLI are stack-based virtual machines The byte codes generated by compilers, perform some operations with them, and put the result on the stack. Stack-based virtual machines possess the property of being easily interpreted and executed simply by lexical analysis and hence are easily portable over different architectures.
- 100. An alternative solution is offered by register-based virtual machines, in which the reference model is based on registers An example of a register-based virtual machine is Parrot, a programming-level virtual machine that was originally designed to support the execution of PERL. Programs compiled into byte code can be executed on any operating system and platform for which a virtual machine able to execute that code The implementation of the virtual machine for different platforms is still a costly task, but it is done once and not for any application.
- 103. Application-level virtualization Application-level virtualization is a technique allowing applications to be run in runtime environments that do not natively support all the features required by such applications. Wine is a software application allowing Unix-like operating systems to execute programs written for the Microsoft Windows platform. A similar solution for the Mac OS X environment is CrossOver, which allows running Windows applications directly on the Mac OS X. VMware ThinApp, another product in this area, allows capturing the setup of an installed application and packaging it into an executable image isolated from the hosting operating system.
- 105. Other types of virtualization • Storage virtualization: • Storage virtualization is a system administration practice that allows decoupling the physical organization of the hardware from its logical representation. • Using this technique, users do not have to be worried about the specific location of their data, which can be identified using a logical path. • There are different techniques for storage virtualization, one of the most popular being network-based virtualization by means of storage area networks (SANs). • SANs use a network-accessible device through a large bandwidth connection to provide storage facilities.
- 106. • Network virtualization • Network virtualization combines hardware appliances and specific software for the creation and management of a virtual network • Network virtualization can aggregate different physical networks into a single logical network (external network virtualization) or provide network- like functionality to an operating system partition (internal network virtualization). • The result of external network virtualization is generally a virtual LAN (VLAN). • A VLAN is an aggregation of hosts that communicate with each other as though they were located under the same broadcasting domain
- 107. Desktop virtualization Desktop virtualization abstracts the desktop environment available on a personal computer in order to provide access to it using a client/server approach. Similarly to hardware virtualization, desktop virtualization makes accessible a different system as though it were natively installed on the host, but this system is remotely stored on a different host and accessed through a network connection. The advantages of desktop virtualization are high availability, persistence, accessibility, and ease of management.
- 108. • Application server virtualization • Application server virtualization abstracts a collection of application servers that provide the same services as a single virtual application server by using load-balancing strategies and providing a high-availability infrastructure for the services hosted in the application server • This is a particular form of virtualization and serves the same purpose of storage virtualization: providing a better quality of service rather than emulating a different environment.
- 110. Live Migration and Server Consolidation
- 111. Pros and cons of virtualization • Advantages of virtualization Managed execution and isolation are perhaps the most important advantages of virtualization Portability is another advantage of virtualization, especially for execution virtualization techniques Java programs are “compiled once and run everywhere”; they only require that the Java virtual machine be installed on the host Portability and self-containment also contribute to reducing the costs of maintenance, since the number of hosts is expected to be lower than the number of virtual machine instances.
- 112. Disadvantages of Virtualization Performance degradation • Since virtualization interposes an abstraction layer between the guest and the host, the guest can experience increased latencies. Inefficiency and degraded user experience • Virtualization can sometime lead to an inefficient use of the host. • In particular, some of the specific features of the host cannot be exposed by the abstraction layer and then become inaccessible • In the case of programming-level virtual machines, some of the features of the underlying operating systems may become inaccessible unless specific libraries are used • For example, in the first version of Java the support for graphic programming was very limited and the look and feel of applications was very poor compared to native applications. • These issues have been resolved by providing a new framework called Swing for designing the user interface, and further improvements have been done by integrating support for the OpenGL libraries
- 113. Security holes and new threats Virtualization opens the door to a new and unexpected form of phishing The capability of emulating a host in a completely transparent manner has led the way to malicious programs that are designed to extract sensitive information from the guest. Examples of these kinds of malware are BluePill and SubVirt. BluePill, malware targeting the AMD processor family, moves the execution of the installed OS within a virtual machine SubVirt infects the guest OS, and when the virtual machine is rebooted, it gains control of the host. Modified versions of the runtime environment can access sensitive information or monitor the memory locations utilized by guest applications
- 114. Disadvantages of Virtualization • The diffusion of many kinds of malware is facilitated by the fact that originally, hardware and CPUs were not manufactured with virtualization in mind. • The existing instruction sets cannot be simply changed to suits the needs of virtualization. • Recently both Intel and AMD have introduced hardware support for virtualization with Intel-V and AMD Pacifica. • The same considerations can be made for programming-level virtual machines: Modified versions of the runtime environment can access sensitive information or monitor the memory locations utilized by guest applications while these are executed
- 115. Technology examples: Xen: paravirtualization • Xen is an open-source initiative implementing a virtualization platform based on paravirtualization • Initially developed by a group of researchers at the University of Cambridge in the United Kingdom • Xen-based technology is used for either desktop virtualization or server virtualization • It has also been used to provide cloud computing solutions by means of Xen Cloud Platform (XCP). • Xen is the most popular implementation of paravirtualization, which, in contrast with full virtualization, allows high-performance execution of guest operating systems.
- 117. • Guest operating systems are executed within domains, which represent virtual machine instances. • Moreover, specific control software, which has privileged access to the host and controls all the other guest operating systems, is executed in a special domain called Domain 0 • Many of the x86 implementations support four different security levels, called rings, where Ring 0 represent the level with the highest privileges and Ring 3 the level with the lowest ones. • Ring 0 for the kernel code, and Ring 3 for user application and nonprivileged OS code • A Xen-based system is managed by the Xen hypervisor, which runs in the highest privileged mode and controls the access of guest operating system to the underlying hardware.
- 118. VMware: full virtualization VMware’s technology is based on the concept of full virtualization, where the underlying hardware is replicated and made available to the guest operating system, which runs unaware of such abstraction layers and does not need to be modified. VMware implements full virtualization either in the desktop environment, by means of Type II hypervisors, or in the server environment, by means of Type I hypervisors. In both cases, full virtualization is made possible by means of direct execution (for non sensitive instructions) and binary translation (for sensitive instructions), thus allowing the virtualization of architecture such as x86. VMware provides additional tools and software that simplify the use of virtualization technology in a desktop environment, with tools enhancing the integration of virtual guests with the host
- 119. Full virtualization and binary translation • VMware is well known for the capability to virtualize x86 architectures, which runs unmodified on top of their hypervisors. • x86 architecture design does not satisfy the first theorem of virtualization, since the set of sensitive instructions is not a subset of the privileged instructions • This causes a different behavior when such instructions are not executed in Ring 0, which is the normal case in a virtualization scenario where the guest OS is run in Ring 1 • Generally, a trap is generated and the way it is managed differentiates the solutions in which virtualization is implemented for x86 hardware
- 121. This approach has both advantages and disadvantages. The major advantage is that guests can run unmodified in a virtualized environment, which is a crucial feature for operating systems for which source code is not available. This is the case, for example, of operating systems in the Windows family. Binary translation is a more portable solution for full virtualization. Translating instructions at runtime introduces an additional overhead that is not present in other approaches. VMware achieves full virtualization by providing virtual representation of memory and I/O devices. Memory virtualization constitutes another challenge of virtualized environments and can deeply impact performance without the appropriate hardware support
- 122. Virtualization solutions: End-user (desktop) virtualization • VMware supports virtualization of operating system environments and single applications on end user computers • Allows installing different operating systems and applications in a completely isolated environment from the hosting operating system • Specific VMware software—VMware Workstation, for Windows operating systems, and Vmware Fusion, for Mac OS X environments—is installed in the host operating system to create virtual machines and manage their execution • The two products allow a guest OS to leverage the resources of the host machine like USB devices, folder sharing, and integration with the graphical user interface (GUI) of the host operating system.
- 123. •
- 124. Virtualization solutions • The virtualization environment is created by an application installed in guest operating systems, which provides those operating systems with full hardware virtualization of the underlying hardware. • This is done by installing a specific driver called Vmware driver in the host operating system that provides two main services: 1. It deploys a virtual machine manager that can run in privileged mode. 2. It provides hooks for the VMware application to process specific I/O requests eventually by relaying such requests to the host operating system via system calls.
- 125. End-user (desktop) virtualization • Using this architecture—also called Hosted Virtual Machine Architecture— it is possible to both isolate virtual machine instances within the memory space of a single application and provide reasonable performance, since the intervention of the VMware application is required only for instructions, such as device I/O, that require binary translation • Instructions that can be directly executed are managed by the virtual machine manager, which takes control of the CPU and the MMU and alternates its activity with the host OS • Virtual machine images are saved in a collection of files on the host file system, and both VMware Workstation and VMware Fusion allow creation of new images, pause their execution, create snapshots, and undo operations by rolling back to a previous state of the virtual machine.
- 126. • Other solutions related to the virtualization of end-user computing environments include VMware Player, VMware ACE, and VMware ThinApp. • VMware Player is a reduced version of VMware Workstation that allows creating and playing virtual machines in a Windows or Linux operating environment. • VMware ACE, a similar product to VMware Workstation, creates policy- wrapped virtual machines for deploying secure corporate virtual environments on end-user computers • VMware ThinApp is a solution for application virtualization. It provides an isolated environment for applications in order to avoid conflicts due to versioning and incompatible applications.
- 128. Server virtualization • VMware provided initial support for server virtualization by introducing VMware GSX server, which replicates the approach used for end-user computers and introduces remote management and scripting capabilities. • The architecture is mostly designed to serve the virtualization of Web servers. • A daemon process, called serverd, controls and manages VMware application processes. • These applications are then connected to the virtual machine instances by means of the VMware driver installed on the host operating system • Virtual machine instances are managed by the VMM. • User requests for virtual machine management and provisioning are routed from the Web server through the VMM by means of serverd.
- 129. • VMware ESX Server and its enhanced version, VMWare ESXi Server, are examples of the hypervisor-based approach. • The two solutions provide the same services but differ in the internal architecture, more specifically in the organization of the hypervisor kernel. • VMware ESX embeds a modified version of a Linux operating system, which provides access through a service console to hypervisor • VMware ESXi implements a very thin OS layer and replaces the service console with interfaces and services for remote management, thus considerably reducing the hypervisor code size and memory footprint.
- 130. VMware ESXi • The architecture of VMware ESXi is shown in Figure 3.15. The base of the infrastructure is the VMkernel, which is a thin Portable Operating System Interface (POSIX) compliant operating system that provides the minimal functionality for processes and thread management, file system, I/O stacks, and resource scheduling. • The kernel is accessible through specific APIs called User world API. • Remote management of an ESXi server is provided by the CIM Broker, a system agent that acts as a gateway to the VM kernel for clients by using the Common Information Model (CIM)8 protocol. • The ESXi installation can also be managed locally by a Direct Client User Interface (DCUI), which provides a BIOS-like interface for the management of local users.
- 132. Infrastructure virtualization and cloud computing solutions • VMware provides a set of products covering the entire stack of cloud computing, from infrastructure management to Software-as-a-Service solutions hosted in the cloud. • Figure 3.16 gives an overview of the different solutions offered and how they relate to each other. • ESX and ESXi constitute the building blocks of the solution for virtual infrastructure management: • A pool of virtualized servers is tied together and remotely managed as a whole by VMware vSphere. As a virtualization platform it provides a set of basic services besides virtual compute services: • Virtual file system, virtual storage, and virtual network constitute the core of the infrastructure; application services, such as virtual machine migration, storage migration, data recovery, and security zones, complete the services offered by vSphere.
- 134. • The management of the infrastructure is operated by VMware vCenter, which provides centralized administration and management of vSphere installations in a data center environment. • A collection of virtualized data centers are turned into a Infrastructure-as-a-Service cloud by VMware vCloud, which allows service providers to make available to end users virtual computing environments on demand on a pay-per-use basis. • A Web portal provides access to the provisioning services of vCloud, and end users can self- provision virtual machines by choosing from available templates and setting up virtual networks among virtual instances.
- 135. • VMware also provides a solution for application development in the cloud with VMware vFabric, which is a set of components that facilitate the development of scalable Web applications on top of a virtualized infrastructure. • vFabric is a collection of components for application monitoring, scalable data management, and scalable execution and provisioning of Java Web applications. • Finally, at the top of the cloud computing stack, VMware provides Zimbra, a solution for office automation, messaging, and collaboration that is completely hosted in the cloud and accessible from anywhere.
- 136. Microsoft Hyper-V • Hyper-V is an infrastructure virtualization solution developed by Microsoft for server virtualization. • Uses a hypervisor-based approach to hardware virtualization, which leverages several techniques to support a variety of guest operating systems. • Hyper-V supports multiple and concurrent execution of guest operating systems by means of partitions. A partition is a completely isolated environment in which an operating system is installed and run. • Figure 3.17 provides an overview of the architecture of Hyper-V. Despite its straightforward installation as a component of the host operating system, Hyper-V takes control of the hardware, and the host operating system becomes a virtual machine instance with special privileges, called the parent partition.
- 137. Architecture: • The parent partition (also called the root partition) is the only one that has direct access to the hardware. • It runs the virtualization stack, hosts all the drivers required to configure guest operating systems, and creates child partitions through the hypervisor. • Child partitions are used to host guest operating systems and do not have access to the underlying hardware, but their interaction with it is controlled by either the parent partition or the hypervisor itself. • Hypervisor: The hypervisor is the component that directly manages the underlying hardware (processors and memory).It is logically defined by the following components:
- 139. Hypervisor • Hypercalls interface: This is the entry point for all the partitions for the execution of sensitive instructions. • This is an implementation of the paravirtualization approach already discussed with Xen. This interface is used by drivers in the partitioned operating system to contact the hypervisor using the standard Windows calling convention. The parent partition also uses this interface to create child partitions. • Memory service routines (MSRs): These are the set of functionalities that control the memory and its access from partitions. • By leveraging hardware-assisted virtualization, the hypervisor uses the Input/ Output Memory Management Unit (I/O MMU or IOMMU) to fast- track access to devices from partitions by translating virtual memory addresses.
- 140. • Advanced programmable interrupt controller (APIC): This component represents the interrupt controller, which manages the signals coming from the underlying hardware when some event occurs (timer expired, I/O ready, exceptions and traps). Each virtual processor is equipped with a synthetic interrupt controller (SynIC), which constitutes an extension of the local APIC. The hypervisor is responsible of dispatching, when appropriate, the physical interrupts to the synthetic interrupt controllers. • Scheduler: This component schedules the virtual processors to run on available physical processors. The scheduling is controlled by policies that are set by the parent partition.
- 141. • Address manager: This component is used to manage the virtual network addresses that are allocated to each guest operating system. • Partition manager: This component is in charge of performing partition creation, finalization, destruction, enumeration, and configurations. Its services are available through the hypercalls interface API previously discussed. • The hypervisor runs in Ring -1 and therefore requires corresponding hardware technology that enables such a condition. • By executing in this highly privileged mode, the hypervisor can support legacy operating systems that have been designed for x86 hardware. • Operating systems of newer generations can take advantage of the new specific architecture of Hyper-V especially for the I/O operations performed by child partitions.
- 142. • Enlightened I/O and synthetic devices • Enlightened I/O provides an optimized way to perform I/O operations, allowing guest operating systems to leverage an interpartition communication channel rather than traversing the hardware emulation stack provided by the hypervisor. • This option is only available to guest operating systems that are hypervisor aware. Enlightened I/O leverages VMBus, an interpartition communication channel that is used to exchange data between partitions (child and parent) and is utilized mostly for the implementation of virtual device drivers for guest operating systems.
- 143. • The architecture of Enlightened I/O is described in Figure3.17. • There are three fundamental components: VMBus, Virtual Service Providers (VSPs), and Virtual Service Clients(VSCs). • VMBus implements the channel and defines the protocol for communication between partitions. • VSPs are kernel-level drivers that are deployed in the parent partition and provide access to the corresponding hardware devices. These interact with VSCs, which represent the virtual device drivers (also called synthetic drivers) seen by the guest operating systems in the child partitions. • Operating systems supported by Hyper-V utilize this preferred communication channel to perform I/O for storage, networking, graphics, and input subsystems. • This also results in enhanced performance in child-to-child I/O as a result of virtual networks between guest operating systems. Legacy operating systems, which are not hypervisor aware, can still be run by Hyper-V but rely on device driver emulation, which is managed by the hypervisor and is less efficient.