CLIF as a Service: Distributed performance testing in continuous integration within the OpenCloudware platform, OW2con'15, Paris.
1 like549 views
The OpenCloudware PaaS platform provides an advanced automated performance testing service, based on OW2's CLIF load injection framework. By enabling the CLIF as a Service (CLIFaaS) option for a given project from the OpenCloudware portal, the project team automatically gets a Jenkins continuous integration server enhanced with performance testing capabilities. Leveraging on the OpenCloudware PaaS' core services, CLIFaaS gracefully handles the full deployment, configuration and execution of both the distributed load injection system and the target distributed application. Once the test run is complete, a performance report is automatically generated and the test-supporting virtual machines are discarded.
![18th November 2015
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<ns1:Envelope xml:lang="en-US" xmlns:ns2="http://nonamespace" xmlns:ns1="http://schemas.dmtf.org/ovf/envelope/1"
xmlns:ns4="http://schemas.dmtf.org/wbem/wscim/1/common" xmlns:ns3="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData"
xmlns:ns5="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData">
[...]
<ns2:AppArchitectureSection>
[...]
<ns2:component name="paclif-node-1">
<ns2:interface name="localipinfo" role="server" signature="org.ow2.sirocco.vamp.deploy.common.wrapper.VampLegacyConfiguration"/>
<ns2:interface name="ipinfo" role="client" signature="org.ow2.sirocco.vamp.deploy.common.wrapper.VampLegacyConfiguration"/>
<ns2:content class="org.ow2.sirocco.vamp.wrappers.clif.PAClifNodeWrapper"/>
<ns2:attributes signature="org.ow2.sirocco.vamp.wrappers.clif.PAClifNodeAttributes">
<ns2:attribute name="proactiveNetRouterAddress" value="clif.rd.francetelecom.fr"/>
<ns2:attribute name="proactiveNetRouterPort" value="2000"/>
<ns2:attribute name="paClifRmHost" value="clif.rd.francetelecom.fr"/>
<ns2:attribute name="paClifRmPort" value="6000"/>
</ns2:attributes>
<ns2:virtual-node name="machine-1"/>
</ns2:component>
<ns2:binding client="springoo-rar.dbinfo" server="springoo-mysql.dbinfo"/>
<ns2:binding client="paclif-node-1.ipinfo" server="springoo-apache-lb.localipinfo"/>
[...]
</ns2:definition>
</ns2:AppArchitectureSection>
[...]
</ns1:Envelope>
VAMP's extensions to OVF
Image (software stack)
Id
Format
OS (id, distribution, version, arch.)
Package (id, version)
Data (id, type source, destination)
State defined | generating |
generated | published
Virtual Machine
Id
Cpu
Memory
NetworkItf (…)
Disk (id, capacity, imageId)
State stopped | started | failed
Applicative Component
Name
Interface (name, signature, role)
Attribute (name, value)
VirtualNode
State stopped | started | failed
Binding
Client
Server
State defined | established](https://image.slidesharecdn.com/b-dillenseger-re-vamp-clif-160111093313/85/CLIF-as-a-Service-Distributed-performance-testing-in-continuous-integration-within-the-OpenCloudware-platform-OW2con-15-Paris-7-320.jpg)
![1118th November 2015
Overall process
VAMPVAMP
virtual machines instantiation,
components configuration and start
OVF {application + load injectors}
CLIF scenario (workload definition)
SiroccoSirocco
UForgeUForge
Continuous
Integration
server
tester
load injectors
application
multi-IaaS
support
IaaS provider
VM image
generation and
publication
[optional]](https://image.slidesharecdn.com/b-dillenseger-re-vamp-clif-160111093313/85/CLIF-as-a-Service-Distributed-performance-testing-in-continuous-integration-within-the-OpenCloudware-platform-OW2con-15-Paris-11-320.jpg)
Ad
More Related Content
What's hot (19)
Viewers also liked (20)
Ad
Similar to CLIF as a Service: Distributed performance testing in continuous integration within the OpenCloudware platform, OW2con'15, Paris. (20)
Ad
More from OW2 (20)
Recently uploaded (20)
CLIF as a Service: Distributed performance testing in continuous integration within the OpenCloudware platform, OW2con'15, Paris.
- 1. 118th November 2015 Re-VAMP load testing with CLIF for continuous integration on the cloud Bruno Dillenseger, Xavier Etchevers Orange Labs Beyond the automatic build of your application components, would it be possible to automate the instantiation of necessary virtual machines over the cloud, the installation of necessary middleware, the deployment and the configuration of components, for both the application under test and the load injection system? If you liked the last year's talk about CLIF meeting Jenkins, you will enjoy their adventure with VAMP!
- 2. 218th November 2015 CLIF: OW2's load testing framework ➔ generic/extensible IP, VoIP, database, mobile networks, custom protocols... ➔ flexible Eclipse, Java Swing, command line, Maven, Jenkins ➔ advanced Millions of virtual users 1000+ distributed load injectors continuous research transfer ➔ mature more than 10 years feedback http://clif.ow2.org System Under Test Tester's console Load injectors
- 3. 318th November 2015 Load tests in continuous integration with the CLIF plug-in for Jenkins http://jenkins-ci.org/ ➔ Automated testing ➔ Automated reporting per-test report trends through tests ➔ The CLIF plug-in brings load testing and performance monitoring capabilities
- 4. 418th November 2015 Pending issues for load testing in continuous integration ➔ System Under Test Once built, automatically deploy and start the application for load testing Including IP addresses settings for distributed applications ➔ Load Injection automatically deploy and configure load injectors automatically provide the load test scenarios with the target IP address ➔ On which infrastructure?
- 5. 518th November 2015 VAMP: Virtual Appliance Management Platform ➔ VAMP deploys virtualized, distributed applications over the cloud pluggable IaaS drivers (e.g OpenStack) multi-IaaS support with the Sirocco driver generating and publishing virtual machines images through the UForge technology component-based description of the application's architecture advanced/autonomic management ● self-repair, elasticity (to appear)
- 6. 618th November 2015 Deployment life-cycle with VAMP Start Installation •Transfert •Intégration •(Post-)configuration Images Provisioning •Packaging •Publication in IaaS Applicative elements (binaries, data, packages …) Virtual appliance generated Virtual images published Virtual machines instantiated Applicative elements configured Application activated Publication Instantiation Configuration Activatio n Generation
- 7. 18th November 2015 <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <ns1:Envelope xml:lang="en-US" xmlns:ns2="http://nonamespace" xmlns:ns1="http://schemas.dmtf.org/ovf/envelope/1" xmlns:ns4="http://schemas.dmtf.org/wbem/wscim/1/common" xmlns:ns3="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:ns5="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData"> [...] <ns2:AppArchitectureSection> [...] <ns2:component name="paclif-node-1"> <ns2:interface name="localipinfo" role="server" signature="org.ow2.sirocco.vamp.deploy.common.wrapper.VampLegacyConfiguration"/> <ns2:interface name="ipinfo" role="client" signature="org.ow2.sirocco.vamp.deploy.common.wrapper.VampLegacyConfiguration"/> <ns2:content class="org.ow2.sirocco.vamp.wrappers.clif.PAClifNodeWrapper"/> <ns2:attributes signature="org.ow2.sirocco.vamp.wrappers.clif.PAClifNodeAttributes"> <ns2:attribute name="proactiveNetRouterAddress" value="clif.rd.francetelecom.fr"/> <ns2:attribute name="proactiveNetRouterPort" value="2000"/> <ns2:attribute name="paClifRmHost" value="clif.rd.francetelecom.fr"/> <ns2:attribute name="paClifRmPort" value="6000"/> </ns2:attributes> <ns2:virtual-node name="machine-1"/> </ns2:component> <ns2:binding client="springoo-rar.dbinfo" server="springoo-mysql.dbinfo"/> <ns2:binding client="paclif-node-1.ipinfo" server="springoo-apache-lb.localipinfo"/> [...] </ns2:definition> </ns2:AppArchitectureSection> [...] </ns1:Envelope> VAMP's extensions to OVF Image (software stack) Id Format OS (id, distribution, version, arch.) Package (id, version) Data (id, type source, destination) State defined | generating | generated | published Virtual Machine Id Cpu Memory NetworkItf (…) Disk (id, capacity, imageId) State stopped | started | failed Applicative Component Name Interface (name, signature, role) Attribute (name, value) VirtualNode State stopped | started | failed Binding Client Server State defined | established
- 8. 818th November 2015 OVF graphical modeler for VAMP
- 9. 918th November 2015 Back to load testing in Continuous Integration ➔ Supporting tools Jenkins for automating tests and reports CLIF for load injection VAMP for deploying the test application and the load injection system over a IaaS ➔ Input tested application build chain VAMP-enhanced OVF description ● application and load injectors combined CLIF test scenario
- 10. 1018th November 2015 CLIF and the application under test in the OVF modeler
- 11. 1118th November 2015 Overall process VAMPVAMP virtual machines instantiation, components configuration and start OVF {application + load injectors} CLIF scenario (workload definition) SiroccoSirocco UForgeUForge Continuous Integration server tester load injectors application multi-IaaS support IaaS provider VM image generation and publication [optional]
- 12. 1218th November 2015 It's time for demo! VAMPVAMP JOnAS
- 13. 1318th November 2015 It's time for conclusion... and questions? ➔ Demonstration of load testing (CLIF) in continuous integration (Jenkins) deployed on cloud (VAMP) ➔ References CLIF http://clif.ow2.org Sirocco http://sirocco.ow2.org VAMP svn://svn.forge.ow2.org/svnroot/sirocco/vamp UForge http://www.usharesoft.com ➔ Developed in the context of the Open Cloudware PaaS project http://www.opencloudware.org
- 14. 1418th November 2015 configurator agent Message Bus Very good question! deployment manager configurator agent VM0 VM1 VM2 Control Plane (VAMP) Applicative Plane (legacy application) VAMP manager The VAMP manager creates and repairs Deployment Managers. It may be inside or outside the IaaS The Deployment Manager (1 per application) creates applicative VMs and recreates them when they fail. Configurator Agents self- configure the application. The applicative components are configured through dedicated wrappers.