CloudStack Automated Integration Testing with Marvin
Download as PPTX, PDF1 like351 views
Integration testing can be an intimidating task to tackle. Where do you start? What is Marvin? What is Jenkins and how does it apply to my testing efforts? How can I leverage a virtual infrastructure to minimize the number of physical hosts that are required? This presentation discusses approaches to leveraging these tools and building an automated regression test suite for a collection of ever-growing features.
![[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...](https://cdn.slidesharecdn.com/ss_thumbnails/36openinfra-2018-naver-cephfs-180704055415-thumbnail.jpg?width=560&fit=bounds)
![[OpenInfra Days Korea 2018] Day 1 - T4-7: "Ceph 스토리지, PaaS로 서비스 운영하기"](https://cdn.slidesharecdn.com/ss_thumbnails/47openinfradaykorea2018hyun-ha-180705032301-thumbnail.jpg?width=560&fit=bounds)
Ad
More Related Content
What's hot (20)
Similar to CloudStack Automated Integration Testing with Marvin (20)
![[OpenStack Days Korea 2016] Track2 - OpenStack 기반 소프트웨어 정의 스토리지 기술](https://cdn.slidesharecdn.com/ss_thumbnails/26mariocho-160226172641-thumbnail.jpg?width=560&fit=bounds)
Ad
More from NetApp (20)
Ad
Recently uploaded (20)
CloudStack Automated Integration Testing with Marvin
- 1. CloudStack Automated Integration Testing with Marvin
- 2. Mike Tutkowski ●CloudStack Software Engineer ●Member of CloudStack Project Management Committee (PMC) ●Focused on CloudStack’s storage component SolidFire (http://www.solidfire.com/) ●Based out of Boulder, CO ●Develop a scale-out SAN technology ●Built from the ground up to support guaranteed Quality of Service (QoS) on a per-volume (LUN) basis (min, max, and burst IOPS per volume) ●All-Flash Array ●Leverage compression, de-duplication, and thin provisioning (all inline) on a 4-KB block boundary across the entire cluster to drive down cost/GB to be on par with traditional disk- based SANs ●Rest-like API to enable automation of all aspects of the SAN
- 3. What is Marvin? Python Testing Framework for CloudStack * deployDataCenter module to make it easy to create a custom cloud (requires JSON input file) * Provides infrastructure for low-level communication with CS MS (cloudstackConnection module) * Easy-to-use modules for sending API commands to CloudStack (ex. CreateStoragePoolCmd) and receiving responses (ex. CreateStoragePoolResponse). * Common abstractions like StoragePool, Volume, Snapshot, Cluster, Host, etc. classes * Utility modules for performing common activities (ex. Restart the management server) * Write tests using the unittest module (start a test method with the word “test”, provide setup, teardown methods, etc.) https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+-+Testing+with+Python
- 4. nosetests test_cloudstack_server.py ************************************************************ import paramiko from nose import with_setup from nose.tools import assert_equals class TestStartCloudStackServer(): def setup(self): ssh = paramiko.SSHClient() ssh.set_missing_host_key_policy(paramiko.AutoAddPolicy()) ssh.connect('192.168.156.34', username='cloudstack', password='solidfire') def teardown(self): return @with_setup(setup, teardown) def test_start_cloudstack_server(self):
- 5. What needs to be automated? 1.Setup of the Test Environment 1.Creation of the Cloud Infrastructure in CloudStack 1.Test Scenarios
- 6. Testing Environment ESXi host with 3 VMs ●Ubuntu VM ●CS Management Server ●CS Database ●Secondary Storage (NFS share) ●2 XenServer VMs (add vhv.enable = true to VMX file of each VM) ●Hosts on which to run VMs
- 7. Setup of the Testing Environment 1.Talk to ESXi host: Revert Ubuntu VM and each XenServer VM to a snapshot. Start Ubuntu VM and each XenServer VM. 2.Put both XenServer hosts in the same resource pool (XenServer name for a cluster). 3.SSH into Ubuntu VM a.Update CloudStack codebase (git fetch upstream master) b.Build codebase (mvn -P developer,systemvm clean install) c.Rebuild the CloudStack database (mvn -P developer -pl developer -D deploydb) d.Run the CloudStack Management Server (mvn -pl client jetty:run)
- 8. Manual Setup of the Testing Environment
- 9. Automated Setup of the Testing Environment 1. Revert VMs PySphere (vSphere Python Module) 2. Put XenServer Hosts in Cluster xmlrpclib (Python Module) to send XenAPI commands 3. Run Management Server Paramiko (Python Module that implements SSH v2 protocol)
- 10. Creation of Our Cloud Infrastructure 1 Basic Zone 1 Pod 1 Cluster 2 XenServer Hosts 2 Primary Storages (local storage on each XenServer host) 1 Secondary Storage
- 11. Manual Creation of the Cloud Infrastructure
- 12. Automated Creation of the Cloud Infrastructure 1.Generate JSON Config File 1.Deploy Cloud with Marvin deployDataCenter module
- 13. Test Scenarios (Follow a Pattern) 1.Create Resources (SolidFire Primary Storage, Disk Offerings, Compute Offerings) 1.Run test scenarios 1.Verify CloudStack DB 1.Verify SolidFire SAN
- 15. Automated CloudStack Tests 1. Create Resources Marvin (setup section of test) 2. Run Test Scenarios Marvin (test* methods) 3. Verify CloudStack DB Marvin (test* methods) & Customized API Plug-in 4. Verify SolidFire SAN Marvin (test* methods) & SolidFire REST-like API (via SolidFire Python SDK)
- 16. Future tasks 1.Leverage Jenkins to Run Tests Nightly 1.Integration Tests for KVM and VMware 1.Integration with AT2