Agility EServices Performance Test

Summary Report for Internet Based

Version 1.0

Submitted To
Agility Logistics

Submitted By

www.AppLabs.com

22-01-2010

AppLabs Main Contact Details Client Main Contact Details

 

 Venkateswarlu Gunduboyina

 

 

Agility E Services AppLabs

Page |1
 Table of Contents
1 Introduction.............................................................................................................................. 3
1.1 About Agility E Services.........................................................................................................3
1.2 Project Background................................................................................................................ 3
1.3 Document Purpose................................................................................................................. 3
2 Executive Summary................................................................................................................4
3 Performance Test Results and Analysis: Client Side..........................................................6
3.1 Hits per second statistics:......................................................................................................6
3.2 Error statistics:......................................................................................................................... 7
3.3 Page Time:.............................................................................................................................. 8
3.4 Response Time statistics:....................................................................................................10
3.4.1 Agility E Services – Pre order booking....................................................................10
3.4.2 Agility E Services – Orderbooking............................................................................11
3.4.3 Agility E Services – Cargo Arrival............................................................................13
3.4.4 Agility E Services - Prepare Stuffing Plan...............................................................14
3.5 Throughput:........................................................................................................................... 16
4 Performance Test Results and Analysis: Server Side.......................................................17
5 Scope of Testing...................................................................................................................27
6 Test Approach....................................................................................................................... 28
7 Performance Observation and Recommendations............................................................30

Agility E Services AppLabs

Page |2
1 Introduction
1.1 About Agility E Services

Agility E Services is a Product of Agility Logistics – The GIL business group offers an integrated portfolio
of logistics solutions supported by a comprehensive network of warehousing facilities, transportation
and freight management services worldwide. DGS, our government contracting business group,
leverages our global logistics network and our track record of exceptional services to provide
comprehensive logistics solutions to the defence and government sector.

1.2 Project Background

Agility Logistics has several applications for its operations and is categorized into different applications
based on the criticality and business requirements.

AppLabs would do proof of concept (POC) test on the UAT staging server to demonstrate its
effectiveness in terms of reporting the client side and server side observation, identifying the bottleneck
and providing appropriate recommendation if any.

1.3 Document Purpose

The purpose of this document is to report the Agility E Services application performance for 750
concurrent user load with a defined transaction scenario and provide insight on the Application and
Database performance.
This document details the workload distribution exercised, measurements gathered for the application,
summary of tests performed, summary of measurements collected, results and conclusions

This document is intended for:

 Agility Management Team

 Project & Software Development Managers

 Service Delivery Manager

Agility E Services AppLabs

Page |3
2 Executive Summary

AppLabs is working towards testing the Agility E Services application in order to observe the
performance and identify any critical areas causing the response time delays. Agility E Services
application has various modules which have been deployed in IIS web server having SQL Server as the
database backend.

The objective of the test is to generate 750 concurrent user load on the Agility E Services application
over the Internet with specified transaction scenario and think times and to observe the client side and
server side performance. Agility team gave the application walkthrough on 28th December 2009.

Scripting of the defined scenarios was started using silk performer 2008 r2, once after the approval of
the test plan. Initially few users and data were loaded for scripting purpose and later all the necessary
data for the load test was loaded. 5 machines are allocated for console and load generation at Applabs,
for Internet based testing. Silk performer was installed in all the machines and the 1000 user license
was installed on one of the machine which was used as console.

Scripting framework was developed initially for all scripts including PreOrder booking, Orderbooking,
Cargo Arrival, Prepare Stuffing Plan, Stuffing Plan Execution, Container land Movement, Update MBL
details, Departure Confirmation. Few Application functionality issues were identified and escalated to
Agility team and they were immediately fixed and made ready for scripting.

Server scripts for windows were given to data centers to deploy them and validate the logs for the
application and the database server. The Logs were validated and appropriate scripts were copied and
made ready for generating the server side metrics during the main test. A 100 user smoke test was
performed to validate the script, server logs and the LG’s capability.

The Application server resource utilization was normal and the CPU Processor time was at 50% at
average. This was the stage even before the test started, few spikes were noticed while during the test
and it reached a maximum of 100 % at one point. The Application server memory has been stable.
Paging activities were not noticed and the memory was well managed by the application server.
Minimal disk resources were utilized during the test.

Database server CPU peaked at 10% and was consistently at 9% till the end of the test. Memory was
not much utilized and also the disk usage was optimal.

MOSS Server CPU peaked at 9.1% and averaged at 1.9%. Memory and disk utilization were also
optimal. ASP.net requests were getting queued and this causes high response times for the end user.

IIS server spiked to 100% and averaged at 25%. Memory and disk utilization were optimal.

Application was able to respond till 400 user load level. Whenever the load increased above 400, the
application responsiveness decreased and threw more number of Internal server errors and
Redirections.

Agility E Services AppLabs

Page |4
 Error Statistics:

# of
Module Step Error Description Reason for Error
Errors

When load is gradually

Login, Click Pre
PreOrder HTTP: 500 - internal server increases the users were
76 Order, Submit Pre
Booking error failed at different steps to
Order, Logout
process at Server

Login, Click Order When load is gradually

Booking, Click increases the users were
HTTP: 500 - internal server
Order Instance, Click Port failed at different steps to
Booking
255 error and HTTP: 1010 - too process at Server and It
of Origin, Submit
Order Booking and many redirections automatically redirected to
Logout homepage
When load is gradually
Login, Click Receive HTTP: 500 - internal server increases the users were
Cargo Cargo Arrival, Submit failed at different steps to
Arrival
56
Cargo Arrival and Sign error and HTTP: 1010 - too process at Server and It
out many redirections automatically redirected to
homepage

When load is gradually

Prepare Login, Click Instance,
increases the users were
stuffing 71 Click Stuffing Plan, HTTP: 500 - internal server failed at different steps to
Plan Select Order
process at Server

Agility E Services AppLabs

Page |5
3 Performance Test Results and Analysis: Client
Side
The following section describe the client side statistics and performance observation

3.1 Hits per second statistics:

The following graph represents the Hits per second statistics observed on the client side

Hits per second depict the total number of hits generated by each and every request. The HPS will
follow the same pattern as throughput unless there are any abnormal errors and same page / object are
downloaded for huge number of time.

From the above graph it can be observed that as the user load increases the hits also increase and
reduce slowly with spikes as usually.

Agility E Services AppLabs

Page |6
3.2 Error statistics:
The following graph represents the Error statistics observed on the client side

There were totally 1,685 successful transaction (excluding the login and logout transaction) and
458 errors. The following table shows the individual breakup of transaction module wise

Agility E Services AppLabs

Page |7
 3.3 Page Time:
The following table represents the Page time statistics observed on the client side

Create PreOrder:

Page Timer (Response in Seconds) Count Min Average Max

AES_CPO_S01_Login 344 6.61 521.01 2548.84
AES_CPO_S02_ClickPreOrderRequest 273 0.59 298.15 1240.66
AES_CPO_S03_ClickBusinessBranch_PopUp 249 0.27 77.57 295.14
AES_CPO_S03_SelectBusinessBranch 249 0.27 67.71 293.26
AES_CPO_S04_ClickHandlingBranch_PopUp 245 0.27 54.41 291.75
AES_CPO_S04_SelectHandlingBranch 245 0.27 39.27 407.08
AES_CPO_S05_ClickShipper_CustomerPopUp 243 0.27 34.2 249.41
AES_CPO_S05_SelectShipper 242 0.25 29.71 407.2
AES_CPO_S06_ClickFinalDestination_LocationPopUp 242 0.27 27.31 228.55
AES_CPO_S06_SelectFinalDestination 242 0.25 28.73 245.2
AES_CPO_S07_ClickCFSICDLocation_CFSLocationPopUp 242 0.27 22.56 192.59
AES_CPO_S07_SelectCFSICDLocation 242 0.25 24.97 406.98
AES_CPO_S08_SubmitPreOrder 224 35.84 258.13 934.03
AES_CPO_S09_ForcedSignOut 33 0.28 272.19 1152.7
AES_CPO_S09_SignOut 204 0.27 172.2 536.92

OrderBooking:

Page Timer (Response in Seconds) Count Min Average Max

AES_OB_S01_HomePage 544 15.64 530.01 2551.84
AES_OB_S02_ClickInstance 501 5.45 185.97 895.14
AES_OB_S03_ClickOrderBooking 382 4.11 214.2 1090.83
AES_OB_S04_ClickOrdBookingCurrency_CurrencyPopUp 376 0.27 36.38 286.09
AES_OB_S04_SelectOrdBookingCurrency 372 0.25 29.81 261.36
AES_OB_S05_ClickCountryOfOrigin_CountryPopUp 369 0.27 31.2 173.03
AES_OB_S05_SelectCountryOfOrigin 369 0.25 23.28 225.11
AES_OB_S06_ClickPortOfOrigin_PortPopUp 369 0.27 31.79 260.47
AES_OB_S06_SelectPortOfOrigin 364 0.25 27.7 408.94
AES_OB_S07_ClickPlaceOfreceipt_LocationPopUp 357 0.27 29.2 260.22
AES_OB_S07_SelectPlaceOfreceipt 355 0.27 28.19 498.89
AES_OB_S08_ClickCountryOfDischarge_CountryPopUp 353 0.27 30.47 260.23
AES_OB_S08_SelectCountryOfDischarge 348 0.25 28.63 407.17
AES_OB_S09_ClickPortOfDischarge_PortPopUp 348 0.27 39.13 260.23
AES_OB_S09_SelectPortOfDischarge 347 0.25 41.64 293.3
AES_OB_S10_ClickPlaceOfDelivery_LocationPopUp 344 0.27 50.84 291.75
AES_OB_S10_SelectPlaceOfDelivery 342 0.25 53.69 293.45
AES_OB_S11_ClickAddAndSavePackage 326 0.53 118.57 490.16
AES_OB_S12_ClickOnConsigneeCode_CustomerPopUp 317 0.27 66.02 260.22
AES_OB_S12_SelectConsigneeCode 299 0.25 55.84 261.63
AES_OB_S13_SubmitOrdBooking 240 107.08 287.53 935.22
Agility E Services AppLabs
Page |8
 AES_OB_S14_ForcedSignout 208 0.27 181.39 837.86
AES_OB_S14_Signout 164 0.31 211.88 1161.75

Receive Cargo Arrival:

Page Timer (Response in Seconds) Count Min Average Max

AES_CA_S01_Login 175 14.17 465.63 2202.2
AES_CA_S02_ClickInstance 146 3.45 192.6 886.52
AES_CA_S03_ReceiveCargoArrivals 118 1.88 239.73 1168.7
AES_CA_S04_SubmitCargoDetails 107 26.53 225.9 678.75
AES_CA_S05_ForcedSignout 39 0.81 241.15 906.06
AES_CA_S05_Signout 105 0.27 209.4 647.47

Prepare Stuffing Plan:

Page Timer (Response in Seconds) Count Min Average Max

AES_PSP_S01_Login 134 26.56 525.33 2524.94
AES_PSP_S02_ClickInstance 125 31.09 209.31 883.56
AES_PSP_S03_ClkStuffingPlan 108 3.05 229.17 1163.66
AES_PSP_S04_SelectCarrierCode 106 0.27 32.22 255.44
AES_PSP_S05_SelectOrder 96 80.52 107.1 467.89
AES_PSP_S06_AddContainer 95 24.25 94.45 684.61
AES_PSP_S07_ClkSubmit 89 86.8 319.84 1285.23
AES_PSP_S08_ForcedLogout 40 0.27 231.85 843.92
AES_PSP_S08_Logout 85 0.27 162.75 599.73

There are three types of timers (Page timers, Step timers and Transaction timers)

Page timers represent the timers for individual page inside every step.

For example: Get Activity item is considered to be a step and the following pages are considered
to be part of each step.

1. Selecting item

2. Selecting date

Step timers include the timers defined between each steps of the scenario.

For example: Preorder Booking Activity is considered to be a scenario and the following steps are
considered to be part of it.

1. Home Page & Login

2. Create PreOrderRequest

3. Enter Details

4. Submit

5. Logout

Transaction timers are the timers for every transaction scenarios. They are
Agility E Services AppLabs
Page |9
 1. Preorder booking

2. Orderbooking

3. Cargo Arrival

4. Prepare Stuffing Plan

3.2 Response Time statistics:

The following graphs represent the response time statistics observed on the client side

The following graph represents the response time statistics observed for
Agility E Services Activity Sheet scenario.

3.4.1 Agility E Services – Pre order booking

The following tables represent the response time statistics for step and transaction timer observed on
the client side at 200,400 and 750 user loads respectively.

200 Users Steady Period Avg Min Max

Overall Response Time 90.878 0.25 905.75
AES_CPO_S01_Login 259.203 6.609 780.578
AES_CPO_S02_ClickPreOrderRequest 196.283 0.593 550.234
AES_CPO_S03_ClickBusinessBranch_PopUp 68.028 0.265 295.141
AES_CPO_S03_SelectBusinessBranch 63.056 0.265 293.265
AES_CPO_S04_ClickHandlingBranch_PopUp 53.732 0.265 291.75
AES_CPO_S04_SelectHandlingBranch 35.912 0.265 213.547
AES_CPO_S05_ClickShipper_CustomerPopUp 31.042 0.265 249.406
AES_CPO_S05_SelectShipper 24.996 0.25 245.281
AES_CPO_S06_ClickFinalDestination_LocationPopUp 24.257 0.265 228.547
AES_CPO_S06_SelectFinalDestination 27.515 0.25 245.203
AES_CPO_S07_ClickCFSICDLocation_CFSLocationPopUp 20.656 0.265 192.594
AES_CPO_S07_SelectCFSICDLocation 20.782 0.25 180.797
AES_CPO_S08_SubmitPreOrder 230.576 35.844 413.687
AES_CPO_S09_ForcedSignOut 237.054 0.281 905.75
AES_CPO_S09_SignOut 169.353 0.266 536.922

400 Users Steady Period Avg Min Max

219.529 0.265 2,304.16
Overall Response Time
849.992 107.359 2,304.16
AES_CPO_S01_Login
675.763 4.062 1,240.66
AES_CPO_S02_ClickPreOrderRequest
111.22 0.265 217.344
AES_CPO_S03_ClickBusinessBranch_PopUp
84.12 0.265 223.219
AES_CPO_S03_SelectBusinessBranch
56.862 0.265 139.39
AES_CPO_S04_ClickHandlingBranch_PopUp
51.453 0.266 407.078
AES_CPO_S04_SelectHandlingBranch
45.537 0.266 114.875
AES_CPO_S05_ClickShipper_CustomerPopUp
46.519 0.266 407.203
AES_CPO_S05_SelectShipper

Agility E Services AppLabs

P a g e | 10
 38.455 0.265 164.64
AES_CPO_S06_ClickFinalDestination_LocationPopUp
33.066 0.265 240.453
AES_CPO_S06_SelectFinalDestination
29.348 0.296 169.594
AES_CPO_S07_ClickCFSICDLocation_CFSLocationPopUp
39.917 0.265 406.984
AES_CPO_S07_SelectCFSICDLocation
361.883 128.453 934.031
AES_CPO_S08_SubmitPreOrder
422.813 58.141 1,152.70
AES_CPO_S09_ForcedSignOut
185.493 38 335.594
AES_CPO_S09_SignOut

Avg Min Max

750 Users Steady Period
1,490.89 81.484 2,548.84
Overall Response Time
1,870.19 1,294.98 2,548.84
AES_CPO_S01_Login
NA NA NA
AES_CPO_S02_ClickPreOrderRequest
NA NA NA
AES_CPO_S03_ClickBusinessBranch_PopUp
NA NA NA
AES_CPO_S03_SelectBusinessBranch
NA NA NA
AES_CPO_S04_ClickHandlingBranch_PopUp
NA NA NA
AES_CPO_S04_SelectHandlingBranch
NA NA NA
AES_CPO_S05_ClickShipper_CustomerPopUp
NA NA NA
AES_CPO_S05_SelectShipper
NA NA NA
AES_CPO_S06_ClickFinalDestination_LocationPopUp
NA NA NA
AES_CPO_S06_SelectFinalDestination
NA NA NA
AES_CPO_S07_ClickCFSICDLocation_CFSLocationPopUp
NA NA NA
AES_CPO_S07_SelectCFSICDLocation
NA NA NA
AES_CPO_S08_SubmitPreOrder
NA NA NA
AES_CPO_S09_ForcedSignOut
190.406 81.484 256.047
AES_CPO_S09_SignOut

3.4.2 Agility E Services – Orderbooking

The following tables represent the response time statistics for step and transaction timer observed on
the client side at 200,400 and 750 user loads respectively.

200 Users Steady Period Avg Min Max

Agility E Services AppLabs

P a g e | 11
Overall Response Time 75.082 0.25 919.313
AES_OB_S01_HomePage 269.436 15.64 919.313
AES_OB_S02_ClickInstance 145.428 5.453 580.609
AES_OB_S03_ClickOrderBooking 128.708 4.11 716.781
AES_OB_S04_ClickOrdBookingCurrency_CurrencyPopUp 33.084 0.265 286.094
AES_OB_S04_SelectOrdBookingCurrency 26.435 0.25 261.359
AES_OB_S05_ClickCountryOfOrigin_CountryPopUp 28.658 0.265 173.031
AES_OB_S05_SelectCountryOfOrigin 20.803 0.25 135.156
AES_OB_S06_ClickPortOfOrigin_PortPopUp 28.084 0.265 241.813
AES_OB_S06_SelectPortOfOrigin 24.643 0.25 408.937
AES_OB_S07_ClickPlaceOfreceipt_LocationPopUp 30.301 0.265 260.219
AES_OB_S07_SelectPlaceOfreceipt 26.326 0.265 498.891
AES_OB_S08_ClickCountryOfDischarge_CountryPopUp 26.415 0.265 260.234
AES_OB_S08_SelectCountryOfDischarge 22.419 0.25 240.438
AES_OB_S09_ClickPortOfDischarge_PortPopUp 29.581 0.265 260.234
AES_OB_S09_SelectPortOfDischarge 31.987 0.25 293.296
AES_OB_S10_ClickPlaceOfDelivery_LocationPopUp 38.975 0.265 291.75
AES_OB_S10_SelectPlaceOfDelivery 36.978 0.25 293.453
AES_OB_S11_ClickAddAndSavePackage 88.594 0.531 490.157
AES_OB_S12_ClickOnConsigneeCode_CustomerPopUp 49.429 0.265 260.141
AES_OB_S12_SelectConsigneeCode 41.632 0.25 261.094
AES_OB_S13_SubmitOrdBooking 261.943 107.078 919.109
AES_OB_S14_ForcedSignout 204.799 0.313 905.953
AES_OB_S14_Signout 182.064 0.265 837.859

400 Users Steady Period Avg Min Max

Overall Response Time 170.582 0.25 2,234.75
AES_OB_S01_HomePage 820.602 91.422 2,234.75
AES_OB_S02_ClickInstance 278.902 87 895.141
AES_OB_S03_ClickOrderBooking 479.867 44.14 1,090.83
AES_OB_S04_ClickOrdBookingCurrency_CurrencyPopUp 46.418 0.265 160.328
AES_OB_S04_SelectOrdBookingCurrency 39.942 0.265 195.328
AES_OB_S05_ClickCountryOfOrigin_CountryPopUp 38.736 0.265 151.031
AES_OB_S05_SelectCountryOfOrigin 30.641 0.25 225.11
AES_OB_S06_ClickPortOfOrigin_PortPopUp 42.779 0.266 260.469
AES_OB_S06_SelectPortOfOrigin 36.623 0.265 237.688
AES_OB_S07_ClickPlaceOfreceipt_LocationPopUp 25.742 0.266 135.406
AES_OB_S07_SelectPlaceOfreceipt 34.039 0.265 407.125
AES_OB_S08_ClickCountryOfDischarge_CountryPopUp 43.074 0.265 196.203
AES_OB_S08_SelectCountryOfDischarge 47.534 0.265 407.172
AES_OB_S09_ClickPortOfDischarge_PortPopUp 68.233 1.688 244.828
AES_OB_S09_SelectPortOfDischarge 70.934 0.265 245.281

AES_OB_S10_ClickPlaceOfDelivery_LocationPopUp 87.563 2.829 243.219

AES_OB_S10_SelectPlaceOfDelivery 105.833 5.437 261.36
AES_OB_S11_ClickAddAndSavePackage 226.234 0.531 421.016
AES_OB_S12_ClickOnConsigneeCode_CustomerPopUp 131.62 0.266 260.219

Agility E Services AppLabs

P a g e | 12
 AES_OB_S12_SelectConsigneeCode 118.885 0.265 261.625
AES_OB_S13_SubmitOrdBooking 507.626 156.125 935.219
AES_OB_S14_ForcedSignout 247.371 5.313 1,161.75
AES_OB_S14_Signout 171.364 1.203 595.032

750 Users Steady Period Avg Min Max

Overall Response Time 1,131.83 65.406 2,551.84
AES_OB_S01_HomePage 1,867.67 479.641 2,551.84
AES_OB_S02_ClickInstance 263.228 184.625 576.25
NA NA NA
AES_OB_S03_ClickOrderBooking
NA NA NA
AES_OB_S04_ClickOrdBookingCurrency_CurrencyPopUp
NA NA NA
AES_OB_S04_SelectOrdBookingCurrency
NA NA NA
AES_OB_S05_ClickCountryOfOrigin_CountryPopUp
NA NA NA
AES_OB_S05_SelectCountryOfOrigin
NA NA NA
AES_OB_S06_ClickPortOfOrigin_PortPopUp
NA NA NA
AES_OB_S06_SelectPortOfOrigin
NA NA NA
AES_OB_S07_ClickPlaceOfreceipt_LocationPopUp
NA NA NA
AES_OB_S07_SelectPlaceOfreceipt
NA NA NA
AES_OB_S08_ClickCountryOfDischarge_CountryPopUp
NA NA NA
AES_OB_S08_SelectCountryOfDischarge
NA NA NA
AES_OB_S09_ClickPortOfDischarge_PortPopUp
NA NA NA
AES_OB_S09_SelectPortOfDischarge
NA NA NA
AES_OB_S10_ClickPlaceOfDelivery_LocationPopUp
NA NA NA
AES_OB_S10_SelectPlaceOfDelivery
NA NA NA
AES_OB_S11_ClickAddAndSavePackage
NA NA NA
AES_OB_S12_ClickOnConsigneeCode_CustomerPopUp
NA NA NA
AES_OB_S12_SelectConsigneeCode
NA NA NA
AES_OB_S13_SubmitOrdBooking
AES_OB_S14_ForcedSignout 115.324 65.406 262.938
NA NA NA
AES_OB_S14_Signout

3.4.3 Agility E Services – Cargo Arrival

The following tables represent the response time statistics for step and transaction timer observed on
the client side at 200,400 and 750 user loads respectively

200 Users Steady Period Avg Min Max

Agility E Services AppLabs

P a g e | 13
 Overall Response Time 209.168 0.265 905.578
AES_CA_S01_Login 283.008 14.172 882.953
AES_CA_S02_ClickInstance 158.858 3.453 585.797
AES_CA_S03_ReceiveCargoArrivals 143.354 1.875 642.578
AES_CA_S04_SubmitCargoDetails 220.397 26.531 678.75
AES_CA_S05_ForcedSignout 230.578 0.812 905.578
AES_CA_S05_Signout 217.945 0.265 647.469

       
400 Users Steady Period Avg Min Max
Overall Response Time 456.403 4.657 2,202.20
AES_CA_S01_Login 810.834 138.422 2,202.20
AES_CA_S02_ClickInstance 270.608 88.172 886.516
AES_CA_S03_ReceiveCargoArrivals 564.545 207.656 1,168.70
AES_CA_S04_SubmitCargoDetails 243.944 125.625 329.032
AES_CA_S05_ForcedSignout 282.135 98.422 906.062
AES_CA_S05_Signout 182.066 4.657 392.14
       

750 Users Steady Period Avg Min Max

Overall Response Time 1,332.63 223.375 2,066.02
AES_CA_S01_Login 1,963.10 1,875.66 2,066.02
AES_CA_S02_ClickInstance 386.915 23.375 550.454
NA NA NA
AES_CA_S03_ReceiveCargoArrivals
NA NA NA
AES_CA_S04_SubmitCargoDetails
NA NA NA
AES_CA_S05_ForcedSignout
NA NA NA
AES_CA_S05_Signout

3.4.4 Agility E Services - Prepare Stuffing Plan

The following tables represent the response time statistics for step and transaction timer observed on
the client side at 200,400 and 750 user loads respectively

200 Users steady state Avg Min Max

Overall Response Time 158.421 0.265 1,285.23
AES_PSP_S01_Login 300.986 26.562 866.797
Agility E Services AppLabs
P a g e | 14
 AES_PSP_S02_ClickInstance 147.536 31.094 856.656
AES_PSP_S03_ClkStuffingPlan 140.281 3.047 836.828
AES_PSP_S04_SelectCarrierCode 30.572 0.265 255.437
AES_PSP_S05_SelectOrder 101.572 80.515 168.219
AES_PSP_S06_AddContainer 77.746 24.25 684.61
AES_PSP_S07_ClkSubmit 293.162 86.797 1,285.23
AES_PSP_S08_ForcedLogout 196.807 0.265 843.922
AES_PSP_S08_Logout 147.964 0.266 557.203

400 Users steady state Avg Min Max

Overall Response Time 370.592 1.359 2,518.20
AES_PSP_S01_Login 901.266 128.109 2,518.20
AES_PSP_S02_ClickInstance 377.481 91.406 883.562
AES_PSP_S03_ClkStuffingPlan 479.669 65.39 1,163.66
AES_PSP_S04_SelectCarrierCode 37.55 4.532 104.75
AES_PSP_S05_SelectOrder 124.648 80.515 467.89
AES_PSP_S06_AddContainer 149.871 28.922 528.203
AES_PSP_S07_ClkSubmit 406.234 171.609 532.687
AES_PSP_S08_ForcedLogout 339.064 1.359 682.875
AES_PSP_S08_Logout 217.806 70.875 599.734

750 Users Steady period Avg Min Max

Overall Response Time 928.793 141.922 2,524.94
AES_PSP_S01_Login 1,679.95 424.156 2,524.94
AES_PSP_S02_ClickInstance 266.228 141.922 555.031
AES_PSP_S03_ClkStuffingPlan 915.906 915.906 915.906
NA NA NA
AES_PSP_S04_SelectCarrierCode
NA NA NA
AES_PSP_S05_SelectOrder
NA NA NA
AES_PSP_S06_AddContainer
NA NA NA
AES_PSP_S07_ClkSubmit
AES_PSP_S08_ForcedLogout 284.672 281.031 288.64
NA NA NA
AES_PSP_S08_Logout

3.3 Throughput:
The following graph represents the Network Throughput statistics observed on the client side

Agility E Services AppLabs

P a g e | 15
The test was conducted within the LAN and Internet there were no major observation regarding
the throughput as it was under utilized for the entire test duration.

Network Client Side Bandwidth details:

Min: 0.15 Mbps (Megabits per second)

Max: 7.98 Mbps (Megabits per second)

Average: 4.50 Mbps (Megabits per second)

Agility E Services AppLabs

P a g e | 16
4 Performance Test Results and Analysis: Server Side

MOSS Server – Operating System statistics

5.1.1 Processor Statistics:

The following graph represents the CPU statistics observed on the MOSS server.

AgilityE - MOSS - CPU Statistics

750 100

675 90

600 80

525 70

CPU Statistics
450 60
Load Size

375 50

300 40

225 30

150 20

75 10

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56

Elapsed Time (hh:mm)

Load Size % Privileged Time % User Time % Processor Time

Description:

CPU statistics provides the percentage of time processor spends on User applications, system processing (Privileged
time).

Observations:

The MOSS WFE (Web front end) server was stable during the test. The highest CPU utilization on this server was
observed 9.1% and average CPU utilization was observed less than 1.9%.

Agility E Services AppLabs

P a g e | 17
Confidential

4.1.2 Memory Statistics:

The following graph represents the Memory statistics observed on the MOSS server.

Agility - MOSS - Memory Statistics

750 2500

675 2250

600 2000

525 1750

Memory Statistics
450 1500
Load Size

375 1250

300 1000

225 750

150 500

75 250

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56
Elapsed Time (hh:mm)
Load Size Available Memory(MB) Total Memory(MB)

Description:

Memory statistics provides the Available memory during the test mapped

against the total physical memory installed on the system.

Observation:

The maximum memory available was 2041 MB and minimum during the test was 1024 MB. The total available memory
on the machine is 4096 MB.

Agility E Services AppLabs

P a g e | 18
Confidential

4.1.3 Disk Statistics: Disk Service Time

The following graph represents the Disk statistics observed on the MOSS server.

Description:

Average disk queue length is the average number of requests waiting for disk activities.

Observation:

The highest value for Average disk queue length was observed less than 0.02. Considering overall duration of the test,
disk performance was stable.

Agility E Services AppLabs

P a g e | 19
Confidential

4.1.4 MOSS Statistics: Requests In Application Queue

The following graph represents the Requests in Application Queue observed on MOSS Server.

AGILITY-MOSS-RequestsInApplicationQueue
750 2000

675 1800

Requests in Application Queue

600 1600

525 1400
Load Size

450 1200

375 1000

300 800

225 600

150 400

75 200

0 0
0:00 0:11 0:23 0:34 0:46 0:58 1:09 1:21 1:32 1:44 1:56

Elapsed Time (hh:mm)

Load Size Requests In Application Queue

Description:

The number of requests waiting in application queue for processing.

Observation:

We observed that hundreds of requests are getting queued in the MOSS server request queue. Should identify the
reason for more requests getting queued like shortage of worker threads to service the requests in queue etc.

Agility E Services AppLabs

P a g e | 20
Confidential

4.1.5 TCP Statistics: Connections Statistics

The following graph represents the Network TCP statistics observed on the MOSS server.

Agility - MOSS - Connection Statistics

1000 250

900 225

800 200

Connections Statistics
700 175

600 150
Load Size

500 125

400 100

300 75

200 50

100 25

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56

Elapsed Time (hh:mm)

Load Size Connections Active Connections Passive Connections Established Connections Reset

Description:

Connection statistics gives the details of TCP connections established with MOSS server during the test.

Observation:

The connections established were stable during the test. The highest number of Connections Active was 2265.

Agility E Services AppLabs

P a g e | 21
Confidential

SQL Server – Operating System statistics

5.1.2 Processor Statistics:

The following graph represents the CPU statistics observed on the SQL server.

Agility - SQL Server - CPU Statistics

750 100

675 90

600 80

525 70

CPU Statistics
450 60
Load Size

375 50

300 40

225 30

150 20

75 10

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56

Elapsed Time (hh:mm)

Load Size % Privileged Time %User Time % Processor Time

Description:

CPU statistics provides the percentage of time processor spends on User applications, system processing (Privileged
time).

Observations:

The BizTalk server was stable during the test. The highest CPU utilization on the BizTalk server was observed 9.66%
and average CPU utilization was observed less than 2.31%.

Agility E Services AppLabs

P a g e | 22
Confidential

4.1.6 Memory Statistics:

The following graph represents the Memory statistics observed on the SQL server.

Agility - SQL Server - Memory Statistics

750 4200

675 3780

600 3360

525 2940

450 2520

Memory Statistics
Load Size

375 2100

300 1680

225 1260

150 840

75 420

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56

Elapsed Time (hh:mm)

Load Size Available Memory(MB) Total Memory(MB)

Description:

Memory statistics provides the Available memory during the test mapped

against the total physical memory installed on the system.

Observation:

The memory utilization was stable during the test. Minimum available memory was 344 MB and maximum available was
512 MB. Total memory is 4096 MB.

Agility E Services AppLabs

P a g e | 23
Confidential

4.1.7 Disk Statistics: Disk Service Time

The following graph represents the Disk statistics observed on the SQL server.

Description:

Average disk queue length is the average number of requests waiting for disk activities.

Observation:

The highest value for Average disk queue length was observed less than 2.06. Considering overall duration of the test,
disk performance was stable.

Agility E Services AppLabs

P a g e | 24
Confidential

4.1.8 SQL Server : Throughput Statistics

The following graph represents the Disk statistics observed on the SQL Server.

Agility - SQLServer- Throughput Statistics

750 5

675 4.5

600 4

Throughput statistics
525 3.5

450 3
Load Size

375 2.5

300 2

225 1.5

150 1

75 0.5

0 0
0:00 0:11 0:23 0:34 0:46 0:58 1:09 1:21 1:32 1:44 1:56
Elapsed Time (hh:mm)
Load Size Bytes Received (in Mbps) Bytes Sent (in Mbps) Throughput (in Mbps)

Description:

Throughput is the total number of bits sent/received per second during the test.

Observation:

The average throughput was around 0.5 Mbps and highest throughput was 1.9 Mbps.

Agility E Services AppLabs

P a g e | 25
Confidential

TCP Statistics:
The following graph represents the Network TCP statistics observed on the SQL server.

Agility- SQL Server - Connection Statistics

750 1200

675 1080

600 960

525 840

Connections Statistics
450 720
Load Size

375 600

300 480

225 360

150 240

75 120

0 0
00:00 00:11 00:23 00:34 00:46 00:58 01:09 01:21 01:32 01:44 01:56

Elapsed Time (hh:mm)

Load Size Connections Active Connections Passive Connections Established Connections Reset

Description:

Connection statistics gives the details of TCP connections established with BizTalk server during the test.

Observation: The connections established were stable during the test. The highest number of Connections Active was
1150.

Agility E Services AppLabs

P a g e | 26
Confidential

5 Scope of Testing

The scope of this project is testing the application which is deployed in the IIS server. The objective is to test the
performance of the application with 750 users and monitor the Web and database server.

The following is the business flow

Agility E Services http://inhydmossitm:11111/_layouts/PILOT/

Pre Order Booking Order Booking

1. AES_CPO_S01_Login 1. AES_OB_S01_HomePage
2. AES_CPO_S02_ClickPreOrderRequest 2. AES_OB_S02_ClickInstance
3. AES_CPO_S03_ClickBusinessBranch_PopUp 3. AES_OB_S03_ClickOrderBooking
4. AES_CPO_S03_SelectBusinessBranch 4. AES_OB_S04_ClickOrdBookingCurrency_CurrencyPopUp
5. AES_CPO_S04_ClickHandlingBranch_PopUp 5. AES_OB_S04_SelectOrdBookingCurrency
6. AES_CPO_S04_SelectHandlingBranch 6. AES_OB_S05_ClickCountryOfOrigin_CountryPopUp
7. AES_CPO_S05_ClickShipper_CustomerPopUp 7. AES_OB_S05_SelectCountryOfOrigin
8. AES_CPO_S05_SelectShipper 8. AES_OB_S06_ClickPortOfOrigin_PortPopUp
9. AES_CPO_S06_ClickFinalDestination_Locatio 9. AES_OB_S06_SelectPortOfOrigin
nPopUp 10. AES_OB_S07_ClickPlaceOfreceipt_LocationPopUp
10. AES_CPO_S06_SelectFinalDestination 11. AES_OB_S07_SelectPlaceOfreceipt
11. AES_CPO_S07_ClickCFSICDLocation_CFSLoc 12. AES_OB_S08_ClickCountryOfDischarge_CountryPopUp
ationPopUp 13. AES_OB_S08_SelectCountryOfDischarge
12. AES_CPO_S07_SelectCFSICDLocation 14. AES_OB_S09_ClickPortOfDischarge_PortPopUp
13. AES_CPO_S08_SubmitPreOrder 15. AES_OB_S09_SelectPortOfDischarge
14. AES_CPO_S09_ForcedSignOut 16. AES_OB_S10_ClickPlaceOfDelivery_LocationPopUp
15. AES_CPO_S09_SignOut 17. AES_OB_S10_SelectPlaceOfDelivery
18. AES_OB_S11_ClickAddAndSavePackage
19. AES_OB_S12_ClickOnConsigneeCode_CustomerPopUp
20. AES_OB_S12_SelectConsigneeCode
21. AES_OB_S13_SubmitOrdBooking
22. AES_OB_S14_ForcedSignout
23. AES_OB_S14_Signout

Agility E Services http://inhydmossitm:11111/_layouts/PILOT/

Receive Cargo Arrival Prepare Stuffing Plan

1. AES_CA_S01_Login 1. AES_PSP_S01_Login
2. AES_CA_S02_ClickInstance 2. AES_PSP_S02_ClickInstance
3. AES_CA_S03_ReceiveCargoArrivals 3. AES_PSP_S03_ClkStuffingPlan
4. AES_CA_S04_SubmitCargoDetails 4. AES_PSP_S04_SelectCarrierCode
5. AES_CA_S05_ForcedSignout 5. AES_PSP_S05_SelectOrder
6. AES_CA_S05_Signout 6. AES_PSP_S06_AddContainer
7. AES_PSP_S07_ClkSubmit
8. AES_PSP_S08_ForcedLogout
9. AES_PSP_S08_Logout

Agility E Services AppLabs

P a g e | 27
Confidential

6 Test Approach
The following approach has been adopted

1. Agility deployed the application on their UAT staging server

2. Scripts were developed using Borland Silk Performer 2008 R2 tool

3. Load was be generated through Internet

The Ramp-Up pattern we have followed is

Elapsed Time Ramp-up User load

0:00:00 0

0:05:00 1 user for every 3 seconds 100

0:10:00 1 user for every 3 seconds 200

0:15:00 Steady State 200

0:20:00 Steady State 200

0:25:00 Steady State 200

0:30:00 Steady State 200

0:35:00 1 user for every 3 seconds 300

0:40:00 1 user for every 3 seconds 400

0:45:00 Steady State 400

0:50:00 Steady State 400

0:55:00 Steady State 400

1:00:00 Steady State 400

1:05:00 1 user for every 3 seconds 500

1:10:00 1 user for every 3 seconds 600

1:15:00 1 user for every 3 seconds 750

1:20:00 Steady State 750

1:25:00 Steady State 750

1:30:00 Steady State 750

1:35:00 Steady State 750

1:40:00 Steady State 750

1:45:00 Steady State 750

1:50:00 Ramp Down 500

1:55:00 Ramp Down 250

2:00:00 Ramp Down 0

Agility E Services AppLabs

P a g e | 28
Confidential

Think time of 10 seconds was implemented between each step and 60 seconds will be implemented
between every iteration.

If any error has occurred, the user will exit the current transaction and re-login to create a new session.

Agility E Services AppLabs

P a g e | 29
Confidential

7 Performance Observation and Recommendations

MOSS Server:

ASP.NET request queuing issue needs to be resolved. This should be likely solved by tuning the availability of
worker threads. Identify all possible reasons behind the sudden spikes in request queues.

The high number of HTTP 500 errors should be resolved. Please check the event and extended logs in MOSS
server.

IIS Server:

Tune the IIS server to reduce CPU consumption and bring down the number of failures.

Tune the object level performance issues to reduce the queue length on IIS server.

Savvion server:

Tune the Savvion server to reduce the spikes in CPU utilization.

Server errors:

Observed too many HTTP 500 internal server errors. Please review the event logs on the MOSS server,
identify the root cause of performance issues and fix them to reduce the server errors.

Observed data loading issues at run time on the INBOX. So please verify the connections between the
application and database layers to get the data loaded into INBOX.

Observed issue with Sign out from the application when the server was at peak load. So please tune the MOSS
server and fix the same.

Observed too many redirections from the MOSS web front end server at peak load.

Please find more server side observations in attached files

Agility E Services AppLabs

P a g e | 30