PRODUC T GUIDE

All trademarks and registered trademarks are the property of their respective owners.

Various Technologies ONE Test System: SITE

Abbreviations
Keynote SIGOS test interfaces for multiple techniques Base Station Controller Base Transceiver Station Call Detail Record Computer Interface to Message Distribution Gateway GPRS Support Node Gateway MSC General Packed Radio Service (2.5G) Global System for Mobile Communications (2G) Home Location Register Internet Protocol Integrated Service Digital Network ISDN User Part Long Term Evolution (4G) Media Gateway Mobility Management Entity MMS Center Mobile Switching Centre Private Branch Exchange Packet Control Function Packet Data Serving Node / Foreign Agent Push-to-talk over Cellular Public Switched Telephone Network Radio Network Controller Serving GPRS Node Serving Gateway SIGOS Integrated Test Environment Short Message Peer to Peer Short Message Service Center Universal Computer Protocol Universal Mobile Telecommunications System (3G) UMTS Terrestrial Access Network Visitor Location Register BSC BTS CDR CIMD GGSN GMSC GPRS GSM HLR IP ISDN ISUP LTE MGW MME MMSC MSC PBX PCF PDSN/FA PoC PSTN RNC SGSN SGW SITE SMPP SMSC UCP UMTS UTRAN VLR

Contents

Keynote SIGOS
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

TEST SYSTEMS

36

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Worldwide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39 Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

USE CASES
Service Quality Monitoring

12

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42 Hardware Components & Interfaces . . . . . . . . . . . 46

Periodic QoS and QoE Testing . . . . . . . . . . . . . . . . . 14 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Content Testing / Handset Simulation . . . . . . . . . 18 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Test Tools for SITE and GlobalRoamer . . . . . . 48

Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Test Applications for SITE and GlobalRoamer. . 54

Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Value Added Services . . . . . . . . . . . . . . . . . . . . . . . . . 68 Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . 70

Roaming Testing
Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21 SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24

International Carrier Quality Testing

Dedicated carrier route selection . . . . . . . . . . . . . 25

Revenue Leakage & Fraud Detection

SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . 27

PROFESSIONAL SERVICES

72

Managed Services on SITE . . . . . . . . . . . . . . . . . . 74 Managed Services on GlobalRoamer. . . . . . . 75 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Revenue Assurance
Test Call / Event Generation . . . . . . . . . . . . . . . . . . . 28 CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Tari Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31

INDEX REFERENCES

78 80

Fixed & IP Network Testing

Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . 32 IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Core Network Testing

Testing without Radio Access . . . . . . . . . . . . . . . . . 34 Regression Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Nomadic & Indoor Testing . . . . . . . . . . . . . . . . . . 35 5

With a customer base of more than 270 operators around the world in over 110 countries... With over 50 representations around the world, covering sales and post sales services... With expert sta from more than 30 nationalities...

...your worldwide partner in telecommunications testing: Keynote SIGOS

Introduction
Company
Testing is our Competence

Portfolio
SITE Active end-to-end test system GlobalRoamer Managed worldwide system Professional Services Consulting and more

Introduction > Company

Foundation of SIGOS Systemintegration GmbH

Testing and integration support for the rst German GSM network

Active participation in standardization process as full member of ETSI

Keynote SIGOS

1985
Industry
First ISDN communication system is established

1987

1989

1990

1991

1992

The idea for GSM is born (Memorandum of Understanding)

First GSM network is launched in Finland (2G)

SMS is introduced World Wide Web (www) is born

Keynote SIGOS
The Company
What we do
Keynote SIGOS provides scalable and fully integrable telecommunications testing solutions to service network operators (mobile and xed line as well as MVNOs) and content providers, carriers and regulators. Our solutions and services are designed to give our customers the full picture on Quality of Service from an end-user perspective. We o er the most comprehensive range of scalable active end-to-end testing solutions available on the market:
Quality of Service testing (speech, data, messaging, VAS) Quality of Experience testing (real device testing) Service Quality monitoring Roaming testing Revenue Assurance and Billing veri cation solutions Diagnosis and Reporting tools Core network testing solutions Drive service Handset simulation Web Service Testing

SIGOS provides test and integration support to all German GSM networks

GlobalRoamer goes online

Launch of BlackBerry, PoC, Video Testing

Keynote acquires SIGOS GmbH

SITE provides test environment for VoIP, ADSL, DSL, HSUPA

Keynote SIGOS

2001
Industry
First commercial UMTS network is launched in Norway

2002
1 Billion of mobile phone subscribers world-wide

2005
HSDPA is introduced

2006
VoIP is now established as communications platform

2007
HSUPA is introduced

www.keynote-sigos.com

Introduction > Company

SITE Testing Environment now includes mobile network End-toEnd testing

SITE End-to-End testing environment for xed line networks is born

SIGOS plans a GSM core network

SITE DECT for type approval tests introduced

SITE ISUP for conformance test for C7 networks

1993

1994

1995

1996

1997

2000

First commercial website

VoIP in its infancy is used for the rst time

GPRS / EDGE (2.5G) ADSL allows high-speed communication over phone lines

3G starts: First CDMA2000 commercial system is launched in South Korea

Who we are
Founded in 1989 under the name of SIGOS Systemintegration GmbH, Keynote SIGOS has more than two decades of broad experience within the telecommunications industry, helping our customers to be even more successful in a competitive environment. With over 160 employees and more than 30 languages spoken, Keynote SIGOS is a truly international company: bringing people from multiple cultural backgrounds together to outstandingly serve our global customer base with what Keynote SIGOS employees all have in common: a true passion for telecommunications! Our strong partner network with over 50 representations around the globe rounds up our worldwide presence.
Keynote SIGOS is headquartered in Germany where our solutions are being developed under highest standards. Representations on multiple continents and our strong partner network distributed all over the world rounds up our world-wide presence.

Launch of Billing Veri cation and Drive Service Test

no

Keynote SIGOS celebrates its 20 Years Anniversary

te SIGOS

Introduction of GlobalResource Pool GlobalRoamer to cover of the world countries LTE Test System

Keynote SIGOS introduces IPv6 test cases and test interfaces

Launch of testing solutions for QoE (Device Gateway, mobiQ) and the core network interface for LTE, S1

Ke y

20
YEA

RS

2008
HSPA+ is introduced Mobile Connections hit 4 Billions world-wide
www.keynote-sigos.com

19 00 89 - 2

2009

2010
Beginning of LTE era (4G)

2011
IPv4 addresses to run out by the end of the year

2012
Global permanent deployment of IPv6

HSPA+ rollouts

Introduction > Portfolio

The Portfolio
Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing

GlobalRoamer

Outbound Roaming Testing

Billing Testing for International Tra c Worldwide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Fraud Detection Revenue Assurance Tool

SITE TEST SYSTEM

Roaming Testing
Clients

SITE Central Unit

LAN / WAN W

Drive Service Testing

CLU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

GO

P GR h wit AL B GLO

Professional Services

Training

Managed Services on SITE

Managed Services on GlobalRoamer

10

www.keynote-sigos.com

The Managed Global Infrastructure and Test System For The Worldwide Telecommunications Industry
With GlobalRoamer, Keynote SIGOS offers the most extensive infrastructure for automated telecommunication testing worldwide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure through a web based user interface. All that is required is a web browser and access to the internet. Simply log on with your password and set up your test schedules without worrying about a thing. However, Keynote SIGOS can also provide fully managed test services so that all that you really need to do is: look at the results. The on-demand worldwide test platform hosted by Keynote SIGOS

Your Own Scalable and Highly Flexible Testing Infrastructure

With the Keynote SIGOS SITE Test System comprising sophisticated hardware and software solutions network operators are enabled to host and work with their own testing facilities. The key is the ability to easily integrate into the existing network infrastructure realities. Interfaces to complementary solutions, e.g. monitoring systems, are provided so that SITE can be exactly matched to your specific requirements. The SITE Test Systems architecture is completely modular. Only the modules that are needed for the required tasks need to be purchased. Your local SITE system can go global by connecting to the worldwide GlobalRoamer probes with our GlobalResource Pool feature - all in one go! One platform for all your end-to-end test requirements

Solution Consulting, Managed Services and More Flexible and Customizable

We at Keynote SIGOS are always here for our customers: in each phase of your testing requirements we provide you with well experienced and specifically trained personnel, whether it be for project implementation, maintenance, managed services, training or solution consulting. All our Professional Services can be customized to your specific needs. For instance, with di erent levels of Managed Services, we can help our customers with the management, operation and administration of tests. Our services are completely customizable and scalable: we handle complete SITE systems for customers as well as manage small occasional testing. Just as you please. Expert sta provide assistance during all project phases

www.keynote-sigos.com

11

Versatility is key!

Keynote SIGOS solutions in action.

12

The Use Cases

Service Quality Monitoring
> > > > > Periodic / On-Demand Testing Network Diagnosis Drive Service Testing Content Testing / Handset Simulation Benchmarking

Roaming Testing
> > > > >

Inbound Roaming Testing Outbound Roaming Testing SLA Testing according to GSMA (GRQ) Roaming Hubbing Testing Roaming Steering Testing

International Carrier Quality Testing

> Dedicated Carrier Route Selection

Revenue Leakage & Fraud Detection

> SIM Box Detection > Early Charging Detection

Revenue Assurance
> Test Call/Event Generation > CDR Comparison Testing > Tariff Testing > Prepaid SIM Recharging

Fixed & IP Network Testing

> Fixed Network Testing > IP Network Testing

Core Network Testing

> Testing without Radio Access > Regression Testing

Nomadic & Indoor Testing

> Nomadic Testing > Indoor Testing

13

Use Cases > Service Quality Monitoring

Service Quality Monitoring

Periodic QoS and QoE testing
Slow setup time, service outages or unsuccessful data downloads are experienced in every network. In order to manage daily operations standardized matrices should be deployed by several divisions, e.g. Service Operations, Service Quality Assurance, Network Operations, International Roaming and Revenue Assurance.

In a highly competitive market, such as the telecommunications industry, providing and maintaining highest quality to end customers is the key to a sustainable competitive advantage. With customers having multiple options at hand, poor quality even the occasional drop in quality can have immediate consequences. Switching between operators never has been easier through mobile number portability. First class service quality has many in uencing factors not all being under the immediate control of the operator. Identi cation of weak points can be di cult and some may remain undiscovered even while their e ects are still evident in the market.

Keynote SIGOS o ers accurate measurements of end-to-end quality for voice and data services by measuring KPIs like call setup success rates, HSDPA, HTTP average throughput or service degradation of BlackBerry services. Taking around the clock automated measurements at the end users interface (rather than in network nodes) operators obtain in-depth insight into end-users percep-tion of the network. Generation of active test calls 24/7 without the cost of 24/7 sta - covering all aspects of the network and the upload of KPIs to a centralized alarming system provides excellent real-time feedback on the service levels of the network.

See your network through the eyes of your customers

Active testing bene ts

Testing time Continuous heartbeat tests End user experience Best re ection of end user experience: E2E service quality tests Test Quality of Service and Quality of Experience Time to detect issues Identi cation and localization of service and network issues can be achieved before actual service degradation and threat of revenue loss Operating costs Reduced operating costs by automating monitoring, testing, and reporting; increased personnel e ciency; costs not correlated with network size and growth Testing scope Pro-active test approach can be realized; in control of testing scope

14

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

On-Demand Testing
Perform reproducible ad-hoc testing!
The customer service desk keeps getting complaints about certain service scenarios like BlackBerry e-mail service not reliable, basic voice calls not possible in certain locations, in the home country as well as abroad. Quick action needs to be taken!

Worldwide Testing
Keynote SIGOS hosts the largest and most comprehensive worldwide test infrastructure, currently covering 4/5 of the worlds countries. GlobalRoamer users bene t from the availability and exibility of the GlobalRoamer test network without the e ort of running their own system. GlobalRoamer account holders log on and schedule their tests whenever the demand occurs. Being able to perform tests independently and without the usual hassles connected with doing business globally like time-zones is an invaluable asset!

Home Network Testing

SITE enables network operators to test all relevant services in their network with a private test system. All locations covered by the private SITE system can be used for exible end-to-end testing. Due to their modular structure, SITE test systems can range from a small local system to geographically widely distrubuted areas as well. The unique feature Global Resource Pool however, enables operators to expand the capability of their SITE system no matter how small or big it may be to reach out to worldwide test locations covering 4/5 of the worlds countries! In fact, they are enabled to utilize the huge network of GlobalRoamer test probes all in one go! See your network through the eyes of your customers Root causes can be localised easily when used in tandem with Keynote SIGOSs integrated analysis tools. Time zone and business hours di erences often make it di cult to run tests with the co-operation of roaming partners. GlobalRoamer o ers an easy and instant solution to this problem.

If a real time test is needed, and its too late to contact a roaming partner, I can re-produce the test scenario identically.

The test call can be replicated repetitively in order to check whether service has been re-established. GlobalRoamer is deployed to survey speci c services over roaming partners networks managing both post-paid and prepaid SIMs across the di erent technologies. The SIMs are co-located in Keynote SIGOS premises in Nuremberg, Germany.

There is no time lost as we do not have to get in touch with the roaming partner. We can execute tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has coverage. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for execution of a roaming test because partners were occupied with other roaming partners tests. The SIGOS test system helps us to manage our test SIMs e ciently as we do not have to send the SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. We can perform multiple test cases easily and simultaneously.

www.keynote-sigos.com

15

Use Cases > Service Quality Monitoring

Network Diagnosis
Model your network & nd the root cause of service outages!
Once periodic heartbeat testing for the services has been set up, very often Service Operations is the rst team to detect service outages through the results of this active testing. But what network entity has caused the fault? SITE proves not only to be a good re ection of real customer experience but also shows up bottlenecks in the network infrastructure via its solution Service Alarm Map (SAM). By supervision of all relevant end-customer services and correlation of network events it becomes possible to both anticipate and analyze service a ecting network problems. A clear and comprehensive mapping of service problems to the performance of individual network elements and systems can then signi cantly reduce downtime and speed up time back to service. Service Alarm Map helps to reduce the time for root cause identi cation and supports the technical service teams with additional information like error-id, trace details & measurement values. This important drill-down functionality from service chain visualization to raw measurement values and trace information improves reaction times in the event of tra c congestion and network element failures.

See your network through the eyes of your customers

The number of customer complaints have been reduced signi cantly due to network issues being identi ed faster by the Keynote SIGOS test system. Real-time alerts and reports of incidents lead to faster resolution of the network issues identi ed. Subscribers are not fast enough to call our Customer Care to lodge a complaint.

MSC 4 BSC 12 SGSN 2 GPRS backbone

LocationUpdate2G

GPRS_Attach2G

Opera server
DL_Duration HttpAv
IN T E RN E T VPN Tunnel

GGSN

PDP_ContextActivation

Router

Internet

DL_Duration HttpAv

Example: The Service Alarm Map (SAM) indicates a problem on BSC12

16

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

Drive Service Testing

Test mobile subscriber experience on the move!
SITE has already been widely deployed for periodic QoS testing and KPI generation. Quality of subscriber experience however is not only driven by static service use but also by service rollout on the move. Testing during moving is an important complementary approach in addition to stationary testing. SITE is a powerful tool for the delivery of Service Assurance and generation of leading Key Performance Indicators (KPIs) for operator networks, not only for static testing but also for mobility, simulating end user experience. Equivalent to the behavior of static Local Units, the SITE System collects a variety of network measurements from moving subscriber probes, known simply as Mobile Local Units (MLUs). These mobility tests are geared for vehicles like taxis, trucks or trains. Consequently they are called SITE Drive Service Tests. The raw information is processed into KPIs and displayed in a Google Maps view or on a color coded geographic map. Drive Service Testing provides you with Service QoS KPIs (Voice Quality etc.) as well as many speci c measurments (RxLevel, Handover, Call ID, MAIO...) Investment Protection Drive Service Tests are fully SITE compatible and can be performed as an extension to existing SITE systems securing current investment into Keynote SIGOS service assurance products.

Unattended System SITE Drive Service Test is a completely autonomous system after installation. No engineer needs to be present in the vehicle for test setup, modi cation or analysis. Easy Installation and Removal MLU is shipped fully pre-con gured and only needs to be connected to the electronic on-board system. No further human interaction, not even switch-on is required. Geographic View SITE system delivers graphical views on your network quality. A comprehensive set of KPIs enriched with further information like speed of moving vehicle, altitude and position can be displayed on a map. Google Maps or WMS maps, e.g. operators own coverage map, display KPIs customizable by operator.

See your network through the eyes of your customers

www.keynote-sigos.com

17

Use Cases > Service Quality Monitoring

Content Testing / Handset Simulation

Do all handsets work perfectly in your mobile network?
Mobile operators and advertisers are ercely competing to sell exciting new mobile content. However, the variety of available services like MMS, Video Strea-ming and Web Browsing may cause problems when using di erent handsets, since the service platforms of the network react individually to each mobile phone type! Data Services like Web and WAP browsing, streaming, MMS or video telephony are ARPU driving services. Premium content download is another huge revenue driver. Subscribers expectations on quality of service are legitimately high. At the same time, handset speci c behavior plays an important role in the delivery of this content and services. Delivered content not displayed in the expected format causes a de nite negative impact on customers Quality of Experience (QoE). How can new devices and services be properly tested in a cost-e ective way that ultimately leads to customer satisfaction and increased revenue? The answer is automated testing while taking handset speci cs into account handset simulation. Keynote SIGOS provides a powerful handset simulation tool, integrated into the SITE and GlobalRoamer test systems. More than 1,000 virtual handsets are available from a ready-to-use and expandable library. Simulate the large variety of handsets without the e ort of labor intensive manual testing.

See your network through the eyes of your customers

Picture and text in wrong position

Handset Simulation Test Concept Features:

Simulation of real subscriber behavior, taking handset speci cs into account Automated testing of services like Web and WAP browsing, MMS, streaming, video telephony, content download Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS Real End-to-End mobile content testing of various handsets Validation of received content with mobile pro les Database with more than 1,000 mobile device pro les and their relevant parameters New customer or country speci c handsets can easily be integrated

18

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

Benchmarking
Who is the best performer?
KPIs for own network are regularly reported to senior management. But how does your network perform compared to the competitors? Who has the best performance? Who o ers the highest quality of service (QoS)? What is the quality situation for your international tra c? In the competitive mobile environment, consistently high QoS is crucial. Benchmarking is an important dimension to make sure your services are competitive. National Approach Most measurement projects start o with a national performance investigation and comparison after national network rollout has been completed. Operators have to nd innovative ways to outperform their competition on network and service quality.
With the SITE test system, network services can be benchmarked against the competition, measuring internationally approved and recognized Key Performance Indicators (KPIs) in a fast and easy way.

Static Test Approach Network benchmark assessment is executed using an active end-to-end test scenario to observe the performance of your network from a subscriber point of view. Typical static benchmarking tests are performed at airports, city centres, mega sports or social event venues and hotspots where masses of people congregate. On-the-Move Test Approach Drive Service tests have the ability to cover di erent geographical areas of locally competing networks rather than being focused on static locations. This simulates subscriber behavior moving from one cell to another and provides a comprehensive performance overview of the complete network. See your network through the eyes of your customers

International Approach In order to get a comprehensive overview of multinational or group-wide benchmarks, GlobalRoamers extensive global footprint can perform international benchmark tests and ensure improved cost e ciencies. Benchmarking of international carriers is an important step in ensuring high quality of service for the international tra c impacting your revenue.

Service performance is benchmarked with national competitors as well as international operators: Static testing Drive service testing Outbound roaming testing (e.g. GRQ)

www.keynote-sigos.com

19

Use Cases > Roaming Testing

Inbound Roaming
Provide best service to visitors in your network!
Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers! Inbound roaming has a big impact on your revenue and a long list of international roaming agreements may be desireable. It comes at a cost: each and every roaming agreement with a new roaming partner requires intense testing according to GSMA standards. In addition, periodic roaming tests with the most important roaming partners need to be performed. How can e orts be reduced? Testing according to GSMA IREG standards is required whenever a new roaming partner is added. It can be a very time-consuming and exhaustive task. It may absorb your most expert sta and repetitive testing can be just as expensive as the initial test setup if performed manually! Therefore, test automation is key for cost e ectiveness and operational e ciency. With the SITE system your sta will perform IREG speci c tests in much shorter times with less e ort and the results will be easily reproducible! Implementation of testing for new roaming partners could not be easier: the SIM card is implemented into SITEs SIM Multiplexer which can be expanded to a capacity of more than 2,000 SIM cards. As soon as the SIM card has been implemented, sta can run the necessary tests. Ready-to-use test cases are available for the execution of tests, according to IR 24, 26, 27, 29,32, 35, 50, 60. These tests can be repeated at any given time! The test results are automatically processed into GSMA conformant reports ready for evaluation.

Get the full picture of your roaming services

Features for inbound roaming testing:

SITE o ers the right concept for inbound roaming testing: Core network test interfaces (A, Gb, IUCS, IUPS) for testing roaming, independently of radio speci c problems Air interface testing for measuring real end-to-end behavior and experience SIM Multiplexer: SIM cards can be managed centrally and securely for all roaming partners (as many as 2,000 SIM cards) Detailed KPI test reports according to GSMA standards Test sets according to IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU

20

www.keynote-sigos.com

Use Cases > Roaming Testing

Outbound Roaming Testing

Assure QoS abroad to optimize and develop outbound roaming revenue

Nowadays it is quite easy to travel the world. Traveling subscribers take availability and proper operation of all mobile services for granted. Outbound roaming contributes considerable revenue and therefore requires QoS assurance.

Operators require information on service quality beyond their own network. To subscribers, perceived mobile quality when traveling abroad is vital, especially for corporate customers. Mobile operators need to ensure subscribers are able to log onto preferred roaming partners networks when traveling, whilst preserving consistently high levels of QoS to maintain long term business sustainability. When your subscribers arrive at a foreign destination, they expect their mobile service to work at all times. All relevant services need to be tested with at least each top roaming partner. If you depend on these partners to execute these required tests, it will be a huge task, considering availability of sta , time zone di erences and the like. The solution is the worlds largest automated on-demand test network: GlobalRoamer. Tests can be executed in more than 500 networks in three quarters of the worlds countries. GlobalRoamer is hosted by Keynote SIGOS and can be accessed from anywhere in the world by logging on through a web interface. Why risk losing subscribers and roaming revenue, when the ability to test the performance of all your roaming partners is at your ngertips? Standard services as well as complex technologies and services like Video Telephony, MMS and UMTS/HSDPA networks can be tested without the need for cooperation with your roaming partners and independently of time zone.

Use GlobalRoamer, the most extensive global infrastructure for automated active End-to-End testing hosted by Keynote SIGOS. With GlobalRoamer you can access an ever increasing number of worldwide networks through a web interface. Thanks to GlobalRoamer we were able to increase our outbound roaming capability dramatically in very short time. Get the full picture of your roaming services

LUP-avail.

GPRS-avail.

Speech

SMS

www.keynote-sigos.com

21

Use Cases > Roaming Testing

SLA Testing according to GSMA GRQ

Consistency & comparability of roaming QoS testing
Since the tra c in outbound roaming has a big value for operator revenue, it is important to monitor the most frequently visited roaming operators. The GSM Association has designed the right concept: GRQ. Roaming tra c may be a low percentage of the entire network tra c, but remains a signi cant pro t contributor. How to gain a global perspective on roaming quality with consistent measurements and thus comparability between home network and visited networks? And how to achieve this goal in a cost e cient manner? The Global Roaming Quality (IR.81) standards developed by the GSMA in cooperation with selected partners like Keynote SIGOS provide an answer to this question regardless of the monitoring and testing methods used. GRQ is a comprehensive framework for pro-active testing and assurance of end-to-end roaming services quality. With SITE and GlobalRoamer you have a unique tool to monitor your SLA agreements with numerous roaming partners. Keynote SIGOS is a self-certi ed vendor of the GSMA GRQ compliant test systems.

27 Active QoS parameters on voice, data and SMS tra c KPIs for ve di erent categories: Network access Service Accessibility Connection Establishment Connection Substainability Connection Quality

Why GRQ?
Common understanding about the criteria for measuring Quality of Service in outbound situations Developed and de ned by GSMA Focus on periodic testing of service quality Applied for monitoring of top roaming partners

Get the full picture of your roaming services

Key Bene ts:

Cost-e cient co-operation with roaming partners by adherence to a shared set of QoS KPIs Improve operational cost e ectiveness, by automated testing and realtime reporting Increased Roaming revenue through fast resolution of home and visited networks SLA violations

GRQ Parameters, de ned by GSMA

# 1 GRQ Parameter name CS LU SR CS LU Delay CLI SpQ SA-MO SA-MT AD-MO AD-MT Throughput Goodput Roundtrip Time Packet Loss Category Voice Voice Voice Voice SMS SMS SMS SMS Data Data Data Data Description Circuit Switched Location Update Success Rate Network Accessibility Circuit Switched Circuit Switched Location Update Delay CLI Transparency Speech Quality Service Accessibility SMS MO Service Accessibility SMS MT Access Delay SMS MO Access Delay SMS MT Throughput (kbit/s) Goodput (kbit/s) Roundtrip Time Packet Loss 2% 1% Major target 95% 50s 95% 2.5 95% 95% 10s 10s Minor target 98% 10s 98% 3 98% 98% 4s 4s X X yes yes x x X X KPI alarm yes Trend report X

...
10 11 12 13 14 15

...

24 25 26 27

22

www.keynote-sigos.com

Use Cases > Roaming Testing

Roaming Hubbing Testing

Connecting the world with a single roaming relationship
Roaming hubs safeguard multi-lateral roaming and interworking relationships. How can a roaming hub concentrate on managing the key roaming priorities? Open Connectivity (OC) is replacing multiple bilateral roaming relationships between operators with a more e cient hub-based approach. Open Connectivity enables multi-lateral roaming and interworking relationships via SMS hubbing and roaming hubbing. Keynote SIGOS worldwide, on-demand test platform caters for roaming hubs. It enables them to perform tests of Outbound Roaming services, IREG testing for Inbound Roaming, and QoS Monitoring, as well as GRQ testing. It improves operational and cost e ciencies because of the automated test approach and real time reporting feature. Roaming hubbing providers are often tasked to actively monitor service availability and service quality on all their multilateral relations. GlobalRoamer allows the activation and testing of Roaming Hubbing customers SIMs. It helps them to work more e ciently to improve the quality of voice, data and SMS services for their customers. Keynote SIGOS GlobalRoamer can add value to many aspects of the Roaming Hub business model. GlobalRoamer is an ideal enhancement to hubs.

Get the full picture of your roaming services

PMN B

PMN A

PMN C

One agreement

One relation

Clearing

Data Services SMS-IW & MMS-IW CAMEL

Reduced complexity

Roaming Coordination Signalling

Increased availability

PMN

PMN

PMN

PMN

PMN

PMN

www.keynote-sigos.com

23

Use Cases > Roaming Testing

Roaming Steering Testing

Are subscribers roaming with preferred roaming partners abroad?
Steering of Roaming (SoR) has been rolled out by Operators in order to direct their outbound roamers to preferred VPMNs in the roaming destinations. Does it work? Steering of Roaming (SoR) solutions have been implemented by mobile operators in order to direct their outbound roamers to preferred VPMNs in each country. In some cases just one preferred VPMN in a country is chosen, in other cases SoR is about managing the proportion of revenue and tra c shares between two or more VPMNs. SoR is the logical result of roaming/IOT agreements which are linked to volumes and percentages for one or more preferred VPMNs. On one hand it is a signi cant commercial matter to detect short- or long-term deviations from these target distributions, on the other hand it is worthwhile to test potential deterioration of customer experience caused by SoR. Get the full picture of your roaming services Detection of Anti-Steering of Roaming is essential as operators may lose subscribers to non-preferred networks resulting in margin losses. Anti-steering is not only a breach to roaming agreements but may also lead to a bad roaming experience as the subscribers could be left without any coverage. Subscribers will not blame the VPMN but their subscribed home network. Subscribers will also not be able to bene t from the special roaming retail tari s that have been o ered to them. By detecting anti-steering activities, higher roaming costs can be avoided. Operators primary business goal is to streamline roaming steering mechanisms such that outbound roaming revenues are optimized while maintaining high levels of end user satisfaction.

VPMN A
Outbound Roaming
ed! Preferr

VPMN B
Outbound Roaming

HPMN

VPMN C
Outbound Roaming

HPMN MSC/VLR Non-Preferred VPMN 1 SoR node MAP messages Update Location UpdateLocation.error 4x UpdateLocation.error 5th attempt is on next VPMN; in this case the preferred PMN Update Location InsertSubscriberData InsertSubscriberData.ack Location Updating Accept UpdateLocation.ack HLR/ AuC

1 2 3 4

Location Updating Request Location Updating Reject 4x Location Updating Reject

Preferred VPMN 1

Location Updating Request

KPIs (examples): Location Update Duration also delivering indication of deterioration of end user experience Number of PMNs rejected number of quad attempts or roaming not allowed rejects List of rejected PMNs non-preferred PMNs tried PMN after successful steering also indicating successful SoR at all LUP mode (automatic/manual) testing correct behavior of SoR Server for manual selection Reject Causes (i.e. Network Failure, PLMN)

24

www.keynote-sigos.com

Use Cases > International Carrier Quality Testing

International Carrier Quality Testing

Who is the best international carrier of choice?
Setting up a call to a subscriber in a foreign country involves the choice of the relevant international interconnection carrier. How much impact has the interconnection carrier on QoS? Who is the best interconnection carrier partner? There is a need for both mobile and xed operators to get a global perspective on interconnection service quality in order to maintain high levels of QoS to subscribers. The international interconnection quality experience is heavily in uenced by the choice of the international carrier at the national boundary. By testing international carriers with an active monitoring system, you can not only monitor if the right calling number is displayed abroad but also the voice quality and call setup time, which can be e ectively measured and reported. In addition, international carrier quality testing can be coupled with False Answer and SIM Box Detection. KPIs (examples): Received CLI on destination side CLI Indicator distinguishing the following cases: CLI from CgPN (OK) No CLI (N) Wrong CLI (W) Mean Opinion Score (PESQ MOS) for Voice Quality (ITU-T P.862.1) Call Setup Time
Example of international CLI quality testing

Stay in control of communication beyond your network

Testing with pre xed called numbers requires knowledge about the current setup at the international gateway exchange. The deployment of an SS7 LU directly at the international gateway Exchange ensures dedicated interconnection carrier testing. Poor CLI and voice quality would inevitably decrease revenue and market share.

For example, if no CLI is received, there would be no possibility to call back and poor voice quality would result in short and frustrating conversations. Maximising revenue is essential in an environment of falling wholesale prices. This objective can only be achieved if you have consistently high quality on your network and on your international interconnection.

Private SITE System

Dedicated carrier route selection

KPI / SLA monitoring

Global Resource Pool

International Gateway

Interconnection Carriers
25

www.keynote-sigos.com

Use Cases > Revenue Leakage & Fraud Detection

Revenue Leakage & Fraud Detection

Make sure your roaming revenues are not being detoured
Fraud - the word sounds quite exciting when it appears on a cinema billboard or a TV programme schedule but when it hits you personally, professionally, or in a corporate environment, it is much less enticing. Fraud will never be completely eliminated but, unless fraud management countermeasures are undertaken, it is unlikely that it will be reduced to a manageable level.

SIM Box Detection

The business goal is to gradually clean incoming tra c terminating through SIM boxes by disconnecting all SIM Box numbers detected and to protect the network from any potential fraudulent upsurge in their use. SIM boxes have multiple negative e ects on operators, roaming hub providers and customers alike, e.g.: revenue loss due to call redirection roaming calls are intercepted, redirected and terminated via fraudulent SIM Box equipment. unnecessary investment due to service inaccessibility as a result of SIM Boxes creating false network congestion issues. revenue loss through CLI Quality Problems; immediate impact is the in-ability to call back. image loss through bad QoS as SIM Boxes often redirect calls over inadequate, highly compressed IP connections, resulting in poor voice quality. Call setup time is extended which leads to the impression of bad call quality from the home network operator.
SIM

Fraud Bypass Detection Features:

Reliable detection of SIM boxes Safeguard your revenues Cost-e ective concept for fraud bypass detection Ensure rst-class end user experience through quick elimination of SIM boxes High test density possible while avoiding network congestion

Identify leaks in your revenue stream

Keynote SIGOS SIM Box Detection is BABT certif ied.

Originating Network

SIM Box Operators Local SIMs are used to terminate international incoming tra c

Terminating Network
Local Retail rate

(A) 0,14

(B) 0,10

GMSC

Air interface

BTS

(C) 0,15 Originating Networks: > PSTN > Mobile > VoIP > Carrier Select (CS) > Calling Cards > Carrier Pre Select (CPS)

Regular Transit

International Interconnect Termination rate

(D) 0,13

Terminating network operator loses 0,03 per minute, i.e. (B) - (D)

26

www.keynote-sigos.com

Use Cases > Revenue Leakage & Fraud Detection

Early Charging Detection

Get it right for your customers

A common phenomenon is the scenario of Early or False Answer during voice call setup procedures. How do you detect and ght these cases? Calls are being charged as if connected, without ever reaching the called party. The lack of Active End-to-End monitoring has led to millions of minutes being inaccurately billed to the originating calling parties worldwide. These fraudulent billings sometimes go unnoticed because the incremental billed call duration per user may be in the fraction of seconds. Prepaid SIMs used in GSM Gateways (SIM Boxes) could lead to false answers when the fraudulent SIM Box SIM credit has been consumed resulting in an announcement being played. In this instance the caller has to pay for the call connection leading to customer complaints and dissatisfaction with the service rendered. Fight fraudulent charges to your customers accounts with GlobalRoamer, the worldwide distributed test infrastructure for end-to-end testing.

Bene ts: Reduce revenue leakage caused by early charging / false answers Ensure billing accuracy and ght interconnect fraud Improve quality of calls leading to a reduction in customer complaints and dissatisfaction Active end-to-end monitoring ensures consistency in billing

International carrier(s) releases answer message even though call(s) are not setup Originating Network Terminating Network (CUSTOMER)
Setup Answer Fraudulent early return of Answer message resulting in charging record for non-delivered service Setup is not even sent to B-Party Call is not established International carrier(s) Setup

Identify leaks in your revenue stream

Unexpected answer on A-side detected and NO incoming setup on B-side International carrier(s) releases answer message even though call(s) are not setup Terminating Network CUSTOMERs SIMs (CUSTOMER) on Roaming
Setup International carrier(s) Setup Answer Setup is not even sent to B-Party Call is not establised Fraudulent early return of Answer message resulting in charging recod for non-delivered service

Unexpected answer on A-side detected and NO incoming setup on B-side

www.keynote-sigos.com

27

Use Cases > Revenue Assurance

Revenue Assurance
Money makes the world go round what happens if your network rating and billing are not correct?
For all network operators validation of billing is of major importance. Operators must provide fair and accurate billing to the customer and also avoid revenue leakage or overcharges caused by services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations. As markets have become increasingly competitive, operators have used innovative tari s, product and service bundles and discounts to di erentiate themselves. Complex and fast changing tari s inevitably create challenges in ensuring correct billing. Testing that is both end-to-end and independent can provide the assurance that the customers are being correctly billed as well as satisfying compliance requirements. Today, manual tests not only provide inaccurate, untrustworthy but in most cases cost ine cient testing. To ensure correct billing, a precise and reliable Revenue Assurance system is essential. With a SITE test system, continuous testing of all services provides maximum assurance that all calls are being correctly billed as each network element can be tested and veri ed.

How to guarantee correct billing?

Three Revenue Assurance concepts are highlighted: Test Call/Event Generation CDR Testing Tari Testing The reliable Revenue Assurance solution comprising CDR generation, CDR comparison and tari modeling is BABT certi ed.

Ensure correct billing, for you and your customers

Test Call/Event Generation

Test call and event generation can be as basic as creating network events by generating calls to test the correct function of a network or its subsystems. SITE is ideally suited as a Test Call/Event Generator for Revenue Assurance projects generating its CDRs to be referenced with the networks live CDRs. Operators need to recognize the value of more than just test call generation; you need to be able to store CDRs to perform veri cation and detection for errors AUTOMATICALLY. New product pre-launch testing can we bill accurately and reliably for the product? Testing of correct function after product updates does the mediation system still summarize all CDRs correctly? Testing of software patching on switches and other infrastructure are we still producing correct CDRs for all call classes? Testing new infrastructure during and after roll out, e.g. new base stations. Testing of roaming tari updates are roamers, still being billed?

28

www.keynote-sigos.com

Use Cases > Revenue Assurance

CDR Testing
Timely detection of revenue leakages
You want a solution which compares CDRs generated by network nodes like the MSC or SGSN in a highly automated way and sends alarms mismatches. SITE acts as a Test Call/Event Generator, it is capable of importing live CDRs from the network and comparing them with the reference CDRs generated by SITE. The live CDRs of the generated test calls are extracted at a chosen point in postprocessing for automated comparison by the test system. CDRs can be veri ed and erroneous CDR elds such as faulty time stamps and call duration can be detected.

CDR Structure Record Type: e.g. TimeBased, VolumeBased, EventBased Service Type: e.g. SPEECH, FAX, GPRS Begin of event: timestamp in milliseconds A Number B Number Call Duration (Time based calls) Data Volume (Volume based calls) Event Count (Event based calls)

Test Call Generation

Live Network

CDRs

Mediation System

CDR Postprocessing
SITE System Virtual SIM Transfer Automated E2E Call Processing (unrated) SITE CDRs (rated or unrated)

Ensure correct billing, for you and your customers

Billing

Filter*
Operator CDRs

CDR Import
Reference CDRs derived from SITE test results

CDR Import*
Live CDRs imported via e.g. csv- les

Reference CDRs

unrated CDR Comparison

Live CDRs

Rated CDRs Unrated CDRs * Customization required

Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test event generator which generates CDRs that you can compare with your network CDRs.

www.keynote-sigos.com

29

Use Cases > Revenue Assurance

Tari Testing
Proactively monitor tari plans against various test cases
You want a solution which not only compares CDRs but also detects billing errors before they turn into customer complaints or revenue losses.

Rating
At the heart of the billing system is the rating engine. This takes the CDRs (call detail records) or IPDRs (internet protocol detail records) from the network, and then applies the appropriate rating plans to turn this information into rated CDRs ready to be associated with the customer.

Billing
Once a CDR has been rated it is applied to the customers account, where discounts can be applied and from which a bill is created. Operators usually produce bills in cycles, spreading the load over a month or quarter and also evening out cash ow. Within SITE your tari model can be replicated. Thus, not only the raw data of CDRs can be compared but in addition also the correct billing of a service can be veri ed. Thanks to SITE, fast regression testing of new pricing plans against a variety of test cases can be performed, detecting potential aws in the billing process at a very early stage.

Ensure correct billing, for you and your customers

Test Call Generation

Live Network

CDRs

Mediation System

SITE System

Virtual SIM Transfer

Tari CDR Model Postprocessing Filter*

(rated)

Billing

Automated E2E Call Processing (unrated) SITE CDRs

Operator CDRs

CDR Import
Billing Veri cation Rating

CDR Import*

Tari Model*
Reference CDRs

unrated CDR Comparison

Live CDRs

Invoice comparison Resource allocation for di erent users or groups Detailed test reports Revenue stream audit Covering billing aspects of outbound roaming

Rated CDRs Unrated CDRs * Customization required

30

www.keynote-sigos.com

Use Cases > Revenue Assurance

Prepaid SIM Recharging

With prepaid subscribers you make substantial pro ts
Prepaid subscribers expect correct voucher recharging. Keynote SIGOS provides a tool to verify Prepaid SIM Card Recharging. SITE or GlobalRoamer have the ability to check if recharging procedures of prepaid cards has been performed successfully. Test Cases collect information about the current account balance and establish a call in the same way a subscriber does. That means entering vouchers using DTMF tones for navigating IVR menus or using USSD commands where supported. After a SIM card recharging attempt the account balance of a dedicated prepaid SIM card is re-checked and compared to balance before recharging attempt. Besides using single vouchers (e.g. from scratch cards) for a single test, Keynote SIGOS Test Systems support comprehensive voucher repository functionality managing numerous numbers. Further customer speci c account verication methods (e.g. via SMS) are also supported on request.

Sample Features
Detection of revenue leaks due to SIM card recharging errors Increase of customer satisfaction and spending due to error free SIM card recharging Simpli ed prepaid SIM card handling in the central SIM Multiplexer

Sample KPIs
Initial account balance Account balance after recharge Used Voucher for recharge Received USSD response string USSD process duration

Ensure correct billing, for you and your customers

www.keynote-sigos.com

31

Use Cases > Fixed & IP Network Testing

Fixed Network Testing

NGN evolution calls for multi-technology testing
With the explosive growth in the mobility arena, one could almost believe that the future of xed networks was doomed. However, xed networks continue to maintain their relevance, with technological evolution requiring new test approaches. Technological advances and the complex changeover from established technologies to new ones triggers the need for ensuring consistency of service quality over all underlying technologies. Poor service quality inevitably leads to loss of pro t if, for example, the line is bad the conversation will be short. With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies xed, mobile and IP-based, either within one technology or across technologies. Fixed network operators bene t from SITE through: Periodic service quality testing Ad-hoc service quality testing SITE supports all interfaces required for xed network testing: PSTN ISDN DSL IP (VoIP) KPIs for xed network testing (examples): Delay Echo Delay MOS Value

Beyond mobile the other kind of telecommunications

Testing in all network technologies, mobile, xed and IP

32

www.keynote-sigos.com

Use Cases > Fixed & IP Network Testing

IP Network Testing
Optimize your data network performance
Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you relying on your customers to nd out about incidents, availability, speed and load issues? Mobile has made its impact on connecting the last mile, particularly for voice communications, but has yet to make its impact on higher speed links and at least one mobile company has admitted that it cannot deliver the speeds contained in the 3G speci cations. So where do xed networks with IP connections beat radio-mobile? When capacities and speeds are high, where Internet access is required or where there are large les to be downloaded, then the optical bre link remains supreme, whether it is a link to a corporate client, a national backbone network or an international submarine cable system.

SITE measures the user perception of your services SITE checks the quality of your calls in real time Use SITE for proactive supervision! Secure your IT with SITE End-to-End monitoring! SITE measures and alerts you in real time!

Beyond mobile the other kind of telecommunications

Web Browsing (HTTP)

KPIs (examples): Duration between the rst and last http data packet HTTP Data Size Duration of web browsing session HTTP Valid Page Content

Ping (ICMP)

KPIs (examples): Round-trip time (min, mean, max) Packet loss Size of Ping packet

FTP SOAP
KPIs (examples): Response Time of SOAP server in seconds

KPIs (examples): Network Non-Accessibility File Size Download Duration Upload Duration IP Service Failure Ratio

TCP/IP Command

KPIs (examples): TCP/IP command Duration of TCPIP command

DNS

KPIs (examples): DNS Query Duration (min, average, max) DNS Host Name Resolution Time DNS Host Name Resolution Failure Ratio

www.keynote-sigos.com

33

Use Cases > Core Network Testing

Core Network Testing

Service Testing independent from Radio Problems
Testing without Radio Access
In some cases the active test approach of using test mobiles on an air interface can be counterproductive because radio speci c problems can disturb results without adding any value. A typical example is roaming testing, where the problems come from the core network. For such cases there is bene t in testing the services by means of simulating the radio access part, connecting directly to the core components such as the MSC, SGSN etc. without involving the radio access components.

Regression Testing
Another instance where connection direct to core network components is required is where tests need to be executed in a very short time. This is typically the case when network components like the MSC or SGSN have been updated or where the inuence of a high number of concurrently connected subscribers has to be checked immediately and automatically. Such kinds of regression testing can usually be executed in less than 20 minutes whilst still covering all services and subscriber pro les.

Typical use cases for testing without radio access part:

Interactive Voice Response incl. interactive announcement tests Testing of Supplementary Services Testing of IN Services Inbound Roaming tests Load Tests on Core Network components Billing Testing via CDR tests Data Content Testing Handset Simulation etc.
ork ore Netw Mobile C

Typical use cases for regression testing without radio access part:
Automated regression testing after upgrade/updates on: MSC (via GSM A) MSC and xed network switches (via ISUP) SGSN (2.5G) via Gb MSC-Server via IuCS SGSN via IuPS SMSC, MMSC WAP-, Web-, Mail-Server SCP testing including IN services and prepaid services etc.

Inside out core network testing can save money

ore Mobile C s Interface rk o Netw

Typical advantages of core network testing:

Not in uenced by radio speci c problems Fast execution of mass tests (e.g. thousands of tests in an hour) Quick results Detailed trace analyses with protocol stack information

see page 2

34

www.keynote-sigos.com

Use Cases > Nomadic & Indoor Testing

Nomadic & Indoor Testing

Portable local unit for exible deployment and mass testing
Indoor: Shopping and Exibition Centers or Airports places of communication. But do mobile services work properly everywhere? There are a lot of interesting and revenue generating use cases for indoor testing. Especially in international airports where testing of inbound roaming characteristics is crucial to secure lucrative business. Also exhibition centers and shopping centers are typical buildings where subcribers very often experience lack of service. Furthermore it is worthwhile to mass-deploy the cost-e cient nomadic units in o ce towers with a lot of business customers. For indoor testing either the air interfaces or direct LAN connection can be recommended.

Sports and Social Events: Testing campaign of short time frame and short notice. The Nomadic local unit is also ideally suited for short-term campaigns like sport events. A lot of sports fans gather at top level events like Formula 1 or soccer championships and expect high levels of service quality. Due to its fast installation the nomadic units can be quickly rolled out even at short notice. After easy deployment at temporary locations this autonomous system sends network information back via its air interfaces. Rural Areas: Where there are people there should be communication. Especially in remote areas it is often impossible to install local units, as no xed IP connection is available. In this case the nomadic local unit is capable of establishing a permanent IP connection via GPRS/EDGE/HSPA modem. The connection is upheld via IPSec tunneling. By this means, test probes can be quickly installed in rural areas where you cannot rely on wired IP connections. The Nomadic local unit is the ideal solution for exible deployment in the eld.

Reach out to remote and temporary locations

www.keynote-sigos.com

35

Invest in the future!

Keynote SIGOS test systems adapt to your demands.

36

The Test Systems

Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c Worldwide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

GlobalRoamer
The Reference System for worldwide testing Largest footprint of test probes around all around the world Managed and serviced by Keynote SIGOS Extensive set of test case applications

Fraud Detection Revenue Assurance Tool

Roaming Testing
Clients

SITE Central Unit

LAN /

Drive Service Testing

CLU LU WLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

GO

P GR h wit AL B GLO

SITE
The Unique Test Platform for various technologies Mobile / Fixed / IP testing Core Network testing Globalize with GRP

37

Test Systems > GlobalRoamer

GlobalRoamer
The On-Demand worldwide test platform!
Challenge
End users demand and expect a high quality, reliable service from their chosen network operator and a similar experience regardless of where in the world they are. Therefore, permanent surveillance of the roaming network is indispensable but extremely di cult due to a lack of operational visibility of the roaming partners networks.

Solution
GlobalRoamer allows you to verify that all services are available to your customers who are traveling worldwide. With test probes in 180+ countries you have your world wide testing platform without investing in infrastructure. Just buy your testing package and run your tests worldwide.

Managed Services are on o er to all Operators looking for an e cient solution!

How does it work?

For testing in mobile networks, by means of Keynote SIGOS SIM Multiplexing technology, your SIMs are capable of being virtually transmitted to any of GlobalRoamers extensive network of remote test stations in more than 230 locations, where tests simulating end customer experience are performed. Complete, real time visibility of the resulting network messaging allows rapid fault resolution. GlobalRoamer also allows you to perform tests across technologies, e.g. Fixed and IP networks as Fixed Mobile Convergence (FMC) becomes more prevalent!

Automated active End-to-End Testing and Monitoring

Get the full picture on what your customers experience worldwide Initiate reproducible test cases which cannot be done with passive monitoring solutions

Unique SIM Multiplexing Technology

SIM cards are hosted centrally from where they are virtually transmitted to any of GlobalRoamers remote test stations where the actual test is performed

Global Testing Network

GlobalRoamers extensive global network of test stations allows access to three quarters of the worlds countries and is continuously being expanded

38

www.keynote-sigos.com

Test Systems > GlobalRoamer

All you need to do

Order your account at Keynote SIGOS For testing in mobile networks: send your test SIM cards to Keynote SIGOS! Access the worldwide test network via the internet! De ne and set your tests running! Collect the results!
GlobalRoamer Login

How to access GlobalRoamer?

NETWORKS

COUNTRIES

LOCATIONS

The World at Your Fingertips

676
677

675

186
187

185

250
251

249

Enter the most extensive global network test system from your desk and gain access to:

GlobalRoamer country GlobalRoamer location

GlobalRoamer is growing continuously. Please contact us for the current footprint and more details. Q4 2012

www.keynote-sigos.com

39

Test Systems > GlobalRoamer

The High Performance Global Test Infrastructure

On-Demand End-to-End Test System for Roaming Situations and More
What is GlobalRoamer? Get access to test 600+ networks in more than 90% of the worlds countries Continuous growth of telco networks accessible through GlobalRoamer Fully hosted and continuously expanded by Keynote SIGOS 2G, 2.5G, 3G and LTE network probes Fixed network probes available

The Cost-e ective Testing Solution

Take Advantage of Deploying GlobalRoamer Without Having to Think About Labor Intensive Operations
Simply start using GlobalRoamer no maintenance, no CAPEX No setup or exit fees for GlobalRoamer use Flexible packages available (prepaid for ad-hoc testing / at-rate for periodic testing) Pay-as-you-use concept

The Independent Round-theClock Event Generator

Bene t from Availability and Accessibility to the Whole World Anytime, Anywhere
Easy web access allows 24/7 availability, irrespective of time-zones Independence and convenience through pre-scheduled automated test execution Massive worldwide test capacity, your SIMs can be used almost anywhere at any time

The Time-Saving and Customizable Tool-Box

Enjoy the Convenience of Prede ned Tests and Reports Whilst Keeping the Option to Customize
Comprehensive libraries of test cases and report templates save valuable time Customer-speci c test cases and reports allow for full exibility User-friendly web-based graphical user interface

The Reliable Sentinel Always on Duty

Keep Track of Your Network On-time and Relevant Information Delivery at your Fingertips
Extensive alarming, performance noti cation and reporting functionality Customizable alarms to alert you to any network issues Adjustable information-depth (from high-level overview to deepest-deep details) Continuous network surveillance with reports (several styles, from graphical to plain text)
www.keynote-sigos.com

40

Test Systems > GlobalRoamer

Use Cases
Service Quality in outbound roaming (on-demand testing / periodic testing) Full range of QoS applications (Voice / SMS / Data) (page 14) Outbound Roaming Testing GRQ GSMA compliant testing (page 22) Steering of Roaming (SoR) Testing Evaluation of proper application of Steering of Roaming and detection of Anti-Steering activities (page 24) Fraud Detection for International Tra c SIM Box Detection, False Answer Detection (page 26) International Carrier Quality Testing Full range of QoS applications (Voice / SMS / Data) (page 25) Revenue Assurance in an international context CDR Comparison, Roaming Tari Model Testing (page 28) International Interconnect Management CLI Veri cation, Voice Quality (MOS), Call Setup Time, Call Attempt Success rateetc. (page 25) Benchmark Testing in operator groups See how your network performs within one operator group (page 19) Service Level Agreement (SLA) Veri cation Verify the ful lment of Service Level Agreements (page 22) Handset speci c Testing in outbound roaming Automated content testing with a broad selection of simulated handsets
(page 18)
Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c Worldwide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Use Cases for GlobalRoamer

Clients from all over the world rely on GlobalRoamer

Mobile Network Operators Fixed Network Operators Mobile Virtual Network Operators (MVNO) Carriers Content Providers Regulators

Who bene ts from GlobalRoamer?

Departments (Examples):
Service Quality Management Operation and Maintenance Roaming Billing Fraud Management Marketing Interconnect International Business Revenue Assurance

www.keynote-sigos.com

41

Test Systems > SITE

SITE
One platform for all your End-to-End test requirements
Challenge
Today, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and reducing cost whilst also maintaining customer satisfaction. Since these tests can be both, labor-intensive and costly they are too often neglected. To meet these challenges preventive and permanent Service Quality Assurance by means of End-to-End testing is essential.

Solution
Keynote SIGOS has developed the most advanced automated test system available on the market. SITE is the proven and exible test platform for cost- and time-saving automated Active End-to-End testing. With SITE, telecommunication operators all around the world bene t from its unique versatility. SITEs modular structure and scalability ensure it can always be matched exactly to your requirements. In addition, your local SITE system can go global by connecting to the worldwide GlobalRoamer probes with our Global Resource Pool feature all in one go!

Why SITE?

Why Automated Active Testing and Monitoring with SITE?

Get the full picture of your end users experience (QoE) and act, instead of reacting to customer complaints Continuously monitor service availability, test and measure quality (KQI) and performance (KPI) Upfront testing ensures a smooth roll-out for new services and new technologies Initiate reproducible test cases which cannot be done with passive monitoring solutions Comprehensive network diagnosis, reporting and alarming Services can be tested before commercial release Identi cation and localization of service and network can be achieved before actual service degradation and threat of revenue losses Reduced time and risks to install or modify network infrastructure by providing extensive recursive testing capability Reduced operating costs by automating monitoring, testing, and reporting; increased personnel e ciency; costs not correlated with network size and growth Number of test cycles is exible

Network Services

SITE Solution Tests ALL

Network Interfaces

SPEECH
Voice Voice Quality Suppl. Services IVR Push-to-Talk VoIP Echo

DATA
DATA IP (CS/PS) Web/Wap Browsing E-mail Streaming Video Telephony Video Quality Digital Rights Mgmt.

MESSAGING
SMS MMS Mobile IM iPhone BlackBerry

FIXED
ISDN S0 ISDN PRI S2m PSTN a/b

RADIO
LTE Uu HSPA+ / DC UMTS Uu EDGE GSM Um CDMA 2000 GSM-R

IP
WLAN DSL Ethernet MM7 SMPP, UCP, CIMP SMTP / IMAP POP3

CORE
IuCS / IuPS GSM Gb GSM A ISUP SS7 IN / CAMEL MAP (HLR/VLR) S1

42

www.keynote-sigos.com

Test Systems > SITE

Open, Modular and Customizable Just the Right System, Always

SITE is an open system and can be easily integrated into existing test environments Existing equipment can be directly linked to SITE and controlled and monitored through the SITE system Software updates, con guration modi cations and problem resolution are quickly and reliably performed by Keynote SIGOS SITEs modular structure software and hardware guarantees maximum exibility in service and protocol testing From portable and Stand-Alone Systems in test laboratories to distributed systems covering the geography of an entire live network, everything is possible

What is SITE?

ONE Test System, ENDLESS Testing Options

SITE uniquely combines Quality of Service (QoS) testing with the ability to deliver Core Network Testing all in ONE test system Mobile, Fixed, VoIP testing Protocol test interfaces SITE enables both, single technology testing as well as cross technology testing Mobile / Fixed / IP-based - all kind of combinations can be tested 2G, 2.5G, 3G and beyond all mobile network technologies can be tested SITE enables thorough testing of all relevant mobile and BlackBerry services, even taking handset speci c characteristics into account if desired Voice Messaging Data Video Value Added Services SITE provides test solutions for billing veri cation and other revenue assurance related applications

Fraud Detection Revenue Assurance Tool

SIM Multiplexer Clients
LAN / WAN

Roaming Testing

SITE Central Unit

Drive Service Testing

CLU LU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

www.keynote-sigos.com

43

Test Systems > SITE

How does it work?

Central SIM Multiplexing Technology an Unparalleled Teleporter for SIM Cards SIM cards are centrally hosted and virtually transmitted to any of the systems remote test stations where the actual test is performed. SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards. Subscriber information from a SIM card is read out by the system and transmitted via a LAN/WAN network to any test location required. The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central SIM Multiplexer unit. Intuitive Workbench Tailored to Users Speci c Demands Comprehensive set of tools are available for Test Creation, Diagnosis as well as Alarming and Reporting to adapt SITE exactly to user demands. (see page 50) Con gurable user access rights User-friendly and intuitive Graphical User Interface which can be accessed from Windows and Linux platforms alike through the Inter- or Intranet. Role-based GUI views provide the right level of information and tools depending on the users role (Test / Report / GIS / Admin).
Test/Report
Network Expert Test Manager Test Case Designer

GIS

Admin
System Administrator

User role-based GUI always gives the right level of information to the user

Test Analysis

Test Admin

Test Design

GIS

System Data Health Bases

The SITE Architecture Ensuring High-Performance, Security and Stability SITE runs on a stable, Linux based server solution o ering highest standards of redundancy. SITE client workstations can be either Windows or Linux based. To ensure maximum performance, the SITE System uses an open SQL database. All con guration information, test results, measurements and KPIs are stored logically, to provide clear measurement and reporting capabilities. Using powerful lter functionality any database listing can be easily modi ed and a multi-format export function allows the sharing of data with other network support tools. Behind the Scenes SITEs Unique Test Management SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be de ned once or periodically, based on very exible selection criteria of date, day, time, frequency and number of repetitions. To avoid any resource con ict, an intelligent resource management system controls access to interfaces and SIM cards, assuring smooth operation and maximum test parallelism. The self-management checks system components regularly and generates an alarm (SNMP-Trap) in the event of any failure.

44

www.keynote-sigos.com

Test Systems > SITE

Globalize your SITE system and take o with GRP!

With Global Resource Pool your SITE system gets access to test probes all over the world
Most SITE solutions are deployed for testing networks within national boundaries. Some existing SITE installations cover international testing by deploying SITE Local Units in neighboring countries for purposes of outbound roaming testing and fraud detection. The unique Global Resource Pool (GRP) feature now allows users to connect private SITE systems with the worldwide network of GlobalRoamer test probes. By this, it means your local SITE system can get access to Keynote SIGOS hosted probes in more than 580 networks worldwide! As GRP connects to GlobalRoamer, which comes as a scalable pre-deployed infrastructure owned and managed by Keynote SIGOS, Operators are liberated from cumbersome manual implementation, operations and maintenance of these Remote Test Interfaces. GRP currently contains GSM Um and UMTS Uu interfaces which are all available for testing.

h wit L A LOB OG

P GR

Connect your local SITE system to the worldwide GlobalRoamer probes with the unique Global Resource Pool feature!

www.keynote-sigos.com

45

Test Systems > SITE > Hardware Components & Interfaces

Hardware Components & Interfaces

Scalable and highly exible infrastructure!
Central Unit
This is the base of the whole Keynote SIGOS Test System SITE. Everything important is integrated: O&M Manager, Scheduler, Resource Manager and Test Execution Manager. Central Unit Extensions (CUX) are important to give the possibility to increase the number of parallel running test cases.

19 (rack mount) 100 V - 240 V, max 8A 4A, approx. 450 W

Main Hardware Components

SIM Multiplexer
The SITE SIM Multiplexer has the capacity to handle up to 225 SIM cards at a time. There is no limit to the number of SIM Multiplexers connected to the SITE System, resulting in an unlimited capacity to manage thousands of SIM cards. Any SIM authentication procedure is handeled between the real SIM stored in the Multiplexer and the relevant interfaces (wireless / core).
SIM Card Board

SIM Server 100-240 V 1A, 50/60 Hz Low power consumption Compact design, only 3HU Compatible for SIM, Micro SIM, USIM, R-UIM Automated voltage negotiation for each SIM card position

Test Interfaces
Keynote SIGOS SITE Test System supports the whole range of todays telecommunication networks. Testing them needs multiple interfaces which are integrated in the SITE systems.

Sample Interfaces

46

www.keynote-sigos.com

Test Systems > SITE > Hardware Components & Interfaces

Remote Components
The remote units, also called local units, are installed wherever they are needed for 2G, 2.5G, 3G and LTE or core network tests.

1) stationary: to be used in a static location 2) portable: can be moved from one location toanother 3) mobile: can be used along the way

Remote Components

CLU5 / WLU5

Nomadic

Local Unit

MLU

Device Gateway
As extension to an existing SITE System the Device Gateway enables the connection of real devices (USB data sticks and Smart Phones) for QoE testing.

All Components: Developed by Keynote SIGOS, made in Germany.

www.keynote-sigos.com

47

Deliver high performance!

Keynote SIGOS provides you with the optimal tools.

48

The Test Tools

On SITE and GlobalRoamer
Reporting & Alarming
> Dashboard > Matrix Report > GIS

Test Creation Tools

> Test Case Editor > SITE Recorder > Test Sequence > Control Structure

Diagnosis Tools
> Service Alarm Map > 3G Layer 3 Tracing

49

Test Systems > Test Tools > Reporting & Alarming

Reporting & Alarming

Fully integrated in GlobalRoamer and SITE
SITE and GlobalRoamer Reporting enables users to create, view and forward multiple reports. These reports are generated from measurements collected in the KPI database. These reports can either be based on Keynote SIGOS standard Key Performance Indicators (KPIs), customized KPIs or KPIs according to ETSI standards. Report creation is done by means of an easy drag-and-drop arrangement. SITE and GlobalRoamer Reporting o ers the possibility to visualize test results using various graphical tools, serving even very speci c presentation and monitoring needs. Flexible standard charts and diagrams as well as enhanced functionalities like histograms, percentile, ad hoc reporting and derive to can be immediately generated from recorded KPI data. Real time alarming is also embedded: resulting alarm noti cations are automatically distributed via SMS, e-mail, SNMP, etc. to de ned recipients. Users can de ne threshold-settings, counters, severity triggering points, etc. which control when alarms should be generated or cleared. Reports can be illustrated in di erent ways, either charts in various formats; markers, bars, lines etc, or by matrix tables to provide a fast color coded overview of vital services or speci c KPIs.

Test Execution on di erent locations

Online Reporting

Reporting Alarming
Test Executions

real time reporting alarming

Post Reporting

Raw-Measurements (Input and Output)

Measurements Strategy / KPI design

KPI Database

Report De nition

Measurement processing: from test execution to test reports

All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI performance in an optimal way: analysis of trends / analysis of incidents based on locations or based on service problems.

Who bene ts from reporting functionality?

Telco Service Manager, who read service performance reports Network Experts, who analyze test results and trace information Report Designer, who set up reports

50

www.keynote-sigos.com

Test Systems > Test Tools > Reporting & Alarming

Dashboard
This Graphical User Interface (GUI) system tool provides a simpli ed intelligent interface to SITE and GlobalRoamer reporting. It is of special interest to the people responsible for the service, who want to work intuitively without any training e ort. KPIs can easily be ltered and individually stored in a few clicks. Individual con gurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.

Matrix Report
The Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is especially useful for Network Management and Operations personnel.

Dashboard Matrix GIS

GIS
For service testing on the move, a Google Maps based Geographical Information System (GIS) is integrated into SITE. Each drive test case collects position data from a GPS receiver during visibility of GPS satellites. These are displayed in a GIS. This means that after service testing a rich set of KPIs according to GPS data locally analysed, displayed on operators individual geographic maps or on Google Maps.

www.keynote-sigos.com

51

Test Systems > Test Tools > Test Creation Tools

Test Creation Tools

Easy and time saving con guration!
Test Case Editor
SITE provides large libraries of Test Cases for main network services in various formats with detailed parameter options. It is also possible to create customized test cases by means of the assembly of various test steps via a user-friendly drag-and-drop mechanism that SITE provides in its Test Case Editor environment. Complex scenarios can be quickly built to enable the testing of new network services.

Control Structure
The Control Structure enables test users to easily create tests at various locations and with di erent SIM cards. It uses the logical operators: list based FOR EACH condition based REPEAT time based WAIT

SITE Recorder
This Tool allows intuitive automated recording of browsing actions taking handset characteristics into account. Mobile and provider speci c web and WAP pages are retrieved from the network via the test probes during recording sessions to get a feel for real download behavior and latency. Traces are shown live while the developer is browsing. The test case can be evaluated before saving the entire browsing session for replay. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a speci c handset or browser in a remote location with no need to travel anywhere to use it.

Test Sequence
The goal of the test sequence concept is to save execution time by avoiding the resource consuming location update process being repeated for each subsequent test case. Usually a test case starts with a switched o mobile terminal. The side-e ect of this approach is that each test case has the following procedure: location update make a call (service test 1) switch o Each of these steps often require more than one minute each to complete. For saving test execution time, an arbitrary number of service tests can be combined in one test sequence, which requires only a single location update. This e ectively simulates typical mobile user behavior e.g.: switch on a mobile (location update) make a call (service test 1) send an SMS (service test 2) web browsing (service test 3) make a call (service test 4) switch o

Test Case Editor SITE Recorder Test Sequence Control Structure

52

www.keynote-sigos.com

Test Systems > Test Tools > Diagnosis Tools

Diagnosis Tools
Keep the overview or go into details!
Service Alarm Map
The Service Alarm Map is used to visualize mobile network services that target a speci c service area. Alarms that are generated by the failure or degraded performance of services can be linked to a speci c network element within the operators infrastructure. This function is implemented by careful correlation between the speci c elements used within a test case execution and the overall network topology which has supported the test scenario that generated the alarms. An example could be a WAP test initiated from a wireless interface located at latitude (x), longitude (y). The topology for this scenario would use speci c BTS/node B, BSC/ RNC infrastructure, assigned to an MSC/ SGSN nally reaching a speci c content portal. Each piece of network information and trace is processed to provide signi cant data on the actual network performance and functionality, nally the data is combined to give a total service area view.

SERVICE View With Service view you get an easy high level overview about the status of the whole network. DETAILS View The Details view is accessed via single network elements of the Service view. It shows exactly which test case leads when to which failures.

Service Alarm Map 3G Layer 3 Tracing

Layer 3 Tracing
Deeper insight into message ow with Layer 3 tracing
Keynote SIGOS o ers SIGOS o ers Layer 3 tracing for 2G, 3G and LTE which is very important for telecommunication network testing. The primary goal is to get a deeper insight into the message ow and the protocol data exchanged between mobile station and network. On Qualcomm-based mobile probes Keynote SIGOS records traces of the Layer 3 Non-Access Stratum (NAS) signalling messages sent and received by the mobile. The information contained in these traces is vital for monitoring and troublewww.keynote-sigos.com

shooting the communication between mobile station and core network. Optionally, the NAS traces are supplemented with traces of Radio Resource Control (RRC) signalling messages exchanged between the mobile and the radio access network. These RRC traces provide valuable additional information, facilitating monitoring and troubleshooting of the Access Stratum (AS) as well. For 2G and LTE, Non-Access Stratum (NAS) Layer 3 tracing is supported.

53

Always at your service!

Keynote SIGOS allows you to test the full range of services.

54

The Test Applications

Network Registration
> Location Update > GPRS Attach

Voice / Voice Advanced

> Voice > Interactive Voice Response > Push-to-Talk > Supplementary Services > Voice Quality

Messaging
> SMS > MMS > Mobile IM

Data

> Data IP > E-mail > WAP / Web Browsing

Video

> Video Telephony > Video Quality > Streaming

Value Added Services

> Ring Back Tone > Digital Rights Management

Handset oriented testing

> BlackBerry > iPhone > Handset Simulation

55

Test Systems > Applications > Network Registration

Network Registration
Fundamental for all mobile services!
Each mobile subscriber wants to be able to communicate in the cellular telecommunications network without having to consider whether the network technology is 2G, 2.5G or 3G. This requires a successful mobile device registration on the base station subsystem (BSS). This is always the rst step for further communication. Even if a call is not set up, the network needs to be able to communicate with the mobile handset to pinpoint where it is. Hence, a mobile network is divided into multiple cells (Base Transceiver Stations BTS). And a group of cells is considered a location area. A mobile device in motion keeps the network informed about changes in di erent location areas. If the handset moves from a cell in one location area to a cell in another location area, the mobile device should perform a location area update to inform the network about the new location of the mobile device. Each Keynote SIGOS test case requires this successful network registration.

Location Update procedure is performed: when the mobile device has been switched o and wants to become active, or when it is active but not involved in a call, and it moves from one location area to another, or after a regular time interval because of signal fade
Some aspects of the registration procedure:

Network Registration Location Update GPRS Attach

make contact with the base station the mobile device registers to the network for access

Sample KPIs
Location Update Duration Received Signal Code Power RX Level Service Type GPRS Attach Duration PDP Context Activation Duration

to start a voice and/or data session

Network location registration is not only necessary for each call, but also for location based services like friends- nder!

56

www.keynote-sigos.com

Test Systems > Applications > Network Registration

Location Update for CS / PS Domain Registration

Mobile switch on Whenever a mobile device wants to obtain service from a cell, it must make sure beforehand that its subscribers SIM can be registered for that cell. By switching on the mobile device, it directly requests to update its current location information in the network. If this is performed successfully, the network acknowledges this with a message Location Update Accept. During this process, the network can ask for the mobile devices identity and check it against reference data (Identi cation and Authentication). When the service con dential subscriber identity has been activated, a new Temporary Mobile Subscriber Identity (TMSI) assignment becomes a component of the location update. In this case enciphering of user data is activated and the new TMSI is transmitted together with the message Location Update Accept. The TMSI is used for security purposes, so that the International Mobile Subscriber Identity (IMSI) does not have to be transmitted over the air interface. The TMSI is a randomly assigned identity, which is updated each time the mobile device is in motion. Network Registration Location Update GPRS Attach

Location Update Request

Identi cation

Authentication

Ciphering Mode-Activation

Location Update Request

Ready for circuit switched services (Voice...)

GPRS Attach Request

Identi cation

Authentication

GPRS Attach for mobile data connection

GPRS Attach is the process during which the mobile device informs the packet core network about its presence in the network. The device usually initiates the GPRS attach after power on. The message sent to the new Serving GPRS Support Node (SGSN) contains the last assigned TMSI, location area information, etc. After the GPRS Attach, procedure when the mobile device is attached to SGSN and has been authorized, the mobile device is prepared for data communication. So when the mobile starts communication, it initiates establishing of Packet Data Protocol Context (PDP context activation).

Ciphering Mode-Activation

GPRS Attach Request

PDP Context Activation

Ready for packed switched services (Data...)

www.keynote-sigos.com

57

Test Systems > Applications > Voice

Voice Services
The basic elements for telecommunication!
Voice
Do not ignore your core services!
Voice services are fundamental to telecommunications companies. It is vital that the user experience of these services is measured continuously by active testing. Only this can assure the quality of this core service. Veri cation of various KPIs are performed on basic voice parameters, such as checking B-channel availability, measuring call establish duration and call success rate alerts, to name a few.

Sample Features
CLI Check Call establishment to external party Call establishment between two parties Call establishment without answer on external side (no connective costs) B-Channel check Check of all available PLMNs

Sample KPIs
Call Duration Received CLI Establish Duration Alert Duration

Voice Push-to-Talk Interactive Voice Response Suppl. Services

Push-to-Talk
Back to the Future with Push-to-Talk!
The push-to-talk services turn mobile phones into walkie-talkies with unlimited range. The bene t of radio-style communication, especially broadcasting to multiple users, makes it much more convenient than making many phone calls or even call conferencing.

Sample Features
Test 1-to-1 or 1-to-many communication

Sample KPIs
Stop-Talking Timer Failure Ratio Stop-Talking Time Session Cut-o Ratio Session Setup Time Voice Delay (in session) Voice Delay ( rst)

Play and record speech data Emulating PTT mobiles Real End-to-End Testing of real-time-always-on voice service Check SIP (Session Initiated Protocol) Control Plane
Photo T-Mobile AG

Check RTP (Real-time Transfer Protocol) User Plane

58

www.keynote-sigos.com

Test Systems > Applications > Voice

Interactive Voice Response (IVR)

Do your voice response services work correctly?
IVR services are deployed during Voicemail access and are a common feature of everyday life such as phone banking, ticketing and customer hotline services. Testing these systems is essential for network operators (and their customers) to assure the quality of their services. IVR systems are sophisticated and extremely di cult to test on an active and reliable basis. Keynote SIGOS innovation has created a tool that can wholly automate this task. The IVR tester is designed so that even the most sophisticated speech menus may be recorded and recognized based on a library of voice prompts.

Sample Features
Testing IVR trees Voice mailbox tests Resource allocation for di erent users or groups Announcement comparison based on new voice prompts Easy integration of new voice prompts DTMF and voice stimulation Customer speci c extension Several languages available

Sample KPIs
Call Duration Duration of played audio le Length of recognized reference prompt Duration of recognition process Recognition con dence of best recognized Reference prompt Recorded audio le location Real duration of recording

Voice

Supplementary Services
Are your customers satis ed with your supplementary services?
Supplementary services like call forwarding, call waiting, call barring, call hold, CLIP/CLIR are multi-switched services which require complex interaction within the network and its elements. Other supplementary services, like prepaid customers checking their current account balance, involves the GSM protocol USSD (Unstructured Supplementary Service Data). At the same time, seamless and instant operation of all supplementary services, including noti cations and coding of all relevant information are vital for a satisfying end-user experience. Keynote SIGOS Test Systems provide you with a comprehensive range of test cases for all relevant KPIs and the ability to test USSD protocol commands as well as operator speci c extensions, so that your customers will pay you compliments on your supplementary services!

Push-to-Talk Interactive Voice Response Suppl. Services

Sample Features
Supplementary Service tests e.g. Call Forwarding Call Hold Call Barring CLIP / CLIR Call Waiting Multi Party Call DTMF and voice stimulation testing USSD testing

Sample KPIs
Forward Erase Duration Forward Register Duration Received CLI Barring Activation Duration Call Hold Duration USSD Received Response

www.keynote-sigos.com

59

Test Systems > Applications > Voice Advanced

Voice Advanced
Do you o er excellent Voice Quality?
Voice Quality
Do you o er excellent Voice Quality?
Voice Quality is, and will remain, the major key performance indicator for each operators network quality. This is recognized by subscribers and operators alike. Bad voice quality represents noise, echo, degraded tele-conversations and immediately sets a poor level of user satisfaction. International Carrier Voice Quality tests can reveal crucial quality information of di erent network carriers and if it has been impacted by the usage of IP routing or SIM boxes. Therefore, veri cation of voice quality is essential. Automated test methods with the intention to mimic subjective tests, allow for a cost e ective and consistent alternative to subjective testing, either on a referenced or an unreferenced algorithm. Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing

Referenced Voice Quality Testing (PESQ and POLQA)

Referenced Voice Quality testing is based on the ITU-T P.862 standard via the PESQ algorithm (Perceptual Evaluation of Speech Quality) and the ITU-T P.863 standard via the POLQA algorithm (Perceptual Objective Listening Quality Analysis). Both form the state-of-the-art techniques and international standards for automated advanced perceptual voice quality analysis, comparing actual test results with audio references. Referenced voice Quality Testing provides a very high level of accuracy. Sample KPIs
POLQA MOS value (P.863) PESQ MOS-LQO value (P.862.1) Background noise Average delay Attenuation Signal to noise ratio

Echo Testing
In the course of the migration of 2G/3G Core Network (CN) and Radio Access Network (RAN) towards IP based transport solutions the importance of Echo measurements raises considerably. In SITE, the echo itself is generated arti cially and its characteristics can be con gured by the user. This allows for the simulation of well de ned (acoustic) echoes that enables users to check whether the echo cancellers are con gured correctly. Sample KPIs
Echo Return Loss (ERL) in dB Echo Delay in ms Echo Classi cation (acceptable, unacceptable, side tone)

Sample Features
Reference speech quality assessment model Accurate full-reference model Customer speci c audio reference les are easy to integrate Objective Mean Option Score / Perceptual Evaluation of Speech Quality (MOS-LQO / PESQ) MOS Voice Quality result values from 1-5 Support of super-wide-band signals up to 14kHz

60

www.keynote-sigos.com

Test Systems > Applications > Voice Advanced

Unreferenced Voice Quality Testing (3SQM)

Keynote SIGOS Test Systems also support the Single Sided Speech Quality Measure 3SQM (ITU-T P.563) for advanced nonintrusive voice quality testing. The technology behind 3SQM is based on a generic perceptual approach and so is independent from any original reference signal. In comparison to intrusive measurement techniques, such as PESQ, 3SQM is based on single ended measurements. In consequence, accuracy may not be as high but measurements can be worked on an analysis of the digital bit stream on an IP packet level. The measurement is limited to the transport stream analysis.

Sample Features
Perceptual analysis of degradations in voice signals Non-intrusive, single ended analysis method Output score correlates well with subjective MOS Available as DLL/Library or Source

Sample KPIs
3SQM MOS value Noise level Background noise Beeps Signal to noise ratio

Voice over IP Quality Testing

Voice Quality is vitally important for any type of network that routes voice tra c. With the shift from dedicated circuits to the e ciency of IP based tra c, it brings its inherent issues with regard to the end customers satisfaction with quality performance. Additional PESQ KPIs such as Real-time Transport Protocol (RTP), Jitter and Packet Loss are actively monitored. Performing checks on a comprehensive set of voice quality metrics ensures that IP networks run smoothly and problems are detected before they cause major disturbances leading to customer dissatisfaction.

Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing

Additional KPIs
RTP Jitter RTP Packet Loss

www.keynote-sigos.com

61

Test Systems > Applications > Messaging

Messaging
Are your Messaging Services delivered reliably and on time?
Short Message Service (SMS)
One of the favored message services!
This simple network application results in large percentages of revenue for every mobile network operator. Therefore, this critical revenue stream would require constant active monitoring so as to achieve consistently high quality of service. SMS often su ers from long delivery durations, modi cation of content or missing text with multiple SMS messages. Due to roaming complexities, SMS messages may be lost resulting in non-delivery of the service paid for by the subscribers.

Sample Features SMS MMS Mobile IM

Check functionality of SMSC Check SM Service functionality at peak times Check SMS transmission time

Sample KPIs
SMS send duration SMS deliver duration SMS end-to-end duration SMS Success ratio

62

www.keynote-sigos.com

Test Systems > Applications > Messaging

Multimedia Messaging Service (MMS)

When words are not enough!
MMS are vital to the network operators younger and higher ARPU (Average Revenue Per User) customers. With its complex functional combination of SMS and GPRS, it is easy for the service to become unavailable in a complex mobile network that is often being upgraded or optimized. In order to gain acceptance as a reliable service frequently used by the subscribers, network errors must be avoided and uncovered by performing active continuous tests. This will safeguard the reputational health of the operators and ensure high quality standards. Sample Features
No MM storage limitations MM to legacy handset tests User de nable test messages MO/MT transmission of multipart MMs Segmentation and reassembly supported Expandable library of MMS test messages Logging

Sample KPIs
MMS send duration MMS fetch duration MMS push arrival to receive MMS Duration MMS connection to send duration MMS send to push arrival duration MMS end-to-end duration MMS Success ratio

Mobile IM
Can your customers chat via Mobile Instant Messaging?
The real time text based communication between two or more participants is popular on PC devices, e.g. Skype, ICQ, MSN, Yahoo, Google etc. This instant messaging platform has made the leap from the PC to the mobile device, connecting friends, peers and colleagues while they are on the go. To get connected to either xed or mobile IM users, Java applets are installed on mobile devices delivering branded IM user interfaces. A single device client may provide access to multiple IM systems which transmit and receive presence information. The device clients have to be compliant to the Open Mobile Alliance (OMA) Instant Messaging and Presence Service (IMPS).

SMS MMS Mobile IM

Sample Features
Registration at the IM server Successful login Get presence-information of other users and whether two parties can see each other Text message receipt from IM server Successful logout from the IM server

Sample KPIs
Time of OMA IM Login Request Session ID given from IM server Time when a party sends the message Time of OMA IM Logout Request

www.keynote-sigos.com

63

Test Systems > Applications > Data

Data
Boost your trusted data communication!
Data IP
Do you meet your subscribers demands with GPRS, EDGE, UMTS and HSPA Data Services?
Mobile IP data services o er subscribers a highly e ective way to connect to a dynamically rich world lled with internet based services such as Email, Instant Messaging, websites, VoIP and much more. GPRS represents the rst step towards faster access provided via EDGE, UMTS, HSPA+ (HSDPA / HSUPA). To maintain this exibility in speed, network operators have to deal with the operation and maintenance of multiple technologies. This complexity drives up costs. Sample KPIs
PS: GPRS Attach Duration GPRS access point PDP context activation Duration PDP setup Connect Duration PDP IP UP Duration

To increase revenue and service quality, SITE and GlobalRoamer o er data tests to access all available technologies via dedicated interfaces to discover service performance and functionality problems.

Sample Features
DNS request Download URL HTTP browsing FTP upload / download Ping a host TCP/IP command Transfer rates measuring

Handset Agent Data IP E-Mail Web / WAP Browsing

CS: CSD Dialin Duration CSD connect assign IP Duration HTTP Download: Duration Throughput FTP: Downloading Duration Uploading Duration Mean Download Rate TCP Handshake (Duration)

Handset Agent (mobiQ speed)

The first Keynote SIGOS App!
The SITE mobiQ speed measures the connection speed straightaway from your mobile device, right from where you are. Complementary to Keynote SIGOS QoE solutions, the Handset Agent delivers KPIs measured from any location. These results are pushed to the SITE system for further analysis and comparison to other data collected in SITE. In the SITE GIS, visualization in Google Maps or WMS maps is possible. Sample KPIs
Data Amount Download Data Amount Upload GPS Mean Download Rate Mean Upload Rate Network Type SIM Network Name

64

Test Systems > Applications > Data

E-Mail
Modern life is unthinkable without E-Mail!
Subscribers not only need voice communication, they also want be in contact with friends and colleagues via mobile E-mail. In order to gain acceptance as a reliable service frequently used by the subscribers, network errors must be avoided and uncovered by performing active continuous tests. The question is, whether mobile E-mails are delivered on time to the receivers designated email addresses. Keynote SIGOS Test Systems provide E-mail testing via multiple interfaces, like GSM Um, GSM Gb, 3G UMTS Uu or Iu PS. It can be checked whether a mobile E-Mail can be sent and received via a POP3 / IMAP / SMTP server. The mobile E-Mail would be sent via Simple Mail Transfer Protocol (SMTP) to an E-Mail server and fetched via Post O ce Protocol version 3 (POP3) or Internet Message Access Protocol (IMAP). Sample Features
Mobile E-mail upload and download from an E-mail server Interfaces: GSM Um, GSM Gb, 3G UMTS Uu or Iu PS SMTP server POP3/IMAP server

Sample KPIs
Mobile E-mail address Mobile E-mail size Mobile E-mail fetch duration Mobile E-mail send duration Mobile E-Mail End-to-End Transaction Time with Noti cation Mobile E-mail success ratio

Data IP E-Mail Web / WAP Browsing

WAP / Web Browsing

What about mobile Internet browsing?
The combination of high throughput protocols such as WLAN, EDGE and HSPA along with the variety of todays multifunctional, big screen handsets have greatly enhanced the mobile internet browsing experience. The network operators need to ensure access to the internet directly via HTTP, HTTPS and FTP via a mobile device. Response, accessibility and data throughput are the major performance indicators for monitoring the quality of service. In addition, Web Browsing tests can access websites, ll in forms, receive cookies, initiate secure transactions, download contents and much more! Sample Features
Chains of user interaction on a web application, e.g. a full ecommerce session HTTP post/get request methods HTTPS (SSL) for secure transactions Cookie handling Follow links both by name or URL

Sample KPIs
HTTP data packet duration HTTP data size Web Browsing duration GPRS access point PDP context activation duration PDP setup connect duration PDP IP UP duration

www.keynote-sigos.com

65

Test Systems > Applications > Video

Video Services
Provide your customers more than moving color pixels!
Video Telephony
Do you provide reliable video telephony in 3G UMTS?
High quality for Video Telephony using 3G UMTS is an absolute must, without which it is used perhaps once, and then never again by your subscribers! The premium cost paid for the use of UMTS service will most often increase customers expectations regarding quality of service rendered. Due to competitive pressure, it is mandatory for wireless service providers to increase their subscribers average revenue quickly by successfully launching new services such as video telephony. At the same time, they must maintain the consistent high quality their customers have come to expect. The implementation of this technology often involves complex interaction between network nodes supplied by di erent manufacturers and therefore constant automated testing should be applied to check initial con gurations, and then provide active continuous monitoring of the service.

Video Telephony Video Quality Streaming

Sample KPIs
Video send duration Video call duration Video le size Audio send duration CS Bearer establish duration

Sample Features
Real End-to-End (mobile-to-mobile) Video Telephony Usage of standard 3G UMTS interfaces no special hardware required Usage of standardized or customer speci c video/audio sequences Usage of a market leading protocol stack

66

www.keynote-sigos.com

Test Systems > Applications > Video

Video Quality
Is your network Video Quality excellent?
3G UMTS opened a world of possibilities with multimedia applications. Customized infotainment like streaming video, video messaging, mobile TV and video telephony o er a unique opportunity to create a market for highly personalized and truly inimitable mobility services. For mobile customers the quality of services is decisive for acceptance; especially for motion picture based services, quality is the key factor of success. Keynote SIGOS Test Systems deliver perceptual quality measurements to reproduce subscribers quality impression mapped to the mean opinion score (MOS), similarly to other quality tests. Be sure that your networks new multimedia applications are more than just moving color pixels. Sample Features
Real End-to-End Testing of real-time video services (video telephony, video streaming, video messaging) Objective MOS Video Quality result values from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good, 5-excellent) PEVQ analysis is based on human model of visual perception

Sample KPIs
MOS value Delays Brightness Contrast Distortion indicators

Streaming
What about your Streaming service?
Today, almost every major event, e.g. sport, news or society events can be accessed via real-time multimedia streams on a mobile phone. These multimedia applications become more and more important in the wireless and mobile community. To make sure that customers can enjoy these exciting premium services, it is most important to guarantee an impeccable streaming service. Using the industry standard protocols RTP and RTSP, the Keynote SIGOS Test Systems are up-to-date with the latest technology. Scheduled and continuous active testing ensure that multimedia streams deliver the desired contents and the required quality even to the largest possible groups. Sample Features
Parallel subsessions per stream, e.g. video and audio Send streamed multimedia over IP TCP or UDP transport protocols Measurement interval in multiple of 100 milliseconds Used industry standard RTP/RTSP

Video Telephony Video Quality Streaming

Sample KPIs
RTSP packets loss percent video RTSP packets loss percent audio RTSP packets received video RTSP packets received audio

www.keynote-sigos.com

67

Test Systems > Applications > Value Added Services

Value Added Services

Todays driver of ARPU!
Value Added Services (VAS)
Is your ARPU driver up and running?
Value Added Services (VAS) are considered todays driver of ARPU. Operators or third-party value-added service providers (VASP), also known as content providers, add value to standard service o erings, encouraging subscribers to optimise their mobile phone usage. With subscribers spending money on VAS, they naturally expect highest quality. Therefore, successful new VAS launch is mandatory while maintaining the consistently high quality customers have come to expect. The implementation of new VAS often involves complex interaction between network elements supplied by di erent application content providers and, therefore, constant automated testing should be applied to check initial con gurations, and then provide active continous monitoring of service quality. Value Added Services Digital Rights Management VAS Examples and Features
Ring tone download by sending request SMS to external number Logo download by sending request SMS to external number Ring back tone, which enables users to select a melody or to record a short greeting that the caller will hear. These activations are done per SMS, per IVR or per Web Browsing Customized new value added services

68

www.keynote-sigos.com

Test Systems > Applications > Value Added Services

Digital Rights Management

Make Premium Content download a premium customer experience and test your DRM!
Digital Rights Management (DRM) is an important enabler for billing of premium priced content, e.g. ring tones. To cater for fast and exible service creation the Open Mobile Alliance (OMA) de ned application-level protocols and behaviors needed to provide powerful as well as reliable content download functionality. The scheme is implemented on most multi-media phones and is intended to be used by mobile content providers to control access to their products. The whole Digital Rights Management process is relatively complex and could introduce multiple risks of malfunction. At the same time, the e ect of a possible error can be disastrous: unhappy customers if a fault occurs during the download and billing process of the premium priced content. Sample Features
The purpose of DRM is to enable controlled purchase and usage of digital media objects The Open Mobile Alliance (OMA) has de ned Digital Rights Management speci cations for the mobile world: Forward Lock (prevents the user from unlawful forwarding of protected content) Combined Delivery (combined rights object / media object) Separate Delivery (separated rights object + encrypted media object)

Sample KPIs
Media Download Purchase Time Download Session Time Download Media Object Access Time

Value Added Services Digital Rights Management

www.keynote-sigos.com

69

Test Systems > Applications > Handset Oriented Testing

Handset oriented testing

So many features for each new device!
BlackBerry
Your network`s sweetest fruit
BlackBerry is one of todays leading wireless connectivity solutions for a large number of mobile business professionals found in enterprise and governmental organizations worldwide. It allows users to stay connected with secured wireless access to e-mail, corporate data, calendar and web, to easily manage all their communication and information from a single BlackBerry device whenever and wherever required. BlackBerry eliminates the hassles of dialup by moving mobile data to a push architecture. Especially for mobile professionals, it is vital that the network operator provides the highest levels of quality and reliability. Sample KPIs BlackBerry iPhone Handset Simulation
Send time Receive time Round trip time Battery level of the device Battery temperature of the device

Sample Features
Real End-to-End testing of BlackBerry push service Testing carried out using a commercial BlackBerry device Check sending and receiving e-mails Check the BlackBerry device integrated email features Check BlackBerry Messenger service Using BlackBerry devices with a java application for re ector code for sending emails Management noti cation and reporting

iPhone
Up with the hype on iPhone tests
For many users, the iPhone and the 3G iPhone represents a new era of mobile phone interaction and services. The unique combination of multimedia content, intuitive multi-touch display controls, accelerometer and much more created strong demand for new operator services dedicated only for a unique group of users. Operators around the world specify this group of iPhone users as high-tech high potential customers with distinctive technology and quality demands. The unique services o ered for this iPhone customer base like the Visual Voice Mailbox create additional quality process demands at each network operator.

70

www.keynote-sigos.com

Test Systems > Applications > Handset Oriented Testing

Keynote SIGOS Test Systems o er dedicated iPhone tests to t simply into all QoS test procedures performed via SITE or GlobalRoamer without any additional effort. At the same time, measurements and KPIs provide clear evidence of the service availability and performance focussed on this group of high-tech high potential customers. Sample KPIs
Duration Failure Rates

SMS noti cation: new message Call the Mailbox Download message from Mailbox

Visual voice

Mailbox

Handset Simulation
Do handsets work perfectly in your mobile network?
The opportunity for mobile operators to sell exciting new mobile content and handsets is enormous, but the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using di erent handsets. How can these new devices and services be properly tested in a cost-e ective way that ultimately leads to increased revenue and customer satisfaction? We can help you with a powerful tool to test all your services, simulating the large variety of handsets in your network. No labor intensive and high-cost manual testing! SITE tests speci c handset characteristics against network services and device speci c monitoring of pages with xed content/ URLs. The following important content questions are validated: Color Support: Check if device is capable of displaying colored images Image Size: Comparison of all downloaded images with maximum height and width of the device Content Support: Check (based on HTTP/ WTP accept header) if device can decode downloaded content Data Format: Check if the downloaded content is valid

BlackBerry iPhone Handset Simulation

Sample Features
Intuitive Recording of browsing actions No drag n drop anymore Support of HTML forms Easy creation and adaptation of browsing sessions Received page content at a glance KPIs for each browsing action User de ned measurements / KPIs can be added with Test Case Editor Whole session can be Replayed during development to evaluate the test case

www.keynote-sigos.com

71

We take the load off your shoulders!

Keynote SIGOS provides adaptable and customizable services.

72

Professional Services Telecommunications

Managed Services on SITE
> SITE Administration Services > SITE Operational Services > SITE QoS/QoE Master Expert Services

Managed Services on GlobalRoamer

> Roaming Steering /Anti-Steering Tests > GRQ Tests > International Carrier Quality Tests > SIM Box Detection > Billing Testing for Roaming > Testing Campaigns for Special Events

Training
> GlobalRoamer User Training > SITE User Training

73

Professional Services > Managed Services

Managed Services
We take the load o your shoulders!
Managed Services on SITE
If you are looking for the bene ts of the most comprehensive active end-to-end test system but dont want to look after the administration of the infrastructure, let us do the job for you. We o er various levels of SITE System Hosting, Administration and Maintenance, while you can fully concentrate on your business.
Task Complexity

SITE QoS / QoE Master Expert Services Initial Setup & Cong SITE Operational Services SITE Administration Service
t

SITE Administration Services

Ensure that the SITE platform is always available for all internal users With this classic Managed Service Package, the customer owns a SITE system and all the relevant administrational tasks are carried out by Keynote SIGOS. Typically, a mix of remote and on-site administration support is recommended.

Quality Indicators (KQIs). We manage reports for troubleshooting and provide test results in an easy to read format. SITE Tools like Dashboard and Service Alarm Map then provide signi cant data on the actual network performance and functionality.

SITE QoS/ QoE Master Expert Services

Reduce the time back to service and improve the service quality step by step By booking this elite package, you can fast-track the Time to back Service! The SITE System is automatically monitoring all crucial services and is alerting the relevant teams as soon as a service problem occurs. Keynote SIGOS experts will then analyse and x the problem by using cutting-edge SITE on-board analysis tools. This package takes the full Quality of Service perspective in account and typically starts from a 3-month duration period. All tasks can be executed on-site or remotely. A dedicated senior consultant will be your single point of contact, managing all related tasks and resources in order to guarantee a smooth process ow.

SITE Operational Services

Guarantee continous service monitoring, reporting and alarming Managed Services on SITE Performance Tests Ensure end-to-end Quality of Service through delivery of Key Performance Indicators (KPIs) prepared for you by Keynote SIGOS. By running a large number of tests over a short period of time (a few days or weeks), we provide you with performance reports invaluable for your benchmarking. QoS Monitoring Ensure long-term monitoring of your Quality of Service! For example, many customers constantly monitor their 50 to 100 most important roaming partners. Keynote SIGOS prepares automated tests and reports on your individual Key

Bene ts of Managed Services

We have the know-how and most experienced engineers in the testing area to tackle dedicated projects. Low or no resources from customer side required. Our customers can focus their energy on using the results to perform network troubleshooting and other crucial tasks. Save costs! A Managed Services contract can take upfront CAPEX out of the budget as well as cut OPEX in the long run.

74

Professional Services > Managed Services

Managed Services on GlobalRoamer

Keynote SIGOS hosts and maintains a variety of GlobalRoamer testing campaigns for several demands. Roaming Steering / Anti-Steering Tests Test the functionality of steering programs! A number of location update tests in steered countries/networks are performed and examined by Keynote SIGOS experts. From the distribution of tests over di erent networks it is determined whether the planned steering ratios between di erent networks are ful lled.
(page 24)

SIM Box Detection Fraudulent usage of SIM boxes remains a major issue for many network operators. Often, the revenue leakage caused stays unnoticed, with no actions taken. Keynote SIGOS SIM Box Detection solution is the leading tool for VoIP anti-fraud systems or VoIP bypass. Make use of our managed services to detect grey routes and real time alerts of SIMs which are being used in SIM Box equipments to stop your interconnect revenue losses!
(page 26)

GRQ Tests Based on general experience of the roaming market, 80% of outbound roaming revenue comes from the top 20 roaming partners. For this reason the GSM Association recommends close monitoring of service quality during outbound roaming with these top roaming partners. With our worldwide test system you can regularly measure, monitor, report and receive alarm on all aspects of service quality among your top roaming partner networks by using the SIM cards of the interested operators throughout our system. Keynote SIGOS supported several operators during the GRQ trial phase and has successfully proven to be fully compliant to the GRQ framework.
(page 22)

Billing Testing for Roaming Operators need to implement e ective solution to manage and control revenue assurance for their roaming agreements, including all aspects of accurate billing. SITE o ers a precise and reliable tool for rating veri cation and CDR comparison in outbound roaming services. With Keynote SIGOS Managed Services you can ensure correct billing for you and your customers and respond to current and future needs quickly!
(page 28)

Managed Services on GlobalRoamer

International Carrier Quality Tests By constantly monitoring the transmission quality of all connected carriers, tra c can be routed intelligently to the best available. Carriers are interested to manage their SLAs with the Operators and to maximise the volume of tra c coming from each operator. To route tra c away from any carrier delivering poor quality transmission, work with Keynote SIGOS to understand and monitor the tra c quality to more than 600 operator networks worldwide!
(page 25)

Testing Campaigns for Special Events Mega events like Olympics, World Cup, religious gatherings and other, lead to a signi cant increase of outbound roaming subscribers and pressure on network operators to provide high quality service. We o er multi-staged testing campaigns to measure and monitor your QoS, adapted to your speci c requirements. Take advantage of our managed service and optimize your earnings for the full duration of special events!

75

Professional Services > Training

Training
Wherever you want, with specially trained experts!
Training
On-site at your locations or at our training center!
Keynote SIGOS o ers a comprehensive range of training to users of SITE and GlobalRoamer. Training can be scheduled on demand on your own site or at the Keynote SIGOS training center in Nuremberg, Germany. Keynote SIGOS training is designed for maximum e ciency. Thats why we limit the seats for each session.

Reporting & Diagnosis - Advanced User Training - Advanced

Training

Reporting & Diagnosis - Base

Administrator Training

Test Case Editor Training

User Training - Base Users Scheduling tests (ad hoc) Strategic Users Scheduling tests Scheduling reports Dening alarms Administrator Administrator of infrastructure, access rights management Test Case Developer Developer of test cases

76

www.keynote-sigos.com

Some of our worl

dw ide

cu

me o t s

rs

Saudi Telecom Company

Telstra Australia

Group

www.keynote-sigos.com

77

Index

Index
Keyword Page Keyword Page
3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29 Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Device Gateway. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27 Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 GIS (Geographical Information System) . . . . . . . . . . . 51 Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45 GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51 Handset Agent . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . 64 Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70 Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59 Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 International Carrier Quality Testing . . . . . . . . . . . . . . 25 International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20 ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46 Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 LTE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63 Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39 Mobile Virtual Network Operators (MVNO) . . . . . . . . 39 mobiQ speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2 Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

78

www.keynote-sigos.com

Index

Keyword

Page

Keyword

Page

Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 PESQ/POLQA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Professional Services Telecommunications . . . . . . . . 72 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 QoE Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26 Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24 Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14 SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46 SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59

System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Tari Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28 Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74 Test Operations Management (TOM). . . . . . . . . . . . . . 74 Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61 Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46

www.keynote-sigos.com

79