Mobile Network Testing

Standalone and system test solutions

ı 15 May 2018

ı Zoran Asenov
ı Netra Ltd. (R&S partner)
ı [email protected]

International Regulatory Conference 2018

The R&S company group at a glance

• History
• Established 1933 in Munich, Germany
• Type of enterprise
• Independent family-owned company founded
by Lothar Rohde and Hermann Schwarz
• Global presence
• In over 70 countries, approx. 60 subsidiaries
• Export share 85 %
• Employees
• 10000 worldwide, with approx. 6000 in
Germany

17.05.2018 International Regulatory Conference 2018 2

R&S Business fields
Test and Broadcast & Secure Cybersecurity Monitoring and
Measurement Media Communications Network Testing
T&M instruments and Broadcast, T&M and Communications IT security products Radio monitoring
systems for: studio equipment systems for: for: equipment for:
for:
• Wireless • Air Traffic Control • Economy • Regulatory
communications • Network operators • Armed forces. • Authorities authorities
• General purpose • Broadcasters • Homeland and
electronics • Studios Encryption technology external security
• Aerospace & • Film industry for:
defense • Manufacturers of Network Testing
applications entertainment • Armed forces • Network operators
equipment • Government • Infrastructure
authorities Vendors
• Critical • Service
infrastructures Companies
• Regulators
Service

17.05.2018 International Regulatory Conference 2018 3

Standalone and system test solutions
QualiPoc Android - The premier handheld troubleshooter
• Multi-functional smartphone-based tool for voice and data service quality troubleshooting and
RF optimization.
ı Key Features
ı Intuitive User Interface
 The intuitive and customizable user interface is based on the latest features of today's
smartphone technology and offers an easy operation;
ı Extensive set of service tests
 Including call tests, voice quality (including POLQA, PESQ, and SQuad08), data tests, video
streaming including video quality (J.343.1) as well as app service tests;
ı High grade of customization
 Create your own monitor with the desired parameters based on templates;
ı Advanced RF optimization feature
 Advanced channel and cell locking are crucial for RF optimization feature to control the
quality and coverage of a wireless networks.
ı OTA application update
 The over-the-air update function offers users a convenient way to keep QualiPoc application
up to date.

17.05.2018 International Regulatory Conference 2018 4

Speech quality measurements in QualiPoc Android
– The core of all MNT test systems

Service QualiPoc
Quality Android
Monitoring
Freerider III

TCM
Benchmarker II Benchmarker II Go

17.05.2018 International Regulatory Conference 2018 5

QualiPoc Android - Supported Test Cases (1)
Test cases
• Air Interface logging
• Forcing Functions (Technology/Band, preferred UARFCN, Channel, Cell)
• Voice Call testing (Call to any)
• Speech Testing (P.862 – PESQ, SQUAD or P.863 – POLQA NB and WB)
• MVoice Server and MM, MOC and MTC, DL and UL
• VoLTE Testing (P.863) including Enhanced Voice Services (EVS) Codec support *(depending on
firmware)
• Speech Audio Delay (RTT) test
• Data (Ping, FTP DL/UL, HTTP DL/UL, Capacity DL/UL (multi thread HTTP/FTP), iPerf UDP/TCP
• HTTP Browsing
• Network Performance Test (iPerf & Capacity)
• Messaging (SMS, MMS, Email)

17.05.2018 International Regulatory Conference 2018 6

QualiPoc Android - Supported Test Cases (2)
Test cases
• YouTube Video Streaming incl. Video-MOS using ITU approved J.343.1 algorithm - completely developed by R&S
• Application service tests:
• Dropbox (File up and download)
• Facebook (Send post and picture, like post, delete post)
• Ookla Speed Test (Latency, UL and DL throughput)
• Line (Instant messaging)
• Line (VoIP incl. audio MOS using POLQA)
• Line (Video call including video quality using J.343.1)
• WhatsApp (Instant messaging)
• WhatsApp (VoIP incl. audio MOS using POLQA)
• WhatsApp (Video call including video quality using J.343.1)
• Netflix video streaming, KPIs: Time to 1st picture, Freezing, Resolution changes (bit rate)
• FCC Speed app (UDP Latency and Packet Loss/Speed test (GET and POST HTTP)
• Instagram (Send pictures and videos, post text and comments, KPIs)
• Generic Video Test
• Multi-RAB job (Simultaneous Voice and Data)
• Parallel job (Up to 3 jobs of any kind running in parallel)

17.05.2018 International Regulatory Conference 2018 7

QualiPoc Android with latest Smartphones
ı Samsung
 Galaxy S9 Cat18 (up to 1.2Gbps)
 Galaxy S8/S8+ Cat16 (up to 1Gbps)
 Galaxy S7 / S7 Edge Cat12 (up to 600Mb/s)
 Galaxy Note 4 (SM-G910F) Cat6
ı Sony
 Xperia XZ1 Cat16 (up to 1Gbps)
 Xperia XZ Premium Cat16 (up to 1Gbps)
 Xperia XZ / X Performance Cat12 (up to 600Mb/s)
ı LG
 G5 Cat12 (up to 600Mb/s)
 G4 Cat6
ı HTC
 10 Cat12 (up to 600Mb/s)
 One (M9) Cat6
ı Motorola
 Motorola Moto Z XT Cat9 Also there are supported android tablets
Samsung and Sony

17.05.2018 International Regulatory Conference 2018 8

QualiPoc Android
map monitor
ı More detailed information on event and map monitor (indoor):
 Technology changes
 Forcing actions
 Waypoints
 Screenshots taken
 Text marker set/Photo marker taken
 Test failures / Notifications.
ı QualiPoc supports multiple formats for indoor measurements
ı (pictures by built in camera, jpeg and png, iBawave project files, Google
IndoorMaps).
ı Outdoor measurements
 GPS related information (Time, Latitude, Longitude, Speed and Accuracy)
 Supported maps: Google Maps, Open Street Maps, Bing, HERE, etc.
 Offline mode (caching)
 BTS list support for all technologies
 Serving BTS, Neighbor cells based on BTS cell list, Navigation to certain location,
Load GPX tracks or predefined routes.

17.05.2018 International Regulatory Conference 2018 9

QualiPoc Android – additional features
ı QualiPoc shows and logs Wi-Fi (2.4 and 5 GHz bands)
related information of connected network:
 SSID, BSSID, RSSI
 IP address
 Frequency
 Channel number
 Link speed
 Connection status
 Time stamp of last Wi-Fi scan result
 Number of Access points found during scanning
 Authentication time to Wi-Fi network
 Access time to Wi-Fi network
 Data Retention
ı QualiPoc offers high grade of customization
 Create own workspace and easy switching between them
 Own monitor creation based on 3 templates and more than 200
parameters

17.05.2018 International Regulatory Conference 2018 10

Smart Benchmarker - System test solutions
ı Main objectives
 Measure subscriber perceived Quality of
Experience
 Comparison against competitor to assess market
situation
ı Main Challenges
 True subscribers’ Quality of Experience assessment
…still compliant with standards
 Voice: POLQA – ITU-T P.683
 Video: VMOS – ITU-T J.343.1
 Reduce as much as possible Operational
Expenditures
 Minimize Re-drives
Save OPEX and CAPEX
 Reduce Configuration and User Errors

17.05.2018 International Regulatory Conference 2018 11

 Smart Benchmarker - System test solutions
Features and Highlights
ı Web-based
ı Fleet management capabilities «native» in our
platform
 Alarming / Notifications
 systems interconnection
 Live Monitoring of units
 Uniform Temperature and RF Conditions (TCM).

ı Evolution of Diversity / NQView software

ı Built on the same measurement engines

 Maintain test structure and KPI’s
ı Installed on Benchmarker II / Benchmarker II Go -
Chassis
 CSM v2, CSM v1

17.05.2018 International Regulatory Conference 2018 12

Smart Benchmarker - System test solutions
Architecture details - Local (in-vehicle) System
ı SmartBenchmarker software runs on each
CSM
 One “System Master” CSM
 Up to 7 (or 3) “Slaves” CSM
ı Each of the CSM supports LAN Connection
 Up to 4 Smartphones on PMW or,
 Up to 4 TCM or,
System
 Up to 2 ASM or, “Slave” “Slave”
Master
 One R&S Scanner
ı Devices and scanner(s) Data
 Centrally controlled / managed accessing the Connection

master via local web browser / laptop USB / local Connection

ı Optional Data Connection to allow Remote
Access / Control

17.05.2018 International Regulatory Conference 2018 13

Smart Benchmarker - System test solutions
Benchmarking Test Phases - Where to save on OPEX and CAPEX

Remote Configuration for

more efficiency / Flexible
Same devices and Configuration configuration for different
Scanners can be
scenarios
used for the Walk
Test (Freerider)
Configuration Error
Dry-run Pre
Walk Test
test check (pre-execution)
to minimize dry-run
phase
Results Dashboard
with relevant
information on the Live Monitoring of
executed test / single devices
Upload of Smart Alarming and
Post Drive Drive Test
measurement files Test monitoring Notifications

17.05.2018 International Regulatory Conference 2018 14

R&S Scanners
Standalone and system solutions / use cases
Network Planning and Optimization
ı Model tuning
ı Coverage validation TSME
ı System internal interference optimization (pilot pollution)
ı System external interference detection
ı Installation defect detection (crossed feeders, broken feeders) TSMA
ı Uplink interference detection (Spectrum measurement)
ı Decoding of BCH information (missing neighbors, configuration issues)
Benchmarking
ı Coverage comparison per technology per operator
ı RF quality comparison per technology per operator TSMW
ı network non-intrusive: no SIM cards from MNO
Regulators
ı Spectrum clearance-Complex multi-band multi-technology networks
ı Network Survey with accurate verification of spectrum (BTS, coverage,
channel utlization)
ı Detection of illegal BTS, spectrum use, cross country RF spillover

17.05.2018 International Regulatory Conference 2018 15

R&S Scanner unique benefits (1)
ı Unbanded – one instrument for all bands
ı Simultaneous measurement of LTE (FDD, TDD), WCDMA, GSM, CDMA, EV-DO, WiMax, TETRA, TD-
SCDMA, eMBMS, NB-IoT / Cat NB1 and spectrum in all bands
ı SW upgradable – adding new technologies in the field (e.g. NB-IoT)
ı Market leading sensitivity and dynamic range with practically no ghost codes
ı Intelligent scheduling: all technologies measured in parallel at high speeds
ı Highest measurement rates
 Even with BCH demodulation active
 Even in dense networks (many Scrambling Codes or PCIs per channel)
ı No GPS (holdover) required for CDMA/EV-DO measurements
ı TSME and TSMA are upgradable to 4x4 MIMO
ı TSME and TSMA have flexible band optioning (changeable by customer)
ı TSMW/TSME/TSMA measure correctly in eMBMS enabled network
ı TSME platform already used for first 5G testing
ı Global service network with local presence

17.05.2018 International Regulatory Conference 2018 16

 R&S Scanner unique benefits (2)
ı Unique innovative features
 Smart Automatic Channel Detection (ACD) for GSM, UMTS, LTE, CDMA/EV-DO,
TETRA, Wi-Max.
 Multi-band multi technology networks
 tool setup time
 re-drives
 LTE Downlink and Uplink Allocation Analyzer
 Non-intrusive analysis of resource allocations
 Cell Load
 Competition
 How many users
 Cell Efficiency
 Base station Position Estimation
 Source of interference across country borders
 Competitor network density
 Site sharing
 MIMO 4x4
 Scanner provides neutral assessment of the RF condition and achievable L1 throughput
 Flexible solution: 4 TSMEs can be chained, or used separately!

17.05.2018 International Regulatory Conference 2018 17

 NB-IoT scanning is supported

01
Non-intrusive analysis of NB-
IoT. Measurements are based
NB-IoT Secondary sync signals on synchronization and
(NSSS)
reference signals.
NB-IoT Reference signals
(NRS) 02
First Multi Technology NB-IoT
scanner!

17.05.2018 International Regulatory Conference 2018 18

LTE eMBMS with scanner and testmobile
eMBMS
01 03
First scanner that CIR analysis to
measures correctly check guard
in eMBMS enabled interval violations
networks today (ISI)

02 04
Fast and accurate Testmobile: check
RF quality the performance of
measurement of the service by
eMBMS network evaluating the
for optimization mobile trace
and
troubleshooting

17.05.2018 International Regulatory Conference 2018 19

The Triangle of 5G Use Cases
LTE-Advanced Pro (3GPP Rel.14) paves the way for 5G
mMTC / Massive IoT enhanced Mobile BroadBand (eMBB) – the
ı A diverse ecosystem (operators, known playground
manufacturers, local authorities,
eMBB ı Established ecosystem (operators,
certification only for some manufacturers, certification of
technologies) devices)
ı Mix of technologies ı Evolution from existing technologies (LTE-
(GSM, Lora, Zigbee, WLAN, A, 802.11 ad) and revolutionary additions
Bluetooth, Cat M, NB-IoT,…) (cm- / mm-wave)
ı It’s all about cost efficiency ı It’s all about data (speed and capacity)
and massive connectivity 1.000.000
devices/km2 URLLC
Ultra reliable & low ı A significantly enhanced and diverse
Machine-Type
latency ecosystem (operators, manufacturers,
Communications
communication- verticals, certification not existing (yet))
(mMTC) / ı Existing technologies do not provide
Massive IoT URLLC sufficient performance
ı It’s all about reliability and security
(data and capacity)

17.05.2018 International Regulatory Conference 2018 20

5GTF scanner @ 28 GHz test setup

28 GHz omnidirectional Rx
antenna R&S AC004R/L2

Signal generator as gNodeB (next

generation Node B) with Tx horn
antenna
R&S®TSME

Downconverter
R&S®ROMES
Local oscillator

17.05.2018 International Regulatory Conference 2018 21

5GTF measurements @28GHz in R&S ROMES
ı Coverage measurements
ı Power measurement on synchronization signal
ı Total SYNC power
ı Power per Resource Element (RE) (like Reference Signal Received Power – RSRP in LTE)
ı Multipath/Signal Quality

ı Beamforming/ angle of arrival measurement

ı Channel Impulse Response/Power

Delay Profile per beam
 See reflections
 See which is the best beam
ı RF Power scan
 Total channel power
 Uplink

17.05.2018 International Regulatory Conference 2018 22

Solutions from R&S – 5G NR testing
ı Generate and analyze 5G NR wideband signals to characterize
sophisticated RF components with:
 R&S SMW200A vector signal generator

 R&S FSW signal and spectrum analyzer

ı Test your 5G NR sub-6 GHz and mmWave devices in production

with:
 R&S CMW100 communications manufacturing test set

 R&S CMP200 radio communications tester

ı Test 5G NR mmWave antennas over the air (OTA) with:

 R&S ATS1000 antenna test system

17.05.2018 International Regulatory Conference 2018 23

 Thank You!

17.05.2018 International Regulatory Conference 2018 24