HEAD acoustics GmbH

Ebertstraße 30a
52134 Herzogenrath, Germany
DATA SHEET
Tel: +49 (0)2407 577-0
Fax: +49 (0)2407 577-99 VFTST-Audio-NB
E-mail: [email protected]
WEB: www.head-acoustics.de (Code 60009)
Acoustical Quality Evaluation of Terminals,
Narrowband Part
Overview
Speech quality assessment of mobile phones
is quite a challenge due to the various kinds
of signal processing involved (e.g. noise re-
duction algorithms, various kinds of speech
processing and the transmission delay itself).
All these aspects have a significant influence
on conversational speech quality.
Therefore, Vodafone has developed the test
specification Performance TST Audio Quality
3.0 which has been implemented by HEAD
acoustics as measurement standard for the
communication analysis system ACQUA. It
provides comprehensive tests for the
analysis of
• Delay
• Speech transmission quality
• Echo
• Quality during double talk
Measurement tree and result diagram for VFTST-Audio-NB in communication analysis system ACQUA
• Quality of background noise
transmission
• Bluetooth® interface
DESCRIPTION SYSTEM REQUIREMENTS Manufacturers need VFTST-Audio-NB to be
The tests implemented in VFTST-Audio-NB VFTST-Audio-NB requires the following able to prove conformance of their
cover all requirements of the Vodafone speci- system components: narrowband devices with the requirements of
fication with regard to acoustical quality the latest Vodafone audio test specification.
in the narrowband range such as • ACQUA Communication Analysis System
• delay measurements in sending and as one of the following variants (version OPTIONS
receiving direction 3.2.100 or later):
• objective speech quality assessment under - Full-license (Code 6810) • ACOPT 17: Relative Approach (Code
single talk conditions in sending and - Workplace (Code 6830, for post-analysis 6839) for "additional noise reduction in
receiving direction and documentation only) RCV" tests (informative)
• echo tests - Compact Systems (Code 6860.xx) • ACOPT 20: Quality Pie (Code 6843),
• detailed evaluation of quality during recommended for graphical result
• HMS II.3-33 (Code 1230.1) HEAD
double talk representation according to ITU-T P.505
Measurement System with pinna type 3.3.
• quality of background noise transmission. • ACOPT 29: EQUEST (ACOPT 29, Code
• HHP III.1 Handset Positioner (Code 1403) 6856), informative
In addition, electric headset interface
measurements based on ITU-T P.381 and • MFE VI.1 Measurement Front End (Code • ACOPT 30: POLQA (Code 6857),
measurements according to VF Acoustic 6462) with option MFEVI-BEQ (Code informative for acoustic tests and as
Safety Requirements Spec. Version 3.0 6461) alternative to TOSQA for Bluetooth® tests
(based on EN 60950, EN 50332 and ETSI EG • MFE XI Universal Bluetooth® Access Point • ACOPT 32: Speech Based Double
202 518) have been implemented in the test (Code 6482), for Bluetooth® measurements Talk (Code 6859), informative: Calcula-
suite. • HAE-BGN Background Noise Simulation, tion of "Echo control characteristics"
version 2.1.300 or later (Code 6971) based on 3GPP TS 26.132 V12.0.0
Moreover, recordings using real (2013-06). Note: The requirements
speech under single talk, echo and double • ACOPT 10 TOSQA2001 Telecommunica- defined in this specification are still under
talk conditions are implemented. Apart from tions Objective Speech Quality Assessment study. The reference implementation
the measured parameters these recordings (Code 6820) published by 3GPP contains known work
also provide listening examples which can be • ACOPT 21 3QUEST, 3-fold Quality items which are currently under discus-
used for audio demonstrations. Evaluation of Speech in Telecommunica- sion. These work items are partly taken
For determination of the quality of back- tions (Code 6844) into consideration within ACOPT 32
ground noise transmission a standardized ar- • ISDN Tester, e.g. Aethra D2500 Pro already. ACOPT 32 is available since
rangement consisting of four loudspeakers • System Simulator e.g. R&S CMU200 ACQUA 3.2 and will be continuously
and one subwoofer is used in a separate test (not delivered by HEAD acoustics) adapted to the ongoing development of
room setup. It allows a close-to-reality • “Additional Single Talker”, e.g second the 3GPP specification.
noise playback and can be used for all HATS mouth, additional Artificial Mouth or • UG VFTST-Audio-WB Upgrade to
types of background noise. equalized speaker as simplified setup wideband measurements (Code 60010)
• Headset Interface Box for coupling
APPLICATIONS wired headsets to MFE VI.1 DELIVERY ITEMS
• Conformance tests of narrowband
terminals, hands-free and headsets ac- • VFTST-Audio-NB measurement
cording to Vodafone Performance TST standard, delivered as ACQUA database
Audio Quality V3.0 and Vodafone Acous- (Code 60009)
tic Safety Requirements Spec. Version 3.0 • V2C file
• Standard documentation as PDF

06.14 D60009e2 Valid since standard implementation Rev02 SP1, subject to change
MEASUREMENTS
The table below lists all measurement that can be performed with VFTST-Audio-NB.
Handset, Handheld Hands‐free and Headset Tests HANB HHNB HENB Bluetooth Interface of Mobile Phones BMNB
System Simulator Calibration ● ● ● System Simulator Calibration ●
Delay in SND/ RCV/ Echo ● ● ● Delay in SND/ RCV/ Echo ●
DUT Delay in SND/RCV/ Round‐Trip ● ● ● DUT Delay in SND/RCV/ Round‐Trip ●
Loopback Delay (Round‐Trip) ● ● ● Junction Loudness Rating RCV/SND
Loudness Rating, Real Speech* RCV/SND RCV/SND RCV/SND Junction Loudness Rating ‐ Volume Control RCV
Idle Channel Noise* RCV/SND RCV/SND RCV/SND Sensitivity Frequency Response RCV/SND
Frequency Response, Real Speech* RCV/SND RCV/SND RCV/SND One Way Speech Quality ‐ TMOS RCV/SND
Speech Intelligibility Enhancement, with/without BGN RCV n/a n/a Switched Level, 5 dB, 10 dB, 15 dB RCV/SND
Artificial Bandwidth Extension* RCV n/a n/a One Way Speech Quality ‐ P.863 RCV/SND
TMOS Estimation by Frequency Response RCV n/a n/a Noise Cancellation Test in SND (long burst) SND
Noise Reduction in RCV ‐ Level vs. Time, Relative Approach RCV n/a n/a Noise Reduction, Part I & II (long burst) SND
Distortion with/ without activation RCV/SND RCV/SND RCV/SND Idle Channel Noise SND Nom. Vol. RCV/SND
Listening Speech Quality TMOS* RCV/SND RCV/SND RCV/SND Automatic Gain Control (AGC) Test RCV/SND
Listening Speech Quality P.863 RCV/SND RCV/SND RCV/SND Attenuation Range during Double Talk (Part I) RCV/SND
Activation Sensitivity RCV ‐ Switch On RCV RCV/SND RCV Attenuation Range during Double Talk (Part II) SND
Attenuation Range ‐ Switch Over RCV/SND RCV/SND RCV/SND Echo attenuation (Spectrum) 20dB ‐ 20ms, 1ms ●
Automatic Gain Control (AGC) Test RCV/SND RCV/SND RCV/SND Echo attenuation 20dB ‐ 20m, 1ms ●
Activation in SND Direction SND SND SND Echo Loss 20 dB Att. Speech Part II BMNB ●
Sidetone Delay ● n/a ●
Sidetone Masking Rate (STMR)* ● n/a ● Electric Headset Interface of Mobile Phones EINB
TCLw (compressed speech)* ● ● ● Delay in SND/ RCV/ Echo ●
Echo Control Characteristics ‐ Informative ● ● ● DUT Delay in SND/RCV/ Round‐Trip ●
Echo Attenuation vs. Time* ● ● ● Loopback Delay (Round‐Trip) ●
Echo Level vs. Time* ● ● ● Frequency Response Real Speech RCV/SND
Perceptual Based Echo Assessment (EQUEST)* ● ● ● Level (RMS, ASL)* RCV/SND
Spectral Echo Attenuation* ● ● ● Automatic Gain Control (AGC) Test RCV/SND
Echo vs. Time, Variant Echo Path* ● n/a n/a Idle Channel Noise RCV/SND
Stability loss ● ● ● Idle Channel Noise, SINR RCV/SND
Initial Convergence with Hoth Noise ● ● ● Listening Speech Quality ‐ TMOS RCV/SND
Attenuation range during Double Talk (automatic DT, P.502) RCV/SND RCV/SND RCV/SND Listening Speech Quality ‐ P.863 RCV/SND
Echo Components during Double Talk ● ● ● Out‐of‐Band Signal SND
BGNT with Near End Speech (CSS), Mensa, Hoth ● ● ● Sidetone Delay ●
BGNT with Far End Speech (Real Speech), Mensa, Hoth ● ● ● Sidetone Masking Rate (STMR)* ●
Comfort Noise: Level Adjustment, Mensa ● ● ● Attenuation Range during Double Talk RCV/SND
Comfort Noise: Spectral Adjustment, Cafe ● ● ● Echo Components during Double Talk ●
Speech and Noise Quality BGN ‐ Mensa, Car, Train, Road, Callc ● ● ● BGNT with Far End Real Speech ‐ Mensa ●
Speech and Noise Quality BGN (ETSI TS 103 106) S‐/N‐/G‐MOS* ● ● ● Speech and Noise Quality BGN ‐ Mensa, Car, Train, Road ●
Speech and Noise Quality BGN – Positional Robustness ● n/a n/a Speech and Noise Quality BGN (ETSI TS 103 106) S‐/N‐/G‐MOS* ●
Speech and Noise Quality BGN – Including Additional Talker ● ● ● Speech and Noise Quality BGN (EG 202 396‐3) ‐ ‐ Mensa, Car, Train, Road ●
Speech and Noise Quality BGN (EG 202 396‐3) ‐ ‐ Mensa, Car, Train, Road ● ● ● Speech and Noise Quality BGN (EG 202 396‐3) S‐/N‐/G‐MOS* ●
Speech and Noise Quality BGN (EG 202 396‐3) S‐/N‐/G‐MOS* ● ● ● TCLw compressed Speech* ●
Speech Qual. TMOS AMR‐WB 12.2, 6.7, 4.75 kBit/s RCV/SND n/a RCV/SND Echo Level vs. Time Speech ●
Various Speech Recording Single Talk, Double Talk, Echo, BGN* ● ● ●
VF Acoustic Safety Requirements Ac.Shock
Media Playback functionality Maximum Acoustic Output Ringtone Test RCV
Headset Idle Channel Noise After Act., WB ● Maximum Acoustic Output Network Test RCV
Headset Distortion (sinusoidal) ● Long Term Exposure Laeq according to EN50332‐1 Left, Right
Headset Wideband Speech Quality (TMOS) ● Long Term Exposure Maximum Output Voltage Vm EN50332‐2 Left, Right
Headset Wideband Frequency Response ● Long Term Exposure WBCV acc. to EN50332‐2 Left, Right
*comprises several measurement variants, e.g. varying application forces
(HANB: Handset Narrowband; HHNB: Handheld Hands-free Narrowband; HENB: Headset Narrowband)

The Bluetooth® word mark and logos are registered

trademarks owned by Bluetooth SIG, Inc. and any use of such
marks by HEAD acoustics GmbH is under license. Other
trademarks and trade names are those of their respective owners.

represented by

Typical test setup

06.14 D60009e2 Valid since standard implementation Rev02 SP1, subject to change