Documents
Documents
Concept, Architecture, Parameters, and Performance 2012. 10. 09 Jun Kyun Choi
Contents
Network Performance (NP) and Quality of Service (QoS) QoS Issues for Next Generation Network Quality of Experience Requirements and Mechanisms
- Performance High quality systems & services - Transport network - OAM functions - TMN
Teleommunication Network
(E.800) : Collective effect of service performances which determine the degree of satisfaction of a user of the service The aspects of QoS that are covered are restricted to the identification of parameters that can be directly observed and measured at the point at which the service is accessed by the user Network Performance (NP) : Network perspectives It is measured in terms of parameters which are meaningful to the network provider and defined independently of terminal performance and user actions
QoS
Network Performance
Allocation
QoS
National Portion A
National Portion B
Allocation
National Domain
International Domain
National Domain
AAL NP for ATM VC layer NP for ATM VP layer Rec. I.356 Rec. I.356 ATM VC ATM VP Physical ATM PL PL Rec. G.826
O.181 : Physical Layer Test Equipment O.191 : ATM Layer Test Equipment I.610 : Performance Monitoring
Rec. I.357 Rec. I.3av
Availability
Performance Parameters
Performance criteria
Function
Speed
Accuracy
Dependability
Availability
[email protected]
10
Rec. I.350 : General Aspects of Quality of Service and Network Performance in Digital Networks, including ISDNs Rec. I.351 : Relationships Among ISDN Performance Recommendations Rec. I.353 : Reference Events for Defining ISDN Performance Parameters
11
IP Performances in ITU-T
ITU-T Recommendation Y.1540 (Internet Protocol Data Communication Service IP Packet Transfer and Availability Performance Parameters) ITU-T Recommendation Y.1541(Network performance objectives for IP-based services) Recommendation Y.1221 (Traffic Control and Congestion Control in IP based Networks)
12
13
Emergence of Converged Service and Integrated Service (Integration of packet and circuit, wireline and wireless, data and video, etc.) Remarkable Growth of Wireless Services Resource Optimization of Wireline and Wireless Network
Evolution of Networking Technology and Perceivable/Controllable Services
Requirements
Multigrade QoS, Manageable and Controllable Network Seamless Service and Seamless Connectivity Open-ended to Growth & Flexibility
[email protected]
14
400ms
50ms
50ms
1*10-3
1*10-3
1*10-3 1*10-4
1*10-3
1*10-3
U U
15
Example Applications Real-Time, Jitter sensitive, high interaction (Speech, Video Transfer) Real-Time, Jitter sensitive, interactive (Speech, Video Transfer) Transaction Data, Highly Interactive, (Signaling) Transaction Data, Interactive Low Loss Only (Short Transactions, Bulk Data, Video Streaming) Traditional Applications of Default IP Networks
Node Mechanisms
Network Techniques Constrained Routing and Distance Less constrained Routing and Distances Constrained Routing and Distance Less constrained Routing and Distances
0 1 2 3 4
Any route/path
Any route/path
16
17
Streaming of live TV content Streaming of video content Streaming of audio content Streaming control Download of video content Upload of video content Download of data Access to web pages Streaming of live speech Streaming of live low resolutio n video content Interactive message exchange Message exchange Payment Transactions
Linear TV including Pay per Vi ew and Multi-view VoD, Network PVR, time-shift TV Music on Demand VoD, Network PVR, time-shift TV Push VoD, Near VoD User generated content Content guides, pictures, applic ations download Portals, information services voice call, audio conference video telephony, video conferen ce Chatting Messaging, Email VoD rental
1 1
1.Consumer television quality can be achieved using the standard Y.1541 QoS classes 0 and 1 together with the DVB-IP AL-FEC mechanism, low to modest overhead and the en hanced decoder according to [ETSI TS102034], Annex E, sub-clause E.5.1.2.
18
CLR0 none
CER default
10-5
none
default
10-5
default
6 msec (NOTE 6)
none
3*10-7
(NOTE 7)
default
19
Admission control Dynamic resource reservation Congestion control ATM, LDP/CR-LDP Traffic classification Priority based treatment Differentiated Service
20
User aspects : Select dynamically for their preferences and application types Provider aspects: Guarantee the minimum QoS, offer the average QoS User aspects : Select dynamically based on acceptable billing Provider aspects: network performance according to Service and traffic classification Provider aspects: Buffer separation per virtual channel or per flow, scheduling algorithm according to service priority
Bandwidth Allocation
21
22
Definition of QoS
Quality of service (QoS) is defined in [ITU-T E.800] as the collective effect of performance which determines the degree of satisfaction of a user of the service. a measure of performance of the network itself. QoS mechanisms
any mechanism that contributes to improvement of the overall performance of the system and hence to improving end user experience.
Definition of QoE
defined in [ITU-T P.10/G.100] as the overall acceptability of an application or service, as perceived subjectively by the end-user Includes the complete end-to-end system effects (client, terminal, network, services infrastructure, etc)
measured subjectively by the end user and may differ from one user to the other
[email protected]
23
QoS
a measure of performance at the packet level from the network perspective. Quality of Service (QoS) also refers to a set of technologies (QoS mechanisms) that enable the network administrator to manage the effects of congestion on application performance as well as providing differentiated service to selected network traffic flows or to selected users. overall performance of a system from the point of view of the users. QoE is a measure of end-to-end performance at the services level from the user perspective and an indication of how well the system meets the users needs. In order to deliver acceptable service quality, QoE targets should be established for each service and be included early on in system design and engineering processes. Quality of experience for the end user is essential for the successful deployment triple-play and beyond services and will be a key differentiator with respect to competing service offerings. Subscribers to network services don't care how service quality is achieved.
24
QoE Dimensions
Quality of Service
Human Components
Service factors
Transport factors
Application factors
Emotions
Service billing
Experience
Multiple service level performance (QoS) metrics that impact overall QoE
the subjective QoE as measured by the MOS QoS by using various objective parameters of service performance (e.g. encoding bit rate, packet loss, delay, availability, etc.). Given a QoS measurement, one could predict the expected QoE for a user Given a target QoE for a user, one could deduce the net required service layer performance. QoE targets should be established for each service included in system design and engineering processes where they are translated into objective service level performance metrics.
[email protected]
26
defined as the difference in the delays encountered by two packets of the same stream selected. usually measure by the worst case delay variation as measured by the difference between the maximum and the minimum transfer delay experienced, i.e. PDV = PTD max PTD min defined according to some quantile of the PTD distribution.
defined as the ratio of the number of packets lost to the number transmitted.
28
Quality of source material: garbage in = garbage out The baseline quality of the codec standard
a range of video codecs: MPEG-2, MPEG-4 AVC (also known as MPEG-4 Part 10 or H.264) and SMPTE VC-1 (known as VC-9) Horizontal resolution to achieve the target bit rates
Resolution
for example, in SD the resolution maybe reduced to Half or Three Quarters which produces a less sharp picture than Full resolution
Bit rate
During periods of high complexity (entropy) compression may leave visible artifacts if the bit rate is not sufficient
Application layer video encoding - Constant bit rate (CBR) vs. Variable Bit Rate (VBR)
Video encoding is naturally variable bit rate but to simplify network engineering for Telco delivery systems, the video encoders are set to provide a constant bit rate VBR streams such as those used in DVD encoding have constant quality since the bit rate is allowed to vary to accommodate varying complexity of the source material CBR streams have variable quality since there may be times when the bit rate is insufficient to accommodate the video complexity but CBR steams enable more straightforward traffic engineering and system design
29
Group of Pictures (GOP) structure improve quality but reduce the improvement to bit rate from compression. improve maximum compression ratio, but increase channel change time and the amount of damage a lost packet will cause. used to better handle scene changes impact the variability of zapping latency and may complicate mechanisms to increase zapping speed.
Shorter GOPs
Longer GOPs
Dynamic GOPs
Wider search provide improved quality but at increased complexity and encoder delay Large search ranges are required for high motion content such as sports: Rate Control Mode decisions greatly affect the bit rate Preprocessing (such as noise reduction)
usually proprietary and non-standard but can improve bit rate / quality tradeoff
30
Broadcast channels Specialty or premium channels On-demand content including movies, time shifted broadcasts, network PVR, live and recorded special events such as PPV, etc. Control Plane
Interactive responsiveness (channel change delay, VoD control responsiveness) Video picture quality
Data Plane
Many potential impact points on video quality in an end-to-end system Impairments: blocking, blurring, edge distortion, judder, visual noise, incorrect image data due to loss, etc. Also interaction of audio and video on overall media quality QoE, Media synchronization
Audio quality
Usability
Service UI (set-up, finding content - EPG, PVR, remote control) mainstream, high quality, popular content is a key TVoDSL success component, particularly for Video on Demand (VoD) services
Content
Reliability/Availability Security/Privacy
31
Subjectively using a controlled viewing experiment and experiment participants who grade the quality using rating scales such as Mean Opinion Score (MOS) Objectively using electronic test equipment to measure various aspects of the video signal Indirectly using measurements of network impairments (loss, delay, jitter) to estimate the impact on video quality.
32
Human vision system is extremely complex and many properties are still not well understood. complicated with video sequences where now the system has both a spatial and a temporal dimension and interactions between the two. viewers assessment of picture quality depends on many factors including viewing distance, display size and resolution, brightness, contrast, sharpness, color saturation, naturalness and distortion. To complicate matters, there is a difference between objective fidelity / accuracy and perceived quality. For example, viewers generally prefer more vibrant colors even though they are not accurate or necessarily natural (de Ridder et al., 1995).
[email protected]
33
Subjective evaluations are done either informally or using formal techniques. Informal evaluation of video quality is often done by service provider crafts persons on site and technical experts (golden eyes) in the video system head end or during commissioning. These skilled experts often have years of experience in knowing what to look for. Unfortunately these golden eyes may not always be available, may not provide repeatable results and may not reflect service providers customer population. There are a number of subjective video quality methods suggested in Rec 500 and selection of the method used requires careful consideration of the impairments being evaluated, sequence duration, desire to closely model a home viewing experience (ecological validity) and other factors. The output of the subjective tests is often an average of the quality ratings called a Mean Opinion Score (MOS).
[email protected]
34
Full Reference (FR) A method when both original transmitted and received video signals are available to determine video quality objectively Reduced Reference (RR) A method when partial information about transmitted video signal and full information about received video signal is available to determine video quality objectively No reference (NR) A method when only received video signal is available to determine video quality objectively. In this method video signal characteristics are used to compare transmitted and received video streams. One way is to do a frame by frame, pixel by pixel comparison of the two video streams and calculate a mean square error (MSE) between the two. The difference between two video sequences can also be expressed as a picture or peak signal to noise ratio (PSNR). PSNR is calculated by log of the ratio of the peak signal squared to the MSE in a similar fashion to analog systems. Until the emergence of models using human perception, PSNR was widely used method of comparing the video quality. It is important to monitor the quality of compressed video transmitted over a packet network from the perspective of a network service provider. It is not always feasible to use full reference (FR) and reduced reference (RR) methods in all locations of the network since the reference may not be available. In addition, the no reference (NR) method would be prohibitively expensive to deploy widely for ongoing performance monitoring when there are many independent video streams to monitor as each of the streams would require separate decoder.
35
Minimum Application Layer Performance for Standard Definition Broadcast Program Sources
Video Codec standard MPEG-2 - Main profile at Main level (MP@ML) MPEG-4 AVC (Main profile at Level 3.0) SMPTE VC-1 Minimum Bit Rate (video only) 2.5 Mbps CBR 1.75 Mbps CBR 1.75 Mbps CBR Preprocessing Enabled Yes (if available) Yes (if available) Yes (if available)
Source material:
4:3 aspect ratio Horizontal x Vertical: 720 pixels x 480 lines (North America) ITU-R BT.601-5 or 720 pixels x 576 lines (Europe) 29.97 fps (North America) or 25 fps (Europe)
[email protected]
36
Number of Channels Mono or stereo 5.1 if available, else left/right stereo pair Stereo Stereo
Minimum Bit Rate (kbps) 128 for stereo 384 for 5.1 / 128 for stereo 96 for stereo 128
Source material:
NTSC (North America) or PAL (Europe / AsiaPac) Most broadcast content is now in stereo (left / right) 48 kHz sample rate for Dolby digital as per ATSC 16 kHz to 44.1 kHz for MP3 32 kHz, 44.1 kHz or 48 kHz for DVB source audio as per ETSI TR 101 154 [email protected]
37
Audio channels:
38
Minimum Application Layer Performance for Standard Definition VoD and Premium Program Sources
Video Codec standard MPEG-2 - Main profile at Main level (MP@ML) MPEG-4 AVC (Main profile at Level 3) SMPTE VC-1
Minimum Bit Rate (video only) 3.18 Mbps CBR 2.1 Mbps CBR 2.1 Mbps CBR
Preprocessing Enabled Yes (if available) Yes (if available) Yes (if available)
Source material:
NTSC (North America) or PAL/SECAM (Europe / AsiaPac) 4:3 aspect ratio Horizontal x Vertical: 1/2 D1 352 pixels x 480 lines (North America) ITU-R BT.601-5 or 352 pixels x 576 lines (Europe) is permitted to ensure encoding quality is maintained for complex materials Telco service providers could run VoD assets at full D1 resolutions but would likely not be able to re-use assets pre-encoded for cable deployments 29.97 fps (North America) or 25 fps (Europe)
Frame rate:
39
Minimum Audio Application Layer Performance for VoD and Premium Standard Definition Materials
Audio Codec Standard Dolby Digital (AC-3) Number of Channels 5.1 if available, else left/right stereo pair Minimum Bit Rate (kbps) 384 for 5.1 / 192 for stereo
40
Minimum Application Layer Performance for High Definition (HD) Broadcast Program Sources
Video Codec standard MPEG-2 - Main profile at Main level (MP@ML) MPEG-4 AVC (Main profile at Level 4) SMPTE VC-1
Minimum Bit Rate (video only) 15 Mbps CBR 10 Mbps CBR 10 Mbps CBR
Preprocessing Enabled Yes (if available) Yes (if available) Yes (if available)
Source material:
ATSC (North America) or DVB (Europe) or TBD (AsiaPac) 16:9 aspect ratio 720p60 (ex. SMPTE 296M) or 720p50 (DVB)
Horizontal x Vertical: 1280 pixels x 720 lines 50, 59.94, 60 progressive scan frames per second Horizontal x Vertical: 1920 pixels x 1080 lines 29.97 (59.94i), 30 (60i) interlaced frames per second, two fields per frame
41
Source material:
ATSC (North America) or DVB (Europe) Many broadcasters are also using Dolby 5.1 for primetime series and special events, particularly concerts and sporting events 48 kHz sample rate for Dolby digital as per ATSC 16 kHz to 44.1 kHz for MP3 32 kHz, 44.1 kHz or 48 kHz for DVB source audio as per ETSI TR 101 154 [email protected]
42
Audio channels:
loss, latency and jitter In general, reasonable end-to-end delay and jitter values are not problematic due to STB dejitter buffers Video streams however are highly sensitive to information loss and the QoE impact Highly dependent on type of data lost
System information and header losses produce different impairments Lost data from I and P frames produce different impairments than B frame packet losses due to temporal error propagation
Dependent on codec used Dependent on transport stream packetization used Loss distance and loss profile With high encoding bit rates, the stream is more vulnerable to packet loss impairments
For the same packet loss ratio, impairments due to loss on a higher rate video stream occur more frequently
43
Decoder concealment algorithms can mitigate perceptual impact of some losses [email protected]
Typical set-top box de-jitter buffers can store 100-500 ms (of SDTV) video the de-jitter buffers should be set as small as possible.
loss distance is a measure of the spacing between consecutive network packet loss or error events; a loss period is the duration of a loss or error event
The loss rates to ensure satisfactory end user service level quality assuming no or minimal loss concealment recommended loss period is specified as less than 16 ms network level techniques : e.g. interleaving and FEC
including loop impairment behavior and interleaved Reed Solomon FEC codes interleaver depth (i.e. FEC block duration) of 8 or 16 milliseconds.
application layer mechanisms : e.g. loss concealment, application layer FEC, Automatic Repeat Request (ARQ) [email protected]
44
Error event is defined as a loss or corruption of a group of a small number of IP packets each containing up to seven MPEG packets of 188 bytes in length. Loss Distance of error events should be limited to at most one per 60 minutes for SD materials and one per 4 hours for HD. Noise margin in the link to combat line noise and enough FEC interleaver depth to combat impulse noise in order to achieve required BER to achieve the packet loss objectives Set-top box decoders should employ error concealment techniques to minimize impact of loss or corrupted video packets.
45
Minimum Transport Layer Parameters for Satisfactory QoE for MPEG-2 encoded SDTV Services
Transport stream bit rate (Mbps) 3.0 3.75 5.0 <200 ms <200 ms <200 ms <50 ms <50 ms <50 ms <= 16 ms <= 16 ms <= 16 ms 6 IP packets 7 IP packets 9 IP packets 1 error event per hour 1 error event per hour 1 error event per hour Latency Jitter Maximum duration of a single error Corresponding Loss Period in IP packets Loss Distance Corresponding Average IP Video Stream Packet Loss Rate <= 5.85E-06 <= 5.46E-06 <= 5.26E-06
Assumptions
MPEG-2 codec, MPEG-2 transport stream, seven 188-byte packets per IP packet no or minimal loss concealment (tolerable loss rates may be higher depending on degree and quality of STB loss concealment) [email protected]
46
Minimum Transport Layer Parameters for Satisfactory QoE for MPEG-4 AVC or VC-1 encoded SDTV Services
Transport stream bit rate (Mbps) 1.75 2.0 2.5 3.0 <200 ms <200 ms <200 ms <200 ms <50 ms <50 ms <50 ms <50 ms <= 16 ms <= 16 ms <= 16 ms <= 16 ms 4 IP packets 5 IP packets 5 IP packets 6 IP packets 1 error event per hour 1 error event per hour 1 error event per hour 1 error event per hour Latency Jitter Maximum duration of a single error Corresponding Loss Period in IP packets Loss Distance Corresponding Average IP Video Stream Packet Loss Rate <= 6.68E-06 <= 7.31E-06 <= 5.85E-06 <= 5.85E-06
Assumptions
MPEG-4 AVC or VC-1 codec, MPEG-2 transport stream with seven 188-byte packets per IP packet no or minimal loss concealment (tolerable loss rates may be higher depending on degree and quality of STB loss concealment)
47
Minimum Transport Layer Parameters for Satisfactory QoE for MPEG-2 encoded HDTV Services
Transport stream bit rate (Mbps) 15.0 17 18.1 <200 ms <200 ms <200 ms <50 ms <50 ms <50 ms <= 16 ms <= 16 ms <= 16 ms 24 IP packets 27 IP packets 29 IP packets 1 error event per 4 hours 1 error event per 4 hours 1 error event per 4 hours Latency Jitter Maximum duration of a single error Corresponding Loss Period in IP packets Loss Distance Corresponding Average IP Video Stream Packet Loss Rate <= 1.17E-06 <= 1.16E-06 <= 1.17E-06
Assumptions
MPEG-2 codec MPEG-2 transport stream with seven 188-byte packets per IP packet STB has some level of loss concealment
[email protected]
48
Minimum Transport Layer Parameters for Satisfactory QoE for MPEG-4 AVC or VC-1 encoded HDTV Services
Transport stream bit rate (Mbps) 8 10 12 <200 ms <200 ms <200 ms <50 ms <50 ms <50 ms <= 16 ms <= 16 ms <= 16 ms 14 IP packets 17 IP packets 20 IP packets 1 error event per 4 hours 1 error event per 4 hours 1 error event per 4 hours Latency Jitter Maximum duration of a single error Corresponding Loss Period in IP packets Loss Distance Corresponding Average IP Video Stream Packet Loss Rate <= 1.28E-06 <= 1.24E-06 <= 1.22E-06
Assumptions
MPEG-4 AVC or VC-1 codec, MPEG-2 transport stream with seven 188-byte packets per IP packet STB has some level of loss concealment
[email protected]
49
50
51