Scribd
Upload
18 views25 pages

Med005 wh06

sounds

Uploaded by

white paint
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
18 views25 pages

Med005 wh06

sounds

Uploaded by

white paint
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 25

Audio/Video Device

Guidelines For The


Microsoft Real Time
Communication Platforms

Regis J. Crinon, Ph.D.


Lead Program Manager
Real Time Media Group
Microsoft Corporation
Session Outline
The Real Time Media communication revolution
The Road to higher quality
Codecs
Signal Processing
Emergence of a market for Real Time
Communication (RTC) devices
An opportunity to work together
Draft guidelines
Demos
Call To action
The Real Time Media
Communication Revolution
Internet Protocol (IP) networks are emerging
as the prevalent means to communicate in
real time
Increasing collaboration and exchange of multimedia
information over corporate and public IP networks
IP telephony is now a viable alternative to Public Switched
Telephone Network (PSTN) services
Session Initiation Protocol (SIP) enables rich multimedia
sessions between multiple end-points
Quality of service is of prime importance
The Road To Higher Quality
Speech codecs

RTAudio RTAudio
(12-32 kbits/sec) (6-12 kbits/sec)

Siren, G.722.1 G.726


(16/24 kbits/sec) (32 kbits/sec)

s
) ork
G.711
s

in g tw
g) rk

(64 kbits/sec)
in o

pl e
pl etw

m n
sa N
z ST
am P n

kH d P
zs dI
kH n

(8 an
6 ba

wb
(1 id e

ro
W

ar
N
The Road To Higher Quality
Audio capture pipeline

Capture Analog
AEC
AGC

Digital
NS VAD
AGC

AGC: Automatic Gain Control


AEC: Acoustic Echo Cancellation RTAudio
NS: Noise Suppression encoder
VAD: Voice Activity Detection
The Road To Higher Quality
Video codecs

RT Video @ 200kbits/sec RT Video @ 400kbits/sec


RTVideo Codec
System-level enhancement
for error recovery

Error Packet loss


recovery detection

RTP/RTCP RTP/RTCP

SMPTE VC-1 SMPTE VC-1


encoder decoder

Optimized for
Real Time communication
RTP: Real Time Protocol
RTCP: Real Time Control Protocol
SMPTE: Society of Motion Picture and Television Engineers
Emergence Of An RTC
Audio/Video Device Market
RTC software RTC Audio/Video
platform (A/V) devices

Quality Quality
Performance Performance
Functionality Functionality
An Opportunity
To Work Together
A new class of AV devices
Control and signaling capability: Ringing,
DTMF, CID,…
Signals are processed digitally
For IP networks
No corresponding WHQL class today
Let’s work together on a set of quality
guidelines to optimize the RTC experience
Initial Set Of Guidelines
Audio
Speaker playback
volume Frequency range
Speaker to
microphone isolation
Passband ripple
Microphone
sensitivity
Channel un-balance

In-built microphone
speaker separation
SNR

Amplitude linearity
Total harmonic
distortion
Initial Set Of Guidelines
Reference dummy

ITU-T Rec. P.58 - Head and torso simulator for telephonometry


Initial Set Of Guidelines
Video
Resolution
Relative
Frame rate illumination

Chromatic aberration
Color formats

SNR

Light sensitivity

Field of view
Depth of field
More Parameters Needed?
An example
With the introduction of the USB Video Class Driver , a number of camera parameters
were added to the KSPROPERTY_VIDCAP_CAMERACONTROL enumeration
The DirectShow IAMCameraControl interface provides access to these properties
SCANMODE
PRIVACY
PANTILT
PAN_RELATIVE
TILT_RELATIVE
ROLL_RELATIVE
ZOOM_RELATIVE
EXPOSURE_RELATIVE
IRIS_RELATIVE
FOCUS_RELATIVE
PANTILT_RELATIVE
FOCAL_LENGTH
Towards Greater Integration

Built-in
microphone array

Built-in speakers
Built-in camera
Headset System Used With
Windows Live Messenger

Juan Zualaga
Plantronics Inc.
Bluetooth Multipoint
Headset Demo
Once paired, headset
connects to PC.
Calls on PC can be
answered via headset
A

B
… AND also connects to
mobile automatically when
in range.
Two virtual ports A
and B available
Calls on mobile can be
answered via headset

One headset for both


Bluetooth Multipoint
Headset Demo
1 headset, 3 phones… PC and Mobile Phone

1 headset, 3 phones….

Mobile phone and desk phone in the office


VGA Camera Used With
Office Communicator 2007

Philippe Depallens
Vice President
Video Engineering
Logitech
Logitech Camera
®

Technologies
Seamless integration of hardware and software
Key camera technologies
RightLight™: RightLight™ is a combination of
intelligent hardware and software designed to
provide users with the best image quality
regardless of environment
RightSound™: RightSound™ is a series of software
algorithm that eliminates echo and maximizes
audio performance
Video Effects™: Making Internet communication
more fun
Logitech Presents ®

QuickCam® Pro 5000


VGA video with RightLight™ Technology for outstanding
low light performance
Hear clear, echo free audio with RightSound™ technology
Wide field of view lens lets more people join in the conversation
Premium USB Headset 350
Superior clarity with the simplicity of a single USB
plug-and-play connection
In-line volume and mute control soft-touch surface allows for
precise control
Noise canceling microphone filters out unwanted background
noise and folds out of sight when not in use
Future Work Items
Determine whether initial set of
parameters needs to be expanded
Define test conditions and means
to verify the guidelines
Consider the possibility to establish
a new class of Windows Hardware
Quality Labs (WHQL) devices for
Real Time Communications
Call To Action
Participate in the review of the initial set of AV
device guidelines
Provide feedback on possible extensions of the
parameter set
New measurements for higher levels
of interoperability
New functionality (signaling, control)
Participate in the establishment of the
testing conditions
Let’s make it happen!
Additional Resources
Web resources
Spec: Audio/Video Device Requirements
and Recommendations – April 2006
Other resources
http://www.microsoft.com/office/uc
http://www.microsoft.com/office/preview
http://messenger.msn.com/Xp
Related sessions
Audio Considerations for Windows Vista
System Logo Certification
Email address: av4rtc @ microsoft.com
© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions,
it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

You might also like