Metrics Definition
Metrics Definition
1 Glossary Term
Glossary of Terms
Abandoned Calls
Calls answered by the ACD system and put in live agent or voice response queue but are
Disconnected by the caller or incorrectly dropped by the queue management system
before being answered.
Absenteeism
A measure of the percentage of staff that are not present during their scheduled shift (see
Item 4.6 Staff, Attrition and Absenteeism).
Accuracy
The quality of the transaction. This measurement is usually separated into fatal and non-
Fatal (and sometimes Compliance) error accuracy. Accuracy may be measured as
“percent correct”, “percent defective”, or “defective parts per million (dppm)”.
Agent Utilization
See CSR Utilization
Aging
Categorization of the age of items in backlog that have not been processed. It must be
Calculated as: “Average Cycles Late” (ACL).
Application
CSP data and documents provided by the CSP to COPC Inc. that will provide the
Certification or bench mark review team with an outline of the approaches and practices
used by an entity to comply with each of the Items of the appropriate COPC-2000
Glossary of Terms
CSP Standard ® and its performance results. Applications are submitted prior to
Baseline Assessments, Benchmark Reviews, and Certification Audits.
Applied
A designation from COPC Inc. identifying entities that have formally committed to
pursue certification to the COPC-2000 CSP Standard. ®
Approach
The processes, practices, an d procedures CSPs must develop and implement to meet the
Requirements of the COPC-2000 CSP Standard or COPC-2000 CSP Gold Standard.®
Asset Efficiency
There are multiple definition s of asset efficiency. Common metrics in clude: seat
utilization, revenue/asset, and other metrics that relate the performance of assets (dollars
or units) to output. Asset efficiency may be measured and managed at either the entity or
program level.
Attrition
Voluntary and involuntary staff separations (see Item 4.6 Staff Attrition and
absenteeism).
Attrition Costs
Typically include most or all of the following: Compensation of new hires for non-
productive period (training time) Agency fees Cost of “lost” production opportunity (pay
per call x number of calls/day x period new hire is not “on the job” Cost of recruitment –
internal and external (newspaper ads, job fairs, and CSP personnel time) Cost of training
– the allocated costs per student for the train in g program Ramp up costs – efficiency of
Availability
The term used by COPC Inc. to designate the percent of a paid day a CSR sp ends
handling customer contacts. It is equal to ATT (+ Hold Time if not included in ATT) +
ACW + Available to Take a Call divided by the number of paid hours. This term should
not be confused with Available Time (Wait or Idle Time between transactions). See
Utilization.
Backlog
Transaction s that has been received but not processed within the defined cycle time. The
appropriate measure for backlog is Average Cycles Late (ACL).
Baseline Assessment
A COPC ® Audit designed to provide a gap analysis of where the entity stands on all
Items of the appropriate COPC-2000 CSP Standard. It is used to identify the non-
compliant ® Items so the entity can take appropriate action prior to the COPC
® Certification Audit.
Benchmark Data
COPC Inc.’s first-hand experience from audits and reviews conducted around the world
and across industry and/or business sectors. These are the best examples of performance
and practices observed by COPC Inc. to address Category 4.0 Performance of the COPC-
2000 ® CSP Standard.
Benchmark Review
A comprehensive assessment by COPC Inc. of a service organization to provide an
Operational performance comparison between the service organization and high
Performance customer contact centers.
Blended Staff
Staff processing a mix of call, electronic and n on -electronic transactions.
Blocked Transactions
The number of calls not received due to network, trunk, or PBX limitation s and /or
settings. Blocked transactions may be measured as the amount of time the network(s),
trunk(s), or PBX are at capacity and must be tracked at least quarterly. This frequency
must be increased if en d-user satisfaction and dissatisfaction data indicates an issue with
customer access.
Calibration Sessions
Meetings during which individuals responsible for the monitoring of transactions comp
are scoring results for selected transaction s and discuss the scoring of these transaction s
to ensure consistency of scoring. These session s include quantitative evaluation of the
Consistency of the scores via comparison to a gauge or reference at the attribute level and
Their correlation with end-user satisfaction and scores provided by clients.
Callback
An outbound CSR call to an end user which must be made as a result of previous CSP
Action which, in-turn is directly related to a previous inbound end-user call.
Client
Clients are (a) the organizations that hire third-party CSPs to provide products and
services to their end users and (b) the groups with in a company that obtain CSP services
from a “sister” group, division, department, or team within the same company.
Complaint
Any negative comment (received in person or by ph one, mail, fax, e-mail, etc.) about
any aspect of the CSP’s products, services, staff, or agents or its clients’ products,
services, staff, or agents.
Compliance Audit
See COPC ® Certification Audit
Compliance Accuracy
A measure of how successfully the CSP meets the legal, regulatory or financial
requirements of various local, state/provincial or federal agencies in handling specific
transactions. A Compliance failure is considered to be a Fatal Error (see also Fatal
Error).
Compliant
Meeting the detailed, individual Item requirements of the COPC-2000 CSP Standard or
® COPC-2000 CSP Gold Standard (as appropriate).
Cost
Typically focuses on efficiency and the cost per unit incurred by a CSP to provide a
product or service. Cost is different from price. Price represents what a CSP might
charge for its services or the cost burden transferred to the parent corporation.
COPC ® Coordinator
The person from the entity responsible for coordinating all activities for compliance to
the COPC-2000 CSP Standard or COPC-2000 CSP Gold Standard (as appropriate). This
® Person is usually the primary interface between the entity and COPC Inc.
Cpk
See Statistical Process Control
CSR Utilization
An efficiency metric calculated as: (talk + hold + wrap + available)/(paid hours)
Cycle Time
The elapsed time (including queue time for inbound telephone and chat contacts) of a
Process. The cycle time in a customer-contact center usually begins when the CSP
receives the transaction (e-mail, mail, and/or fax), and usually ends when the transaction
is completed from the end-user’s perspective (e.g., when the product or e-mail is actually
received).
Defect
An error or an undesired result that is different from the planned or expected outcome.
Glossary of Terms
Demand (Demand Requirement)
A calculation which identifies the expected CSR resource needs, based on the forecasted
Transaction volume and AHT (“Unloaded Demand”) or, based on the forecasted
transaction volume, AHT and shrinkage (“Loaded Demand”).
Department
Within an entity, a distinct group or segment of the operation most often defined by the
Entity’s organization structure. The department may be comprised of the operation’s
service delivery customer contact component or a support service (e.g., human resources,
Information technology).
Deployment
The extent to which Approaches are used throughout the organization.
Download
Usually refers to data being sent between clients and the CSP. See ‘Electronic
Download’ also.
Glossary of Terms
DMAIC
See Statistical Process Control (SPC)
Efficiency Metrics
Refers to units of input (typically labor hours or costs) divided by units of output
(typically number of transactions, time or revenue). Also referred to as productivity
metrics.
Electronic Download
The activity that occurs when an end user accesses the Web or FTP site and requests a
download of in formation or software. See ‘Download’ also.
E-mail
Electronic memos and letters sent over an internal or external network. These can be
free- form messages or information provided by filling in an electronic form.
Glossary of Terms
End User
End users are the customers of internal CSPs and the customers of third-party CSPs’
clients. They may be consumers, businesses, field organizations, or the retailers,
distributors, and specialists that make up a distribution channel.
Entity
The company, organization, or service operation applying, or seeking certification to, the
COPC-2000 CSP Standard or COPC-2000 CSP Gold Standard (as appropriate). As an
® Example, any of the following could be considered an entity for the purposes of COPC
® Certification:
Glossary of Terms
Exceptions
Non-compliant transactions (e.g., incomplete applications, checks that are over or short
Paid, incomplete orders).
Fatal Errors
Inaccuracies that cause an entire transaction to be deemed defective. Typically, these are
errors that will cause the end user to contact the CSP again or result in unnecessary
expense for the end user, CSP, or client (see also Compliance Accuracy).
Forecast Accuracy
Forecast accuracy is defined and must be measured at two levels:
•Staffing Forecast Accuracy (e.g., actual vs. forecasted transaction volume for the
forecast developed to identify required staffing levels to recruit/hire and train staff).
•Scheduling Forecast Accuracy (e.g., actual vs. forecasted transaction volume for
the forecast developed schedules for existing staff).
Forecasting
Analysis o f historical transaction volume and AHT arrival pattern s and shrinkage to
determine future patterns and demand requirements
Glossary of Terms
Full Time Equivalent (FTE)
Usually defined by the entity. It requires standardizing full-time and part-time employees
to a full-time equivalent. For example, two part time CSRs who each work half time
would be considered one FTE.
High-Performing
Companies and entities that are generally recognized as having achieved high levels of
Organizations service, quality, revenue, cost, and client and end-u ser satisfaction.
Indefinite Staff
Staff occupying positions with no known end date.
Issue Resolution
The percentage of processed transactions in which the en d users’ requests were
successfully resolved.
Glossary of Terms
•For customer-contact centers, KCR jobs include CSRs, e-mail or web agents,
collectors, telemarketers, and mail/fax processors, as well as the staff, who direct,
manage, and evaluate their performance (often referred to in the industry as leads
or supervisors).
Other processes that the CSP performs, including those required by contract with its
clients that bear materially on the CSP’s ability to meet its client and end-user
requirements and targets. For processes not specifically identified in Exhibit 1, the CSP
must identify its KCRPs based on:
Key Suppliers
Key suppliers are those organizations, external to the entity, that perform a KCRP or
KSP. These suppliers need not be external to the company; other parts of the comp any
that are not part of the entity may also be considered key suppliers. Corporate
departments that provide information systems and telecommunications represent key
suppliers. Key suppliers may also in clude clients and client-designated companies.
Glossary of Terms
Key Support Processes (KSPs)
Key support processes are those necessary to enable or perform KCRPs to meet targeted
levels. These almost always include reporting performance to clients, invoicing clients,
information systems, forecasting, hiring and recruiting, training, and telecom (for
customer- contact centers). KSPs are identified in Exhibit 1.
Lag Time
The time between when a forecast is prepared and when the resulting action will be
completed (often called the operational lag time). For example, if six weeks are required
to successfully recruit, train and assign new CSRs to handle an expected future
transaction volume, then the forecast must be prepared at least six weeks earlier (i.e., it
has a lag time of six weeks).
Levels
Measurements which reflect performance at specific times that are evaluated relative to
the performance achieved by appropriate comparisons.
Licensee
Companies that are licensed by COPC Inc. to determine compliance to the COPC-2000
® CSP Standard and nominate entities for certification to the COPC-2000
CSP Standard. ® They perform audits and reviews using the COPC-2000
CSP Standard or COPC-2000 ® Gold Standard. Licensees must follow specific
guidelines to ensure the integrity of the COPC CSP Standards and the COPC
Certification Audit.
Line Staff
Personnel handling the customer contacts and other KCR jobs (CSRs and
pick/pack/shippers).
Glossary of Terms
Logged-off
CSRs log-off to tell the ACD system they are no longer working. Log-off rules vary by
company (e.g. ., CSRs log-off during lunch hours and/or at the end of each shift only).
COPC Inc. recommends that CSRs log-off only at shift end. Also referred to as sign-off.
Logged-on
CSRs log-on to tell the ACD system they are starting work. This usually means entering
a touchtone code or agent number. Also referred to as sign-on.
Monitoring
See Transaction Monitoring
Non-fatal Errors
Inaccuracies that do not cause an entire transaction to be deemed defective. Examples
include errors in professionalism, soft skills, and some data input errors.
Occupancy
OJT
On-the-job training.
On Time
The percentage of transactions processed within the targeted cycle time.
Glossary of Terms
Performance Metrics
Measures used by the CSP to track performance, particularly of KCRPs. Examples and
Requirements are presented in Category 4.0 Performance and Exhibit 1.
Precision
See Confidence Interval
Glossary of Terms
Process, In- Control
A process that is performed as intended and in a consistent manner, and is designed to
meet client and end-user requirements and targets, and that shows little variation in
performance (see Item 2. 2 Process Control ).
Process Sigma
See Statistical Process Control
Program
A program is support provided for a specific product or service for a specific client.
Individual clients often have multiple programs. These might be services provided to
different divisions or departments within the client organization, a similar service
provided for different products, different services provided for the same product, or
individual campaigns. Programs should be defined based primarily (although not
exclusively) on the client’s and the CSP’s organization structures. The more distinct the
organization structure, the more the CSP is likely to have different programs. Thus, a
CSP that uses two different teams for one client probably has two programs for that
client.
Quality
Doing things accurately at the first attempt (e.g., giving the correct answer to an inquiry,
inputting an order correctly, and shipping the correct product to the correct address).
Requirement
There are two definitions of this term as it is used in the COPC-2000 CSP Standard, ®
COPC-2000 CSP Gold Standard, and COPC-2000 VMO Standard:
1. Any need that the CSP or VMO has to fulfill (e.g., respond to e-mails). Reference is
made throughout all the COPC ® Family of Standards to client and end-user
requirements.
Schedule Adherence
There are multiple definitions of schedule adherence. The numerator and denominator
will vary, depending on the definition. For example, comparing actual and scheduled
work by time of day and type of work (handling transactions, attending meetings,
coaching, on break, etc.).
Calculation
[15 (actual break) – 5 (late start) – 5 (late return)] / [15 (scheduled break)] = 33%.
On a daily, weekly, and monthly basis, this measurement must include the weighted
average (based on the number of client-required FTE) of schedule attainment for the
relevant 30- minute intervals.
To illustrate this calculation, assume the client-required staffing plan calls for 15 FTE to
be available from 10:00 am to 10:30 am.
If 14.5 FTE are available during this interval, the schedule attainment would be
calculated as follows:
Calculation
1- (ABS (Actual FTE - Required FTE)/Required FTE)
Actual FTE = 14.5, Required FTE = 15
1 – (ABS (14.5 - 15)/15) = 1 – (ABS (-.5)/15) = 1 – (.5/15) = 1 - .033 = 96.7%
Scheduling
Assigning CSR resources (planned ‘roster’) by period to meet the estimated loaded
demand. See Demand/Demand Requirement.
Service
There are two definitions of this term as it is used in the COPC-2000® CSP Standard,
COPC-2000 CSP Gold Standard and the COPC-2000 VMO Standard:
1. The speed in which things are done from the customer’s perspective. This might be
how long it takes to talk to a live agent or how long it takes to receive a response to an
email.
2. A specific function that the CSP or VMO has to provide, e.g., Inbound Customer
Service, Technical Support, Collections, etc.
Skill-based Routing
Software controlled ACD function that routes callers to specific CSR(s) based upon
predetermined parameters and calling conditions (e.g., CSR language capability, call
priority, etc.).
SKU
Stock Keeper’s Unit
Specific Attribute
An individual element or component used to break down overall satisfaction into the
elements that create or contribute to satisfaction (e.g., accuracy, timeliness).
Glossary of Terms
Staff Classification
Two distinct staff classifications within CSPs describe position s (as opposed to the
personnel occupying those positions) from the end-user perspective.
•Indefinite staff occupies positions with no known end date. They are employed either
by the CSP, or by a staffing or recruiting firm (in which case they are often called
“temps”). A CSR position that is occupied during the course of a year by four three-
month “temps” is de facto an indefinite position for the purposes of the COPC
Family ® of Standards.
•Temporary staff occupy positions for which there is a known end date, such as for a
holiday rush.
Staff, Contract
Full- and part-time staff on the payroll of a staffing/recruiting agency.
Staff Utilization
See Utilization
Staffing
Calculating the estimated number of CSR resources by period (regardless of who will
actually be assigned) that are required to handle the forecast transaction load (loaded
demand).
Glossary of Terms
Statement of Direction (SOD)
A documented statement of the CSP’s overall direction (e.g., vision, mission, or purpose)
that clarifies its commitment to clients and end users. It must address one or more of
client and end-user satisfaction, service, quality, or cost. Management and employee
behavior must be aligned with the statement of direction.
Supervisor
The managerial position within a CSP to which a CSR reports (also referred to as a first
line management).
Support Staff
The personnel responsible for supporting staff in KCR jobs. This usually includes
information systems, information technology, telecom, human resources,
schedulers/forecasters, and management.
Sustained Improvement
Three consecutive data points which are statistically significantly above the previous
performance level. The three points do not have to demonstrate successive improvement,
i.e., each point does not have to demonstrate higher performance than the previous data
point, but all three data points have to be statistically significantly above the previous
performance level. For the COPC-2000 CSP Gold Standard, the CSP must be able to
demonstrate improvement through the use of a statistical measure such as a moving
average or R-square on a trend line.
Target
A quantified level of performance for a requirement (e.g., respond to 95% of e-mails
within 24 hours of receipt).
Glossary of Terms
Technical Support Representative (TSR)
COPC Inc. uses this term interchangeable with CSR, agent, representative, rep or other
terms used to refer to the line staff that handle end-user contacts.
Temporary Staff
Staff occupying positions for which there is no known end date.
Time on Phone
The actual length of time a CSR is talking on the phone with an end user including hold
time (commonly referred to as average talk time). See Utilization, CSR Utilization, and
Occupancy.
Transaction Monitoring
Reviewing the style, format, professionalism, knowledge, and accuracy of information as
it is provided by CSRs to end users (see Item 2.4 Transaction Monitoring ). For calls,
this is usually performed by remote or side-by-side observation of actual calls. For e-
mails or correspondence, this is usually performed by reviewing the CSR’s written
responses to end- user inquiries.
Trends
Evaluation of how performance has changed over time.
Unscheduled-time Hours
The number of hours a CSR (or a group of CSRs) is scheduled to work but does not
because of unplanned absences - such as illness, tardiness and last-minute personal days -
in a given timeframe. Example: a CSR is absent one workday, takes an unplanned
personal day and is tardy by an hour twice during a 21-day month, totaling 18 hours.
This information is used in the absenteeism calculation.
Glossary of Terms
Vendor Management Organization (VMO)
An organizational unit or group of individuals, typically within the client enterprise,
responsible for managing at least a portion of the enterprise’s programs with CSPs.
Voice-Over-Data
Incoming calls to agents direct from en d users that are using the client’s website. The
Internet circuit is shared between the audio for the call and the data for the screen (s).
Requires speakers (or headset) and a receiver associated with the user’s terminal.
Web Callback
Callbacks generated when the end user activates a button on the clients website that sends
a message with the telephone number to an automatic out-dialer at the CSP. The out-
dialer dials the end user and connects to a CSR.
Web Chat
On a network, real-time exchange of written communication between customers and a
CSR. Usually used for technical support, product queries, idea generation or customer
satisfaction discussions. Typically a CSR chats concurrently with two or more end users.
Uptime
The percentage of time that systems are available to be used as intended (computer
systems, telephone lines, ACDs and desktop terminals).
Upload
Data being sent from the end user to the CSP/Client or other designated location.
Utilization
An efficiency metric calculated as:
(Talk + hold + wrap + available)/(paid hours)
Vendor
COPC Inc. uses this term interchangeable with “supplier”.