DMADV Sample Project
DMADV Sample Project
Background
DMADV Storyboard
Audit Project
D M A D V
Req./
New Product Distributio Customer
Core Planning Marketing Production Logistics Sales
Contract
Introduction n Service
Communicate
Business Develop Execute Evaluate
Level 1 Environmental Business
Plans Plans Performance
Data Plans
Identify Facilities
Schedule Audits
protocols
Complete Logistics
Confirm findings
10. Is there anything else you would like to share with us? “Catch all”
Audit Project
DMA D V
Gap to
Design Project Discovery Process
Cost Be
Method Size Potential Knowledge
Closed
Small
PMIS small least least highest
moderate
medium moderate
QFD moderate moderate moderate
large large
medium high
Benchmarking high low large
large moderate
audit
SBU/division
performance
ratings
compliance
audit
Determine
modularfor
SBU/division
performance
In-depth
appropriate
compliance
Comm.
Rating
Determine
consistent
Comm.
Rating
locally
Needs (Whats)
Needs (Whats)
Clearly Identifying current and potential risk
Clearly Identifying current and potential risk
and problems
and problems 48 489 9 9 99 9 9 9 9 3 9
Independent
Independent Audits
Audits 39 39 1 1 9 9 9
TheGlobal
The Global Program
Program is locally
is locally relevant 36
relevant 363 3 9 9 9 1
Fair
FairAudits
Audits 30 309 9 1 13 9 3 9 9 9 1 1
Consistent Audits 24 9 9 3 9 9 1
Consistent Audits
Verification of completeness of corrective
24 9 9 3 9 9
Verification of completeness of corrective
action 21 9 9 1 9
action accepted audits
Externally 21 213 9 1 9 1 3 39
Complete
Externally communication
accepted audits 16 219 3 9 13 3 9 3 1
Importance 1422
Complete communication 16 9 1071 987
9 966
3 900
3 765 514 504
9
Importance 1422 1071 987 966 900 765
How Much January 2003 - 100 % of 25 - 30 80% of time match An accuracy rate of All elements of ISO Provide bi-monthly
100% lead auditors Compliance audit type to 100% for critical 19011 will be reports for BOD
are iso lead modules by January auditee; 100% findings and 80% incorporated into meetings; provide
assessor certified; 1, 2004;100% of the match of audit team accuracy for non- the Global Audit monthly reports to
50% of auditors 15 System modules on process critical findings and Program design by Exec. Com.,Quality
certified to TCCC
Our by June 1, 2004 knowledge; In 2004 overall plant ratings January, 2004. Division and SBU
certified auditor at least 50% of for each audit by heads by February
program audits conducted December 2003 5, 2004
requirements by with fully certified
end of 2004 auditors; 2005 on
(transition). 80% 80% of audits
thereafter as steady conducted with fully
state in system. certified auditors
Audit Project D M A D V
Potential
synergies and
conflicts between
design ideas
identified
Audit Project D M A D V
Audit Program – FMEA
Occurrenc
Occurrenc
Detection
Detection
Severity
Severity
Potential
Cause(s) of Current
RPN
RPN
Design Requirement Potential Failure Mode Potential Effect(s) of Failure Failure Controls Recommended Actions
e
Decision criteria and process Incorrect individual findings Over estimation of current 8 Auditor does not 7 10 560 Auditor calibration and training. 8 4 4 128
for consistent ratings of leading to incorrect overall performance leading to false follow process Also, include evidence in
individual findings and overall facility performance rating sense of security and/or mis- working papers that process
facility performance representation of risk & Under was followed. Incoporate
estimation of current review of audit ratings prior to
performance leading to unfair closing meeting.
audits
Determine audit & audit team Inability to capture local ideas / Local levels start performing 6 Lost or 7 10 420 Create a procedure for 6 4 5 120
appropriate for the auditee in request that could be Routine for considering the
audit activities for local issues
mishandled reviewing, sharing learnings
collaboration with local
SBU/division
globalized incorporation of local needs into Audit
and the GAP is unable to
detect local risks.
requests across geographies, and for
validation and tracking of
program solutions with originator within
an agreed timeframe.
Determine audit & audit team Inability to capture local ideas / Local levels start performing 6 Variaton in 6 10 360 Routine for considering the 6 4 1 24
appropriate for the auditee in request that could be audit activities for local issues requests incorporation of local needs
collaboration with local globalized and the GAP is unable to into global audit program (and
SBU/division detect local risks. TCCQS) that includes criteria
for review and evaluation
against TCCC standards and
applicability for globalization.
TCCC Certified auditors Insufficient number of auditors Insufficient resources to meet 8 Transfer of 4 10 320 Develop and apply auditor 8 1 1 8
certified audit objectives Division auditors selection criteria during
who are not transition. Use auditor pool
capable across SBU's while building
SBU capability.Identify multiple
external certification bodies in
design phase.
TCCC Certified auditors Mix of Internal and External
Insufficient number of auditors Insufficient resources to meet
8 Division auditors auditors
4 10 320 Use auditor pool across SBU's 8 4 1 32
certified audit objectives not available for while building SBU
enables annualtransfer
audits of all capability.Identify multiple
external certification bodies in
manufacturing operations design phase.
Top design requirements tested for failure and countermeasures incorporated in design
Audit Project D M A D V
Audit planning
Audit Program – Process Flow
designed in Report
Determine Execute
accordance Secure Audit
Level Audit Audit
with ISO2 19011 Resources Performance
Needs Plan
•Identify number of •Determine audit type Select the audit team Develop audit schedule:
plants to be audited required based on facility based on: ▪ Schedule systems audits based
and location maturity on auditee’s readiness and auditor
• Qualification
•Establish maturity of •Determine additional availability
• Right process knowledge
facility and rank auditing needs (obtained ▪ Firm scheduling of compliance
operations based on by use of the collaborative • Location of auditor
audits (prioritized based on risk
potential risk. (Based routine established in the • Language ability profile)
IT Enablers: on Division GAP) • Availability Draft Schedule indicates:
• Searchable assessment against •Determine the preferred • Lead Auditor
established criteria) ▪ Availability of auditee
Auditor and audit timing from the
Divisions ▪ Duration and type of audit
Operation
▪ Timing of audit & team who will
Databases
conduct audit
• Scheduling
Confirmation of schedule
Software
Communication of final schedule
How Much:
80% of time match audit type to auditee; 100% match of audit team on process knowledge; In 2004 at least 50% of audits
conducted with fully certified auditors; 2005 onwards 80% of audits conducted with fully certified auditors
Firm scheduling routines to have the right team at the right location
conducting the right audit
Audit Project D M A D V
Selection,
training and Audit Program – Process Flow
evaluation
of auditors Determine Execute Report
Secure Audit
consistent
Level 2 with Audit Audit
Resources Performance
ISO-19011 Needs Plan
Certification
Level 3 Selection Training Certification
Maintenance
Select using criteria for: Train auditors in: Certify auditors Certification Periodic re-training and
• Personal Attributes • Audit principles criteria evaluation
• Education • Audit execution
• Related experience • ISO Lead Assessor
• Process Technologies
• Business Processes
• Quality Management
System (ISO-9000)
• Laws and regulations
In-depth protocols and decision criteria deliver consistent and fair audits
Audit Project D M A D V
Audit Program – Process Flow Audit reporting
activities
Determine Execute Report designed to
Secure Audit meet ISO-19011
Level 2 Audit Audit
Resources Performance
Needs Plan
How Much:
Provide bi-monthly reports for BOD meetings; provide monthly reports to Executive Committee,
Quality Division and BU/Vision heads by February 5, 2004
The program design requirements to meet these high level needs are:
Certified auditors
Match audit type and audit team appropriate for the auditee’s facility status, in collaboration w ith local BU/Division
Standardized, modular, protocols and w ork aids for Systems and Compliance audits
Decision criteria and process for consistent ratings of individual findings and overall facility performance
Audit program certified by recognized third party to ISO 19011
Combination of external/internal audit teams
Audit Project
D M A D V
Audit Project - Determine Audit Needs
QFD #1
High Level
Hows (Design Requirements) Design
performance
compliance
Comm.
Rating
Needs (Whats)
Clearly Identifying current and potential risk
and problems 48 9 9 9 9 9 Detailed
Independent Audits 39 1 9
The Global Program is locally relevant
Fair Audits
36
30
3
9 1
9
3 9 9
Design
Options
QFD #2
Consistent Audits 24 9 9 3 9 9
Verification of completeness of corrective
action 21 9 9 1 9
Externally accepted audits 21 3 1 3
Complete communication 16 9 9 3 3 9
Importance 1422 1071 987 966 900 765
Options
AUDIT TYPE TEAM SELECTION SCHEDULING
Division QA Manager
Quality Indicator only
Determined by Audit
Scheudling Process
Div QA Mgr Selects
Hub Audit Manager
Determined using
TCCQS Maturity
continiuum only
CTQs
Determined by
Determined by
Determined by
Determined by
Decentralised
Select Team
Centralised
Scheduling
Manager
Auditee
Weight
Team
Team
Needs (Whats)
EMS Mngr 18 Do auditors have required language skill? X Ensure there are sufficient trained auditors available with the required skills
17 Do auditors have required process knowledge? X
18 Do auditors have required language skill? X
Telephonic
19 Is location of auditors suitable for conducting audits? X Ensure there are sufficient trained auditors available with the required skills in yours
Confirmation
with audit
discussion with
division to get a
Discussion with
bottler & Define a procedure for rigorous planning. Use auditor SBU
19 Is location of auditors suitable for conducting audits? X
manager (14) plan for action
preparation of
20 Can audit be re-scheduled? 20 Can audit be re-scheduled? X
(15)
CAP (16)
Planning of resources pool across SBU's while building SBU capability. GAP 21 Is there a lead auditor available? X Ensure there are sufficient trained auditors available with the required skills in yours 21 Is there a lead auditor available? X
No 9
ineffective
4 no current controls 10 360 Identify multiple external certification bodies in design 9 2 4 72 22 Allocate resources to the prioritized list SBU 22 Allocate resources to the prioritized list X
Agree with Forward plan by Mngr 23 Prepare/Review Draft Schedule X Note: Minimize this loop with more active involvement with the Divisons in the early 23 Prepare/Review Draft Schedule X Note: Minimize this loop with more active involvement with the Divisons in the early
content of CAP
(18)
email to audit
manager (17) phase. stage of the scheduling process.
stage of the scheduling process.
Yes
24 Communicate Draft Schedule to Divisions 24 Communicate Draft Schedule to Divisions X
Voice mail to SBU Inform Hub 25 Agree with draft schedule? (DIVISION) 25 Agree with draft schedule? (DIVISION) X Note: Minimize this loop with more active involvement with the Divisons in the early
Q.A.and copy
Pres. Copy PVP, Div.
Pres, SBU QA, SBU division
26 Communicate proposed changes (DIVISION) X Note: Minimize this loop with more active involvement with the Divisons in the early stage of the scheduling process.
Tech, Div Tech technical
detailing critical status director (19)
stage of the scheduling process. Alternately commit the Division to respond within 26 Communicate proposed changes (DIVISION) X Note: Minimize this loop with more active involvement with the Divisons in the early
(20)
Process for updating is GAP an agreed timeframe or the schedule would be accepted as it is. stage of the scheduling process.
8
not followed
4 no current controls 10 320 Audit the updating process at a local level 8 2 4 64 27 Are changes feasible? X
Mngr 27 Are changes feasible? 28 Communicate to Divison that changes are not possible X Note: Minimize this loop with more active involvement with the Divisons in the early
28 Communicate to Divison that changes are not possible stage of the scheduling process.
29 Prepare final schedule 29 Prepare final schedule X
30 Communicate final schedule 30 Communicate final schedule X
Document Management
Audit program, management of procedures and modules, incorporating:
• Document creation • Document revision
• Document review • Document approval
• Document distribution • Document control
• Document archiving
(Above done with electronic workflow)
Conclusions:
➢ Improved consistency in applying the definitions
➢ Auditors did not have a good understanding of the findings
used (and/or lack of context or different context)
➢ Most auditors did well with the audit format
Next Steps:
➢ Incorporate above into development of ongoing Auditor
Training and Calibration exercises (already built into
Auditor Development and Certification)
Audit Project Process Management Control System DM A D V
Process Name: Primary Customer Customer’s CTQs: Clearly ID Current & Outcome Indicators (Ys):
Audit of Process: Plant Potential Risk & Problems Y1= % of Reportable Incidents That Were Preventable
Management Fair Audits Y2=% of Survey Scores Indicating Dissatisfaction
Outcome Upstream
Misc.
Process Map Indicators Indicators Capturing Data
Information
(Ys) (Xs)
Mfg. Audit Needs
Determine Global -Name -Name -Indicator Formula
Indicator “Physical” Who -Procedures
-Numerator & -Numerator & When to Recovery
Chart Item to Performs
Hub Audit Group SBU/Divison Bottler
Manufacturer Denominator Denominator Check Action -Abbreviations
Type Check Check
- Specification or Description -Comments
Determine Current Status and Audit Type
1
Evaluate Plants using
Previous Audit Performance X1.1 = % of P Chart Audit Plan Weekly Hub Audit HUB Mgr The team must
and Maturity
Audits Mgr adjusts to collectively cover all
2 Scheduled with get a the process
Prioritize Risk & Timing
of Audit
incomplete qualified knowledge and local
knowledge on audit team knowledge required.
3
team prior to All team members
Identify Audit Type (# of audit audit must have been
knowledge execution trained in behavioral
4 requirements skills. Each audit will
Do Existing Audit
Modules Cover Content
not met in have 3 defect
Needed ? schedule / total opportunities ( (1)
No
number of audit process knowledge
knowledge required, (2) local
5
Contact TCCQS to requirements knowledge (culture,
Create Module Yes scheduled in 1 language, gov’t, etc.,
wk) (3) behavioral skills.)
6 7
ID Audit Team
Yes
8 X1.1
Allocate
Auditors
9 10
Draft Schedule and Agree With
Communicate Schedule ?
11
Schedule Audits
Are Changes No
Feasible
12
No
Adjusted Schedule
13
Communicate
Final Schedule
Yes
Rev # Date Change Log – Describe Revisions By Apppr
1 12/30/03 B. Cappad
Audit Project
Summary