mortlock-case-study
mortlock-case-study
Current Situation, Summer 2013 Project Manager: “What’s the funding situation?”
Monday Morning Project Management Office Chief Engineer: “We have over US$35 million in operations
Staff Meeting: and maintenance funding reserved for the buy that must be
Chief Engineer, Project Office: “Sir, we have an Enhanced obligated by the end of the September or the Army will lose
Combat Helmet (ECH) update. We just learned that Direc- the funding.”
tor, Operational Test & Evaluation sent Congress the ECH Project Manager: “Okay. Well, you know the drill. The
“Beyond Low Rate Initial Production Report,” and recom- operational testers probably already have the ear of the
mended that the Army not buy or field the helmet. The report boss—the Army Acquisition Executive, who is the deci-
says the unit cost is too high and that soldiers wearing the sion authority because the ECH was a wartime directed
ECH would have an unacceptably high risk of dying from requirement with high visibility. Let’s get together a solid
excessive backface transient deformation from threat bullets.” briefing to review, and let’s start scheduling the pre-briefs.
Project Manager:1 “Hmmm . . . that puts us right in the Also, we need to be prepared to provide the congressional
middle between the warfighters and the operational tes- committees an update with the Army’s decision. There are
ters. Both Army senior leaders and Congress rely on the many stakeholders involved with the ECH, and some will
independent assessment of operational testers for good not be happy. So, we need to think about how this will play
reasons. They have a lot of influence.” out with the media and senior leaders from all the stake-
holders with a solid strategic communications plan.”
Chief Engineer: “Yes sir. Also, the testers received concur-
rence from the Army Surgeon General with their assess-
Background
ments and recommendations.”
The protection of American soldiers in combat was a top
Project Manager: “So, after a four-year joint development priority for senior leaders in the U.S. Army, Defense Depart-
and testing effort with the Marine Corps in which the ment, and Congress. The Defense Department committed
ECH finally passed its requirements, now we have to get considerable resources and funding over the years in research
an Army decision on whether to buy and field the helmet and development, resulting in advanced materials and man-
against the recommendations of the testing and medical ufacturing processes. These investments paid off. American
communities, who have legitimate safety concerns?” soldiers went into battle with technologically advanced,
rigorously tested combat equipment. Soldiers knew that
Chief Engineer: “Yes sir. The warfighters and Army com-
their combat equipment worked as intended. In the end, that
bat developers have been very involved in this effort, and
increased the combat effectiveness of the soldiers and their
they remain adamant that the ECH should be fielded to
units. The force protection of soldiers was considered as a
deploying soldiers. The requirement remains over 35,000
layered approach. The outer force protection layer for sol-
helmets. The Marine Corps is strongly in favor of buying
diers was situational awareness. The middle force protection
and fielding the helmet as well.”
layer was concealment. The inner force protection layer was
personal protective equipment, like helmets, eyewear, and
1Within the U.S. Defense Acquisition, a project manager (usually a U.S. Army officer in ballistic vests with ceramic plate inserts. Specifically, combat
the rank of colonel) reports to a politically appointed civilian called the Army Acquisition
helmets provided soldiers skull and brain protection against
Executive—the ultimate program decision authority. The Director, Operational Test &
Evaluation (DOT&E) is an independent, politically appointed, senior executive charged both ballistic threats (e.g., bullets) and blunt impact forces,
with overseeing operational live fire testing and reporting directly to the Secretary of and prevented mild traumatic brain injury and concussions.
Defense and Congress on program testing.
During the wars in Iraq and Afghanistan, the Army col-
lected battle-damaged helmets to better understand the
Project Management Journal, Vol. 49, No. 1, 96–109 threat and capabilities of the helmets. The battle-damaged
© 2018 by the Project Management Institute
Published online at www.pmi.org/PMJ helmets were often later returned to soldiers in ceremonies
as shown and described in Figure 1. In many situations, the Advances in material research provided the opportunity
helmets saved the soldier lives, and these ceremonies under- to increase ballistic protection at a reduced weight. The
scored the importance of soldier protective equipment for maturation of ballistic fabrics based on para-aramid polymer
combat effectiveness and soldier force protection. technology enabled the Army to replace the M1 with the Per-
Despite an emphasis on improving force protection, efforts sonnel Armor System for Ground Troops (PASGT) helmet in
to modernize helmets faced the challenges that all programs the mid-1980s. These helmets were in the three to four pound
within the Department of Defense faced: a complex, bureau- range (lighter than the M1) and provided increased ballistic
cratic Defense Acquisition institution.2 The accelerated pace protection. The shell of the helmet consisted of layers of bal-
of technology innovation, rapidly evolving threats, and declin- listic aramid fabric, the most famous of which is DuPont’s
ing defense budgets made program management within the Kevlar®—resulting in the “Kevlar” or “K-pot” nicknames.
DoD challenging but even more critical than ever. Defense The ballistic aramid technology allowed helmets to provide
Acquisition operated in an uncertain, complex, and ambigu- not only fragmentation protection from explosions but also
ous environment, but maintained a simple focus: develop, small caliber hand gun protection at a reasonable weight.
procure, and field advanced warfighting capability to soldiers Eventually, the Modular Integrated Communication Helmet
to enable technological superiority on the modern battlefield. replaced the PASGT helmet on a limited basis. By the mid-
2000s, the Advanced Combat Helmet was the Army’s primary
Army Combat Helmet Evolution helmet. The basis for all combat helmets after the M1 “steel
Army combat helmets evolved over time as the Army traded- pot” and prior to 2008 was para-aramid polymer technology.
off increased performance and cost (see Figure 2). The com- These helmets provided soldiers important performance
bat helmets that soldiers wore into battle showed a constant improvements like increased ballistic protection, reduced
improvement in performance and increase in cost over time. weight, and better blunt impact protection by replacing web-
Improvement in performance resulted from advances in bing suspension systems with padding systems between the
material research and manufacturing techniques. Soldiers helmet shell and the wearer’s head.
wore the M1 helmet, nicknamed the “steel pot,” from the In the late 1990s and early 2000s, the U.S. Army Research
1940s through the late 1970s. The M1 provided ballistic pro- Lab, the U.S. Army Research Development and Engineering
tection largely because steel is hard. The M1 helmet consisted Command, and commercial industry teamed to mature the
of a pressed manganese steel shell with a webbing suspension next generation of ballistics materials, resulting in the develop-
that soldiers fitted to their heads. Despite being an improve- ment of high-molecular-weight polyethylene ballistics fibers
ment over previous helmets, the M1 helmet was heavy and that could be weaved into fabrics with application to combat
uncomfortable, and it provided little blunt trauma protection. helmets. Polyethylene polymer materials had different perfor-
mance characteristics than para-aramid polymer materials.
2Referto Figure 4 and Appendix 1 for a description of the U.S. Defense Department Above certain temperatures, para-aramids (classified as ther-
Acquisition institution. mosets) polymers broke down, lost their properties, and could
Blunt Impact
Advanced
ACH Combat Helmet Procured:
Increased Protection
1,400,000
Helmet Cost
not be remolded back into their original states when cooled. requirements to protect soldiers against both blunt trauma
On the other hand, above certain temperatures, polyethylene and ballistic threats. Three ballistic properties remained
polymers (classified as thermoplastics) broke down but could particularly important for describing impacts to helmets:
be remolded into their original state when cooled. The appli- complete penetration (the bullets goes completely through
cation of high-molecular-weight polyethylene fiber material the helmet), partial penetration (the bullet does not go
in helmets created the misperception that helmets might completely through the helmet), and backface deformation
easily lose their form under ballistic events and potentially (a measure for the amount the round’s impact indents the
jeopardize soldiers’ safety. Ultimately, the advantages of helmet material).
polyethylene helmets for reduced weight and greater ballistic The final performance of the helmet in testing and in
capability outweighed this concern. The basis of future Army combat depended both on the inherent properties of the
helmets—both the ECH and its eventual replacement, the materials used to develop the helmet and the processing
Soldier Protection System future combat helmet—remained techniques used to manufacture the helmet. Helmet require-
high-molecular-weight polyethylene technology. ments used performance-based requirements. Each helmet
manufacturer optimized its design over time using a com-
Helmet Testing Basics 3 bination of materials (layers of polymer fibers woven into
The Army rigorously tested combat helmets worn by sol- sheets with chemical binders) and different processes based
diers against protocols to ensure they conform to stringent on temperature, pressure, and time. The use of statistics was
important in testing because testing simulates live com-
3Appendix 2 presents a tutorial on helmet testing. bat, and the warfighter required a high confidence that the
and with commercial industry for the last decade. Dr. Suchez Two important determinants of program success were
explained that the application of these new novel polymers requirements definition and alignment of those requirements
to helmets allowed the Army to consider the following basic against capability gaps. Simply put, poorly defined require-
options for the new helmet requirements: (1) maintain the ments set a project’s initial trajectory that would be difficult to
protection levels of the current helmets with a reduced weight fix later in the development cycle. Project initiation was some-
of up to 20%, or (2) increase the protection levels but maintain times the result of a need from the warfighters generically
(or increase) the weight of the helmet. called capability pull. Alternatively, a project resulted from
Colonel Smith knew that the Army’s senior leaders would an innovative new technology without a specific identified
rely on the advice and recommendations of the project man- warfighting application generically called technology push.
ager during the meeting. The final decision would be made The question of technology push or capability pull at program
by the Army Acquisition Executive, the Honorable (Hon) initiation often delayed efforts and created perception chal-
Ron Cho. The Hon Cho would likely turn to key stakeholders lenges among key stakeholders. The ECH effort was driven
before making the final decision. by the urgent need for a new helmet to address protection for
The first stakeholder was the project manager, and Colo- soldiers against rifle threats in combat, and enabled by the
nel Smith thought that he was well prepared to discuss key maturation of high-molecular-weight polyethylene technolo-
considerations from a cost, schedule, performance, and tech- gies. The helmet requirements had to balance acceptable min-
nology perspective. The second stakeholder was the warf- imum risk versus maximum safety for protective equipment,
ighter representative, also called the “user” representative. and weight reduction (soldier load) versus protection (bal-
The warfighter representative was a crusty old officer named listic and blunt force). Colonel Smith knew that this balance
Colonel Billy Johnson from Fort Benning, home of the U.S. would not be an easy compromise for any of the stakeholders.
Army Maneuver Center of Excellence. Colonel Johnson spent During the meeting hosted by the Hon Cho, Colonel
most of his time in the Army leading soldiers in combat. Colo- Johnson was adamant that the ECH had to address the
nel Johnson took his job seriously as the ultimate approver of rifle threat, be fielded as quickly as possible, and reduce
the requirements. He was passionate about the possibility for the weight on soldiers in combat. Colonel Smith laid out
a new helmet because he believed that the current helmets the basic options that he had discussed with Dr. Suchez; the
were too heavy and uncomfortable. He also represented the ECH would not be able the address the rifle threat and also
warfighters currently downrange in combat, and was under reduce the helmet weight. Colonel Johnson was not happy,
extreme pressure to approve requirements for a new helmet and doubted the validity of the technology assessment. He
to protect soldiers not only against fragmentation and hand- stated that, just a week prior, he received an industry brief
gun rounds, but also against enemy rifle threats. Another key from a company that claimed they could develop a helmet
stakeholder was Colonel Harry Crisp, the representative from at reduced weights that also addressed increased threats.
the testing community—specifically from the Director, Opera- Dr. Suchez, also in attendance, spoke up and said that it was
tional Test and Evaluation. Any new helmet development not unusual for industry to make claims that they could not
program fell under operational testing oversight to approve back up, and that the application of a new technology into
the testing protocols used to ensure the requirements were helmets is technically challenging from a manufacturing
met. Director, Operational Test and Evaluation also provided perspective. “It’s one thing to produce a prototype helmet in
an independent assessment of the helmet’s operational effec- a controlled laboratory,” he said, “but completely different to
tiveness and suitability for soldiers to Army senior leaders produce many helmets from a manufacturing line that consis-
and documented that assessment in reports to Congress. tently perform against rigorous testing requirements.”
Colonel Harry Crisp had years of experience as a tester and To address the schedule aspect of the program, Colonel
evaluator of Army systems. The importance, influence, and Smith next laid out the options of pursuing a formal program
visibility of operational tester’s independent assessment were of record through the deliberate acquisition process versus
increased by the recent congressional and public concerns pursuing a rapid acquisition process supported by a directed
calling into question the adequacy of soldiers’ protective or urgent requirement. Establishing a formal ECH program
equipment. involved a four-year time period of contracting, development,
Colonel Smith knew that each of the stakeholders was and testing. Year one allowed for the refinement, analysis,
passionate about a new helmet program. He realized that and approval of formal requirement documents and the
his role as the project manager was not to advocate for a development of testing protocols. Year one also allowed for
new program but to give advice about the underpinning the Army to request development and procurement funding
technological possibilities; additionally, he needed to lay out from Congress in the Army’s base budget for the program.
the cost, schedule, and performance implications of various Years two and three involved the development and testing
strategies for the development, testing, and procurement of of helmet prototypes resulting from competitively awarded
the new helmet. contracts (cost-plus type contracts) to be awarded to industry
PROJECT
PROJECT
MANAGER
MANAGER
the production of a small number of helmets to undergo The testing results demonstrated that the ECH met its
testing in order to validate that the contractor could success- requirements and offered soldiers the potential for greater
fully produce the helmets to performance requirements. protection compared to the current helmet. Against a require-
In late 2011, the ECH passed the second round of first arti- ment for a 35% increase in fragmentation protection, the
cle testing. To meet an aggressive production schedule for the ECH demonstrated an average increase of 53%. For the 9-mm
Army, the vendor submitted an engineering change proposal pistol deformation requirements, the ECH demonstrated
for second and third production lines. It took all of 2012 for an average increase in performance of 10% over the current
the vendor to successfully pass the third round of first article helmet. Finally, against the chosen test rifle threat, the ECH
testing for all three production lines after working through demonstrated an over 153% increase in protection for resis-
issues between test sites, the U.S. Army Test Center, and the tance to penetration; of note, was the fact that there was no
National Institute Justice laboratories, as well as issues with backface deformation requirement against rifle threats for the
the source of testing rifle rounds (Winchester versus Hornady ECH. The current helmet 9-mm pistol backface deformation
versus Remington). requirements were too restrictive for rifle threats, and there
was no basis to assign these requirements to rifle threats The full rate production decision involved significant pro-
without injury data, which did not exist. To avoid jeopardizing curement money (US$35 million) to buy and field the ECH.
the program due to unachievable or unrealistic requirements, Despite testing results in which the ECH demonstrated supe-
rifle backface deformation testing occurred for government rior performance against the requirements over current hel-
reference purposes only. mets, Army leaders, specifically the Hon Cho and Colonel
Smith, faced a difficult decision. Not all key stakeholders
Part Two: ECH Procurement and Fielding interpreted the test results similarly, raising significant con-
Decision, Summer of 2013 cerns about the safety of soldiers who might wear the ECH in
After passing testing and four years since program initiation, combat. The Director, Operational Test & Evaluation issued a
in the summer of 2013, the ECH was ready for a full rate pro- congressionally mandated “Beyond Low Rate Initial Produc-
duction decision. Subsequently, the ECH would be produced tion Report” recommending that the ECH not be fielded to
as quickly as possible to the approved acquisition objective soldiers. The operational testers believed that the cost per
quantity. Each production lot of helmets would undergo lot helmet (roughly 2.5 times the current helmet) did not justify
acceptance testing to verify continued compliance to speci- the minimal performance increase, and were also concerned
fication requirements. Finally, after passing lot acceptance that the Army did not test the ECH against the most stressing
testing, the Army could field helmets to soldiers deploying or most prevalent enemy rifle threats. Additionally, and more
into combat. importantly, the testers stated that soldiers wearing the ECH in
combat would face an unacceptable risk of head injuries due the test rifle threat was 18% to 89% higher than the 9-mm pistol
to excessive backface deformation caused by rifle rounds. The requirement. Colonel Smith concurred with those numbers
medical community, through the Army Surgeon General, sup- but indicated that he was not finished presenting the rest of the
ported the Director, Operational Test & Evaluation conclusions field data results, which indicated that nearly 74% of soldiers
that ECH would put soldiers in unacceptable risk of head inju- died if the threat round completely penetrated the helmet.
ries. These concerns put the Hon Cho and Colonel Smith in a Again, Colonel Crisp dismissed that data, and again brought
difficult position. To further complicate matters, the Hon Cho up the rifle threat round used in testing. Colonel Johnson
had just spoken to the Director, Operational Test & Evaluation, asked a question about the operational safety margin built
who emphatically stood behind their recommendation. into the testing. Colonel Smith replied in the affirmative that
Again, the Hon Cho convened the same Council of Colo- the chosen rifle round was fired at the ECH at muzzle velocity
nels that met four years earlier to discuss the decision to and at 0% obliquity, operationally providing soldiers a safety
initiate the ECH program. Colonel Smith admitted the ECH margin, because in combat, rounds are fired at considerable
program had not met the original timelines, but emphasized distance, slowing down in flight and striking at non-direct
that the helmet had finally successfully passed testing and met angles. Therefore, even though the chosen test round was not
its performance requirements. Colonel Smith also stressed the most stressing rifle threat round, the ECH still provided
that US$35 million was at risk if the procurement decision considerable protection and 153% more protection from pen-
passed the end of the fiscal year, which was nearing. Colonel etration than the current helmet against the rifle threat.
Crisp noted that he understood the program history well and The Hon Cho realized that the meeting of the Council
understood the challenges. He reiterated that, in operational of Colonels was probably at a point of agreeing to disagree.
testers’ opinion, the ECH was not operationally effective or He understood each of the positions clearly and thanked
operationally suitable for fielding to soldiers. The risk of injury everyone for their candid and articulate input. Colonel Smith
to soldiers was unacceptable; in the testers’ and the Army understood well what that meant. Again, he had to recom-
Surgeon General’s opinions, soldiers wearing the ECH could mend a path forward for decision with the major stakehold-
suffer life-threatening skull fractures from excessive backface ers not on the same page. Colonel Smith wrote the following
deformation from threat rifle rounds. Additionally, Colonel questions that he knew he would have to address with Hon
Crisp noted that the ECH was not tested against the most Cho before any decision was made:
stressing threats, bringing into question the validity of the
requirements. Colonel Johnson was livid that there was even a • Who were the key stakeholders and how would he manage
question about the requirements. The entire community and their expectations?
all stakeholders had agreed to the original requirements more • How does the Army balance the importance of development
than four years earlier. Everyone had accepted the program test data versus field data from helmets that were battle dam-
risks. Now, three years later than planned, when the ECH aged? Should developmental test results or field data carry
finally passed testing, concerns were raised. Colonel Johnson more weight in decision making? How can the same develop-
stated that the warfighter community strongly recommended ment test data be interpreted differently by stakeholders?
getting the ECH to soldiers as quickly as possible. • Are the concerns of the testing and medical communities
Colonel Smith again tried to remain neutral to avoid warranted?
the appearance that the project manager was biased toward • How does the Army address these concerns with Congress,
buying the ECH. He was compelled to provide the complete the media, and the American public?
picture to the Hon Cho for the most informed decision. His • What are the advantages, disadvantages, and second order
program office was also charged with the collection and implications of various courses of actions for the path for-
analysis of battle-damaged helmets from soldiers who had ward? What are the decision criteria?
been shot in the head while wearing their helmets. Analysis of • How do you quantify benefits such as saving a soldier’s life
those helmets indicated that no soldiers had died or suffered and compare these benefits with long-term, potential health
major injuries as a result of excessive backface deformation problems like concussions or musculoskeletal neck injuries
of the helmet. The average deformation observed was 35% of from the weight of helmets?
the 9-mm pistol requirement of 25.4 mm (or coincidentally,
exactly 1 inch). Colonel Crisp interrupted and stated that the Suggested Readings
operational testers placed no value on the results because they Aubert, A. (2016, April 19). U.S. Army soldier reunited with
were not statistically robust, and were not done under strict equipment that saved his life in Afghanistan [Audiovisual
testing conditions where the variables were controlled. Colo- media]. Aired on ABC7. Washington, DC.
nel Crisp also pointed out that the government’s own reference Cox, M. (2013, July 30). Army, Marines to field better ballistic
testing indicated that the backface deformation observed from helmets. Retrieved from http://www.military.com
Appendix 1: U.S. Defense Acquisition Programs within Defense Acquisition require resources
Institution—Decision Framework (for funding) and contracts (for execution of work) with
Within the U.S. Defense Department, the development, test- industry. Congress provides the resources for the Defense
ing, procurement, and fielding of capability for the warfighter programs through the annual enactment of the Defense
operates within a decision-making framework that is com- Authorization and Appropriation Acts, which become law and
plex. Within the private sector, similar frameworks exist. The statutory requirements. The project manager, through war-
U.S. Defense Acquisition Institution has three fundamen- ranted contracting officers governed by the Federal Acquisi-
tal support templates that provide requirements, funding, tion Regulations, enters contracts with private companies
and management constraints. The Executive Branch, Con- within the Defense industry. Other important stakeholders
gress, and Industry work together to deliver capability with include actual warfighters, the American public, the media,
the program manager as the central person responsible and functional experts (like engineers, testers, logisticians,
for cost, schedule, and performance. Figure 6 depicts this cost estimators, etc.), as well as fiscal and regulatory lawyers.
framework. As a backdrop to this complicated organizational structure
The government project manager is at the center of for Defense project managers, there are three decision-making
Defense Acquisition, which aims to deliver warfighter capa- support templates: one for the generation of requirements, a
bility. The project manager is responsible for cost, sched- second for the management of program milestones, and a third
ule, and performance (commonly referred to as the “triple for the allocation of resources. Each of these decision support
constraint”) of assigned projects—usually combat systems systems is fundamentally driven by different and often contra-
within the Defense Department. The Executive branch of dictory factors. The requirement generation system is driven
government provides the project manager a formal chain of primarily by a combination of capability needs and an adaptive,
command in the DoD. The project manager typically reports evolving threat. The resource allocation system is calendar-
directly to a program executive officer, who reports to the driven by Congress writing an appropriation bill—providing
Service Acquisition Executive (an Assistant Secretary for that control of funding to the Congress and transparency to the
Service—either Army, Navy, or Air Force), who reports to American public and media for taxpayer money. The Defense
the Defense Acquisition Executive (the Under Secretary of Acquisition Management System is event driven by milestones
Defense for Acquisition, Technology, and Logistics). Depend- based on commercial industry best practices of knowledge
ing on the program’s visibility, importance, and/or funding points and off-ramps supported by the design, development,
levels, the program decision-making authority is assigned to and testing of the systems as technology matures. Often inte-
the appropriate level of the chain of command. gration and manufacturing challenges occur.
Cost Events-
Needs-
Project Driven
Driven
Media Management
Performance Schedule
Defense
Requirements Acquisition
Generation Management
System System
Warfighter Testers
INDUSTRY
Variation Zone
0.5
0
V0 V50 V100
(0 penetration) (100% penetration)
Striking Velocity
To Increase Testing
0.5 Success, Keep Away
From V0 (Required)
as Far as You Can
0
V0 (required) Striking Velocity
(0 penetration)
a unique V50 for each helmet design. Generally, the design exhibited by a helmet in testing, the lower the potential for inju-
goal is to make V50 as high as possible and as close to V100 as ries to the wearer’s head. Figure 9 is a pictorial representation
possible. of a sample backface deformation measurement. After a series
During ballistic testing, if a bullet only partially pen- of tests, testers plot the observed backface deformations for a
etrates the helmet, testers measure the backface deformation helmet. This results in a distribution of values around an aver-
using calipers or laser techniques. The lower the deformation age value (Figure 10). The lower the average measured backface
Data Distribution
deformation compared to the required value, the more protec- represents a worst-case condition that is representative of
tion the helmets offers and the greater the testing success rate extremely close combat scenarios. Under these conditions,
for the design and manufacturer (see Figure 10). the round strikes the helmet with the maximum force and
There is an additional important point to understand the highest chance for penetration, but during combat, the
about helmet testing with respect to battlefield operational enemy fires at various distances from their targets. Over these
relevance. In testing, the Army performs V0 resistance to distances, bullets slow down and strike their intended targets
penetration and backface deformation testing with the threat at various angles. Therefore, in combat, bullets strike soldier
rounds fired at the helmet at speeds representing threat helmets at speeds significantly lower than muzzle velocity
weapon muzzle velocity and at angles of 0% obliquity. This speeds and from non-perpendicular angles.