JoslinPhDFinalv1 1
JoslinPhDFinalv1 1
net/publication/281026964
CITATIONS READS
3 6,568
1 author:
Robert Joslin
SBS Swiss Business School
20 PUBLICATIONS 477 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Robert Joslin on 17 August 2015.
Robert Joslin
5 November 2014
2
Acknowledgements
Being introduced into the research world is something I will never forget as it has been a
wonderful, enlightening experience.
I would like to express my sincere gratitude to my main supervisor, Ralf Müller, who has always
been there for me, responding to my frequent emails during the day, night, and throughout the
weekends; and to Shankar Sankaran, who will get back to me whenever I have questions—thank
you both for your guidance, continuous motivation, and support.
Additionally, I am grateful to the members of the Skema faculty and to Frederique O’Brien, who
is the PhD support executive who has helped and supported me throughout the course of
working toward this PhD. My special appreciation goes to Rodney Turner, with whom I have
enjoyed many discussions at dinner and at conferences; and to Roberta Storer for her time and
effort in reviewing and providing suggestions for improvements of my manuscript. Moreover, I
would like to thank all of my colleagues at Skema, especially Khalid Khan, who has been a great
support to me during the course of working toward this PhD.
One of the success factors for a PhD (besides a lot of time, money, and motivation) is the
supervisor. Ralf Müller has been a source of inspiration for ideas and suggestions; and when my
motivation began to wane, he offered me an office and accommodations for two weeks at the
Department of Leadership and Organizational Behavior at the BI Norwegian Business School.
Finally, I would like to thank my children Ethan and Sydney for putting up with Dad always
talking about research and for tactfully changing the subject to something more interesting.
Robert Joslin
3
Certificate of Authorship/Originality
I certify that the work in this dissertation, Relationship Between Project Management Methodology
(PMM), Project Success, and Project Governance, has not previously been submitted for a degree, nor
has it been submitted as part of requirements for a degree except as fully acknowledged within
the text.
I also certify that I have written the dissertation. Any help that I have received in my research
work and the preparation of the dissertation itself has been acknowledged. I certify that all
information sources and literature used are indicated in the dissertation.
Robert Joslin
4
Abstract
Project management methodology (PMM), practices, and guidelines are the only explicit
information that project managers have and, when properly maintained, should reflect the most
current knowledge and guidance to achieve repeatable successful project outcomes. Despite
more than 50 years of research in the field of project management, project success rates are
persistently low and, when viewed at a macro level, the impact can be seen at a country level.
The aim of this research is to advance the understanding of PMMs through a new perspective on
PMM by: (a) developing a natural to social science comparative model; (b) using proven research
methods to determine whether there is a relationship between the PMM and project success that
is influenced by project context, notably project governance; (c) identifying whether there are
similarities and differences in the observed phenomena from the comparative and the
conventional mixed-method approaches, and if so, to explain why, and (d) determining the direct
impact of project governance on PMM and project success. First, this study will increase the
understanding of PMMs and the factors that impact the effectiveness of a PMM used to support
a project in order to achieve repeatable, successful project outcomes. Second, this study will
increase the understanding of project governance influence on the direct and indirect impact of a
PMM’s effectiveness and completeness, the PMM’s influence on project success, and project
governance’s direct impact on project success.
The first study, (a conceptual prestudy) explored whether it was possible develop a natural
science comparative to social science, notably project management. The result was a comparative
model that was tested using theory building based on complex adaptive systems (CAS). The
findings showed it is possible to create a comparative that can be used to identify new
phenomena and explain existing phenomena based on a natural science perspective, which
cannot be easily explained using traditional social science perspectives.
The second study used a theoretically derived research model to qualitatively investigate if
different project environments impact the relationship between PMMs their elements and
5
project success, and whether this relationship is influenced by the project environment, notably
project governance. The findings showed that there is a positive relationship between a PMM’s
elements and the characteristics of project success and that the influence of the project
environment, notably project governance, does influence the effectiveness of this relationship.
The third study quantitatively determined the relationship between a PMM and project success
and the influence of project governance on this relationship. The study found that the successful
application of a comprehensive PMM, where the term comprehensive is taken to mean including or
dealing with all or nearly all of the elements or aspects of something, accounts for 22.3% of the
variation in project success. Project governance has an indeterminable effect on the relationship
of PMM and project success. However, project governance does have a direct influence on the
establishment and evolution of a PMM and whether it is a comprehensive PMM or one that
needs to be supplemented by the project manager.
The fourth and final study explores the role of project governance on project success. The
findings show that (a) a stakeholder-oriented project governance accounts for 6.3% of the
variation in project success, and (b) project governance structures that are more control
behavior-outcome orientation have no impact on project success.
Part I of this thesis provides a synthesis and reflection of the findings in the papers that are
appended in Part II.
Note: the term methodology when used in the context of projects has been abbreviated to PMM,
meaning project management methodology.
6
Table of contents
Acknowledgements 3
Certificate of Authorship/Originality 4
Abstract 5
Part I: Summary of the Research
Chapter 1. Introduction 12
1.1 Background and research context 12
1.1.1 Need for new research methods 12
1.1.2 Project failure rates and the need for effective PMMs 13
1.1.3 Governance (project governance) as an environmental variable 15
1.1.4 Subjective nature of project success 15
1.2 Research focus 16
1.2.2 Aim and objectives 16
1.2.1 Research questions 18
1.2.3 Delimitations 19
1.3 Structure of the thesis 19
1.3.1 Part I 19
1.3.2 Part II 20
7
Chapter 4. Research methodology 40
4.1 Research philosophy 40
4.1.1 Paradigms as world views 40
4.1.2 Paradigms as epistemological stances 41
4.1.3 Paradigms as shared beliefs in a research field 42
4.2 Approach, strategy, and choices 42
4.2.1 Approaches 42
4.2.2 Strategies 42
4.2.3 Choices 43
4.3 Research process sequence 43
4.4 Research models 45
4.4.1 Prestudy—derived model—research model 1 45
4.4.2 Qualitative research model—research model 2 45
4.4.3 Quantitative research model 3 46
4.4.4 Quantitative research model 4 48
4.4.5 Integrated research models 1, 2, 3, 4 50
4.4.6 Philosophical triangulation 51
4.5 Prestudy (study 1) 53
4.5.1 Data collection instrument development 53
4.5.2 Validity and reliability 53
4.5.3 Limitations of the research 53
4.6 Main study—Qualitative research (study 2) 54
4.6.1 Data collection instrument (semistructured interviews) 54
4.6.2 Sampling approach 54
4.6.3 Data collection 54
4.6.4 Data analysis method 55
4.6.5 Validity and reliability 55
4.7 Main study—Quantitative research (studies 3 and 4) 56
4.7.1 Data collection instrument 56
4.7.2 Sampling approach 56
4.7.3 Data collection 57
4.7.4 Data analysis method 59
4.7.5 Validity 59
4.7.6 Reliability 60
8
Chapter 5. Research findings 61
5.1 Presentation of papers and objectives 61
5.2 Extended abstract of Paper 1 61
5.3 Extended abstract of Paper 2 63
5.4 Extended abstract of Paper 3 64
5.5 Extended abstract of Paper 4 65
Chapter 7. Conclusions 91
7.1 Summary of the research process 91
7.1.1 Overview of the research findings 92
7.1.2 Hypothesis testing 95
7.1.3 Answers to research questions 97
7.1.4 Theoretical implications 98
7.1.5 Managerial implications 99
9
7.2 Strengths and limitations 100
7.3 Recommendations for future research 101
7.3.1 Natural science comparative 101
7.3.2 Main study 101
Figures:
Figure 2-1 Two-level comparative model 23
Figure 2-2 Methodology approaches for evolutionary-revolutionary project outcomes 24
Figure 2-3 Humans inspired by nature 25
Figure 3-1 Importance of success dimensions over the project/product life cycles mapped 28
to scope of success factor literature mapped to project/product life cycle
Figure 3-2 Governance paradigms 35
Figure 3-3 Governance paradigms (Müller (2009) 36
Figure 4-1 The research process 44
Figure 4-2 Prestudy-derived research model 45
Figure 4-3 Qualitative research model 46
Figure 4-4 Quantitative research model 47
Figure 4-5 Integrated research model 51
Figure 4-6 Philosophical and methodical triangulation 52
Figure 6-1 GOVorientation (shareholder-stakeholder) factor impact on the five dimensions 74
of project success
Figure 6-2 Key topics raised from this study 76
Figure 6-3 The three steps in descriptive theory and normative theory 87
Figure 6-4 Redrawn research model indicting the influence of governance on the 88
independent and dependent variables
10
Part II: Appendices
Appendix I, Paper 1
Joslin, R., & Müller, R. (2014). New insights into project management research: A natural
sciences comparative.
In EURAM 14th Annual conference, Valencia, Spain (pp. 1–41); a revised version was accepted
for publication in the Project Management Journal (PMJ).
Submitted to the International Journal of Managing Projects in Business (IJBM), based on a revised
version of the paper presented at the PMI Research and Education Conference, July 2014 (pp.
1–29). Portland, Oregon, USA
Appendix V
Interview questions for the qualitative study
Appendix VI
Online questionnaire for the quantitative study
11
Chapter 1. Introduction
This chapter introduces the need for new research methods and provides new insights into how Project Management
Methodologies (PMMs) may be better selected and applied to improve the chances for project success.
The chapter then describes the aims and objectives of the two parts of the thesis: the prestudy (natural science
comparative) and the main study—the impact of a PMM on project success with the determination of whether
project governance impacts this relationship. The main study also investigates the impact of project governance
directly on a PMM and then directly on project success. After this, the research focus is described and concludes
with a summary table of the research papers.
One area in project management research that would benefit from an alternative perspective
using contemporary methods is in the area of addressing persistently high project failure rates.
This would be especially beneficial for projects that are using PMMs which are also suffering
from high project failure rates (Wells, 2012). Project failure rates and PMMs are described in
more detail in section 1.1.2.
12
A prestudy was carried out to create a natural science comparative with the aim of creating an
alternative perspective on PMMs. This comparative should help identify and explain new and
existing factors that impact the effectiveness of PMMs in achieving project success and
suggestions for addressing these factors.
The results of the prestudy—the natural science comparative, is contained in Appendix I of this
thesis. It is also a book chapter in the book from Drouin, Müller, and Shankaran (2013) on
project management research methods titled “Novel Approaches to Organizational Project
Management Research.”
1.1.2 Project failure rates and the need for effective PMMs
Projects are the lifeline of an organization’s future and are also the truest measures of an
organization’s intent, direction, and progress (PMI 2013a). Organizations grow and evolve
through projectification (Maylor, Brady, Cooke-Davies, & Hodgson, 2006), where every
euro/dollar invested should take the organization one step closer to its stated goals. However,
project success rates are low and not improving (Bloch, Blumberg, & Laartz, 2012; GAO
(Government Accountability Office), 2013; The Standish Group, 2010), despite the fact that the
knowledge associated with project success and failure has been steadily increasing over the years.
Project failure is estimated yearly in the hundreds of billions of dollars (McManus & Wood-
Harper, 2008) where failure is not limited to any specific industry (Flyvbjerg, Bruzelius, &
Rothengatter, 2003; Nichols, Sharma, & Spires, 2011; Pinto & Mantel, 1990).
To address low project success rates, the project-related knowledge based on research and
practitioner experiences have been codified and updated into what are now established
standards, PMMs, and guidelines with tools, techniques, processes, and procedures (Flyvbjerg et
al., 2003; Morris, Crawford, Hodgson, Shepherd, & Thomas, 2006; Pinto & Mantel, 1990).
Lessons learned and ongoing research are continually enhancing PMMs to ensure that success
factors are reflected either directly or indirectly within the PMM, guidelines, process, and
procedures (Cooke-Davies, 2004). Research has shown that PMMs provide more predictable
project management outcomes than projects that do not use a PMM, but still suffer from high
failure rates (Lehtonen & Martinsuo, 2006; Wells, 2012).
The literature on PMMs is somewhat contradictory. For example, literature is split on whether
PMMs directly contribute to the goals (Cooke-Davies, 2002; Fortune & White, 2006; White &
Fortune, 2002) or to the perceived appropriateness of project management (Lehtonen &
Martinsuo, 2006). Literature is also divided on whether PMMs that are standardized (Crawford &
13
Pollack, 2007); customized, or a combination of both (Milosevic & Patanakul, 2005) lead to
greater project success. A third view is whether international PMMs (McHugh & Hogan, 2011)
versus in-house PMMs (Fitzgerald, Russo, & Stolterman, 2002) lead to greater project success.
Lehtonen and Martinsuo (2006) sum up the research PMMs by stating “The confusion in
research results is reflected also in companies’ swing between standardized and tailored systems,
and between formal and chaotic methodologies” (p. 7).
The literature covering PMMs, including the divergent views of what constitutes an effective
PMM, can be divided into two categories: one that cover PMMs as a homogeneous entity and
the other that consider only one part or element of a PMM (e.g., project scheduling or
stakeholder management). The term PMM implies a homogeneous entity; however, it is really a
heterogeneous collection of practices that vary from organization to organization (Harrington,
Voehl, Zlotin, & Zusman, 2012). Looking at a PMM as a single entity or an isolated element of a
PMM precludes the ability to understand the impact of the interaction of the PMM’s elements,
which all should contribute to project success. The lack of understanding the building blocks of
a PMM and its impact on project success is highlighted in Fortune, White, and Jugdev’s (2011)
longitudinal study, which found that using PMMs produced a number of undesirable side effects.
In this study, 46% of the respondents reported negative side effects. Could these undesirable
effects be a consequence of limited research on the interaction between PMM’s elements or
perhaps missing PMM elements?
To understand the impact of the relationship between a PMM and project success, the building
blocks of a PMM need to be understood. As the building blocks of a PMM are not defined,
agreed upon, or commonly accepted, the following definition is used for this study: “the building
blocks of a PMM are PMM elements that may include processes, tools, techniques, methods,
capability profiles, and knowledge areas.” A PMM should also take into account the different
levels of scope and comprehensiveness where the term comprehensiveness is taken to mean
including or dealing with all or nearly all elements or aspects of something comprehensive
(OxfordDictionaries, 2014). Each organization must decide on the level of PMM
comprehensiveness, where the more comprehensive the PMM, the less need for it to be
supplemented with PMM elements when it is applied to a project. It is unclear from the literature
if comprehensive PMMs or PMMs that need to be supplemented lead to greater project success;
also what the influence is of project context, notably project governance, on the relationship
between project success and a comprehensive PMM or a PMM that needs to be supplemented.
The next section is on project governance and the influence of project governance on PMMs.
14
1.1.3 Governance (project governance) as an environmental variable
Governance influences organizations as it “provides the structure through which the objectives
of the organization are set” (OECD, 2004, p. 11). Governance influences people indirectly
through the governed supervisor and directly through subtle forces in the organization (and
society) in which they live and work (Foucault, 1980). Governance in the area of projects takes
place at different levels where there is project governance on individual projects, namely “the use
of systems, structures of authority, and processes to allocate resources and coordinate or control
activity in a project” (Pinto, 2014, p. 383). Project governance has been referred to as “the
conduct of conduct”; a form of self-regulation where “the regulator is part of the system under
regulation” (Müller, 2009, p. 1). Governance influences the way projects are set up (Turner &
Keegan, 2001), their organizational structure (Müller, Pemsel, & Shao, 2014a), the running of
projects (Winch, 2001) and their risks strategies (Abednego & Ogunlana, 2006). Because
governance influences organizations, as well as multiple aspects of project management, it is also
likely to influence the value created by project management, especially the effectiveness of a
PMM and its impact on project success. The literature does not cover the direct influence of
project governance on a PMM or project success, nor does it cover the impact on the nature of
the relationship between a PMM and project success. There is a knowledge gap in the literature
that is addressed in this research.
Project governance is used in the first and second parts of the main study as the moderator
(environmental) variable and in the third part of the main study as the independent variable.
Müller and Turner (2007b) define project success factors as “elements of a project, which, when
influenced, increase the likelihood of success; these are the independent variables that make
success more likely” (p. 8).
15
Schultz, Slevin and Pinto (1987) suggested that the relative importance of success factors varies
over the project life cycle, so detailed planning would not be very useful if performed at the end
of a project. Success factors are not limited to only a project life cycle, they also extend into the
product life cycle as well. Shenhar, Dvir, Levy, and Maltz (2001) described the importance of
success factors in both projects and product life cycles from project completion to production,
and extend out to preparation for product/service replacement. Researchers soon realized that
success factors without structure, grouping, and context result in increased project risks;
therefore, success factor frameworks were introduced (Judgev & Müller, 2005). Pinto developed
a success framework covering organizational effectiveness and technical validity (Pinto & Slevin,
1988). Freeman and Beale’s (1992) success framework included efficiency of execution, technical
performance, managerial and organizational implications, manufacturability, personal growth,
and business performance. Shenhar et al (2001) described how there is no-one-size fits-all; then
using a four-dimensional framework, they showed how different types of projects require
different success factors and described the strategic nature of projects where project success
should be determined according to short- and long-term project objectives.
Success frameworks also extend to how project success is measured. Pinto and Prescott (1988),
Shenhar, Tishler, Dvir, Lipovetsky, and Lechler (2002), Hoegl and Gemünden (2001), and
Turner and Müller (2006) developed different measurement models for success that are
applicable for different types of projects or different aspects of project success.
Project success is the dependent variable used in the studies two, three and four of this thesis
(see sections 4.6 and 4.7).
16
The objectives of this research are as follows:
Academic
1. To understand the relationship between a PMM including its elements and project
success.
2. If the first research objective is met, then determine how project context, represented by
project governance, influences the relationship between a PMM’s elements and project
success.
3. To understand the relationship between project governance and a PMM.
4. To understand the relationship between project governance and project success.
5. To create an alternative and new research perspective in the form of a natural science
comparative to see if the findings in objectives 1 and 2 can be explained using a
different research perspective in addition to finding new phenomena with the new
comparative.
6. To provide sufficient evidence that the new natural science comparative method can be
used in future research studies to provide alternative perspectives and new insights that
may not be possible with current approaches.
7. To understand the role of project governance in influencing the establishment of a
PMM.
Practitioner
1. Provide practitioners with the knowledge of which governance environments are likely
to impact the completeness of a PPM and will therefore require supplementing to
achieve project success.
2. Provide the project management office (PMO) or other PMM designers with
information on whether and when to customize their organizations’ PMM according to
the governance paradigm of the section, department, or organization.
3. Highlight to managers who are considering replacing an institutionalized PMM
(including ones with derivatives of their main PMM), the importance of understanding
project context and how this is reflected in their incumbent PMM, so that an informed
decision can be taken on how and whether they should replace the incumbent PMM.
4. Highlight to management how some project governance orientations are more
correlated to success than others and also to identify which project success dimensions
are impacted by project governance.
17
1.2.1 Research questions
There are five research questions: one relating to the prestudy and the other four to the main
part of the research.
Prestudy
The prestudy research question is formulated as follows:
1. How can a natural science perspective be used in understanding social science phenomena where
methodology is the social science phenomena under observation?
In the prestudy, the environmental impact is an integral part of the natural science comparative,
meaning the comparative is contingent on the environment. Therefore contingency theory is
being used as the theoretical lens for the prestudy.
Main study
For the first part of the mixed method research (qualitative) the core research question is
formulated as follows:
2. What is the nature of the relationship between the PMM including its elements and project success, and
is this relationship influenced by the project environment, notably project governance?
The unit of analysis is the relationship between the PMM and project success.
The above research question was used in the qualitative part of the sequential mixed-methods
research.
The second part of the mixed–method research (quantitative), refined the research question as
follows:
3. What is the nature of the relationship between a PMM and project success and is this relationship
influenced by project governance?
The unit of analysis is the relationship between the PMM and project success.
For the first and second parts of the main study, contingency theory is being used as the
theoretical lens to help understand the influence of environmental factors (project context,
notably project governance) on the relationship between PMM and project success.
The third part of the main study—the mixed method research (quantitative)—looks at the
impact of project governance on PMM and project success. The following research questions are
asked:
18
4. What is the relationship between project governance and a PMM?
The unit of analysis is the relationship between project governance and PMM.
The unit of analysis is the relationship between project governance and project success.
The third part of the main study uses both agency theory and stewardship theory as the
theoretical lens.
1.2.3 Delimitations
For the prestudy, data collection was not limited to any specific geographic location, because
nature (genotyping and phenotyping) impacts every part of the globe.
For the main study, the mixed-methods research was not fixed to any set country although the
qualitative part of the study interviewed 19 people in Switzerland, Germany, UK, and the USA.
There was no restriction on the industry sectors. For the quantitative study, the respondents
represented industries from North America (38%), Europe (24%), Australasia (22%) and other
(15%).
1.3.1 Part I
Chapter 1 is the introductory chapter in which the empirical and theoretical relevance and the
research focus of this dissertation are discussed.
Chapter 2 refers to the prestudy and further discusses and explains key theoretical themes and
concepts investigated in the first research paper in Appendix I. This chapter provides additional
insights to the previously examined theories in the studies and concludes with the knowledge
gaps and proposed comparative model.
Chapter 3 refers to the main study and further discusses and explains key theoretical themes and
concepts investigated in the second, third and fourth research papers in Appendices II, III, and
IV. This chapter brings in additional insights to the previously examined theories in the studies
and concludes with the knowledge gaps, hypotheses, and proposed research models.
Chapter 4 discusses the research methodology including the philosophy, design, and approaches.
This chapter is divided for the prestudy into the qualitative and quantitative parts of the research.
19
Chapter 5 provides a summary of the study’s research findings, conclusions, and insights and
their contribution to addressing the research objectives.
Chapter 6 brings together the conclusions from conducted studies into a comprehensive picture
through analysis and discussions.
Chapter 7, the concluding chapter, reexamines the objectives and research question and, in
addition, discusses the implications of the findings and presents the limitations, strengths, and
suggestions for further research.
1.3.2 Part II
The appendices contain the four research papers on which this dissertation is based, an overview
of the interviews conducted for the qualitative research, and the questionnaire used to conduct
the quantitative research contained in Part II of this thesis.
I Paper 1: Natural to social Revised version EURAM 14th Annual Conference, Valencia,
New Insights into Project science comparative from the Spain, June 2014
Management Research : A including theory conference
Natural Sciences building section and proceeding
comparative section accepted by PMJ Project Management Journal
Comparative
Accepted for 2015 (Volume 46, Issue 1)
II Paper 2: Qualitative part of Revised version PMI Research Conference Portland, Oregon,
The Impact of Project the PhD from the USA, July 2014
Methodologies on Project conference
Success in Different Project proceeding
submitted to International Journal of Managing Projects in Business
Environments (Submitted)
IJMPB
20
Chapter 2. Use of comparatives—Basis for the
natural science to social science comparative
This chapter provides a literature review of key concepts used in the prestudy of the thesis. It starts with a
description of how comparatives are made, describes the concepts within the natural science comparative, and finally
introduces the comparative model.
One of the most powerful tools used in intellectual enquiry is comparison, because any
observation made repeatedly gives more credence than a single observation (Peterson, 2005).
Boddewyn (1965) describes comparative approaches as those concerned with the systematic
detection, identification, classification, measurement, and interpretation of similarities and
differences among phenomena. The disciplines, such as social science (including project
management), usually rely on observation rather than experimentation unlike the natural sciences
where randomized experiments are the ideal approach for hypothesis testing. However, some
research problems cannot be readily addressed using experiments, for example, when looking at
research involving two or more species in evolution, ecology, and behavior (Freckleton, 2009).
Comparative approaches have been used for years to address the limitations of experiments;
virtually every field in biological sciences uses comparatives (Gittleman & Luh, 1992).
Comparative analysis, unlike experimental studies, has historically relied on simple correlation of
traits across species. Over the past 20 years, improvements to comparative frameworks have
been made in classifications and the use of statistical methods to the degrees of relatedness in the
comparative (Harvey & Pagel, 1998; Martins & Garland, 1991).
Comparatives have been made between natural to social sciences using metaphors, such as in the
book, Images of Organization (G. Morgan, 1997); biological comparatives such as cells of an
organism to organizational knowledge (R. E. Miles, Snow, Mathews, & Miles, 1997); or
behavioral characteristics of a group of organisms called complex adaptive systems (CAS) with
organizational leadership (Schneider & Somers, 2006). Few have gone beyond the juxtaposition,
yet still have provided new insights into explaining phenomena that may not have been
discovered or explained without the comparative.
21
research. A frequently drawn conclusion is that all social phenomena (such as projects) are
context dependent; and therefore, natural science research approaches are deemed inappropriate
for gaining understanding of social phenomena (e.g., Flyvbjerg, 2001). This perspective may be
appropriate in some research studies, but presents an oversimplification in others. A great deal of
natural science research takes place in context-dependent situations just as social science research
takes place in situations of contextual independence (Knorr-Cetina, 1981).
In the field of project management research, comparatives are made mainly through theoretical
lenses such as complexity theory, agency theory, stewardship theory, critical point theory,
prospect theory, contingency theory, and complex adaptive system theory. Some of these
theories are derived by observing nature, such as in complexity theory and complex adaptive
system theory (Brown & Eisenhardt, 1997; Holland, 2012). Comparatives are performed
between two items things of interest that may not have been researched, for example, project
managers and career models (Bredin & Söderlund, 2013).
From the literature, there is clearly a need and benefit in using comparative approaches in the
field of project management. A great deal of the man-made world is based on nature and its
evolutionary principles, including insights gained by comparing species or comparing a part of an
organism, such as a cell or a gene, with the phenotype and behavioral characteristics of that
organism.
Dawkins (1974) stated that “biology is the study of complicated things that give the appearance
of having been designed for a purpose” (p. 1). Project management can be inherently complex in
terms of achieving desired outcomes within volatile environments. There are many similarities
between biology and project management in terms of complexity, design, impact of changing
environments, and product lineage.
From the literature review, it can be concluded that there is a knowledge gap when comparing
the core makeup and characteristics of an organism with the core makeup and characteristics of
project management.
Creating a new comparative, like any other type of analysis, requires that the phenomena is
compared and abstracted from a complex reality. For research. it is important to provide a focus,
careful delineation of the scope, the use of defined and accepted terms, and the development of
assumptions (Boddewyn, 1965).
The focus of the social science comparative is a PMM. The idea is that the core makeup of a
project is based on its used or lived PMM. In the natural science world, the core makeup of an
organism is its genotype, which is the genetic makeup of a cell or an organism. One cannot see a
22
genotype, but what can be seen is the organism that is called a phenotype (from the Greek
phainein, “to show” + typos, “type”) and it is the composite of an organism’s observable
characteristics or traits. Comparatively, a project applies a PMM, consisting of a set of elements
for potential use (genotype); however, in any given project, only the outcome from the use of the
applied (sub)set of elements used in a particular project (phenotype) can be seen.
The comparative model is shown in Figure 2-1. It comprises two levels: Level 1 is at the
genotype and PMM level, where the latter has been called “progenotype” for project genotype;
Level 2 is at the phenotype of an organism and project outcome. Detailed mapping tables were
created in order to build both levels of the comparative. Both the progenotype and project
outcome, that is, the project or service, are reified in the comparisons, which helps to make
abstract concepts more concrete or real by showing them in a different perspective.
Environment
Phenotype Level 2
Impact on Human Impact on Project
(Management)
Mapping table
Outcome
Impact on Organism/
Nonhuman
The reason for selecting the genotype as a comparative against the progenotype (project
genotype) in the social science world is because it allows ideas to be considered, which would not
be obvious using other methods, and different methods reveal different aspects of a
phenomenon.
One of the ideas is described below, which provides an introduction into the thinking behind the
comparative. The genes of an organism exist within the DNA of each single cell of an organism
(Csete & Doyle, 2002). Each one of the billions of cells is preprogramed with information as to
what and how to build something without any central control. Taking this idea across the social
science world of projects is equivalent to having a PMM that contains how and what to build in
every element of the PMM. This may make sense, but only in certain types of projects. Referring
to Figure 2-2, based on the author’s observations, projects are categorized between (a)
23
evolutionary and revolutionary and (b) one-off projects and ongoing projects. The projects that
are more evolutionary than revolutionary would be potentially appropriate to investigate if the
idea of combining the “what to build” and “how to build it” into one integrated PMM is
beneficial. The other project types would keep the information of what and how to build
separately.
Humans have always be inspired by nature, and the majority of inventions today have been
copied from nature (Vincent, 2001).
Would it be possible to learn not only from the outcome (i.e., the phenotype), but how it was
created (i.e., the genotype) and the process of organic growth? Figure 2-3 shows how man is
inspired by birds to create aircraft. What about creating an integrated PMM for the projects that
produce evolutionary products or services, which includes every aspect of what is going to be
built and how it is to be built into one, just like a cell within an organism?
24
Figure 2-3: Humans inspired by nature
In conclusion, social science (including project management) relies heavily on observation, and
comparatives provide a great deal of insight. Humans have been copying nature and, in doing so,
have created hundreds of nature-inspired inventions (Benyus, 1997) called “biomimicries” (Bar-
cohen, 2006). This makes a lot of sense as nature has perfected each attribute of an organism
over thousands of generations. There are also many similarities between project management
and biology, especially epigenetics, which is the study of stable alterations in gene expression-
potential that arise during development and cell proliferation (Jaenisch & Bird, 2003).
Epigenetics has raised a number of questions as to whether humans can not only learn a great
deal from the organism (i.e., the phenotype), but can also learn from its genotype and how it
evolves? When a project outcome, product, or service can be compared to a phenotype, then can
a project’s PMM be compared against a genotype and, if so, what can we learn? The results of
the prestudy are described in Appendix II and used in the discussion found in Chapter 6 to help
provide an alternative perspective to the findings in the main part of the research. This is the
basis on how the comparative was built.
The next chapter is a literature review of project success, PMMs and the use of contingency
theory, and a theoretical lens for the overall study.
25
Chapter 3. Project Management Methodologies
(PMMs), project success, project governance,
contingency theory, agency theory, and
stewardship theory
This chapter provides a literature review of key concepts used in this thesis. It starts with a discussion of project
success, followed by a discussion of PMMs including differences between a method and PMM, then project
governance first as a context factor and second as an independent variable is explored, and finally contingency
theory is proposed as the theoretical lens for the first two parts of the main study with agency and stewardship
theory proposed as the theoretical lens for the third and final part of the main study.
The measures used to judge the success or failure of a project, called success criteria, are the
dependent variables that measure success per Morris and Hough (1987). Defining and agreeing
upon project success criteria to make project success measurable is a way to overcome the
subjective interpretation of project success (Müller & Turner, 2007b).
The understanding of project success has evolved over the past 40 years of research from the
simplistic triple constraint concept, known as the iron triangle (time, scope, and cost), to
something that encompasses a multidimensional concept encompassing many more success
criteria attributes (Atkinson, 1999; Judgev & Müller, 2005; Müller & Judgev, 2012; Shenhar &
Dvir, 2007). Project success is a multidimensional construct that includes both the short-term
project management success efficiency and the longer-term achievement of desired results from
the project, that is, effectiveness and impact (Judgev, Thomas, & Delisle, 2001; Shenhar, Levy, &
Dvir, 1997).
26
Even with a concerted effort to define and measure project success, many studies and reports
conclude that many projects fail to meet their objectives (Bloch et al., 2012; Cicmil & Hodgson,
2006; GAO (Government Accountability Office), 2013; The Standish Group, 2010).
Understanding how to measure success is one thing; but if success is rarely achieved, then the
focus needs to be on success factors, that is, what needs to be in place for a project to succeed.
Project success factors have been the focus of many researchers (Belassi & Tukel, 1996; Cooke-
Davies & Arzymanow, 2003; Pinto & Slevin, 1988; Tishler et al., 1996; White & Fortune, 2002).
To ensure a common understanding of the term success factors, the definition from Turner (2008)
is used: “Project success factors are elements of a project, which, when influenced, increase the
likelihood of success; these are the independent variables that make success more likely.”
Some project management literature refers to success factors as critical success factors (Lehtonen
& Martinsuo, 2006; Müller & Judgev, 2012; Pinto & Mantel, 1990), while other literature refers
to them only as success factors (Cooper, 1999; Mir & Pinnington, 2014). It is useful to
understand the origins of the term success factors and whether there are any differences in these
terms. The concept of success factors was created by Daniel (1961) and refined by Rockart
(1979) where Rockart introduced the word “critical” into the term. Rockart described critical
success factors as the few key areas where “things must go right” for the business to flourish.
When results in these areas are not adequate, the organization’s efforts for the period will be less
than desired. Rockart’s focus of critical success factors was at the C-level and top management.
The term critical success factors was later adopted in project management but is not consistently
used in the literature. The project management literature referring to critical success factors and
success factors overlap, suggesting that they mean the same thing; therefore, it is assumed as
such in this literature review.
Judgev and Müller (2005) carried out a retrospective review on the understanding of project
success and found that the number of success factors that have been identified are increasing
and also have a longer term perspective. This can be seen in Figure 3-1 where the literature on
critical success factors originally only covered the project execution phase and a small part of the
handover phase. Then, over time, the literature extended out to include both the project life
cycle and then the product life cycle. Schultz, Slevin, and Pinto (1987) suggested that the relative
importance of success factors varies over the project life cycle. Shenhar, Dvir, Levy, and Maltz
(2001) described the importance of success factors, not just on the project life cycle but also on
the product life cycle, from project completion to production, and then to preparation for
project/service replacement. The literature on critical project success factors mapped to the
27
importance of success dimensions reveals that it has taken over 30 years to fully understand the
implications of the project success dimensions on efficiency, customer impact, business success,
and the ability to prepare for the future.
Researchers soon realized that success factors without structure, grouping, and context would
result in suboptimal results; therefore, success factor frameworks were introduced (Judgev &
Müller, 2005). The first integrated frameworks came in the 1980s where Morris and Hough
(1987) were pioneers in developing a comprehensive framework on the preconditions of project
success (Judgev & Müller, 2005). The frameworks varied depending on what aspects were
covered. Pinto developed a success framework on organizational effectiveness, technical validity,
and organizational validity (Pinto & Slevin, 1988). Freeman and Beale’s (1992) success
framework included efficiency of execution, technical performance, managerial and
organizational implications, manufacturability, personal growth, and business performance.
Shenhar et al. (2001) described how there is no one size fits all, then using a four-dimensional
framework, he showed how different types of projects require different success factors and
described the strategic nature of projects where project success should be determined according
to short- and long-term project objectives.
Figure 3-1: Importance of success dimensions over the project/product life cycles mapped to scope of
success factor literature. Adapted from Judgev and Müller ( 2005) and Shenhar et al. (2001)
28
Figure 3-1 combines the importance of success dimensions over time with the scope of the
literature on critical success factors. What is immediately apparent is the short-term view that
researchers took in the 1960s to 1980s in understanding how projects are executed, then the
literature expanded in terms of a greater short-term understanding of project efficiency by
looking at the project life cycle as well as a forward-looking view, which also encompassed the
later phases of the product life cycle, that is, operations and retirement.
In summary, project success can mean different things to different project stakeholders;
therefore, implementation of measurable project success criteria helps to ensure agreement and
understanding. Determining whether a project met its objectives is one thing, but when attention
is not paid to determining what the relevant project success factors are, project success is unlikely
to be achieved. As research continues on the topic of project success, new project success factors
are being identified that take a longer-term perspective and are being added into the success
factor frameworks.
Project success is the dependent variable in the research models of the main study.
The term methodology is derived from Greek methodologia and is defined as a system of methods
used in a particular area of study or activity (OxfordDictionaries, 2014).
In the project management field, project management methodology (PMM) is defined as:
• A system of practices, techniques, procedures, and rules used by those who work in
a discipline (PMI, 2013a).
• A collection of procedures, techniques, tools, and documentation aids that will help
the system developers in their efforts to implement a new information system. A
PMM consists of phases and subphases, which will guide the system developers in
their choice of techniques that could be appropriate at each stage of the project and
also to help them plan, manage, control, and evaluate information systems projects
(Fitzgerald et al., 2002).
The term method is derived from Greek methodus, and is defined as a particular procedure for
accomplishing or approaching something, especially in a systematic or established manner
(OxfordDictionaries, 2014).
29
Forty years ago, the first formal PMMs were set up by governance agencies to control project
budget, plans, and project quality (Packendorff, 1995). Since that time, the literature on PMMs
has covered standardization, customization, or a combination thereof; in-house, international
methodologies; soft factors; the roles of the PMO in PMM development; and the impacts of
PMMs on project success.
Customization
Turner and Cochrane (1993); Shenhar and Dvir (1996) were a few of the first proponents of
customization to show that projects exhibit considerable variation, which at the time went
against the literature trend that assumed all projects were fundamentally similar. Payne & Turner,
(1999) found that project managers often report better results when they can tailor procedures to
the type of project they are working on, matching the procedures to the size of the project, or
the type of resource working on the project. Wysocki (2011) stated that the often-used term one
size fits all does not work in project management.
McHugh and Hogan (2011) found that in-house PMMs work well but there are demands from
external customers for a recognized PMM. This is, in part, due to the assurance that the
organization is using what is considered to be “best practices” as well as a supply of trained
resources.
Standardization
PMM and processes have been referred to as organizational processes implying they have
degrees of standardization (Curlee, 2008). However, there is a risk that structured methodologies,
when developed in a normative way, become prescriptive and based on a series of checklists,
guidelines, and mandatory reports(A. Clarke, 1999). The ISO 9000 standards are frequently
criticized for being too standardized and prescriptive while generating excessive costs and
paperwork (A. Brown, Wiele, & Loughton, 1998; Stevenson & Barnes, 2001). Crawford (2006)
found that “owners” of project management practices were following a path of corporate
control and standardization; whereas the project managers showed that certain project processes
did not apply to their local projects, thus creating a tension between project managers and the
corporate control and related standards. The primary function that promotes standardized
methodologies is the PMO. Hobbs, Aubry, and Thuillier (2008) observed the dilemma that exists
between PMOs that are focused on standardizing organizational PMM and the need for
flexibility in the execution of a project.
30
Combination of standardization and customization
A contingency approach to standardizing parts of a PMM was suggested by Milosevic &
Patanakul (2005) where it made sense to standardize only parts of the PMM in an organization.
In summary, there is little consensus in the literature on whether PMMs should be standardized,
customized, or a combination of both. Aubrey, Müller, Hobbs, and Blomquist (2010) found that
the more experienced PMOs are using new methods derived from agile methodologies that allow
flexibility in processes and PMM. This suggests a contingency between PMMs and project
success; however, literature is also split on whether PMMs directly contribute to the goals (Aubry
et al., 2010) or to the perceived appropriateness of project management (Lehtonen & Martinsuo,
2006).
The description of a PMM varies among the international PMM standards. For example, the
Project Management Institute describes a PMM as a system of practices, techniques, procedures,
and rules (2013a); whereas Prince II is not described as a PMM but rather as a method (OGC,
2002) that contains processes, but requires techniques to be added. Ericsson considers its
PROPS PMM to be a model and not a PMM, where the model describes all of the project
management activities and documentation (Ericsson, 2013). Anderson and Merna (2003) have
helped to categorize PMMs into process models, knowledge models, practice models, and
baseline models. The categorizations of PMMs helps in understanding what type of
project/industry the PMM is targeting, but it does not help in understanding the impact of a
PMM on project success. Perhaps it is not sufficient to look at the PMM as a whole, but instead
at its building blocks, which the author terms PMM elements. If the elements of PMM are
understood, then this is the foundation for understanding how the elements collectively impact
project success. PMMs comprise a number of heterogeneous elements that, when applied to a
project, should have a positive impact on project success. To achieve the desired effect, a PMM
needs to take into account scope and comprehensiveness where the term comprehensiveness is
defined as including or dealing with all or nearly all elements or aspects of something
(OxfordDictionaries, 2014). PMMs that are not comprehensive are considered incomplete in this
study and, therefore, will need to be supplemented during the project life cycle. From a survey of
project management current practices White and Fortune (2002) found that very few methods,
tools, and techniques were used; and for the ones that were used, almost 50% of the respondents
reported drawbacks to the way they were deployed. This suggests that organizational PMMs
suffer from a lack of applicability and comprehensiveness. Research supports this assessment as
organizations experience limitations in their PMMs irrespective of whether it is an in-house or an
off-the-shelf PMM (Fortune et al., 2011; Joslin & Müller, 2014b; Wells, 2013). When the
31
selection of PMMs was carried out at the organizational level, it frequently did not address the
needs of the departments and projects, resulting in project managers’ tailoring of their
organizational PMMs, specifically for their projects (Wells, 2013).
In summary, there is no agreement as to what makes up a PMM, which may influence whether
or not a PMM is seen as being comprehensive. Researchers are also divided as to whether
standardized versus customized methodologies contribute more or less to project success, but
observations have been made where experienced PMOs are applying a contingency approach to
PMMs. There is also the question of whether PMMs directly contribute to project success or
indirectly via the appropriateness to project management.
The reason for selecting PMM as the independent variable in the research model is to determine
whether a PMM directly or indirectly contributes to project success; and, if directly, what
percentage of project success can be accounted for by correctly applying a PMM; and is the
relationship between a PMM and project success influenced by environmental factors, notably
project governance.
The Office of Government Commerce (OGC) (2002) terms governance as a framework that
defines the accountability and responsibility of people who are driving the organization as well as
the structure, policies, and procedures under which the organization is directed and controlled.
Governance theory was originally developed from policy research in political science
(Friedmann, 1981; Krieger, 1971; Nachmias & Greer, 1982) and extended to encompass many
levels, including international governance, national governance, corporate governance, and
project governance (Klakegg, Williams, & Magnussen, 2009). Researchers have addressed
governance from different perspectives, using a number theories to help explain observed
phenomena. The most notable theories are shown in Table 3-1.
32
Table 3-1: List and description of governance theories
Agency theory Agency relationship exists between two Mitnick (1973), Jensen and
parties (the principal and the agent) in Meckling (1976)
organizations where both actors are
perceived as rational economic actors that
act in a self-interested manner.
Stewardship Actors (managers) are stewards whose Donaldson and Davis (1991)
theory motives are aligned with the objectives of
their principles rather than their own goals.
Resource Directors and managers are able to Pfeffer and Salancik (1978)
dependency prioritize, acquire, and facilitate the
theory utilization of resources aligned to
organizational objectives.
The use of contingency theory as the theoretical lens in studies 1, 2, and 3; and agency theory
and stewardship theory as the theoretical lens in study 4, are described in detail in sections 3.4
and 3.5.
Governance in the area of projects takes place at different levels where there is project
governance on individual projects, namely “the use of systems, structures of authority, and
processes to allocate resources and coordinate or control activity in a project” (Pinto, 2014, p.
383). There is governance for groups of projects, such as programs or portfolios of projects,
where the emphasis is on collective governance, which is viewed as governance of projects
(Müller & Lecoeuvre, 2014).
Project governance is defined by the Project Management Institute as “the alignment of project
objectives with the strategy of the larger organization by the project sponsor and project team
33
[…] is defined by and is required to fit within the larger context of the program or organization
sponsoring it, but it is separate from organizational governance” (PMI, 2013b, p. 553).
The governance of projects, combined with project governance, coexist within the corporate
governance framework and cover project portfolio, program, and project management
governance (Müller, Turner, Anderssen, Shao, & Kvalnes, 2014).
The literature on project governance models or guidelines addresses different contexts, such as
project governance for risk allocation (Abednego & Ogunlana, 2006), a framework for analyzing
the development and delivery of large capital projects (Miller & Hobbs, 2005), NASA-specific
framework for projects (Shenhar et al., 2005), governing the project process (Winch, 2001),
mechanisms of governance in project organizations (Turner & Keegan, 2001), normalization of
deviance (Pinto, 2014), stakeholder management (Aaltonen & Sivonen, 2009), project
governance roles (Turner, 2008), and governance in project-based organizations (functional,
matrix, or projectized) (Müller, Turner, et al., 2014).
One can conclude from the literature that project governance is contingent on its application and
also on its environment. The literature does not cover understanding the impact of project
governance on the relationship of PMMs and project success, which is addressed in this research.
To understand the impact of governance on the relationship between PMM and project success,
a method to categorize each organization’s governance positioning is required ideally within a
governance model.
Governance models are developed from different perspectives using either a top-down or a
bottom-up approaches (Klakegg, Williams, & Magnussen, 2008). Top-down approaches are
developed from a shareholder-outcome perspective, whereas bottom-up approaches take a
process-control perspective and can be considered as an extension of a PMM (Müller, 2009). The
present study requires a governance model that considers the perspectives of shareholder versus
stakeholder and a “follow the process” versus “get it done” (outcome) approach. This is because
the governance model perspectives map to the overall objective of a project, that is, a successful
outcome, with the objective of a PMM (structured approach to deliver a project), all within an
environment that is influenced by shareholders and stakeholders.
The governance models that incorporate topics such as ethics, corporate citizenship, roles, and
responsibilities (Dinsmore & Rocha, 2012; Renz, 2008; Turner, 2008; Walker, Segon, &
Rowlingson, 2008) were excluded because the emphasis of the study is on the shareholder-
stakeholder and behavior-outcome aspects of the organization. Therefore, the most relevant
34
model was Müller’s governance model (2009) which draws on the theories of transaction cost
economics, agency theory, and institutional theory using legitimacy to emphasize conformance.
Müller’s governance model explains the governance of projects through four governance
paradigms, where one paradigm is used for one project by the project’s parent organization;
however, the use of paradigms can vary across the organizational units throughout the
organization.
The governance paradigms from Müller (2009) are shown in Figure 3-2 along with the theories
that the paradigms are derived from.
Müller’s governance model addresses corporate governance orientation and control orientation
at the level of the organizational unit that governs a project. The corporate governance
dimension builds on the Clarke (1998) and Hernandez (2012) models where they claim that a
corporation’s governance orientation can be found on a continuum from a shareholder to
stakeholder orientation. The shareholder theory of corporate governance assumes the main
purpose of an organization is to maximize shareholder return (S. Brown & Eisenhardt, 1997).
Therefore, the value system of these types of organizations prioritizes shareholders over
stakeholders; and qualitative objectives, such as employee well-being, good relationships with
interest groups, and ethical standards, take second priority (Müller, 2009). Stakeholder theory
takes the wider social responsibility of organizations into account. An organization that is
35
stakeholder-oriented balances the qualitative and quantitative requirements of a wide range of
stakeholders (Müller, 2009) . The purpose of the organization is to create wealth and value for its
stakeholders (T. Clarke, 1998).
Referring again to Figure 3-2, the corporate governance orientation is the horizontal line where
pure shareholder or stakeholder orientation exists at opposite ends of the continuum. Every
organization will be found on this continuum.
The second dimension is about control, representing the control exercised by the governing
institution over the project and its manager. There is a distinction between organizational
control, which focuses on goal accomplishment by controlling outcomes (e.g., reaching a set of
objectives), versus compliance with a focus on employees’ behaviors (e.g., following a process,
such as a project management PMM) (S. Brown & Eisenhardt, 1997; Ouchi & Price, 1978;
Ouchi, 1980).
The vertical line in Figure 3-2 is the control orientation where the extreme points are
organizations solely focused on goal accomplishment by controlling the results (outcomes)
versus compliance in employee behavior (following a process or a project management PMM).
Every organization will be found on this continuum.
Each of the quadrants in Figure 3-2 represents a governance paradigm and every organization
can be represented by one of these paradigms. The names and attributes of each paradigm are
shown in Figure 3-3.
36
Using the governance paradigms from Müller (2009), including the scales, governance is the
moderating variable in the research models for studies 2 and 3, and the independent variable for
study 4.
3.4 Contingency theory—Theoretical lens for the prestudy and first two parts of
the main study
A management theory developed more than 50 years ago, called contingency theory, suggested
that there is no single best way to manage and structure an organization (Burns & Stalker, 1961;
Woodward, Dawson, & Wedderburn, 1965). Woodward (1965) suggested that technologies
influence organizational attributes such as span of control, centralization of authority, and the
development of rules and procedures. Burns and Stalker (1961) introduced the concepts of
mechanistic versus organic organizations, and how organic organizations are better suited to
dynamic changing environments. Lawrence and Lorsch (1967) showed that varying rates of
change affect the ability of organizations to cope. Since the 1960s, there is a large body of
literature on structural contingency theory (Argote, 1982; L. Donaldson, 1987; R. E. Miles &
Snow, 1978; Ouchi, 1980).
So what is the contingency theory of organizations? It is the change in the effect of one variable
(an independent variable) on another variable (a dependent variable) depending upon a third
variable (the moderator variable) (L. Donaldson, 2001, p. 5).
In the field of project management research, prior to the 1980s, contingency factors were rarely
taken into account when researching into project management topics (Judgev & Müller, 2005). In
the late 1980’s, the first studies on project management started to use contingency theory as a
theoretical lens for project context (L. Donaldson, 2006). Research topics that have used
contingency theory include the topology of projects with minor and major impacts (Blake, 1978);
innovation types in business (Steele, 1975); product development project types (Wheelwright &
Clark, 1992); leadership styles for project and functional managers in organizational change
(Turner, Müller, & Dulewicz, 2009); project procedures tailored to context (Payne & Turner,
1999); leadership styles according to project type (Müller & Turner, 2007a); and project type and
the ability to select appropriate management methods linked to project success (Boehm &
Turner, 2004; Shenhar & Dvir, 1996).
A recent bibliographical review of the use of contingency theory in the field of project
management showed that contingency is increasingly being applied in research papers with a
noticeable increase since 2005 (Hanisch & Wald, 2012). Fitzgerald, Russo, and Stolterman (2002)
noted that the most successful PMMs are those developed for the industries or organizations
37
that are aligned to the context factors. Lehtonen and Martinsuo’s management study of project
failure and the role of project management PMM concluded “some contingency variables may
have an impact on the relation between PMM and success” (Lehtonen & Martinsuo, 2006, p.
10). This supports the notion of contingency theory where the independent variable, PMM, and
the dependent variable, success, is influenced by a third variable.
Contingency theory is being used as the theoretical lens for the studies 1, 2 and 3 to help
understand the impact of PMM on project success and to determine that governance is acting as
a contingency (moderator) variable. The aim of the main part of the research is to understand the
impact of PMM on project success in the context of governance.
The use of contingency theory in the prestudy is implicit, because, in the natural science world of
biology, every organism is influenced by its environment (Dawkins, 1974). The comparative
takes this contingency perspective across to the social sciences in terms of showing how PMMs
are also contingent on their project and organizational environments.
3.5 Agency theory and stewardship theory—Theoretical lens for the third part of
the main study
Agency theory and stewardship theory, two opposing but appropriate theories. Agency theorists
argued that corporate managers (agents) may use their control over the allocation of corporate
resources opportunistically in order to pursue objectives contrary to the interests of the
shareholders (principle) (Jensen & Meckling, 1976). Agency theory has been used by researchers
in traditional finance, economics, marketing, political science, organizational behavior, sociology,
and corporate governance (Eisenhardt, 1985). The formal definition of agency theory states that
an agency relationship exists between two parties (the principal and the agent) in organizations
where both actors are perceived as rational economic actors that act in a self-interested manner
(Mitnick, 1973).
Agency relationships are referred to between two parties, that is, the principle and the agent, but
there can be several principle agents in a project process, such as procurement of resources or
change request processes (Toivonen & Toivonen, 2014). Corporate and project governance,
when designed correctly within the context of the organization, should minimize the risks and
issues associated with agency issues. Agency theory based on Jensen and Meckling’s (1976) view
of principle agent models have been criticized because they neglect to consider that the principle-
agent transitions are socially embedded and therefore impacted by broader institutional contexts
(Davis, Schoorman, & Donaldson, 1997a; Wiseman, Cuevas-Rodríguez, & Gomez-Mejia, 2012).
38
Stewardship theory arose in response to the criticism regarding the generalizability of agency
theory, which states that the actors (managers) are stewards whose motives are aligned with the
objectives of their principles, rather than being motivated by their own goals (L. Donaldson &
Davis, 1991). The steward differs from the agent in that the steward is trustworthy and will make
decisions in the best interests of the organization. This is achieved by meeting the organization’s
demands as well as the steward’s personal needs. The steward aligns the personal and
organizational interests by prioritizing the long-term goals over short-term gains (Davis,
Schoorman, & Donaldson, 1997b). Stewardship theory has been criticized, because it views the
organization in a static way and does not account for stewards’ resorting back to an agent
position when their positions are threatened (Pastoriza & Ariño, 2008). Neither agency theory
nor stewardship theory is more valid than the other, as each may be valid for different types of
phenomena (Davis et al., 1997b).
The third part of the main study investigates the relationship between project governance and
project success and project governance and a PMM where observed phenomena will be
described through the agency theory – stewardship theory lens.
39
Chapter 4. Research methodology
This chapter presents the research philosophy and explains the details of the research model for each of the four
studies, then an integrated research model across all studies, a section on philosophical triangulation, and concludes
with the research methodology for each of the studies.
The research paradigm guides how decisions are made during the research process. Paradigms
can be characterized through their ontology (what is reality), epistemology (how do you know
something is true) and methodology (approach/process). Combined, these characteristics create
a holistic view of how knowledge is understood, how the researcher is positioned in relation to
this knowledge, and what methodological strategies were used to discover it (Guba & Lincoln,
1994). It is ontology and epistemology rather than methods, which are the determinants of good
social science (Alvesson & Sköldberg, 2009).
There are four commonly used versions of research paradigms in social science (Morgan, 2007)
whose origins are mostly derived from books such as Thomas Kuhn’s seminal book, The Structure
of Scientific Revolutions (Kuhn, 1970), and Burrell and Morgan’s book, Sociological Paradigms and
Organisational Analysis (Burrell & Morgan, 1979). The three versions of the paradigm concept
share the same belief system that influences the kind of knowledge researchers seek and how
they interpret the data they collect.
40
appropriate for the prestudy, because the author maps the attributes of the subjects under
observation and, therefore, will not influence the phenomena.
Critical realism serves as the underlying paradigm in the qualitative part of main mixed-methods
research. Critical realism emphasizes the existence of an objective reality independent of the
researcher’s descriptions and ideas (Alvesson & Sköldberg, 2009). Within critical realism, social
constructions are recognized, but they are outlined in an objectivist way (Alvesson & Sköldberg,
2009). Critical realism takes a middle-ground position between positivism and interpretivism. In
positivism, theory aims to predict, whereas in interpretivism, theory describes conditions or
context for the production of meaningful experiences (Wikgren, 2005). Critical realism
emphasizes the need to critically evaluate objects to be able to understand social phenomena
(Sayer, 1992). Critical realism consists of different levels, which addresses the fact that complex
social phenomena cannot be explained by solely looking at mechanisms and processes that
operate on purely one level (Wikgren, 2005). Entities might be analyzed at different aggregation
levels, where some entities also emerge from lower levels (Easton, 2010). The qualitative part of
the interviews will be carried out at the upper levels whereas the online questionnaire will be
carried out at the lower levels.
Postpositivism is the final paradigm used for the two quantitative studies as part of the mixed
methods research. Postpositivism assumes an objective and extrinsic reality (facts and laws)
exists (Tekin & Kotaman, 2013). However, the perspective of post-positivist research is not to
establish generalizations about the phenomenon under observation, but rather to focus on
“meaning and understanding of the situation or phenomenon under examination” (Crossan,
2003, p. 54). Project governance and project success are both socially constructed phenomena;
therefore, the impact of project governance on project success is investigated to provide
conditional knowledge that can be used to understand when and how to improve project
governance’s positive impact on project success.
41
4.1.3 Paradigms as shared beliefs in a research field
This third perspective of paradigms is from a research methodological viewpoint and is used to
design research or a conceptual framework and processes to guide the inquiry of knowledge on
the topic of interest. The main part of the research proposes using mixed methods, because the
qualitative part will provide a deeper understanding of a methodology and the impacts of the
environment on the relationship of a PMM and project success. The finding of the qualitative
study will be used to create the online survey for the quantitative part of the mixed methods
where the findings can then be generalized.
Deductive reasoning starts from a general rule to the more specific rule (sometimes called a top-
down approach) and asserts “the rule explains a single case” (Alvesson & Sköldberg, 2009).
Inductive reasoning starts from specific observations to broader generalizations and theories
(sometimes referred to as the bottom-up approach). A number of cases are considered and
assume a connection exists which is generally valid. The inductive approach is used for
understanding a new or unknown phenomenon and collects data through interviews,
observations, and focus groups (Miles & Huberman, 1994) .
The prestudy uses a deductive approach as it is based on the principles of science and uses
already established knowledge which is tested in a new circumstance. The main study uses a
deductive approach, which uses existing theory for hypothesis development and testing.
4.2.2 Strategies
The prestudy is based on transformative research by suggesting a particular empirical natural
science perspective for some social science phenomena, such as research in project management
methodologies and project portfolios as a comparative to existing perspectives. The National
Science Foundation (NFS) (2007, p. 10) describes transformative research as:
research driven by ideas that have the potential to radically change our understanding of an important
existing scientific or engineering concept or leading to the creation of a new paradigm or field of science or
engineering. Such research also is characterized by its challenge to current understanding or its pathway to
new frontiers.
42
Transformative research results often do not fit within established models or theories and may
initially be unexpected or difficult to interpret; further, their transformative nature and utility may
not be recognized until years later. Transformative research has the following characteristics:
challenges conventional wisdom; leads to unexpected insights that enable new techniques or
methodologies; and/or redefines the boundaries of science, engineering, or education.
How can a natural science perspective be used in understanding social science phenomena?
For the main study, the qualitative study is based on interviews to determine the source of the
questions and contextual information that helped to formulate the questionnaire in the
quantitative part of the study.
4.2.3 Choices
For the prestudy, a conceptual approach was taken using a natural science perspective in an
attempt to answer those parts of the research questions that remain unanswered by the main
study.
For the main study, a mixed-research method (qualitative and quantitative) was chosen in order
to answer the research questions from both the critical realism and postpositivist perspectives.
For the qualitative studies, the overall methodological approach of the study was deductive.
However, the research model was qualitatively validated through interviews that were inductively
analyzed.
What is the nature of the relationship between the PMM including its elements and project success, and is this
relationship influenced by the project environment, notably project governance?
Figure 4-1 illustrates the steps taken in the research process. The symbol (E) denotes empirical
information based on interviews, meetings, and surveys whereas the symbol (L) denotes
documents and theoretical data gained through the literature reviews.
43
With the prestudy being primarily related to natural science, the positivist, deductive approach
was taken using transformative research strategy. The first paper (Appendix I) that resulted from
the research was based on literature findings and a number of key concepts such as Universal
Darwinism (Nelson, 2006), gene centric view of evolution (Dawkins, 1974), and evolutional
stable society (Dennett, 1996). The paper contained the findings from the analysis and the
mapping tables that were created to compare the attributes of both worlds (natural and social
sciences), and a detailed literature review on comparative analysis approaches, as well as a theory-
building section that showed comparatives already exist across sciences (which also comply with
Universal Darwinism) and are used in research.
Once the prestudy was completed and the link created between natural and social sciences
(methodology), then the main part of the PhD could commence. Paper 2 was produced based on
the literature (L) and findings (E) from the qualitative study. Paper 3 used the questions and
findings that came out of the interviews in the qualitative research to create an online survey and
the findings from the survey and literature were the basis for Paper 3. Paper 4 used the same data
collected from the online survey that related to governance and project success to understand if
there was a direct relationship between the two variables.
This thesis brings both the prestudy and the main study together in the discussion section.
Paper 1 (Appendix I) was presented in June 2014 at the EURAM research conference held in
Valencia, Spain and a revised version was submitted and accepted by the Project Management
Journal (PMJ). Paper 2 (Appendix II) was presented in July 2014 at the PMI research conference
44
in Portland, Oregon, and a revised version was submitted to the International Journal of Managing
Projects in Business (IJMP). Paper 3 (Appendix III) and Paper 4 (Appendix IV) have been
submitted to the International Journal of Project Management (IJPM).
The literature on PMMs in section 3.2, describes, the importance of PMMs as their integral role
within a project but raises questions as to whether PMMs directly contribute to project success
or indirectly by means of the appropriateness to project management (Lehtonen & Martinsuo,
2006). Research on PMMs focuses either on a part (or element) of a PMM such as project
scheduling or stakeholder management, or as a whole or homogeneous entity, for example, a
PMM and the impact on success (Mir & Pinnington, 2014).
There are PMMs that are standardized, customized, and a combination of both, implemented in
different organizational environments, which indicates there are one or more project
45
environmental factors present (Fortune et al., 2011; Lehtonen & Martinsuo, 2006; Milosevic &
Patanakul, 2005; White & Fortune, 2002).
What is the nature of the relationship between the PMM including its elements and project success, and is this
relationship influenced by the project environment, notably project governance?
The research model (see Figure 4-3) was derived from the research question and the
subsequently developed propositions were derived from the literature review in section 3:
Note: The research model is shown even though in qualitative research, there are normally no
research models, as the aim is to understand meanings that people attach to phenomena and not
to test variables and their relationships. However, the model is shown because it provides a link
to the prestudy and quantitative part of the study which is explained in section 4.4.5 as an
integrated research model.
46
in every organization, may have an influence on project selection, set-up (including PMM),
execution guided by a PMM, and project close, which ultimately could impact project success.
What is the nature of the relationship between a PMM and project success, and is this relationship influenced by
project governance?
47
Therefore following hypothesis is derived.
Hypothesis 1: There is a relationship between the PMM’s elements and project success.
H1.1: There is a positive relationship between a comprehensive set of PMM elements and
project success.
H1.2: There is a positive relationship between supplementing missing PMM elements and
project success.
H1.3: There is a positive relationship between applying relevant PMM elements and project
success.
Referring to the literature in section 3.2 on PMM, the effectiveness of a PMM is contingent on
the environment (Fitzgerald et al., 2002; Fortune et al., 2011; Lehtonen & Martinsuo, 2006;
Shenhar, Dvir, Lechler, & Ploi, 2002; White & Fortune, 2002). Referring to section 3.3 of the
literature review, governance influences projects in the way they are set up (Turner & Keegan,
2001), in their organizational structure (Müller, Turner, Anderson, Shao, & Kvalnes, 2014), in the
running of projects (Winch, 2001) in their risks strategies (Abednego & Ogunlana, 2006), in the
project process (Winch, 2001), in project-based organizations (functional, matrix, or
projectized)(Müller, Pemsel, & Shao, 2014b) and in stakeholder management (Aaltonen &
Sivonen, 2009).
Hypothesis 2: The relationship between the project PMM and project success is moderated by
project governance.
H2.1: The impact of a comprehensive set of PMM elements on project success is moderated
by project governance.
H2.2: The impact of supplementing missing PMM elements on project success is moderated
by project governance.
H2.3: The impact of application of relevant PMM elements on project success is moderated
by project governance.
48
considerably from an organizational perspective. The first orientation can range from extreme
shareholder with a view of maximizing shareholder financial returns to the other extreme of the
continuum of a pure stakeholder orientation where stakeholder needs take priority over profit.
The second orientation ranges from extreme control orientation of the continuum to extreme
behavior orientation. Every organization governance orientation can be located somewhere on
the two continuums (Müller & Lecoeuvre, 2014). Therefore with governance being pervasive
throughout an organization, coupled with the ability to gauge and also explain the consequences
of the governance positioning using shareholder and stakeholder theory (from an organizational
perspective) and agency theory and stewardship theory (from the perspective of behavior of
individuals), it is interesting to understand and explain if and why project governance directly
impacts project success. The operationalized governance paradigms from (Müller & Lecoeuvre,
2014), will be used to understand the relationship between project governance and project
success. This then leads to the research question:
The literature on project governance in section 3.3, describes extensive literature on the link
between corporate governance and corporate performance, which shows weaker governance
mechanisms have greater agency problems resulting in lower corporate performance (Hart, 1995;
Hirschey, Kose, & Anil, 2009; John & Senbet, 1998; Ozkan, 2007); greater shareholder rights
have a positive impact on corporate performance (Hirschey et al., 2009); and independent boards
lead to higher corporate performance (Millstein & MacAvoy, 1998). The link between
governance and project performance (success) is implied where project governance is seen as
important in ensuring successful project delivery (Biesenthal & Wilden, 2014).
49
H3.2: There is a positive relationship between governance control (behavior-outcome) and
project success.
The natural science comparative findings can be applied to both the qualitative and quantitative
studies, and this is reflected in the discussion section of the overall findings in section 6.5.
The sequence of the studies started with the natural science comparative to determine if a
comparative could be built between the natural sciences and social sciences (project
management). Once the link was determined in the comparative (which was a PMM), the main
part of the PhD was required to determine if the same phenomena could be observed and
explained using traditional methods in social science (see 4.4.6 on philosophical triangulation). A
mixed-methods approach was required starting with the qualitative part to understand more
about the concept of elements of a PMM and the impact of the environment (if any) on the
relationship between the PMM elements and project success. Then the findings of the qualitative
study and the literature review on project governance (see section 3.3) refined the research model
in terms of project context into the final research model. A fourth study using the quantitative
data from the online survey was used to better understand the direct relationship between
project governance and project success.
50
Figure 4-5: Integrated research model
51
Figure 4-6: Philosophical and methodical triangulation
Referring to Figure 4-6, the philosophical triangulation intersects are explained below:
Intersect A: Observed phenomena from the main qualitative (QUAL) research, which cannot
be explained from a natural science perspective, nor from the quantitative (QUANT) main study
research, and is, therefore, methodological specific.
Intersect B: Observed phenomena from the prestudy, which cannot be explained from a social
science perspective, and is, therefore, methodological specific.
Intersect C: Observed phenomena from the main QUANT research, which cannot be
explained from a natural science perspective nor from QUAL research of the main study, and is,
therefore, methodological specific.
Intersect D: Observed phenomena from the main studies for QUAL and QUANT research
providing a philosophical triangulation, but cannot be explained from a natural science perspective,
and, therefore, this part (B) is methodological specific.
Intersect E: Observed phenomena from the main QUAL study, which can also be explained
from a natural science perspective providing a philosophical triangulation, but cannot be explained in
the QUANT research, and, therefore, this part (C) is methodological specific.
Intersect F: Observed phenomena from the main QUANT which can be explained from a
natural science perspective, providing a philosophical triangulation, but cannot be explained from the
QUAL research, and, therefore, this part (A) is methodological specific.
Intersect G: Observed phenomena, which can be explained from a natural science and both
QUAL and QUANT social science perspectives, and therefore providing a full philosophical
triangulation.
This will be used in the discussion section of this thesis to bring in an alternative perspective.
52
4.5 Prestudy (study 1)
4.5.1 Data collection instrument development
A literature review was conducted on genetics or, more specifically, epigenetics, which is the
study of stable alterations in gene expression potential that arise during development and cell
proliferation (Jaenisch & Bird, 2003), and on project management, which is the application of
knowledge, skills and techniques to execute projects effectively and efficiently (PMI, 2013a).
Darwin’s evolutionary process criteria were applied to the concept of a PMM including its
elements, and all criteria were met. A number of scenarios were described using the attributes of
both worlds to see if these were realistic and plausible, for which they were. A theory-building
exercise was carried out which first looked to find another comparative that was researched and
accepted in the academic community and one that exists in both the natural and social science
worlds at two levels: a gene level and an organism level on one side, and an element level and the
project outcome on the other. Complex adaptive systems (CAS) were selected as the theory-
building comparative, because these systems exist in all four areas (natural to social sciences and
at two levels), and CAS has become a major focus of interdisciplinary research in both social and
natural sciences (Lansing, 2003) . The results of the theory building concluded that the attributes
of CAS were present for each part of the natural science comparative and, therefore, give greater
validity to the comparative model.
Finally, the paper was read by a professor of biology to determine whether the references on the
natural science side were accurate, and the feedback supported this.
53
been made in classifications and through the use of statistical methods to the degrees of
relatedness in the comparative (Harvey & Pagel, 1998; Martins & Garland, 1991). The next step
would be to look at statistical methods to see the degrees of relatedness in the comparative.
The interviews were semistructured and lasted between 60 and 90 minutes. Interview notes and
recordings were documented and compared for cross-validation. When additional questions or
54
clarity were required on the responses, follow-up was done using Skype sessions and email. This
was needed for three of the interviews.
For example, the recorded data was broken down into concept units and provided with labels
(codes). The first interviewee was asked to describe whether the PMM for any given project type
integrates the “how to build” something with the “what to build,” or is the “what to build’
(requirement specifications) for the project type kept separately and why?
… we have methods that are quite integrated in all what they deliver. So for example, in the CRM practice
we have separate methodologies for Seibel and Salesforce.com. We are trying to get into manufacturing and
the products that we would like to deliver are ones we would like to create. We would ultimately like to
market end-to-end solutions, so how can they productize themselves using unique methodologies integrating
the what and the how. The reasons why there are so many different types of in-house methods are because they
are tailored to each area. The advantage of a methodology that integrates the what and the how is that it is a
unique offering giving enhanced value and we should be able to corner a market. The disadvantage is that
some clients may not want this.
By analyzing the meaning of the words “enhanced value,” we see that a highly integrated PMM
provides a competitive advantage in new markets and also aids in productizing an organization.
So these words were coded to an integrated PMM and to a customized PMM.
As the interviews progressed, the same method was used to identify codes from the interviewees’
responses. As new questions were asked, a PMM categorization was built to show the
positioning of a PMM in terms of the origins and levels of customization and the benefits and
disadvantages of integrating the “what” and the “how” into one PMM.
55
authenticity, external validity/transferability/fittingness, and finally utilization/application/
action/orientation, was used to inspect the analysis of the processes and the results. The
reliability and validity are assured by considering the following:
Reliability
The data was collected from a spread of industries and countries (USA, Switzerland, Germany,
and the UK). Identified patterns were cross-validated for reliability.
Validity
Concept validity was given through the theoretically derived model, which was built on existing
literature, and from which the propositions were drawn. Construct validity was achieved through
convergence of the interviewee data.
Project, program, and project team members and functional managers were contacted using
email with a link to the web survey. In addition, the survey details were placed on several
LinkedIn forums for project management which included the Project Management Institute
(PMI), the International Project Management Association (IPMA), and several other project
management LinkedIn groups. An email with the survey link was sent to a number of PMI
chapters. During April 2014, 386 respondents answered the survey within a period of 14 days.
The following filter question was asked:
Do you have an understanding of your organization’s or client’s PMM where you have been involved as a project
stakeholder, that is, someone working in or impacted by projects?
From the responses, 132 were disqualified through the filter question at the beginning of the
survey and, therefore, were excluded from the survey. This resulted in 254 full responses that
56
could be used for analysis. The respondents came from 41 different countries with 24% from
Europe, 38% from North America, 22% from Australasia and 16% from other countries. The
average respondents’ work experience was 22 years and the average project-related work
experience was 15 years.
An ANOVA test with a significance level of 0.05 was carried out between the demographic
regions to see if there were differences in responses between the regions. The p value for the test
was 0.249, showing no statistical differences between the regions. An ANOVA analysis was
performed to assess if there was a difference between the mean project success rates for early
and late respondents, the p value for the test was 0.149, showing no statistical differences in the
means.
The questionnaire design is shown in Table 4-1 detailing the constructs for PMM, success, and
governance, including the literature sources and scales used in the online questionnaire.
The construct, project success, is based on five success factors: project efficiency, organizational
benefits, project impact, future potential, and stakeholder satisfaction. The reliability of the five
success factors is shown in Table 4-2 where all factors have a Cronbach’s alpha value over 0.7,
indicating good reliability (Field, 2009).
The construct, project governance, is based on ten questions where five are related to
shareholder versus stakeholder orientation and the other five are related to behavior versus
outcome control (Müller & Lecoeuvre, 2014).
57
Table 4-1: Questionnaire design—PMM, project success, and governance
Project Success Project efficiency (Diallo & Thuillier, 2004; 5-point Likert
Müller & Turner, 2007b; scale, strongly
Shenhar et al., 1997) disagree –
strongly agree
Organizational benefits (Jessen & Andersen, 2000; 5-point
Thomas & Fernández, 2008;
Turner, 2008)
58
4.7.4 Data analysis method
Analysis was carried out following the guidelines from Hair, Black, Babin, & Anderson (2010).
Data was checked for normality using skewness and kutosis measures of ± 2. Boxplots of
variables were done to identify outliers and t-tests between outlier respondents’ answers and the
wider sample to identify the representativeness of the answers of outliers. The answers from
eight respondents appeared to be significantly different from the wider sample responses and
thus they were excluded from the analysis. This accounted for fewer than 3% of the valid
responses and resulted in all variables meeting the thresholds for skewness and kurtosis, hence
the data for the variables being normally distributed (Hair et al., 2010).
Exploratory factor analysis was carried out on the PMM, governance, and success variables to
identify unknown, underlying structures and also to reduce the number of variables to a
manageable size while retaining as much of the original information as possible (Field, 2009).
Factor analysis was then used to determine the underlying dimensions for project context
(governance) and project success characteristics. Following Sharma, Durand, and Gur-Arie
(1981), hierarchical regression analysis was used to test the relationship between PMM and
success (hypothesis 1) and to test the moderating influence of governance on the relationship
between PMM and success (hypothesis 2). Finally, a number of ANOVA tests were used to
compare the mean of groups including early and late responders, difference of geographical
regions, difference of service and product based projects, project management experience levels,
and comprehensiveness of methodologies to determine additional information pertaining to two
or more of the research model variables.
4.7.5 Validity
Validity shows how well the concept is defined by the measures, whereas reliability shows the
consistency of measures (Hair et al., 2010). Reliability of the data was carried out in different
ways. Content validity was done by literature-based development of the measurement
dimensions, and face validity was tested during the pilot. Construct validity was ensured through
the use of earlier research results for the definition of the measurement dimensions, the
development of the questionnaire (Joslin & Müller, 2014c; Khan et al., 2013; Müller &
Lecoeuvre, 2014), pilot testing of the questionnaire, and item-to-item and item-to-total
correlations that were performed quantitatively through unrotated factor analyses. Testing item-
to-item and item-to-total correlations showed that the required threshold values of 0.3 and 0.5,
respectively, were reached (Hair et al., 2010).
59
Validity was tested through an unrotated factor analysis for each of the dimensions, which also
served as the Haman test to exclude common method bias-related issues as suggested by
Podsakoff and Organ (1986). The results for governance, project success, and PMM factor
analysis gave a Kaiser-Meyer-Olkin (KMO) sampling adequacy value of 0.8 or higher (with a
significance of p < 0.001). KMO measures the intercorrelations between the variables through
the measure of sampling adequacy (MSA). Kaiser (1974) recommends that acceptable values
should be greater than 0.5, values between 0.5 and 0.7 are considered to be mediocre, values
between 0.7 and 0.8 are considered to be good, values between 0.8 and 0.9 are great, and values
above 0.9 are superb.
4.7.6 Reliability
Reliability was ensured by asking multiple questions per measurement dimension and testing for
Cronbach’s alpha values per measurement dimension being higher than 0.60 (Cronbach, 1951).
The Cronbach’s alpha values for all of the measurement dimensions were greater than 0.747,
which shows that the constructs are reliable (Hair et al., 2010)
The questionnaire was piloted by 10 respondents using a purposive sample. Only small wording
changes were made to some of the questions to improve clarity. The pilot users’ responses were
not used in the final analysis.
This concludes the PMM chapter for studies 2, 3 and 4. The next chapter describes the
objectives and aims of each study as well as a summary of the research findings.
60
Chapter 5. Research findings
This chapter provides a summary of the research findings presented in the four papers upon which this thesis is
based. The results are presented as extended abstracts and give an initial response to the objectives of this research.
Table 5-1: The relation between the abstracts and the objectives of this research
61
process, the attributes of complex adaptive systems (CAS), which contain agents that are self-
similar and numerous, and therefore seen as complex (Holland, 2012), are used to validate the
constructs of the research.
This study found that the attributes of genes can be mapped to the attributes of the elements of
a PMM and, in doing so, provide a new perspective where a PMM and what it is being built
upon is the “core makeup” of a project, which is called a progenotype. This perspective is
different from current perspectives on project management, which consider the project manager,
project team, and stakeholders to be the core makeup of a project. With this alternative
perspective, the project resources support only the realization of the progenotype to create a
successful project outcome, that is, the product or service. Viewing a project from this
perspective while reifying both the progenotype and the project outcome makes both more
concrete or real and shows how a project is competing (for survival) from project
conceptualization to project completion. Examples include, the elements of a PMM are
competing to be selected for use on a given project where only the most suitable PMM elements
will be selected; a project is competing for management time and resources, and a project
outcome is competing against other similar products and services to ensure it has a long and
successful product/service life.
Topics covered in the paper include altruism, universal Darwinism, replication, and complexity
along with descriptions of the attributes of gene, progenotype, organism, and project outcome,
which are then used to help identify and explain phenomena that challenge conventional project
management thinking. Deriving new project management phenomena from the comparative
requires an understanding of evolution and competition using Darwin’s three components of
evolutionary process (Darwin, 1859). New phenomena are described, which were derived from
the comparative model and include impotent methodologies, lessons fighting for management
attention, naturally aging projects, and lone projects versus linked projects, where the former are
at higher risk of cancellation.
Examples of research questions are described to provide the reader with the applicability of the
comparative as an alternative method to identify and explain new or existing phenomena. The
paper closes with suggestions of future research topics where the model could provide new
insights.
The author believes that using the comparative model will challenge established thinking so that
many aspects of project management will be seen in a new light in both the project management
research and practitioner communities.
62
Keywords: transformative research, natural science comparative, methodologies, complex
adaptive systems, and Universal Darwinism.
This paper presents the results of the first stage of a larger study to determine the impact of the
elements of a PMM on the characteristics of project success and whether different project
environments impact the relationship between PMM and project success.
A philosophical stance of critical realism was used, which provides a link between things and
structures, such as the collected data and the researcher’s knowledge (Smith, 2006). The essence
of critical realism is to use the researchers own measurement process to generate the most
accurate understanding of the world (Hunt, 1990).
A deductive approach was applied to validate a theoretically derived research model. Nineteen
interviews across eleven industrial sectors and four countries were used to collect data. Pattern-
matching techniques were utilized in the analysis to deductively validate a theoretically derived
research model (M. Miles & Huberman, 1994).
The aim of this paper is to qualitatively validate the constructs of a theoretically derived research
model, clarify terminology, and gain additional insights that may help to steer the direction of a
larger study on PMMs, their elements, and their impact on project success.
Interview questions were derived using contingency theory as a theoretical lens and theoretical
sampling was used to determine the interviewee list. Data was collected from 19 semistructured
interviews, then theoretical saturation was reached. Participants were from 19 different
organizations that spanned four countries (Switzerland, Germany, UK, and USA).
Questions were structured to determine whether a PMM influences the characteristics of project
success, which environmental factors influence the effectiveness of the PMM in achieving
project success, and how do they accomplish this.
The findings show that the top six environmental factors, which include project governance,
culture, pressure to reduce costs, leadership maturity, political decision making, and skills and
resource constraints, impact the use of a PMM and its elements with resulting characteristics in
63
project success. Project governance was the most cited environmental factor and the reason for
this included insufficient governance around the processes and/or overall project, where
misfitting project governance did not provide the checks and balances for other environmental
factors. The consequence of this impacted the effectiveness of the relationship between PMM
and project success.
The interviews also highlighted the importance of understanding the origins of an organization’s
PMM and a way to categorize the levels of PMM customization when looking at the impact of
environmental factors for each level of customization.
The findings should benefit practitioners by allowing them to understand the impact of a PMM
on project success, moderated by the project environment. PMOs will understand the need to
customize their organization’s PMM(s) according to project type and environmental context. For
management who may be considering the replacement of an institutionalized PMM (including
derivatives of their main PMM), the findings highlight the importance of understanding the
project type and environmental context and how these are reflected in their incumbent PMM.
Once understood by management, an informed decision can be made on whether and how to
replace the incumbent PMM.
A philosophical stance of post positivism was used which assumes an objective and extrinsic
reality (facts and laws) exist (Tekin & Kotaman, 2013). However, the perspective of post-
positivist research is not to establish generalizations about the phenomenon under observation,
but rather to focus on the “meaning and understanding of the situation or phenomenon under
examination” (Crossan, 2003, p. 54). A PMM, project governance, and project success are all
socially constructed phenomena; therefore, the impact of a PMM on project success is
investigated to provide conditional knowledge that can be used to understand when and how to
64
improve a PMM’s positive impact on project success especially under the influences of different
project governance contexts.
A cross-sectional, worldwide, online survey using questions on PMM, project success, and
project governance yielded 254 respondents who were assessed to determine the impact of PMM
on project success and its interaction with project governance (Joslin & Müller, 2014c; Khan et
al., 2013; Müller & Lecoeuvre, 2014).
Analysis was done through factor analysis and moderated hierarchical regression analysis. The
results of the study show that the use of a comprehensive PMM accounts for 22.3% of the
variation in project success. The context factor, governance, which was represented by four
governance paradigms is a quasi-moderator. Such a moderator is identical to a full moderator
“except that the former not only interacts with the predictor variable but is a predictor variable
itself. Because it is a predictor, this type of variable is not considered a moderator in the
psychometric literature” (Sharma et al., 1981). However, project governance does have a direct
impact on PMM, regardless of whether it is a comprehensive or incomplete PMM and whether
the PMM is likely to be supplemented or not.
The findings should benefit practitioners by providing awareness that governance impacts the
choice of the organizational PMM, experience and skills are required to successfully apply it, and
indications for the way a PMM evolves is shown in different governance paradigms.
This paper contributes to the understanding that the effectiveness of a PMM is not only
determined by the manner in which it is applied, but also in the way that organizational
governance paradigms influence the selection and evolution of a PMM.
Governance is the way managers are held responsible for their actions. Within the realm of
projects “governance, as it applies to portfolios, programs, projects, and project management,
65
coexists within the corporate governance framework” (Müller, 2009). Project governance is
associated with responsibilities, processes, and policies that allow projects to achieve
organizational objectives (Clegg & Pitsis, 2002). This implies project governance is in some way
linked to project success.
Two theoretical lens are used in this study: agency theory, which states that an agency
relationship exists between two parties (the principal and the agent) (Jensen & Meckling, 1976);
and stewardship theory, which states that the steward differs from the agent in that the steward
is trustworthy and will make decisions in the best interests of the organization (L. Donaldson &
Davis, 1991).
A cross-sectional, worldwide, online survey yielded 254 responses. Analysis was done through
factor and linear regression analyses.
The findings show that requiring people to follow project processes does not necessarily lead to
better project results. This challenges the governance aspects of frameworks such as Carnegie
Mellon University’s Capability Maturity Model Integration (CMMI®), or the governance
process/outcome orientation behind the Project Management Institute’s Organizational Project
Management Maturity Model (OPM3®) (PMI, 2013b) where the premise is that a stronger process
control leads to better organizational results. In line with that, Yazici (2009) showed that
maturity models have only helped to improve project success on a repeatable basis in certain
organizational cultures. Instead, understanding and managing the diverse needs of project
stakeholders, which is reflected in a stakeholder-oriented governance structure, leads to the
highest chance for project success.
The dimensions of project success used in this study (project efficiency, organizational benefits,
project impact, future potential, and stakeholder satisfaction) were all correlated (hence impacted
by) the independent variable GOVorientation (shareholder-stakeholder). The success dimension
“future potential” is the dimension most strongly correlated with project success. An
interpretation of this is that shareholder-oriented governance through project success improves
the organizational capability by fully utilizing its resources and, by successful completion, enables
future projects to be selected, resourced, and completed successfully. The lowest correlated
success dimension to governance is stakeholder satisfaction. One explanation is that not all of
the stakeholders will personally benefit from the projects nor will all of the stakeholders approve
of the way projects are run, which is in part impacted by the governance approach adopted and
the acceptance of the governance by the culture of the organization. In addition to this, is the
unlikely prospect of obtaining agreement on project success from stakeholders with diverse
66
backgrounds and interests (Müller & Judgev, 2012), hence impacting overall stakeholder
satisfaction. The other three success dimensions (project efficiency, organizational benefits, and
project impact) were correlated between the dimensions “future potential” and “stakeholder
satisfaction.”
The findings should benefit practitioners influencing the design of project governance who
should try to ensure that a stakeholder-oriented governance approach is implemented to increase
the chances of project success. Also, contrary to some of the process maturity models,
practitioners should understand that governance, which is oriented towards controlling,
irrespective of whether it is behavior- or outcome-oriented, is not correlated with project
success.
67
Chapter 6. Analysis and discussion
This chapter looks at the constructs and hypothesis testing and then discusses the findings of the thesis by
connecting the prestudy with the main study to provide an overarching analysis and discussion. The chapter closes
with a theory-building section.
Khan, Turner, and Maqsood (2013) conducted a literature review of project success criteria that
spanned 40 years of research and created a scale based on five dimensions:
• Project efficiency,
• Organizational benefits,
• Project impact,
• Stakeholder satisfaction, and
• Future potential.
Khan, Turner, and Maqsood’s (2013) model was selected for this study as it is based on the latest
literature which is a superset of the success criteria from the leading researchers on project
success. Their model offers a balance between hard and soft factors and measures, as well as
presenting both a short and long-term perspective. The five success dimensions are comprised of
25 success criteria variables.
Table 6-1 shows the project success variables for each success dimension and provides the
results validation.
68
Table 6-1: Project success dimensions
The first dimension, comprehensive set of PMM elements, represents a comprehensive PMM
and can be applied to projects so that the PMM does not need to be supplemented. The
difference between a PMM and a comprehensive PMM is whether the PMM needs to be
supplemented by the project manager or not. Comprehensive methodologies do not need to be
supplemented.
69
Table 6-2: Dimensions of a PMM
Accumulated
Variance
PMM Success Factor Variables Variance
Explained
Explained
Comprehensive METH01: Comprehensive set processes 19.8% 19.8%
set of METH05: Comprehensive set of tools
methodology
METH09: Comprehensive set of techniques
elements
METH13: Comprehensive set capability
profiles
METH17: Comprehensive set of knowledge
areas
Supplemented METH02: Supplemented missing processes 18.1% 37.9%
missing METH06: Supplemented missing tools
methodology
METH10: Supplemented missing techniques
elements
METH14: Supplemented missing capability
profiles
METH18: Supplemented missing knowledge
areas
Applied METH03: Applied relevant processes 17.3% 55.3%
relevant METH07: Applied relevant tools
methodology
METH11: Applied relevant techniques
elements
METH15: Applied relevant capability profiles
METH19: Applied relevant knowledge areas
The second dimension, supplemented missing PMM elements, refers to an organization’s PMM
that is not comprehensive and needs to be supplemented with missing PMM elements to achieve
a successful project outcome. These elements can be processes, tools, techniques, capability
profiles, and knowledge areas.
The third dimension, applied relevant PMM elements (which can include processes, tools,
techniques, capability profiles, and knowledge areas), determines if the relevant PMM elements
were applied to achieve a successful project outcome (irrespective of whether the PMM was
supplemented or not).
The three PMM dimensions described in Table 6-2 include the success factor variables that the
PMM dimension comprises. The dimension “comprehensive set of PMM elements” contains
19.8% of the explainable variances for the five PMM success factor variables. The dimension
“supplemented missing PMM elements” contains 18.1% of the explainable variances for the five
success factor variables. Collectively, the three PMM dimensions explain 55.3% of all of the
success factor variables.
70
6.3 Construct of project governance
In the quantitative research study 3, the construct of project governance is described by two
dimensions: shareholder–stakeholder orientation and behavior–outcome orientation. These are
two axes that are the basis of four governance paradigms from Müller (2009). Referring to Table
6-3, the GOVControl factor contains 28% of the explainable variances in the original eight
governance questions and GOVorientation contains 25%. Together they contain 53% of the
variance of the ten governance questions, which is less than the 58.2% that Müller & Lecoeuvre
(2014) described for the operationalization of the governance categories of projects.
The “items included” column in Table 6-3 highlights the subjects of the project governance
question. The actual governance questions can be found in questions 23 to 33 of Appendix IV.
Accumulated
Variance
Governance Items Included Results Validation Variance
Explained
Explained
Behavior– Personnel and procedures Müller (2009), Müller 28% 28%
outcome Formal and informal & Lecoeuvre (2014)
GOVControl PMO
Compliance—experience
Shareholder– Decisions Müller (2009), Müller 25% 53%
stakeholder Remuneration & Lecoeuvre (2014)
GOVorientation Profitability and ethics
Stakeholder and financial
Objectives
H1.1 There is a positive relationship between a comprehensive set of PMM elements and
project success.
H1.2: There is a positive relationship between supplementing missing PMM elements and
project success.
H1.3: There is a positive relationship between applying relevant PMM elements and project
success.
71
The hypotheses were tested by using exploratory factor analysis using principle component
analysis on the PMM, governance, and success variables to identify the underlying structures and
reduce the number of variables to a manageable size while retaining as much of the original
information as possible (Field, 2009). Validity was tested through unrotated factor analysis for
each dimension, which also served as the Haman test to exclude common method bias-related
issues, as suggested by Podsakoff and Organ (1986). The results for each of the three concepts
gave a Kaiser-Meyer-Olkin (KMO) sampling adequacy value of 0.8 or higher (p < 0.001)
indicating the data’s appropriateness for this analysis.
A control variable was used to filter out spurious effects. It also helped to ensure internal
validity. “Years of project experience” was selected as the control variable, because it helped to
reduce the confounding effect of variations in a third variable that could also affect the value of
the dependent variable. This control variable should also be reflective of experience in using
methodologies.
The results showed that the control variable had no significant effect on the dependent variable,
project success; and the PMM factors MF01, MF02, and MF03 were significant (p ≤ 0.005), with
an R2 of 22.3%.
Hypothesis 1 including H1.1, H1.2, and H1.3 are supported when the application of a comprehensive PMM
accounts for 22.3% of the variation in project success.
The results support the findings of White and Fortune (2002) and Shenhar et al. (2002), showing
that the experience of using a PMM, including the correct choice of tools, techniques, and
processes are two success factors for project success.
Hypothesis 2: The relationship between the project PMM and project success is moderated by
project governance.
H2.1: The impact of a comprehensive set of PMM elements on project success is moderated
by project governance.
H2.2: The impact of supplementing missing PMM elements on project success is moderated
by project governance.
H2.3: The impact of the application of relevant PMM elements on project success is
moderated by project governance.
A study by Joslin and Müller (2014c) showed that governance is seen as a major influence on the
effectiveness of using PMMs to achieve project success.
72
For the moderating effect of governance, the findings showed that one of the two moderator
factors, GOVorientation, which is the shareholder versus stakeholder continuum, acted as a
quasi-moderator. This means that GOVorientation has an indeterminate relationship between
applied PMM elements (MF03) and project success, as well as the ability to directly influence
project success (Sharma et al., 1981). The other two independent variables, comprehensive set of
PMM elements (MF01) and supplemented PMM elements (MF02), were not moderated by either
of the two moderator factors. Applying the relevant PMM elements’ impact on project success is
contingent in GOVorientation (shareholder–stakeholder continuum), but it is unclear whether
the impact is more on the dependent variable or more on the relationship of an independent-to-
dependent variable, thus an indeterminate relationship.
A table of the research question, hypotheses, and results are shown in Table 6-4.
Using the results of the exploratory factor analysis and validity and reliability testing from the
first data analysis for research model 1, the two project governance factors, GOVorientation
(shareholder-stakeholder) and GOVControl (behavior-outcome), were linearly regressed against
project success.
73
The findings showed that only the GOVorientation (shareholder-stakeholder) factor was
significantly correlated to project success where the Beta (0.250, p < 0.001) showed that
stakeholder oriented governance with an R2 (0.063) accounts for 6.3% of the variation in project
success (p < 0.000). The results from linearly regressing GOVorientation (shareholder-
stakeholder) against each of the five dimensions of project success are shown in Figure 6-1. The
success dimension “future potential” is the highest dimension correlated with project governance
(adjusted R2 = 0.063; Beta 0.258****). An interpretation of this is that shareholder-oriented
governance, through project success, improves organizational capability by fully utilizing its
resources and, by successful completion, enables future projects to be selected, resourced, and
completed successfully. This drives motivation for future projects; hence improving the
organizational capability, which improves the future potential of the organization. The lowest
correlated success dimension of project governance is stakeholder satisfaction (adjusted R2 =
0.022; Beta 0.162**). The explanation for this is that not all of the stakeholders will personally
benefit from the projects nor will all of the stakeholders approve of the way projects are run,
which is in part impacted by the governance approach adopted and the acceptance of the
governance by the culture (governmentality) of the organization.
Figure 6-1: GOVorientation (shareholder-stakeholder) factor impact on the five dimensions of project
success
74
The summary of research findings is shown in Table 6-4.
75
6.5 Overarching analysis and discussion
This section compares findings from the analysis with the literature, and also includes the natural
science comparative to provide a different perspective or new insight. Figure 6-2 shows a
compilation of the key topics and results discussed in the individual papers for this overarching
analysis and discussion.
Note: the term methodology when used in the context of projects has been abbreviated to PMM
meaning project management methodology, and has the same meaning.
76
development environment, while replacing obsolete or superseded practices and tools (Durward
II, Jeffrey, & Allen, 1998). The literature does not discuss the dynamic nature of the elements of
a PMM, which implies that once a PMM is standardized or customized, it remains that way.
The qualitative study shows that several environmental factors impact the effectiveness of a
PMM and its elements. Each PMM element is potentially impacted due to the environment;
when this interaction and effect exists, it should be understood and acted upon by the project
manager. These findings are supported in the literature, which advocates the importance of
customizing the PMM to the project environment (Fitzgerald et al., 2002; Shenhar, Dvir, et al.,
2002).
The environmental factors impacting the effectiveness of a PMM in supporting project success
include project governance, a sponsor’s understanding of the need for a PMM, political senior
decision makers, culture, and pressure to reduce costs. The quantitative studies did not
differentiate between the elements of the PMM—all were grouped and positively correlated with
project success. The findings showed that applying the relevant PMM elements is linked to
project success. This implies that organizations that have incomplete PMMs are successfully
supplementing them with the missing PMM elements (by the project manager) to achieve the
desired project outcome—project success. This was also supported in the quantitative findings
however supplementing PMMs has a lower correlation to project success than PMMs that are
considered to be comprehensive. One of the project governance factors (GOVorientation) acts
as a quasi-moderator, which means that the effect on the relationship between PMM and success
was undeterminable. The other governance factor (GOVControl) has no moderation effect, but
it does impact directly the evolution of a PMM with consequences resulting in whether it is a
comprehensive or incomplete PMM. The effectiveness of the PMM will vary depending on the
organization’s unique set of influencing factors. Perhaps the success factor termed “experience
of using PMMs” should therefore be reworded to “the experience of applying effective PMMs,”
because a project manager who uses a PMM that does not take context into account the result
will likely not be effective.
The second PMM-related success factor is the “correct choice of project management
PMM/tool” (Fortune & White, 2006; Hyväri, 2006; Khang & Moe, 2008). This is an interesting
77
success factor, because it implies there is at least one methodology/tool within an organization.
What is unclear from the success factor description is whether the organization has made the
correct choice for the methodology/tool or whether it is up to the project manager to decide
depending on the type of project. The findings from the quantitative and qualitative studies show
that environmental factors, such as governance and culture, influence some of the attributes of a
PMM, for example, completeness. In the qualitative study, one of the interviewees stated that
“their PMM, which was specifically developed in-house, takes into account the company
culture.”
PMMs are contingent on context factors, two of which are governance and culture. Selecting the
correct PMM does not help achieve project success unless the project manager also has the
experience of applying a PMM. Both PMM success factors need to be present to achieve project
success; therefore, these factors should be integrated as one success factor and reworded as
follows: “experience in selecting and applying effective PMMs.”
78
changed elements are suboptimal when compared to the existing elements. Taking this
comparative to the project management world, project managers in an organization with a
comprehensive PMM could risk increased project failure when they change any of the proven
PMM elements. An organization using a PMM that needs to be supplemented is taking a risk by
relying on the project managers to do the right thing in knowing which elements, and with what
content, to supplement. This is reflected in the findings of the quantitative study, which showed
that supplementing a PMM gives a lower project success rate than using a comprehensive PMM
in the first place. These findings are supported by the study from (White & Fortune, 2002) on
current practices in project management where they reported that the 24% of the respondents
found frequent limitations of their project management PMM and 14% of these reported
“unexpected side effects” due to unawareness of the environment.
79
success factors associated with project methodologies were refined through discussion to
“experience in selecting and applying effective PMMs.” A PMM is an organizational asset, but
the value of the asset is dependent upon many factors. The maximum value of the asset (PMM)
is when the PMM supports the project managers of the organization to make the right decisions
in a timely manner, using an efficient and effective combination of processes, tools, techniques,
methods, capability profiles, and knowledge areas that give the highest likelihood of project
success. Anything less than this reduces the effectiveness of the PMM in supporting project
success.
In the natural science comparative, an organism is considered “fit” because of the applicability of
the genes expression of the organism has the best chances for reproduction compared to others
in the same evolving species in the given environment (Wright, 1932). Every organism in its
natural habitat is fine-tuned (adapted) to that environment (Dawkins, 1974). Organisms that are
low on the fitness landscape invariably become extinct, mainly due to their inability to adapt to a
changing environment. Examples include: the dodo, Tasmanian tiger, and the dinosaurs.
PMMs serve one purpose—to increase the chances of project success; when they are low on
their fitness landscape, for whatever reason, they will eventually be replaced in part or in whole
with another competing PMM. However, if the reasons are not understood as to why PMMs are
not achieving their maximum value, then the fate of the PMM successor is likely to be the same
as its predecessor.
In the main study, from the qualitative findings, all of the respondents mentioned at least one
environmental factor that influences the relationship between PMM and project success. The top
five factors raised were project governance, which was the most often cited, followed by four
factors that were equally raised: political senior management decisions, culture, resource
constraints, and pressure to reduce costs. In the quantitative study (study 3), one of two project
governance factors (GOVorientation, shareholder–stakeholder) was considered to be a quasi-
80
moderator, meaning the effect on the relationship between a PMM and project success was
undeterminable, but the other project governance dimension (GOVControl, behavior–outcome)
had an impact on the scope of the PMM in use by an organization.
The findings from the natural science comparative suggest that environmental factors greatly
influence the relationship between a PMM and project success. This is because on the genotype-
phenotype (natural science) side of the comparative, the environment greatly influences the
development of an organism. Some of the environmental influences can be seen in the
phenotype where the impacted genes (in the genotype) are highly pleiotropic—meaning the gene
is expressed in the phenotype (Guillaume & Otto, 2012). Whereas other environmental
influences may not be seen in the phenotype, these influences may still impact the organism but
in more subtle ways, such as the ability to ward off infections (Lewtas, Walsh, Williams, &
Dobiáš, 1997). This provides a perspective to answering the research question regarding whether
a relationship exists between the PMM’s elements and project success, and is it influenced by the
project context such as project governance.
The natural science comparative suggests that the PMM and its elements directly influence
project success; however, some of the PMM elements’ impact on the characteristics of project
success may not be observable (e.g., low pleiotropic PMM elements), but they are still important
in achieving overall project success. The project environment will have an impact on the
effectiveness of the PMM and its elements in achieving a successful project outcome.
In the first quantitative study (study 3), the moderating effect is undeterminable from the
regression analysis; however, when survey participants of study 2 were directly asked the
question “were the use of the PMM elements (including subelements) influenced by the project
governance structure,” 38% responded “some influence.” In the qualitative study findings,
several environmental factors were mentioned, which impact the relationship between PMM and
success. One explanation is that using different research paradigms and research methods can
provide different results; however, both the natural science comparative and the findings of the
qualitative study suggest that when governance is a major part of the environment, it has some
impact on the relationship between PMM and project success (see section 4.4.6 and Figure 4-6).
For the quantitative study findings, it may be that the impact of project governance is not
determinable or that the impact of project governance depends on some other context variables
or variables not assessed herein. An explanation for the quantitative finding in study 3, using the
natural science comparative is that the PMM elements that were impacted by project governance
81
only exhibit a low pleiotropic effect; therefore, the impact was not detected in the characteristics
of project success.
Looking now from a natural science perspective, understanding evolution has given us a picture
of how organisms have evolved and how they have adapted (or not) to the environment
(Dawkins, 1974). Also, the complexity of evolution in natural sciences is increasing (Adami,
Ofria, & Collier, 2000). This increasing complexity was understood by Lamarck (1838), who
believed the evolution of organisms was a one-way road which he called “complexity force” or in
French “Le pouvoir de la vie.” The topic of complexity is also one of the most discussed topics
in project management where the development of products or services is becoming ever more
complex (Vidal, Marle, & Bocquet, 2011). Perhaps one can hypothesize that it is also likely that
82
PMMs will need to become more robust to be able to manage increasingly complex projects,
which happens to be a common complaint by many practitioners of today’s PMMs (Fortune et
al., 2011; White & Fortune, 2002).
Without understanding the history of a PMM and the organizational needs it addresses, ill-
informed decision makers risk making PMM-related decisions that will negatively impact the
ability of a PMM to support the organization’s project needs.
This research endeavor mainly looked at project governance from a positive perspective. The
findings from study 4 ranged from positive to neutral (no-impact) depending on the governance
orientation. However, the qualitative study (study 2) shed light on the potentially negative aspects
of implemented governance structures. For example, some of the interviewees described
misfitting project governance structures that impacted the ability to follow procedures to obtain
resources, finalize requirements, test strategies, and provide quality assurance. The findings did
not go so far as to suggest actions to enhance the positive aspects and minimize the negative
aspects of project governance.
In summary, the finding showed project governance directly impacts PMM and project success
but has an indeterminate impact as a moderator on the relationship between PMM and project
83
success. Could this also be the case with the extant literature on the indirect impact of project
governance on project success?
Complexity is a topic that is often discussed in senior management circles within and outside of
the project environment (Hitt, 1998). The topic of complexity is especially pertinent to projects,
programs, operational systems, and processes (Boyle, Kumar, & Kumar, 2005; Joslin, 2013).
84
The findings from the interviews in the qualitative study show that project governance was the
most often-mentioned environmental factor impacting the effectiveness of the applied PMM.
Examples were given of misfitting project governance structures impacting the ability to follow
procedures to obtain resources, finalize requirements, test strategies, and quality assurance. The
interviewees did not go so far as to suggest actions to enhance the positive aspects and minimize
the negative aspects of the environmental governance factor, but success was contingent on
project governance.
In the quantitative study 3, governance was found to have a direct influence on whether an
organization has a comprehensive PMM or not, and whether the elements are supplemented or
not. The findings also showed that organizations with comprehensive PMMs have higher project
success rates than those that do not, so success is contingent on project governance. In addition,
project governance was a quasi-moderator, which suggests PMM and project success may be
contingent on project governance, but the results are indeterminate.
Fitzgerald, Russo, and Stolterman (2002) noted that the most successful PMMs are those
developed for the industries or organizations, which suggests contingency theory was a good
choice as the theoretical lens for this study.
Agency theory and stewardship theory were selected as the theoretical lens in the quantitative
study 4. Agency theory describes a relationship between two parties (the principal and the agent)
where both actors are perceived as rational economic actors that act in a self-interested manner
(Mitnick, 1973). Agency theory is particularly relevant in the field of project management as there
are many principle-agent relationships in a project supply chain. Stewardship theory is often
considered the contra of agency theory (L. Donaldson & Davis, 1991), and therefore is also
relevant to this study especially when considering projects that are developed within a
stakeholder-orientation governance paradigm.
Project managers (agents) are tasked with complex projects and need to get things done;
therefore, flexibility and trust is required from their principle (Turner & Müller, 2004). If trust is
present, this implies that project managers are acting in a stewardship role on behalf of their
85
principle (manager or project sponsor), which they (manager or project sponsor) should also be
acting as a steward on behalf of the stakeholders (including shareholders) of the organization.
The findings of the study show that stakeholder governance is significantly correlated to project
success; whereas the (behavior-outcome) control-oriented governance has no impact on project
success. This is aligned with stewardship theory. Out of the five success dimensions (project
efficiency, organizational benefits, project impact, future potential, and stakeholder satisfaction)
the lowest correlated success dimension to governance is stakeholder satisfaction. One
explanation for this is that not all of the stakeholders will personally benefit from the projects
nor will all of the stakeholders approve of the way projects are run, which is in part impacted by
the governance approach that is adopted. The findings could imply that principle-agent issues
exist that are impacted by the governance of the project when these agents do not personally
benefit during the life of the project and/or through the project outcome. This is especially true
when the project goals provide increased transparency and/or process and controls that reduces
the opportunity for personal gains.
From a natural science perspective, can agency theory or stewardship theory be explained by the
comparative? Agency theory suggests self-interest only, which fits the Darwinian laws of fitness
(Darwin, 1859). Dawkins (1974) would also agree with the concept of the selfish gene that
altruism does not exist in a natural world. Several studies also support this, which are based on
game theory including the prisoners’ dilemma, and show why two individuals might not
cooperate, even if it appears that it is in their best interests to do so (Nowak & Sigmund, 1993).
Is it possible then that stewardship theory has a place in natural science? Only if the organisms
live in a “social” society where social is defined in terms of the structure and order of the society
(Lin & Michener, 1972). If stewardship theory has a place in the natural science world, it would
be at the top level of social organisms are called “eusocial,” notably, bees, ants, and other colony-
oriented organisms (Kramer & Schaible, 2013). In this case, however, the greater good of the
colony is for the greater good of the individual organism passing on the collective genes of the
colony, which are all derived from the queen of the colony. It is up to the reader to debate if
there is really a place for stewardship theory in the natural world.
Agency theory and stewardship theory have helped to understand and interpret the findings of
the study and, while doing so, created new questions for further research (e.g., is stakeholder
satisfaction contingent on a stewardship orientation environment?).
86
6.5.13 Theory building
Theory building occurs in two stages: the descriptive stage and the normative stage. Within each
of these stages, theory builders proceed through three steps (Carlile & Christensen, 2005). Kuhn
(1970) observed that during descriptive theory building, confusion and contradiction were
typically the norm.
Figure 6-3: The three steps in descriptive theory and normative theory (Carlile & Christensen, 2005)
The natural science comparative follows the descriptive theory triangle in Figure 6-3, whereas the
main study followed the normative theory triangle. As the natural science comparative used the
same variable as the main study comparisons, that is, “methodology,” observations could be
made in one study and then determined whether the same phenomena can be seen and explained
in the other studies. The comparative analysis starts with a mapping of concepts and terminology
and, in doing so, explains why phenomena in genomics (study of genetics) can be compared with
practices, behaviors, and established thinking in project management. The natural science
comparative followed a deductive process working from the top of the pyramid to the bottom.
The main study was mostly deductive, except for the qualitative study with its interviews, which
were inductively analyzed. For both the qualitative and quantitative studies, the normative
pyramid was followed mainly from the top to the bottom.
These research findings have helped to quantify the impact of a PMM at the collective element
level, similar to the genes and the impact on an organism. Contingency theory has been used as
the theoretical lens that has been supported in the first three studies where environment has a
direct and indirect influence on the selection of a PMM, the evolution of a PMM, and the
influence on the relationship with project success. The natural science comparative indicated that
87
the elements of a PMM actually compete against each other to be selected within a PMM. A
practical example of this is the choice of similar tools, templates, techniques, and processes that
are available, and only the best one of each group will be selected. This competitive aspect of the
elements of a PMM was not part of the original scope in the main part of the research. Instead,
the first quantitative study results (study 3) showed that all of the relevant and applied PMM
elements are positively correlated to project success. This is consistent with the natural science
comparative where, once the elements are selected, they no longer compete; instead they work
together. This notion of competing PMM elements comes from the comparative and is
explained by the conception of an organism. During the conception period, the genes fight to be
selected (dominant) so once attached to the loci (DNA), from this point onwards, they work
together to the collective good of the organism (Mendel, 1866).
The comparative analysis also shows that all the elements of the PMM will be impacted from the
project environment, but not all of the impact will been seen as traits in project success. This is
because each element has a different pleiotropic level, meaning only the highly pleiotropic
elements are likely to be seen as an impact of the characteristics of project success, that is, in one
or more project success criteria. PMM elements that have a big impact on the likelihood of
project success are called success factor elements, for example, realistic schedule, efficient cost
control, and accurate budgeting.
Figure 6-4: Redrawn research model indicating the influence of project governance on the independent
and dependent variables
88
The research model for study 3, has been redrawn (see Figure 6-4) to include the direct
interaction of one of the governance factors (GOVControl) on two of the PMM factors (MF01
and MF02). The first factor, MF01, determines if the organization’s PMM is comprehensive in
terms of its elements. The second factor, MF02, determines whether the project manager
supplemented the organization’s PMM knowing that it is not comprehensive and/or felt some of
the personal PMM elements were better suited to the project at hand. GOVorientation
(shareholder–stakeholder) is a quasi-moderator, meaning it has an indeterminable effect on the
moderation of MF03 and project success.
The first quantitative study (study 3) also conducted exploratory research and showed that the
environment factor for governance, GOVControl (behavior–outcome), does influence whether
the PMM is comprehensive or not. Even though governance may not moderate the relationship
between PMM and success, it does directly influence the evolution of a PMM in terms of
whether it is comprehensive or not—that is, it does or does not need to be supplemented. The
qualitative study showed the importance of understanding the history of a PMM in terms of its
evolution, irrespective of whether a PMM evolved from a generic standard PMM into varying
levels of customization, or whether a PMM was developed in-house and evolved into varying
levels of customization.
The quantitative study 4, built on the findings (and questions) from quantitative study 3, was
conducted to understand if different governance orientations directly impact project success.
The theoretical lens used was both agency theory and stewardship theory, which are more
applicable than contingency theory, which was used in the first three studies. The findings of the
study 4 show that stakeholder governance is significantly correlated to project success whereas
the (behavior-outcome) control oriented governance has no impact on project success. This is
aligned with the concept of stewardship theory. Out of the five success dimensions (project
efficiency, organizational benefits, project impact, future potential, and stakeholder satisfaction),
the lowest correlated success dimension to governance is stakeholder satisfaction. One
explanation for this is that not all of the stakeholders will personally benefit from the projects.
The findings could imply that principle-agent issues exist that are impacted by the project and/or
project outcome. From a natural science perspective, agency theory suggests self-interest only,
which fits the Darwinian laws of fitness (Darwin, 1859). Dawkins (1974) would also agree with
his concept of the selfish gene that altruism does not exist in a natural world, supporting the
concept of agency theory. Stewardship theory, on the other hand, was found to have little or no
place in natural science. If stewardship theory does apply it is only if the organisms live in a
social society where “social” refers to the structure and order of the society (Avilés & Purcell,
89
2012). Even then, if stewardship theory were to explain natural science phenomena, it would
have to be at the top level of social organisms which are called “eusocial,” notably, bees, ants,
and other colony-oriented organisms (Linksvayer, 2010). So would organisms choose the greater
good of the colony over personal gain? Yes, but only because the individual organisms ensure
the passing of the collective genes of the colony (which are all derived from the queen of the
colony), therefore implying some form of self-interest.
In summary, this chapter detailed the constructs for three variables: project success, PMM, and
project governance. The hypotheses were described with supporting literature, and the prestudy
and main study were brought together to provide alternative perspectives, challenges, and
questions to the observed phenomena coming out of the other three studies.
The next chapter concludes the thesis, shows the contributions to both the academic and
management communities, and provides suggestions for future research.
90
Chapter 7. Conclusions
This chapter concludes and closes the thesis with areas for future research. A summary of the research process,
overview of the findings, and revelation of whether the objectives of the research were met, are followed by answers to
the research question. The strengths and limitations of the study are highlighted. The theoretical and practical
contributions of the research are listed, concluding with recommendations for future research.
For the prestudy, once the philosophical perspective was clarified, the foundations of the
comparative were defined, and a literature review was carried out on the foundation of the
comparative (Universal Darwinism), which was then extended to areas in biology, more
specifically genomics, where the characteristics of a PMM and project outcome were mapped.
The results of the comparative analysis were written into a book chapter (Joslin & Müller, 2013);
then a theory-building section and detailed comparative literature were added, which were
presented at the EURAM conference (Joslin & Müller, 2014a); and subsequently the comparative
was reworked substantially and submitted to the Project Management Journal (PMJ). Only the
research paper is included in Part II of this thesis.
For the main study, the research was executed through three stages using mixed methods. The
first stage was a qualitative study where 19 semistructured interviews were conducted. The
interviewees were project, program, and senior IT managers from seven industries across four
countries: Switzerland, Germany, UK, and the USA, who all have detailed knowledge of their
organization’s PMM(s). The aims of the study were to qualitatively validate the constructs of the
research model, gain agreement in the use of the term PMM elements, and gain additional insights,
91
such as the importance of understanding the PMM source and level of customization. The
guidelines of Miles and Hubermann (1994) were followed during the research. The results were
written into a research paper that was presented at the PMI Research & Education Conference
in Portland, Oregon (Joslin & Müller, 2014b), then improved and subsequently submitted to the
International Journal of Managing Projects in Business (IJMPB). Only the research paper submitted to
IJMPB is included in Part II of this thesis.
The second stage of the main study was the quantitative study. A web-based questionnaire was
developed to collect information on methodologies, project success, and governance paradigms.
The scales for project success were taken from Khan, Turner, and Maqsood (2013), and the
scales for governance came from Müller and Lecoeuvre (2014). The PMM scales were based on
the data collected in the qualitative study, and factor analysis was used to determine the internal
consistency of the scales. The process to carry out the data analysis followed the guidelines of
Hair et al. (2010). The results were written into a research paper and submitted to IJPM. This
paper is included in Part II of this thesis.
The third stage of the main study was also a quantitative study and utilized the data, scales, and
some of the open questions from the first quantitative study. Analysis was done through factor
and linear regression analyses. The process to carry out the data analysis followed the guidelines
of Hair et al. (2010). The results were written into a research paper and submitted to IJPM. This
paper is included in Part II of this thesis.
92
comparative spans the natural and social sciences and functions at both the suborganism level
(genes) and the organism level (phenotype). Likely, so does CAS. To help with the explanations,
the PMM was reified to what it would be like if the elements of a PMM were competing to be
selected for a project. With the comparative built, three scenarios were described and explained
using the model: selfish projects, lessons intentionally not learned, and competing PMMs with
the bricolage of individual elements through use and copy across PMMs.
This paper was presented in June 2014 at EURAM in Valencia, Spain; then it was improved and
subsequently submitted to and accepted by the PMI’s Project Management Journal for the January
2015 publication.
The second paper (Joslin & Müller, 2014b), describes the findings of the qualitative study. The
paper establishes that there is a positive relationship between the elements of a PMM and project
success, and that the effectiveness of the PMM varies according to environmental factors. A
number of environmental factors were mentioned with governance being the most often cited.
From the interviews, it was evident of the importance in understanding the origin of a PMM.
Just knowing if the incumbent PMM is standardized or customized is not sufficient because a
PMM could be generic thus standardized; or generic then customized, thus standardized; or
customized, thus standardized. These steps also help to understand the evolution of the PMM in
the organization and what is meant by standardized or customized. This paper was presented at
PMI’s Research Conference in Portland, Oregon, in July 2014, improved and subsequently
submitted to the International Journal of Managing Projects in Business (IJMPB).
The third paper (Joslin & Muller, 2014c) discusses the finding of the first quantitative study. A
new PMM scale was created using three factors; and all three factors were positively corrected to
project success. Project governance as a moderator was represented by two factors: shareholder–
stakeholder and behavior–outcome. Shareholder–stakeholder was found to be a quasi-moderator
on one of the three independent factors: MF03 (applying relevant PMM elements). The second
project governance factor, behavior–outcome, was not a moderator but an exogenous,
predicator, intervening, antecedent, or suppressor variable (Sharma et al., 1981). The behavior–
outcome project governance factor was regressed directly against the three independent factors,
and findings showed that outcome-oriented organizations are more likely to supplement missing
PMM elements, as required, than those that are more compliance-oriented and have had a
complete PMM from the outset. Project governance may have an indeterminable effect when a
PMM is applied, but before a PMM is applied, project governance impacts the selection of the
93
PMM and whether it is comprehensive or needs to be supplemented by the project manager
during a project life cycle.
The results were written into a research paper and submitted to IJPM.
The fourth paper (Joslin & Muller, 2014d) discusses the finding of the second quantitative study,
which utilized the data, scales, and some of the open questions from the first quantitative study.
This study explores the impact of project governance on project success. The findings show that
a stakeholder-oriented project governance accounts for 6.3% of the variation in project success,
and that project governance structures that are more control behavior-outcome orientation have
no impact on project success.
The results were written into a research paper and submitted to IJPM.
94
7.1.2 Hypothesis testing
There were three main hypotheses and eight subhypotheses in this research endeavor.
For the first hypothesis H1, there is a positive relationship between a PMM and project success.
The research showed that 22.3% of the variation of project success is accounted for by the
correct application of a PMM with a significance of (p ≤ 0.005).
The subhypotheses:
H1.1 There is a positive relationship between a comprehensive set of PMM elements and
project success—was supported. Additional analysis showed that PMMs that are
comprehensive have higher success rates than PMMs that need to be supplemented. This
implies that organizations with comprehensive PMMs invest in updating their PMMs
through lessons learned and/or new PMM elements that are more appropriate than the ones
they replace.
H1.2 There is a positive relationship between supplementing missing PMM elements and
project success (MF02)—was supported. Incomplete PMMs create a risk that, unless
supplemented, will negatively impact project success. Organizations with incomplete PMMs
would have to rely on the experience of their project managers to determine how, what, and
when to supplement so as to ensure a well-executed and successful project.
H1.3 There is a positive relationship between applying relevant PMM elements (MF03) and
project success—was supported. Having a comprehensive PMM and supplementing a PMM
when PMM elements are missing is important; however, unless the PMM elements are
relevant to the particular project and applied in an effective way, the chances of process
success are reduced. The Pearson correlation of MF03 to project success shows the highest
correlation (0.385) compared to MF01 (0.196) and MF02 (0.168) which confirms its
importance as a key project success factor.
For the second hypothesis H2, the relationship between PMM and project success moderated by
project governance, was partly supported.
The subhypotheses:
H2.1: The impact of a comprehensive set of PMM elements on project success is moderated
by project governance—was not supported. Having a comprehensive model is of little value
until it is applied on a project; therefore, governance would not play a part in impacting the
relationship between PMM and project success until the PMM is applied. So the findings are
95
logical. This does raise the question as to whether governance directly impacts the selection
and evolution of a PMM, which is answered in the discussion section (see section 6.5.8).
H2.2: The impact of supplementing missing PMM elements on project success is moderated
by project governance—was not supported. The comments for H2.1 also apply to H2.2.
H2.3: The impact of application of relevant PMM elements on project success is moderated
by project governance—was partly supported. One of the two moderating factors
GOVorientation (shareholder–stakeholder) was observed to be acting as a quasi-moderator
and not a full moderator. The second proposed moderator, GOVControl (behavior–
outcome), was not a moderator but possibly an exogenous, predicator, intervening,
antecedent, or a suppressor variable (Sharma et al., 1981). Therefore, hypothesis 2 is only
partly supported.
For the third hypothesis H3, there is a positive relationship between project governance and
project success, was supported.
96
7.1.3 Answers to research questions
There were two core research questions: one relating to the prestudy and the second to the main
part of the research. The research questions have already been summarized in the research
findings and as a consequence of the research papers. The following are answers to the research
questions.
Prestudy
The prestudy (study 1) research question was formulated as follows:
How can a natural science perspective be used in understanding social science phenomena where methodology is the
social science phenomena under observation?
Main study
For the main research, the core research question was formulated as follows:
What is the nature of the relationship between the PMM including its elements and project success, and is this
relationship influenced by the project environment, notably project governance?
The findings of the qualitative and quantitative studies showed a positive relationship between
PMM and its elements and project success. The qualitative study findings also found a link where
project context influences the relationship between PMM and success; whereas a number of
context factors were given, for example, project governance, senior management politics, culture,
and budget cuts. Project governance was the most frequently mentioned context factor.
The second part of the mixed-methods quantitative study (study 3) refined the research question
into:
What is the nature of the relationship between the PMM’s elements and project success, and is this relationship
influenced by project governance?
PMM elements have a positive relationship with project success, but only one of the two
governance factors, GOVorientation (shareholder–stakeholder) showed a quasi-moderating
effect, which according to Sharma et la (1981) is indeterminable. The second governance factor
97
GOVControl (behavior–outcome) is not a moderator but possibly an exogenous, predicator,
intervening, antecedent, or a suppressor variable.
In summary, the findings from the three studies show that a PMM should be seen not as a
homogeneous entity, but as a living and evolving heterogeneous set of elements (processes,
tools, techniques, capability profiles, methods, and knowledge areas) that are heavily influenced
by the environment. Environmental influences impact not just the appropriateness of the PMM
elements for any given project, but also the original PMM selection process in terms of the type
of PMM selected and how the PMM evolved in terms of the characteristics of the PMM
(comprehensiveness). Organizations that take a holistic view into understanding the factors
influencing the PMM selection, PMM evolution, and PMM appropriateness (including the
elements) for any given project are likely to see improved project success rates with the added
benefit of likely reduced complaints about the inappropriateness of a PMM.
The third part of main study the mixed method quantitative research (study 4) looks at the
impact of project governance on PMM and project success. The following research questions are
asked:
Behavior-outcome oriented governance has a direct significant impact on two of the three
interdependent PMM factors (MF01 and MF02), which shows that governance does influence, in
some way, the selection and evolution of a PMM and also shows whether the PMM is
comprehensive or not. Organizations that are more outcome-oriented have incomplete PMMs
whereas behavior-oriented organizations have more comprehensive PMMs.
Stakeholder-oriented project governance structures accounts for 6.3% of the variation in project
success, so stakeholder-oriented governance is correlated to project success. However, for
organizations having project governance structures that are more behavior-outcome oriented,
their project governance structures have no impact on project success.
Agency theory and stewardship theory help to explain governance-based phenomena directly
relating to PMMs and project success.
98
Governance plays a quasi-moderating effect on the applied PMM and directly impacts the
establishment of the PMM and how it evolves to be comprehensive and/or need to be
supplemented before project use.
The natural science comparative suggests that there may be other types of moderators that
influence the relationship between PMM and project success, therefore indicating the need for
further research.
Project governance directly impacts project success when the governance approach is more
stakeholder-oriented, reflecting the importance of governmentality.
Organizations that are more focused on shareholders than stakeholders have a lower probability
of project success; therefore, a project portfolio manager who knows his/her organization’s
governance paradigm and the implications on current and future projects may help influence,
shift, or create local project governance paradigms that are more conducive to success.
Organizations that are more outcome-oriented supplement their PMM more than organizations
that are more process/compliance-oriented; where the latter organizations are more likely to
have a comprehensive PMM than the former organizations. The organizations controlled by
outcomes expect the project manager to perform and supplement the PMM as necessary so as to
meet the goal of shareholder value. These organizations should only recruit senior project
managers who have the experience to determine what to supplement in a PMM in order to
achieve project success.
Organizations that have a more comprehensive PMM also need experienced project managers to
ensure the achievement of high success rates. By understanding the governance paradigm and
the state of the evolution of the organization’s PMM, a program or project portfolio manager
will have a good indication of the project management skills and, especially, the experience
necessary for a successful project outcome.
99
When project success rates are dropping and lessons learned indicate a misfitting PMM,
understanding the governance paradigms and the risks associated with the evolution of PMMs
within each governance paradigm may provide valuable information as to the root cause of the
problems.
Organizations that enforce a strict governance approach for process compliance reduce the
opportunity for maximizing their organization’s chances of project success, unlike organizations
that implement a stakeholder-oriented project governance, which is correlated to project success.
To the best of the author’s knowledge, this is the first study to quantitatively assess the
contribution of PMM usage to project success.
A limitation of this study was the questionnaire distribution method where snowball-and-
convenience sampling does not allow for questionnaire distribution by industry, project type, or
geography. Using professional associations such as IPMA and PMI for distribution of the
questionnaire may also exclude project managers and other applicable respondents who are not
part of these professional associations. Other limitations are: the inconclusive findings on the
role of governance as a moderator or quasi-moderator; and that the natural science comparative
has not been tested outside of this study.
Viewing a PMM in terms of elements that may exist within a hierarchy may be a strength or a
weakness. The strength of the approach is that it allows comparisons to be made using the
natural science comparative as well as the concept of elements exhibiting individual and
collective group effects on the characteristics of project success. Also by using the term elements, a
more neutral feeling is allowed from the perspective of the project management, whether
elements are kept or replaced with something that is more appropriate for the project at hand.
The limitation of this approach is that it requires a project manager or reader to shift his/her
view of PMMs from a homogeneous entity to something that is a heterogeneous collection of
elements.
100
7.3 Recommendations for future research
7.3.1 Natural science comparative
One recommendation for future research is to apply the comparative model in existing research
areas in order to understand how it performs in terms of supporting current findings, challenging
current findings, and discovering new findings. It would also be important to understand the
limitations and strengths of the comparative model.
Another recommendation is to extend the comparative model along the attribute dimensions to
allow a broader scope of applicability. For example, the attribute dimension “collaborate” can be
extended to include social organisms (Danforth, 2002; Simon, 1960), which will provide insights
into understanding why independent projects in a project portfolio may be at greater risk of
being canceled or put on hold than linked or related projects.
Another angle for research is to focus on one PMM element, such as a process or a tool, and
then develop a subelement structure and determine the impact of the governance paradigms on
this element and its related subelements.
In summary, the findings from the three studies show that a PMM should be not seen as a
homogeneous entity but as a living and evolving heterogeneous set of elements (processes, tools,
techniques, capability profiles, methods, and knowledge areas) that are heavily influenced by their
environment. Environmental influences impact not just the appropriateness of the PMM
elements for any given project, but also the original PMM selection process in terms of the type
of PMM selected and how the PMM evolves in terms of the characteristics of the PMM
(comprehensiveness). Organizations that take a holistic view of understanding the factors
influencing PMM selection, evolution, and appropriateness (including the elements) for any
given project are likely to see improved process success rates with the added benefit of reduced
complaints about the inappropriateness of a PMM. This is more likely when the organization
101
selects a project governance structure that is more stakeholder-oriented. The findings from the
fourth study show how project governance has a direct impact on both the PMM and project
success.
This study’s contribution to knowledge is a new comparative that allows project management to
be seen in a different perspective. PMMs should be seen as dynamic sets of elements that are
influenced throughout their “PMM” lives; and when understood by organizations, these
elements can help them to be more effective in supporting projects and hence positively impact
process success. Project governance can take a different orientation where the control (behavior-
outcome) orientation has a direct impact on whether a PMM is comprehensive or needs
supplementing and whether the corporate (shareholder-stakeholder) orientation directly impacts
project success.
102
Chapter 8. References
Aaltonen, K., & Sivonen, R. (2009). Response strategies to stakeholder pressures in global
projects. International Journal of Project Management, 27(2), 131–141.
Abednego, M. P., & Ogunlana, S. O. (2006). Good project governance for proper risk
allocation in public-private partnerships in Indonesia. International Journal of Project
Management, 24(7), 622–634.
Adami, C., Ofria, C., & Collier, T. (2000). Evolution of biological complexity. In
Proceedings of the National Academy of Sciences, 97, 4463–4468).
Alvesson, M., & Sköldberg, K. (2009). Reflexive Methodology: New Vistas for Qualitative
Research (2nd ed.). London: SAGE Publications, Ltd.
Atkinson, R. (1999). Project management: Cost, time and quality, two best guesses and a
phenomenon, it’s time to accept other success criteria. International Journal of Project
Management, 17(6), 337–342.
Aubry, M., Müller, R., Hobbs, B., & Blomquist, T. (2010). Project management offices in
transition. International Journal of Project Management, 28(8), 766–778.
Avilés, L., & Purcell, J. (2012). The evolution of inbred social systems in spiders and other
organisms: From short-term gains to long-term evolutionary dead ends? In H. J.
Brockmann, T. J. Roper, M. Naguib, J. C. Mitani, & L. W. Simmons (Eds.), Advances in
the Study of Behavior (Vol 44, pp. 99–133). Burlington, MA: Academic Press.
Belassi, W., & Tukel, O. I. (1996). A new framework for determining critical success/failure
factors in projects. International Journal of Project Management, 14(3), 141–151.
103
Benyus, J. M. (1997). Biomimicry: Innovation Inspired by Nature. Innovation. New York:
Harper Collins.
Biedenbach, T., & Müller, R. (2011). Paradigms in project management research: Examples
from 15 years of IRNOP conferences. International Journal of Managing Projects in
Business, 4(1), 82–104.
Biesenthal, C., & Wilden, R. (2014). Multi-level project governance: Trends and
opportunities. International Journal of Project Management, 32(8), 1291–1309.
Blake, S. (1978). Managing for Responsive Research and Development. San Francisco, CA:
WH Freeman & Co.
Bloch, M., Blumberg, S., & Laartz, J. (2012). Delivering large-scale IT projects on time, on
budget, and on value. Harvard Business Review. Retrieved from
http://www.mckinsey.com/insights/business_technology/delivering_large-
scale_it_projects_on_time_on_budget_and_on_value Projects.pdf
Boehm, B., & Turner, R. (2004). Balancing agility and discipline: Evaluating and integrating
agile and plan-driven methods. In Proceedings of the 26th International Conference on
Software Engineering, May 23-28, Edinburgh, Scotland.
Boyle, T. A., Kumar, U., & Kumar, V. (2005). Organizational contextual determinants of
cross-functional NPD team support. Team Performance Management, 11(1/2), 27–39.
Bredin, K., & Söderlund, J. (2013). Project managers and career models: An exploratory
comparative study. International Journal of Project Management, 31(6), 889–902.
Brown, A., Wiele, T. Van Der, & Loughton, K. (1998). Smaller enterprises’ experiences with
ISO 9000. International Journal of Quality & Reliability Management, 15(3), 273–285.
Brown, S., & Eisenhardt, K. M. (1997). The art of continuous change: Linking complexity
theory and time-paced evolution in relentlessly shifting organizations. Administrative
Science Quarterly, 42(1), 1–34.
Bryde, D. J. (2005). Methods for managing different perspectives of project success. British
Journal of Management, 16(2), 119–131.
Bunge, M. (1996). The seven pillars of Popper’s social philosophy. Philosophy of the Social
Sciences, 26(4), 528–556.
Burns, T., & Stalker, G. (1961). The Management of Innovation. University of Illinois at
Urbana-Champaign’s Academy for Entrepreneurial Leadership Historical Research
Reference in Entrepreneurship. London: Tavistock.
Burrell, G., & Morgan, G. (1979). Sociological Paradigms and Organisational Analysis.
London: Heinemann.
104
Carlile, P., & Christensen, C. (2005). The Cycles of Theory Building in Management
Research (No. 05-057). Boston, MA.
Cicmil, S., & Hodgson, D. (2006). New possibilities for project management theory: A
critical engagement. Project Management Journal, 37(3), 111–122.
Clarke, A. (1999). A practical use of key success factors to improve the effectiveness of
project management. International Journal of Project Management, 17(3), 139–145.
Clarke, T. (1998). The stakeholder corporation: A business philosophy for the information
age. Long Range Planning, 31(2), 182–194.
Clegg, S. R., & Pitsis, T. S. (2002). Governmentality matters: Designing an alliance culture
of inter-organizational collaboration for managing projects. Organization Studies, 23(3),
317–337.
Cooper. (1999). The invisible success factors in product innovation. Journal of Product
Innovation Management, 16(2), 115–133.
Crawford, L., & Pollack, J. (2007). How generic are project management knowledge and
practice? Project Management Journal, 38(1), 87–97.
Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika,
16(3), 297–333.
Csete, M. E., & Doyle, J. C. (2002). Reverse engineering of biological complexity. Science,
295(5560), 1664–1669.
Curlee, W. (2008). Modern virtual project management: The effects of a centralized and
decentralized project management office. Project Management Journal,
39(Supplement), S83–S96.
105
Daniel, D. R. (1961). Mangement information crisis. Harvard Business Review, 39(5), 111–
121.
Davis, J. H., Schoorman, F. D., & Donaldson, L. (1997a). Davis, Schoorman, and Donaldson
Reply: The distinctiveness of agency theory and stewardship theory. Academy of
Management Review, 22(3), 611–613.
Davis, J. H., Schoorman, F. D., & Donaldson, L. (1997b). Towards a stewardship theory of
management. Academy of Management Review, 22(1), 20–47.
Dawkins, R. (1974). The Selfish Gene (30th ed.). Oxford, England: Oxford University Press.
Dennett, D. C. (1996). Darwin’s Dangerous Idea: Evolution and the Meaning of Life. New
York: Simon & Schuster.
Denzin, N. K., & Lincoln, Y. S. (2000). The discipline and practice of qualitative research. In
N. K. Denzin & Y. S. Lincoln (Eds.), The SAGE Handbook of Qualitative Research (3rd
ed., pp. 1–44). Thousand Oaks, CA: SAGE Publications Inc.
Diallo, A., & Thuillier, D. (2004). The success dimensions of international development
projects: The perceptions of African project coordinators. International Journal of
Project Management, 22(1), 19–31.
Dinsmore, P. C., & Rocha, L. (2012). Enterprise Project Governance: A Guide to the
Successful Management of Projects Across the Organization. Enterprise Project
Governance. New York: AMACOM Books.
Donaldson, L. (1987). Strategy and structural adjustment to regain fit and performance: In
defence of contingency theory. Journal of Management Studies, 24(1), 1–24.
Donaldson, L., & Davis, J. H. (1991). Stewardship theory or agency theory: CEO governance
and shareholder returns. Australian Journal of Management, 16(1), 49–65.
Donaldson, T., & Preston, L. E. (1995). The stakeholder theory of the corporation: Concepts,
evidence, and implications. The Academy of Management Review, 20(1), 65–91.
Dougherty, M. J. (1998). Is the human race evolving or deevolving? Retrieved October 28,
2014, from http://www.scientificamerican.com/article/is-the-human-race-evolvin/
106
Drouin, N., Müller, R., & Sankaran, S. (2013). Novel Approaches to Organizational Project
Management Research. (R. Müller, N. Drouin, & S. Sankaran, Eds.). Frederiksberg,
Denmark: Copenhagen Business School Press.
Durward II, K., Jeffrey, K., & Allen, C. (1998). Another look at how Toyota integrates
product development. Harvard Business Review, 76(2), 36–47.
Easterby-Smith, M., Thorpe, R., & Jackson, P. (2008). Management Research: Theory and
Practice (3rd ed.). London: SAGE Publications.
Easton, G. (2010). Critical realism in case study research. Industrial Marketing Management,
39(1), 118–128.
Ericsson. (2013). PROPS Manual for Project Managers. Stockholm, Sweden: Ericsson.
Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). Thousand Oaks, CA: SAGE
Publications.
Fitzgerald, B., Russo, N., & Stolterman, E. (2002). Information Systems Development:
Methods in Action. Berkshire, England: McGraw Hill Education.
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003). Megaprojects and Risk: An
Anatomy of Ambition. Cambridge, England: Cambridge University Press.
Fortune, J., & White, D. (2006). Framing of project critical success factors by a systems
model. International Journal of Project Management, 24(1), 53–65.
Fortune, J., White, D., Judgev, K., & Walker, D. (2011). Looking again at current practice in
project management. International Journal of Managing Projects in Business, 4(4),
553–572.
Foucault, M. (1979). Governmentality. In Discipline and Punish: The Birth of the Prison.
New York: Vintage.
107
Freeman, M., & Beale, P. (1992). Measuring project success. Project Management Journal,
23(1), 8–17.
Gittleman, J., & Luh, H. (1992). On comparing comparative methods. Annual Review of
Ecology and Systematics, 23, 383–404.
GAO (Government Accountability Office). (2013). HUD Needs to Improve Key Project
Management Practices for Its Modernization Efforts, GAO-13-455, June 12, 2013.
Report to Congressional Committees. Washington, DC.
Guillaume, F., & Otto, S. P. (2012). Gene functional trade-offs and the evolution of
pleiotropy. Genetics, 192(4), 1389–409.
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis (7th ed.).
Upper Saddle River, NJ: Prentice Hall Inc.
Hanisch, B., & Wald, A. (2012). A bibliometric view on the use of contingency theory in
project management research. Project Management Journal, 43(3), 4–23.
Harrington, H., Voehl, F., Zlotin, B., & Zusman, A. (2012). The directed evolution
methodology: A collection of tools, software and methods for creating systemic change.
The TQM Journal, 24(4), 204–217.
Hart, O. (1995). Corporate governance: Some theory and implications. The Economic
Journal, 105(430), 678–689.
Harvey, P., & Pagel, M. (1998). The Comparative Method in Evolutionary Biology. Journal
of Classification. Oxford, England: Oxford University Press.
Hempel, C. (1965). Aspects of Scientific Explanation and Other Essays in the Philosophy of
Science. London: The Free Press.
Hirschey, M., Kose, J., & Anil, M. (Eds.). (2009). Corporate Governance and Firm
Performance: Volume 6. Bingley, UK: JAI Press.
Hitt, M. (1998). Twenty-first-century organizations: Business firms, business schools, and the
academy. Academy of Management Review, 23(2), 218–224.
108
Hobbs, B., Aubry, M., & Thuillier, D. (2008). The project management office as an
organisational innovation. International Journal of Project Management, 26(5), 547–
555.
Hoegl, M., & Gemünden, H. G. (2001). Teamwork quality and the success of innovative
projects: A theoretical concept and empirical evidence. Organization Science, 12(4),
435–449.
Holland, J. (2012). Signals and Boundaries: Building Blocks for Complex Adaptive Systems.
Cambridge, MA: MIT Press.
Hunt, S. D. (1990). Truth in Marketing Theory and Research. Journal of Marketing, 54(3), 1–
15.
Jaenisch, R., & Bird, A. (2003). Epigenetic regulation of gene expression: How the genome
integrates intrinsic and environmental signals. Nature Genetics, 33(Suppl.), 245–254.
Jensen, M., & Meckling, W. (1976). Theory of the firm: Managerial behavior, agency costs,
and ownership structure. Journal of Financial Economics, 3(4), 305–360.
Jessen, S. A., & Andersen, E. (2000). Project evaluation scheme: A tool for evaluating
project status and predicting project results. Project Management Journal, 6(1), 61–67.
John, K., & Senbet, L. (1998). Corporate governance and board effectiveness. Journal of
Banking & Finance, 22(4), 371–403.
Joslin, R. (2013). The impact of new societal structures on project manager competencies and
implication for project methodologies tools and techniques (PMTT ). In IPMA Expert
Seminar, Zurich (pp. 1–17).
Joslin, R., & Müller, R. (2013). A natural science comparative to develop new insights for
project management research. In N. Drouin, R. Müller, & S. Sankaran (Eds.), Novel
Approaches to Organizational Project Management Research: Translational and
Transformational (pp. 320–345). Frederiksberg, Denmark: Copenhagen Business School
Press.
Joslin, R., & Müller, R. (2014a). New Insights into Project Management Research : A Natural
Sciences Comparative. In EURAM 14th Annual Conference (pp. 1–41). Valencia, Spain.
Joslin, R., & Müller, R. (2014b). The impact of project methodologies on project success in
different contexts. In PMI Research and Education Conference, July 28-29, 2014 (pp.
1–29). Portland, OR: Project Management Institute.
109
Joslin, R., & Müller, R. (2014c). The impact of project methodologies on project success in
different project environments. International Journal of Managing Projects in Business,
In Review.
Judgev, K., & Müller, R. (2005). A retrospective look at our evolving understanding of
project success. Project Management Journal, 36(4), 19–31.
Judgev, K., Thomas, J., & Delisle, C. L. (2001). Rethinking project management: Old truths
and new insights. International Project Management Journal, 7(1), 36–43.
Khan, K., Turner, J. R., & Maqsood, T. (2013). Factors that influence the success of public
sector projects in Pakistan. In Proceedings of IRNOP 2013 Conference, June 17-19,
2013. Oslo, Norway: BI Norwegian Business School.
Khang, D., & Moe, T. (2008). Success criteria and factors for international development
projects. Project Management Journal, 39(1), 72–84.
Klakegg, O. J., Williams, T., & Magnussen, O. M. (2009). Governance frameworks for
public project development and estimation. Project Management Journal, 39(1), 27-42.
Kramer, B. H., & Schaible, R. (2013). Life span evolution in eusocial workers—A theoretical
approach to understanding the effects of extrinsic mortality in a hierarchical system.
PloS One, 8(4), e61813.
Krieger, S. (1971). Prospects for communication policy. Policy Sciences, 3(2), 305–319.
Kuhn, T. (1970). The Structure of Scientific Revolutions (2nd ed., Vol. 2). Chicago: The
University of Chicago Press.
Lamarck, J. B. P. A. (1838). Histoire naturelle des animaux sans vertäbres. Histoire (Vol. V,
pp. 1–232). Paris: J.B. Bailliäre.
Lawrence, P., Lorsch, J., & Garrison, J. (1967). Organization and environment: Managing
differentiation and integration. Administrative Science Quarterly, 12(1), 1–47.
Lehtonen, P., & Martinsuo, M. (2006). Three ways to fail in project management: The role of
project management methodology. Project Perspectives, XXVIII(1), 6–11.
Lewtas, J., Walsh, D., Williams, R., & Dobiáš, L. (1997). Air pollution exposure–DNA
adduct dosimetry in humans and rodents: Evidence for non-linearity at high doses.
110
Mutation Research/Fundamental and Molecular Mechanisms of Mutagenesis, 378(1-2),
51–63.
Lin, N., & Michener, C. (1972). Evolution of sociality in insects. Quarterly Review of
Biology, 47(2), 131–159.
Martins, E. P., & Garland, T. (1991). Phylgentic analyses of the correlated evolution of
continuous characters–A simulation study. Evolution, 45(3), 534–557.
Maylor, H., Brady, T., Cooke-Davies, T. J., & Hodgson, D. (2006). From projectification to
programmification. International Journal of Project Management, 24(8), 663–674.
McHugh, O., & Hogan, M. (2011). Investigating the rationale for adopting an internationally-
recognised project management methodology in Ireland: The view of the project
manager. International Journal of Project Management, 29(5), 637–646.
McManus, J., & Wood-Harper, T. (2008). A Study in Project Failure. Retrieved August 10,
2013, from http://www.bcs.org/content/ConWebDoc/19584
McShea, D. (1991). Complexity and evolution: What everybody knows. Biology and
Philosophy, 6(3), 303–324.
Miles, M., & Huberman, A. (1994). Qualitative Data Analysis: An Expanded Sourcebook
(2nd ed.). Thousand Oaks, CA: SAGE Publications Inc. USA.
Miles, R. E., & Snow, C. C. (1978). Organizational strategy, structure, and process. Academy
of Management, 3(3), 546–562.
Miles, R. E., Snow, C. C., Mathews, J., & Miles, G. (1997). Organizing in the knowledge
age: Anticipating the cellular form. The Academy of Management Executive, 11(4), 7–
20.
Miller, R., & Hobbs, B. (2005). Governance regimes for large complex projects. Project
Management Journal, 36(3), 42–50.
Millstein, I., & MacAvoy, P. (1998). The active board of directors and performance of the
large publicly traded corporation. Columbia Law Review, 98(5), 1283–1322.
Milosevic, D., & Patanakul, P. (2005). Standardized project management may increase
development projects success. International Journal of Project Management, 23(3),
181–192.
111
Mir, F. A., & Pinnington, A. H. (2014). Exploring the value of project management: Linking
project management performance and project success. International Journal of Project
Management, 32(2), 202–217.
Mitnick, B. M. (1973). Fiduciary rationality and public policy: The theory of agency and
some consequences. In Annual General Meeting of the Americian Political Science
Association. New Orleans, LA: American Political Science Association.
Morris, P. W., Crawford, L., Hodgson, D., Shepherd, M. M., & Thomas, J. (2006). Exploring
the role of formal bodies of knowledge in defining a profession—The case of project
management. International Journal of Project Management, 24(8), 710–721.
Morris, P. W., & Hough, G. (1987). The Anatomy of Major Projects: A Study of the Reality of
Project Management. New York: Wiley & Sons Inc.
Müller, R., Andersen, E. S., Kvalnes, Ø., Shao, J., Sankaran, S., Turner, J. R., Biesenthal, D.,
Walker, D. H. T., & Gudergan, S. (2013). The interrelationship of governance, trust, and
ethics in temporary organizations. Project Management Journal, 44(4), 26–44.
Müller, R., & Judgev, K. (2012). Critical success factors in projects: Pinto, Slevin, and
Prescott—The elucidation of project success. International Journal of Managing
Projects in Business, 5(4), 757–775.
Müller, R., Pemsel, S., & Shao, J. (2014a). Organizational enablers for governance and
governmentality of projects: A literature review. International Journal of Project
Management, 32(8), 1309–1320.
Müller, R., Pemsel, S., & Shao, J. (2014b). Organizational enablers for project governance
and governmentality in project-based organizations. International Journal of Project
Management, In press.
Müller, R., & Turner, J. R. (2007a). Matching the project manager’s leadership style to
project type. International Journal of Project Management, 25(1), 21–32.
112
Müller, R., & Turner, J. R. (2007b). The influence of project managers on project success
criteria and project success by type of project. European Management Journal, 25(4),
298–309.
Müller, R., Turner, J. R., Anderssen, E., Shao, J., & Kvalnes, Ø. (2014). Ethics, trust, and
governance in temporary organizations. Project Management Journal, 45(4), 39–54.
Nachmias, D., & Greer, A. (1982). Governance dilemmas in an age of ambiguous authority.
Policy Sciences, 14(2), 105–116.
Nichols, K., Sharma, S., & Spires, R. (2011). Seven imperatives for success in IT
megaprojects. Retrieved August 20, 2013, from http://www.mckinsey.com/~/
media/McKinsey/dotcom/client_service/Public Sector/PDFS/McK on Govt/Full
reports/TG_Autumn_2011_MOG7 Final.ashx
Nowak, M., & Sigmund, K. (1993). A strategy of win-stay, lose-shift that outperforms tit-for-
tat in the Prisoner’s Dilemma game [letter to editor]. Nature, 364, 56–58. Retrieved
from http://www.nature.com/nature/journal/v364/n6432/abs/364056a0.html
OECD. (2004). OECD Principles of Corporate Governance 2004. Paris: OECD Publishing.
OGC. (2002). Managing Successful Projects with PRINCE2 (2nd ed.). London: The
Stationery office.
Ouchi, W., & Price, R. (1978). Hierarchies, clans, and Theory Z: A new perspective on
organization development. Organizational Dynamics, 21(4), 2–78.
OxfordDictionaries. (2014). The Concise Oxford English Dictionary (12th ed.). Oxford,
England: Oxford University Press.
Packendorff, J. (1995). Inquiring into the temporary organization: New directions for project
management research. Scandinavian Journal of Management, 11(4), 319–333.
Pastoriza, D., & Ariño, M. (2008). When agents become stewards: Introducing learning in the
stewardship theory. In 1st IESE Conference on Humanizing the Firm & Management
Profession, June 30-July 2, 2008 (pp. 1–16). Barcelona: IESE Business School.
113
Payne, J., & Turner, J. R. (1999). Company-wide project management: The planning and
control of programmes of projects of different type. International Journal of Project
Management, 17(1), 55–59.
Pfeffer, J., & Salancik, G. (1978). The External Control of Organizations: A Resource
Dependence Perspective. New York: Harper & Row, Publishers.
Pinto, J. K., & Mantel, S. (1990). The causes of project failure. IEEE Transactions on
Engineering Management, 37(4), 269–276.
Pinto, J. K., & Prescott, J. (1988). Variations in critical success factors over the stages in the
project life cycle. Journal of Management, 14(1), 5–18.
Pinto, J. K., & Slevin, D. P. (1988). Project success: Definitions and measurement
techniques. Project Management Journal, 19(1), 67–73.
PMI. (2013a). A Guide to the Project Management Body of Knowledge (PMBOK® Guide).
(5th ed.). Newtown Square, PA: Project Management Institute.
PMI. (2013b). Organizational Project Management Maturity Model (OPM3®) (3rd ed.).
Newtown Square, PA, USA: Project Management Institute.
PMI. (2013c). Software Extension to the PMBOK® Guide Fifth Edition. Newtown Square,
PA: Project Management Institute.
Podsakoff, P. M., & Organ, D. (1986). Self-reports in organizational research: Problems and
prospects. Journal of Management, 12(4), 531–544.
Renz, P. (2008). Project governance: Implementing corporate governance and business ethics
in nonprofit organizations. Journal of Management & Governance, 13(4), 355–363.
Reuters. (2013). Thomson Reuters Business Classification (TRBC). New York: Reuters.
Rockart, J. (1979). Chief executives define their own data needs. Harvard Business Review,
57(2), 81–93.
Sayer, A. (1992). Method in Social Science: A Realist Approach. Oxford: Psychology Press.
114
Schneider, M., & Somers, M. (2006). Organizations as complex adaptive systems:
Implications of complexity theory for leadership research. The Leadership Quarterly,
17(4), 351–365.
Schultz, R., Slevin, D. P., & Pinto, J. K. (1987). Strategy and tactics in a process model of
project implementation. Interfaces, 17(3), 34–46.
Sharma, S., Durand, R., & Gur-Arie, O. (1981). Identification and analysis of moderator
variables. Journal of Marketing Research, 18(3), 291–300.
Shenhar, A. (2001). One exploring size does not fit all projects: Classical contingency
domains. Management Science, 47(3), 394–414.
Shenhar, A., & Dvir, D. (1996). Towards a typological theory of project management.
Research Policy, 25(4), 607–632.
Shenhar, A., & Dvir, D. (2007). Reinventing Project Management: The Diamond Approach
to Successful Growth and Innovation. Boston, MA: Harvard Business School Press.
Shenhar, A., Dvir, D., Lechler, T., & Ploi, M. (2002). One size does not fit all—True for
projects, true for frameworks. In Proceedings of PMI Research Conference, Seattle,
Washington, USA (pp. 99–106).
Shenhar, A., Dvir, D., Levy, O., & Maltz, A. A. C. (2001). Project success: A
multidimensional strategic concept. Long Range Planning, 34(6), 699–725.
Shenhar, A., Dvir, D., Milosevic, D., Mulenburg, J., Patanakul, P., Reilly, R., Sage, A.,
Sauser, B., Srivannaboon, S., Stefanovic, J., & Thamhain, H. (2005). Toward a NASA-
specific project management framework. Engineering Management Journal, 17(4), 8–
16.
Shenhar, A., Levy, O., & Dvir, D. (1997). Mapping the dimensions of project success.
Project Management Journal, 28(2), 5–13.
Shenhar, A., Tishler, A., Dvir, D., Lipovetsky, S., & Lechler, T. (2002). Refining the search
for project success factors: A multivariate, typological approach. R&D Management,
32(2), 111–126.
Simon, W. (1960). Herbert Spencer and the “social organism.” Journal of the History of
Ideas, 21(2), 294–299.
115
Stevenson, T., & Barnes, F. (2001). Fourteen years of ISO 9000: Impact, criticisms, costs,
and benefits. Business Horizons, 44(3), 45–51.
Tashakkori, A., & Teddlie, C. (2009). Foundations of Mixed Methods Research. Integrating
Quantitative and Qualitative. Thousand Oaks, CA: SAGE Publications Inc, USA.
Tekin, A. K., & Kotaman, H. (2013). The epistemological perspectives on action research.
Journal of Educational and Social Research, 3(1), 81–91.
The Standish Group. (2010). Chaos Summary for 2010. The Standish Group. Boston, MA.
Retrieved from www.standishgroup.com
Tishler, A., Dvir, D., Shenhar, A., & Lipovetsky, S. (1996). Identifying critical success
factors in defense development projects: A multivariate analysis. Technological
Forecasting and Social Change, 51(2), 151–171.
Toivonen, A., & Toivonen, P. U. (2014). The transformative effect of top management
governance choices on project team identity and relationship with the organization—An
agency and stewardship approach. International Journal of Project Management, 32(8),
1358–1370.
Too, E. G., & Weaver, P. (2014). The management of project management: A conceptual
framework for project governance. International Journal of Project Management, 32(8),
1382–1394.
Tsoukas, H., & Chia, R. (2011). Introduction: Why philosophy matters to organization
theory. In M. Lounsbury (Ed.), Philosophy and Organization Theory (Research in the
Sociology of Organizations) (Vol. 32, pp. 1–21). Bingley, West Yorkshire, England:
Emerald Group Publishing Limited.
Turner, J. R. (2006). Towards a theory of project management: The nature of the project
governance and project management. International Journal of Project Management,
24(2), 93–95.
Turner, J. R., & Cochrane, R. (1993). Goals-and-methods matrix: Coping with projects with
ill defined goals and/or methods of achieving them. International Journal of Project
Management, 11(2), 93–102.
116
Turner, J. R., & Müller, R. (2004). Communication and co-operation on projects between the
project owner as principal and the project manager as agent. European Management
Journal, 22(3), 327–336.
Turner, J. R., & Müller, R. (2006). Choosing Appropriate Project Managers: Matching their
Leadership Style to the Type of Project. Newtown Square, PA: Project Management
Institute.
Turner, J. R., Müller, R., & Dulewicz, V. (2009). Comparing the leadership styles of
functional and project managers. International Journal of Project Management, 2(2),
198–216.
Vidal, L.-A., Marle, F., & Bocquet, J.-C. (2011). Measuring project complexity using the
Analytic Hierarchy Process. International Journal of Project Management, 29(6), 718–
727.
Walker, D., Segon, M., & Rowlingson, S. (2008). Business ethics and corporate citizenship.
In D. H. Walker & S. Rowlinson (Eds.), Procurement Systems: A Cross Industry Project
Management Perspective (Vol. 27, pp. 101–139). London: Taylor & Francis.
Wateridge, J. (1998). How can IS/IT projects be measured for success? International Journal
of Project Management, 16(1), 59–63.
Weill, P., & Ross, J. (2004). IT Governance: How Top Performers Manage IT Decision
Rights for Superior Results (Vol. 1, pp. 63–67). Watertown, MA: Harvard Business
Review Press.
Westerveld, E. (2003). The project excellence model: Linking success criteria and critical
success factors. International Journal of Project Management, 21(6), 411–418.
Wheelwright, S., & Clark, K. (1992). Revolutionizing New Product Development: Quantum
Leaps in Speed, Efficiency, and Quality. New York: The Free Press.
White, D., & Fortune, J. (2002). Current practice in project management—An empirical
study. International Journal of Project Management, 20(1), 1–11.
117
Williams, M., & Vogt, P. (2011). Introduction: Innovation in social research methods. In M.
Williams & P. Vogt (Eds.), The SAGE Handbook of Innovation in Social Research
Methods (pp. 19–24). London: SAGE Publications.
Woodward, J., Dawson, S., & Wedderburn, D. (1965). Industrial organization: Theory and
practice. London: Oxford University Press.
Wysocki, R. K. (2011). Effective Software Project Management (6th ed.). Hoboken, NJ:
Wiley.
Yazici, H. (2009). The role of project management maturity and organizational culture in
perceived performance. Project Management Journal, 40(3), 14–33.
Yusoff, W., & Alhaji, I. (2012). Insight of corporate governance theories. Journal of Business
& Management, 1(1), 52–63.
118
Part II Appendices
Appendix I, Paper 1
Joslin, R., & Müller, R. (2014) New insights into project management research: A natural
sciences comparative
Presented at EURAM 14th Annual conference, Valencia, Spain (pp. 1–41); a revised version was
accepted for publication in the Project Management Journal (PMJ)
Submitted to the International Journal of Managing Projects in Business (IJBM), based on a revised
version of the paper presented at the PMI Research and Education Conference, July 2014 (pp.
1–29), Portland, Oregon, USA
Appendix V
Interview questions for the qualitative study
Appendix VI
Online questionnaire for the quantitative study
Appendix I
New Insights into Project Management Research: A Natural
Sciences Comparative
Abstract
In this paper, a new research perspective towards project management phenomena is
developed. It builds on the existing natural science theory of genotyping and phenotyping
by developing a contemporary comparative model for project management research, which
compares natural science molecular biology (genomics) as a way to investigate social
science (specifically project management) phenomena. The comparative maps concepts and
terminology and, in doing so, explains why phenomena in genomics (study of genetics) can
be compared with practices, behaviors, and established thinking in project management. To
support the theory building process, the attributes of complex adaptive systems (CAS) are
used to validate the constructs of the research. The comparative is then used to answer the
research question by identifying two social science phenomena “lessons intentionally not
learned” and “bricolage of competing methodology subelements,” followed by a detailed
explanation of the reasons for the phenomena using the attributes of the comparative. This
paper provides further examples of phenomena that were derived from the comparative
model as well as the types of research questions where the model would provide insight.
The authors believe that using a comparative model will challenge established thinking so
that many aspects of project management will be seen in a new light in both the research
and practitioner communities of project management.
Introduction
Over the past 40 years, project management research has grown and matured. The
methods and techniques used today provide well-established frameworks for designing and
executing research studies. However, the success of these established approaches had some
unforeseen consequences, because research questions are often limited by the
1
New Insights into Project Management Research: A Natural Sciences Comparative
methodological starting positions and possibilities (Williams & Vogt, 2011). Research designs
determine the nature of the results, therefore a limited set of research methods will impact
the variance of research designs, which in turn leads to almost predictable results. Drouin,
Müller, & Sankaran (2013), succinctly described this design dilemma by stating “if we always
do what we always did then we should not be surprised that we always find what we always
found.”
Contemporary methods have been developed and applied in many fields of scientific
activities, which have provided for the development of new theories that challenge
established theories and provide for fresh and alternate explanations of phenomena (e.g.,
Alvesson & Sköldberg, 2009; Flyvbjerg, 2001).
The purpose of this paper is to suggest that context-related concepts of natural science can
be used as a theoretical lens for research in projects and their management, for example, in
social phenomena such as projects. The concept of genotyping and phenotyping is used to
exemplify the use of natural science perspectives to social science phenomena. Underlying
this concept is an objective ontology applied to real entities (reifying a project as a “thing”),
using the epistemological stance of both process and/or variance methods in the sense of
Van de Ven and Pool (2005).
ideas, discoveries, or tools that radically change our understanding of an important existing
scientific or engineering concept or educational practice or leads to the creation of a new
paradigm or field of science, engineering, or education. Such research challenges current
understanding or provides pathways to new frontiers. (NSF, 2007, p. 10)
To achieve the purpose the following research question is posed: How can a natural science
perspective be used in understanding social science phenomena?
The results of the research will benefit both the academic and practitioner communities by
providing alternative perspectives on project management which should provide new
insights into project management phenomena from a different epistemological perspective.
2
New Insights into Project Management Research: A Natural Sciences Comparative
In addition, the ability to create stability in the research results through the combination of
methodologies in the study of the same phenomenon will be provided.
The next section contains a literature review of the theories behind a comparative analysis
and then covers complex adaptive systems (CAS) which is the perspective taken for theory
building. The comparative model is then described and is followed by two examples of how
the model is applied. The paper is concluded with a discussion and conclusion.
Literature Review
Comparatives
One of the most powerful tools used in intellectual enquiry is comparison, since any
observation made repeatedly gives more credence than a single observation (Peterson,
2005). Boddewyn describes comparative approaches as those concerned with the
systematic detection, identification, classification, measurement, and interpretation of
similarities and differences among phenomena (1965). The disciplines such as social science
including project management usually rely on observation rather than experimentation
unlike natural sciences where randomized experiments are the ideal approach for
hypothesis testing. However, some research problems cannot be readily addressed using
experiments, for example, when looking at research involving two or more species in
evolution, ecology, and behavior (Freckleton, 2009).
Comparative approaches have been used for decades to addresses the limitations of
experiments, where virtually every field in biological sciences uses comparatives (Gittleman
& Luh, 1992). Comparative analysis, unlike experimental studies, have historically relied on
the simple correlation of traits across species. Over the past 20 years, improvements to the
comparative frameworks, have been made in classifications and the use of statistical
methods to the degree of relatedness in the comparative (Harvey & Pagel, 1998; Martins &
Garland, 1991).
Comparatives have been made between natural to social sciences using metaphors, such as
the book Images of Organization (Morgan, 1997) and biological comparatives, for example,
cells of an organism to organizational knowledge (Miles, Snow, Mathews, & Miles, 1997)
and behavioral characteristics of a group of organisms known as complex adaptive systems
(CAS), or with organizational leadership (Schneider & Somers, 2006). Few have gone beyond
3
New Insights into Project Management Research: A Natural Sciences Comparative
the juxtaposition but still have provided new insights into explaining phenomena that may
not have been discovered or explained without the comparative.
… that the situational logic of natural and technological science research appears similar to
the situational dynamics inherent in social method, and that this similarity is strengthened
by the apparent universality of interpretation in both social and natural science method.
Given this similarity, it is time to reconsider customary routine distinctions between the
social and the natural science which ascribe to the former what they deny to the latter. And
given this similarity, it may be time to reconsider scientific method in general as just
another version of, and part of, social life.
In the field of project management research, comparatives are made mainly through
theoretical lenses including complexity theory, agency theory, contingency theory, and
complex adaptive system theory (K. Eisenhardt, 1989; Hanisch & Wald, 2012; Holland,
1992). Some of these theories are derived from observing nature such as complexity theory
and complex adaptive system theory (Brown & Eisenhardt, 1997; Holland, 2012).
Comparatives have also be done between two things of interest that may not have been
researched, for example, project managers and career models (Bredin & Söderlund, 2013).
From the literature, it is clear that there is a need and benefit in using comparative
approaches in the field of project management. A great deal of the man-made world is
based on nature and its evolutionary principles, including humans gaining insights by
comparing species or comparing a part of an organism (such as a cell or a gene) with the
phenotype and behavioral characteristics of that organism.
Dawkins stated that “biology is the study of complicated things that give the appearance of
having been designed for a purpose” (1988). Project management can be inherently
4
New Insights into Project Management Research: A Natural Sciences Comparative
complex in terms of achieving desired and designed outcomes within volatile environments.
There are many similarities between biology and project management in terms of
complexity, design, impact of changing environments, and product lineage.
There is a literature gap in comparing the core makeup and characteristics of an organism
with the core makeup and characteristics of project management.
Creating a new comparative, like any other type of analysis, requires that the phenomena is
compared and abstracted from a complex reality. Therefore, it is important to provide a
focus, careful delineation of scope, use of defined and accepted terms, and the
development of assumptions (Boddewyn, 1965). The focus and delineation of scope
including use of terms for the natural science comparative model is described in the section
following the literature review.
The study of complex adaptive systems, a subset of nonlinear dynamical systems, has
become a major focus of interdisciplinary research in both social and natural sciences
(Lansing, 2003). To understand the concepts behind CAS, it is important to note that CAS
have a large numbers of components, often called agents, that interact and adapt or learn
(Holland, 2012).
CAS were first derived from systems theory and cybernetics in the 1950’s (Ashby, 1957;
Carnap, Fechner, & Hartmann, 2000), then the term complexity science in the 1960s took
hold from where CAS evolved. Since the late 1980s, CAS have been used to model virtually
every aspect of our world, including impacts of disruptions in weather, earthquakes,
communications, transportation, energy, and financial systems as well as to influence
management practices and project management research (Shan & Yang, 2008).
5
New Insights into Project Management Research: A Natural Sciences Comparative
Because CAS exist in both natural and social science worlds and are well researched, these
make an obvious choice for building the theory behind the natural to social science
comparative model that is described in the next section.
Progenotype
Cannot
touch it Genotype Methodology plus the
“what” to build
Referring to Figure 1, the comparative model, which is also the research model, shows the
linkage between the natural science and the social science worlds. Starting with the natural
science part of the model, a genotype (Greek genos, race + Latin typus, type) is the genetic
6
New Insights into Project Management Research: A Natural Sciences Comparative
makeup of a cell or an organism. A phenotype (from Greek phainein, “to show” + typos,
“type”) is the composite of an organism’s observable characteristics or traits, that is,
something physical and, in most cases, can be seen by the human eye. Every organism from
the point of conception is influenced by the environmental conditions that have a direct
impact on its phenotype. The term phenotype results from the expression of an organism’s
genes, the influence of environmental factors, and the interactions between the two. A
genotype is the genetic makeup of a cell where it has the information of what and how to
replicate in order to ultimately create the organism and keep the organism alive (Boulding,
1978).
Moving to the social science part of the model, the term progenotype denotes the project
core make-up included in the lived project methodology, its elements (which are the parts
of the methodology), and the requirements of what to build. The progenotype includes all
the information to create the project outcome (product or service) and, ultimately, the
information to be able to maintain and enhance the product or service.
A project’s environment is described in terms of what impacts the progenotype (i.e., the
project core make-up) and how the environment impacts the development of the project. In
natural science, the equivalent is the particular environment impacting a genotype of an
organism. Using this comparison, there is a way to compare the genotype with the
progenotype when the environmental factors impact both worlds (genotype and
progenotype), resulting in genes and methodology elements being used (switched on) or
not used (switched off). The switching effect on genes and elements throughout the life of
an organism and respective project life cycle results in observable characteristics in a
phenotype or project outcome, called traits. These traits can then be traced back to the
respective genes/elements in the genotype/progenotype.
The model also shows that the phenotype of an organism (the organism itself) is
comparable to the project outcome (product or service). The details of this aspect of the
comparison are described in detail after the topic of evolution of organisms and evolving
project methodologies (progenotype) are covered.
7
New Insights into Project Management Research: A Natural Sciences Comparative
underlying factor in the development of the comparative. The next section describes the
evolutionary aspects of the underlying principles of the model.
Over billions of years, organisms have evolved by constant gradual evolution from bacteria
to what they are today (Dawkins, 1988). Project deliverables such as cars, buses, cities and
all their infrastructure and subcomponents have also evolved but over a much shorter
evolutionary period. Darwin’s theory of evolution (Darwin, 1859) states that organisms that
have successfully evolved are the best-suited variants optimized for their environment, and
these organisms in turn create offspring which then start a new round of evolution. This
reproductive cycle can be viewed as an evolutionary algorithm that creates and/or forms
the fitness landscape for the organisms that are best adapted to the then given
environment (Wright, 1932).
The social science concept of evolution is similar to natural science where product or service
evolution is within a project environment. The meaning of evolution within the social
sciences, specifically project management, is the new release of a product/service (project
outcome) where the procedures for problem-solving and trial-and-error indicate an
evolutionary process at work. More specifically, product/service evolution refers to
searching for the best solution for any given problem on how to meet success criteria by
entering trials, testing performance, eliminating failures, and retaining the successes. This all
assumes that the environmental conditions change within known boundaries; otherwise,
there is a risk of project outcomes (product/service) becoming obsolete.
The same is true for the natural science world, where examples of species unable to cope
with the drastic changes to their environment include dinosaurs, dodo, and the Irish elk.
Today, many species are in imminent risk of extinction due, in part, to their inability to
adapt quickly enough to their changing habitat.
8
New Insights into Project Management Research: A Natural Sciences Comparative
In the social science world, products can be designed to adapt according to the environment
within a given range, but when the environment changes too much, there is a likelihood of
obsoleteness. The advantages over nature are that a replacement product can be designed
for current and future environmental conditions, with or without the design lineage (genes)
of the predecessor product.
One key difference between natural and social science is that humans can predict, to some
extent, the impending environmental changes. This is achieved by applying intelligence and
tools/techniques to the problem. Decisions can be taken to obsolete a product or continue
with a product’s evolution (lineage). In the natural science world, an organism does not
have the ability to prepare itself in a noncyclical changing environment, as there is no
foresight. An organism either adapts or becomes extinct.
In summary, mutations in organisms are random but evolution is not. Evolution promotes
the survival of species through natural selection. Product/service evolution is structured
through reasoning with the underlying premise of being competitive, that is, “fit” for
purpose.
Complexity
Evolution has no boundaries, irrespective of whether it is in the fields of natural or social
science. Jean-Baptiste Lamarck believed the evolution of organisms was a one-way road
which he called “Complexity force” or in French “Le pouvoir de la vie” (Lamarck, 1838). In
social science, the management and development of products or services within project and
programs are also becoming more complex (Vidal, Marle, & Bocquet, 2011). Complexity is a
regular topic that is discussed in senior management circles within and outside of the
project environment (Hitt, 1998). Many project influencers talk about reducing project
complexity. This statement is easy to make without understanding the complexities and
challenges to achieving a successful project outcome. If the complexity discussion was
moved to the natural science field to build an organism, it is unlikely that the same
9
New Insights into Project Management Research: A Natural Sciences Comparative
comment on complexity would result. The concern from the project influencers is really
about unnecessary complexity and not complexity itself. Evolution in both natural and social
sciences is resulting in greater complexity (Adami, Ofria & Collier, 2000; McShea, 1991) but
should not be over complex—one could say a sort of practical application of Occam’s razor.
Replicator
The goals of every organism are to survive and to replicate so its genes have the greatest
chance of survival over generations (Dawkins, 1974). The term “replicator” was first
developed by Darwin (Darwin, 1859) in natural science. So what is the equivalent of the
term replicator in the project world? If a product or service is going to be successful, then
the progenotype must be resilient and have a high fidelity at the element level to ensure
that it always creates a successful outcome. To achieve this, the progenotype and the
project outcome, need to be replicated as many times as possible to build up a base for
justification of future product updates. This, in turn, will help determine whether the
product starts and/or continues with a lineage or not.
Universal Darwinism
Darwin’s theories have been generalized over the years, and all generalizations fall under
the grouping called Universal Darwinism (Dennett, 1996). To date, two categories exist
within Universal Darwinism: gene and nongene-based extensions. Gene-based extensions
cover areas including physiology, sociology, and linguistics, whereas nongene-based
extensions, cover areas including complex adaptive systems, memetics, cultural selection,
and robotics.
This paper is based on a gene-based universal Darwinism extension to derive the model and
a gene and nongene-based universal Darwinism extension (CAS) to build the theory behind
the model.
With these characteristics in mind, we can now develop the comparative model.
10
New Insights into Project Management Research: A Natural Sciences Comparative
Environment
Phenotype Level 2
Impact on Human Impact on Project
(Management)
Mapping table
Outcome
Impact on Organism/
Nonhuman
The genotype (genes) are the starting point because, through their expression, they will
impact the organism’s phenotype but not the other way around, a one-way causation. The
first comparative is between the genotype and the methodology elements (progenotype).
The second comparative (Level 2) compares an organism’s (phenotype) to a project
outcome (phenotype).
Figure 3 provides a detailed two-level mapping table between genotype to progenotype and
organism to project outcome. The bottom half of the table shows where the key attributes
of an organism’s genes have been described and compared against the key attributes of a
project’s progenotype.
11
New Insights into Project Management Research: A Natural Sciences Comparative
Every organism has a unique genome, which contains, through encoded DNA, the entirety of
an organism’s hereditary information. The genome describes what and how to build a
unique organism. Comparatively, a procedural-based methodology that has been updated
through lessons learned derived from a product with lineage (versions), contains all the
information on how and what product to build. Genes have enduring attributes that have
ensured their survival over millions of years. A progenotype also has enduring attributes
that will determine if it will survive over the course of time, or, be replaced with something
more adaptable to the environment.
Referring to the Level 1 comparative in Figure 3, there is a striking similarity between the
attributes of a gene and the attributes of an element of a progenotype. For example, in
gene backup versus safeguarding of project knowledge, both reduce the risks of losing
unique knowledge. New gene creation from existing genes versus distribution of project
knowledge ensures that the genetic/project procedures are at the right place and time.
12
New Insights into Project Management Research: A Natural Sciences Comparative
Creating new genes from DNA versus project innovation; ability to create. Finally, self-
learning versus project lessons learned; ability to adapt.
How are genes, versus the elements in a progenotype, controlled to ensure that the
described attributes are realized? There are several types of genes— one of them is the
“master gene” (Pearson, Lemons, & McGinnis, 2005). A master gene controls and monitors
the progress of the other genes within its domain. The control of genes is totally
decentralized. Comparatively, the elements of a (progenotype) are controlled with
something equivalent to a master gene called “local governance.” Learning from the study
of genomics, it would make sense to control progenotypes by decentralized updates like the
master gene concept. Progenotypes, like genomes, contain a vast amount of context-related
information. A single person is unlikely to have the knowledge to decide which content
needs to be updated according to context. If a person attempts to update a progenotype
without expert knowledge in the specific edit, then it will likely lead to a suboptimal result,
which in turn would reflect in the project performance and ultimately impact the project
outcome. Wikipedia is built on the concept of decentralized updates using experts in their
knowledge domain. One person invariably takes the lead as a subject matter expert
coordinating other contributors. This is similar to the master gene concept in natural
science. If this decentralized approach was taken to update a progenotype, then topic
experts would also decide which progenotype’s elements would be the most appropriate for
each project’s profile including context.
In the natural science world, natural selection at the gene level is where competing genes,
that is, a gene that has two or more alleles (or competitors) competes to be selected and
becomes the dominant gene where the nonselected genes are recessive genes (Mendel,
1865). However, in future generations, it is possible that recessive genes could be selected
due to environmental and non-environmental reasons. Recessive genes can cause problems
in the organism, which may or may not be seen in the organism’s traits (Dewey, Barrai,
Morton & Mi, 1965). It is also possible to select an element within a progenotype, which is
not as applicable as its alleles (equivalent approaches); this may cause problems which may
or may not be observable as a project trait. There are certain genes that greatly impact their
phenotype’s traits, which are called high-pleiotropic genes, and other genes that have less
impact on their phenotype’s traits (low-pleiotropic genes). The same is true for the
13
New Insights into Project Management Research: A Natural Sciences Comparative
elements within a progenotype. Some elements will have a higher impact on the project
outcome (product/service) than others.
Now moving to the Level 2 comparison of an organism’s phenotype and the project
outcome (product/service). The key attributes of an organism are mapped to the key
attributes of a project outcome. The path back to the gene (genotype) is shown to ensure a
consistency of comparison.
The majority of a gene’s attributes (except for mimicry and signals) is directly related to the
gene’s ability to survive and replicate (Wickler, 1968). The mimicry and signal attributes
(described later) have been included because they indirectly help the genes to survive by
means of the organism.
A gene competes against its alleles to determine the dominant gene (Gagneur, Elze, &
Tresch, 2011). Nonhuman organisms compete for survival, however humans compete for
paid jobs and battle to stay in their jobs, which often leads to territorial behavior. A project
outcome, typically a product or service, competes against other similar products or services
in terms of price, quality, and performance.
Replication is a prerequisite for survival in both the natural and social science worlds. When
a gene replicates, its fidelity is 1 in 100 million (Pray, 2008), where fidelity means the degree
of exactness with which something is copied or reproduced. Environmental conditions may
cause mutations in cells during the replication process. Influences like radiation, chemicals,
pollution, and viruses can all impact an organism’s cells and, therefore, the DNA/genes
contained within (Lewtas, Walsh, Williams & Dobiáš, 1997). Products are also replicated
with degrees of fidelity. The quality control checks ensure that the replication process stays
within predefined tolerances. Products like organisms suffer from defects that may be
undetected by the quality control checks but are likely to be observed during the products’
lifespans.
Collaboration. The term “collaborate” is used in context of the gene and the project
outcome, whereas “apparent altruism” is used for organisms. Genes that don’t compete
(non-alleles) collaborate to produce phenotypic effects to support their organism’s survival
(Nelson, 2006). This could be in the form of signaling or other similar traits. The project
outcome (product/service) is often designed to collaborate with other products and/or
14
New Insights into Project Management Research: A Natural Sciences Comparative
services for example, other component parts, internet services, servers and infrastructure,
or software. Whenever there is an interface from one product or service to another, it is a
form of collaboration. Collaboration is normally associated with organisms, but there is no
reason why products and services cannot be considered to collaborate by interfacing to
support their collective needs within any given environment. Organisms (human and
nonhuman) collaborate where there is mutual benefit, but they appear to do altruistic
things, meaning disinterested and selfless concern for the well-being of others.
This raises question as to why do altruist actions exist if there is no personal benefit? In
evolutionary biology altruism contradicts the theory of natural selection (Dawkins, 1974).
There are many explanations concerning altruism within nonhuman species, and all of them
point to an underlying self-interest. A mathematical model using game theory was created
by Maynard Keens (J. M. Smith, 1982) called evolutionarily stable strategy (ESS), which
shows that altruism does not pay off in the survival of a species. A similar model called the
prisoner’s dilemma, also using game theory, shows why two individuals might not
cooperate, even when it appears that it is in their best interests to do so (Nowak & Sigmund,
1993). Humans have more complex motives than animals, but the underlying acts of
altruism always include aspects of self-interest for both humans and animals (Fehr &
Fischbacher, 2003; Simon, 1993). Collaboration in humans with apparent altruism is really
just collaboration where both parties will benefit.
Signaling. Signaling is a phenotype trait that is created by gene expression that help
the organism to survive (Wickler, 1968). Signaling is the conscience act of switching on and
off something that warns or attracts a recipient of the signal. Products and services have
built-in signally systems for both attracting and warning the recipients of the signals.
Resilience. Resilience is a feature that genes have built-up by using various
techniques described in the Level 1 mapping. To some degree, organisms and humans are
resilient to environmental conditions. Accordingly a product or service also needs to be
resilient to environmental conditions.
Maintainability. When a gene and/or organism cannot maintain itself, it will die.
Likewise, when a product or service is not maintainable, it will fall into disrepair and soon be
replaced with something that is more maintainable.
Adaptability. When a gene or organism, or likewise a product or service, cannot
15
New Insights into Project Management Research: A Natural Sciences Comparative
adapt to the environmental conditions, it will most likely become extinct or obsolete. Some
organisms have learned to become adaptable, but only when the change to the
environment is not too extreme and/or when the change does not occur too quickly
(Williams, Shoo, Isaac, Hoffmann & Langham, 2008). The same is true for a product or
service where environmental conditions could render it obsolete when the designed degree
of adaptability is not sufficient to function.
Mimicry. Mimicry is a phenotype trait that is created by gene expressions that help
the organism to survive by mimicking other species (Wickler, 1968). The same trait occurs in
the product and service world when better known branded products and services are
mimicked because this increases the likelihood of survival of the mimickers.
Sense of time. Organisms exhibit a sense of time using a biological process called a
circadian rhythm (Yerushalmi & Green, 2009). This rhythm is widely observed in plants,
animals, fungi, and cyanobacteria, and oscillates in 24-hour cycles. Products and services are
also time-cognizant to ensure that maintenance and upgrade windows do not overlap with
operational times. Projects that create products and services also work to time through
their schedules to ensure deadlines are met.
Theory Building
Many scholars define theory in terms of relationships between independent and dependent
variables. Other scholars have defined theory in terms of narratives and accounts
(DiMaggio, 1995). According to Eisenhardt, theory is evaluated primarily by the richness of
its account, the degree to which it provides a close fit to empirical data, and the degree to
which it results in novel insights (M. Eisenhardt, 1989). As the constructs of the comparative
model are new, no empirical data exists to substantiate or disprove the model. In absence of
any previous comprehensive theory building, this section aims to builds theory by using the
established constructs of CAS and, in doing so, will provide validity for the constructs of the
natural to social science comparative.
There are two ways to use CAS for the comparative model theory building. Referring to
Figure 4, the first way, which is the simplest, is to describe the attributes of CAS and then
show how these exist in both natural and social science worlds for each entity. The second
way is to review the literature that describes CAS comparatives for each entity pair, for
16
New Insights into Project Management Research: A Natural Sciences Comparative
example, CAS within an organism and genotype. This paper focuses on the first approach by
comparing the attributes for each entity across both worlds for Levels 1 and 2.
CAS are special cases of complex systems, that is, dynamic networks of interactions and
relationships (Holland, 2006). These cases exist in natural sciences and social sciences (Miles
et al., 1997) and within and across organisms (Holland, 1992). As such, these complex
systems exhibit Darwinian properties of variance, selection, and heredity (Hodgson &
Knudsen, 2006). Examples of organisms that are part of CAS include ant colonies, swarms of
bees, flocks of birds, and humans in societies (Rammel et al., 2007). Examples of CAS within
organisms include cells, the nervous system, and the immune system (Holland, 1992). In the
man-made world, examples of CAS include the internet, power grids, cities and societies
(virtual and physical).
Using Holland’s definition of CAS attributes, agents within a CAS are self-similar and
numerous, therefore seen as complex. The agents’ behavior within the complex
environment anticipates responses, and therefore exhibits emergent behavior allowing CAS
self-organization (Holland, 2012). An example of an agent is an ant within an ant colony,
therefore numerous in numbers. The ants are continually responding to the environment,
therefore exhibiting an emergent behavior that results in a collective self-organizing
process.
17
New Insights into Project Management Research: A Natural Sciences Comparative
Figure 4: Theory building using complex adaptive systems in both natural and social sciences
Referring to Figure 4, the links between the comparative model and CAS will be discussed by
comparing the attributes of each entity. If the attributes of each of the linked entities are
the same or comparable, then this provides a foundation for the comparative.
Starting with the entity “Genotyping labeled as (A) and the entity “CAS within an organism”
labeled as (E), a genotype is the genetic makeup of cell where there are millions of cells
within an organism (Feder, 2000). In a human, there are approximately 200 types of cells
and all exhibit similar characteristics with more than 1 trillion cells within a human (Bianconi
et al., 2013). There is no central control of cells and their behaviors, but each cell type has a
specific role and responds to different situations. Cells exhibit the characteristics of CAS and
so have been labeled as such (Lansing, 2003). Therefore the genotype which exists within all
cells, within the nucleus, in the DNA, chromosomes and genes, are considered a CAS
(Holland, 2002).
The second link is between the “phenotype” labelled as (B) and the “CAS across organisms”
labeled as (F). A phenotype is the expression of its genes (genotype) and as such is a living
18
New Insights into Project Management Research: A Natural Sciences Comparative
organism (Jaenisch & Bird, 2003). Organisms that live in large groups such as ants and
humans are similar in themselves, exhibit emergent behavior, and self-adapt to the
environments they live in (Holland, 1992). These attributes are consistent for any organism
that lives in large groups (Dawkins, 1974). The conclusion can be drawn that a phenotype
(organism) that is part of a large community is also part of a CAS.
The third link is between the “Progenotype,” that is, project methodology and its elements
labeled as (C) and a wiki which is a CAS and labeled as (G). A methodology can contain
thousands of elements called units of knowledge (Joslin & Müller, 2013). The elements of
any methodology are typically created by one or more individuals who have combined and
recombined processes that are based on knowledge spanning over a 100 years. For
example, in A Guide to the Project Management Body of Knowledge (PMBOK® Guide) – Fifth
Edition (Project Management Institute, 2013) had more than 250 contributors and
reviewers working on producing the Body of Knowledge where most of the source material
can be traced back through the previous editions to the originators of the units of
knowledge. The origin of Office of Government Commerce (OGC) Prince2 methodology
(OGC, 2002) was based on a predecessor called PromptII. 1 Many of PromptII elements were
derived from third party concepts, for example, Gantt charts, program evaluation and
review technique (PERT), and procurement.
To remain relevant, every methodology needs to evolve within the context of the
environment for which it was designed. This is achieved by managing the methodology
elements in terms of creating new elements to add new knowledge and removing or
changing one or more methodology elements to update existing knowledge. A methodology
contains many methodology elements and subelements where the subelements are
considered to be at the lowest level. Methodologies can and do evolve in a similar manner
as wikis. A wiki is defined as a website or database developed collaboratively by a
community of users, allowing any user to add and edit content (Pearsall, Soanes, &
Stevenson, 2011). Wikipedia, the most well-known of all wikis, is updated in a decentralized
and uncoordinated way by approximately 100,000 individuals.2 Wikis exhibit all of the
1
Prompt II developed by Simpact Systems Ltd in 1975
2
Source http://www.quora.com/
19
New Insights into Project Management Research: A Natural Sciences Comparative
attributes of a CAS (Andrus, 2005; Nikolic & Davis, 2012), and therefore methodologies that
are being constantly evolved and adapted in a wiki-like environments3 are also CAS.
The fourth and final links are the “project outcome” labeled as (D), that is, a product or
service; and “CAS across products or services” in the social science world, labeled as (H).
Man-made CAS such as power grids, the internet, automated driverless cars, autonomous
robots, and online marketplaces are derived from products and services that are used or
configured to coexist in an environment with other similar or identical products (Shenhar &
Bonen, 1997). Products that are similar, used in large numbers in an evolving, connected
way with no central control, exhibit the characteristics of CAS (Holland, 2006).
In summary, the four constructs of the model exhibit CAS attributes as they are either CAS
systems in themselves or one of many agents described as a CAS. Therefore, the
comparative of a genotype labeled as (A) to a progenotype labeled as (C) is demonstrated
both from the comparative mapping within this paper and by the comparison of CAS
attributes previously discussed. The same logic applied to the relationship between a
phenotype labeled as (B) and the project outcome labeled as (D).
To simplify the explanation, the following environmental factors (i.e., moderator variables)
are described in a project and natural science (genotype) perspective as follows:
The independent variable progenotype is subdivided into elements and subelements where
each subelement can be considered to be a unit of knowledge, which is a similar analogy to
a gene being a unit of heredity.
3
Harvard University and Cornell are two universities with wiki-based project management methodologies.
Other project management wikis can be found by searching on wiki + project management methodology.
20
New Insights into Project Management Research: A Natural Sciences Comparative
There is no formal definition of a unit of knowledge within the field of project management.
Therefore, the following working definition is used for this paper: a unit of knowledge is the
smallest unit of information that is able to take on the state of being true of false. Using this
definition, a methodology subelement can now be defined as a unit of knowledge
constituting an affirmation being the smallest unit that can be true or false.
A project contains processes, tools and techniques, deliverables, and stakeholders, which
can be referred to as project elements. The sum of the elements constitutes a project. A
project element in this context is defined as an essential or characteristic part of a project.
Assuming project outcome traits are measurable, we can state the following hypotheses:
H1a The relationship between progenotype and project outcome is moderated by the
project environment.
A unit of analysis is the relationship between the progenotype and project outcome.
A project manager has experience that was gained from several project implementations.
Some of the projects created new versions of Product 1. The lessons learned from previous
versions of Product 1 were fed back into Project 1’s unique progenotype. Some of this
knowledge was generalized and put into the organization’s generic progenotype.
Both the generic progenotype and the unique Project 1 progenotype are evolving like an
organism’s genome when it replicates. Both progenotypes are adapting through the lessons
learned, which benefits the next generation of projects. However, the generic progenotype
does not have a lineage (unlike the unique Project 1 progenotype). In an evolutionary sense,
when an organism’s genome is always based on an average mix of genes within a species,
then it cannot evolve (Darwin, 1859) and probably is extinct after an epoch. With this
comparative, there is a risk that when an organization tries to use a generic progenotype
21
New Insights into Project Management Research: A Natural Sciences Comparative
Continuing with the project manager example, the same project has a newly assigned
project manager. The project progenotype has evolved with every new product release. In
the applied research model example, the project manager is considered to be an
environmental factor and can decide whether to implement Project 1’s unique progenotype
or change the units of knowledge of the progenotype by:
• Replacing them,
• Leaving some out, or
• Complementing existing units of knowledge with his or her own personal units of
knowledge.
The changes to the unique progenotype may or may not improve the traits of the project
during the project’s development (embryonic stages) and in the project outcome. If the
units of knowledge are excluded and are not replaced with something equivalent, there is a
high probability that the deficiencies in the methodology will appear as project traits during
the project development, project outcome (product or service), and project management
outcome. Project management outcome traits would include increases to cost, scope
impact, delays in schedule, and decreased customer satisfaction.
The project manager now decides to substitute units of knowledge from the unique
progenotype with his or her own units.
Depending on how these units of knowledge are integrated into the progenotype and how
applicable the units are to the project environment, the project traits will be influenced
either in a positive, neutral, or negative way. There is an equivalent in natural science where
the genome of a species has been modified by a virus or another organism (larva) that
22
New Insights into Project Management Research: A Natural Sciences Comparative
splices (changes) the DNA structure by introducing its own genes (Dawkins, 2004). The
effect is that the change in the phenotype and behavior of the organism during its
embryonic and fully grown stages are mainly to the benefit of the larva or virus and less so
to the organism itself (Dawkins, 2004). The comparative is where the project manager
changes the unique progenotype’s (genome) to achieve the project outcome but may also
personally benefit from the changes. This would have not been the case if the progenotype
was implemented without change.
Two natural science examples are given, one with a negative outcome and the other with a
positive outcome:
Very few gene mutations result in positive outcomes—most result in negative outcomes
(Loewe, 2008). Could this be a word of warning for the project managers who are
considering the alteration of established progenotypes, who don’t have an in-depth
understanding of the project environment, or don’t know how the units of knowledge in the
progenotype interact with each other within that project environment?
For project managers with little or no experience who venture to change a highly evolved
progenotype (derived from a product with lineage), there is a likelihood of a failed project
outcome (if it ever gets to this point). In the natural science world, some viruses cause havoc
in the infiltrated organism, and the result is that the organism’s immune system is triggered,
which normally kills the virus after a hard fight. The analogy in the social science world is the
“inexperienced project manager” who vastly deviates from a highly evolved progenotype
without understanding the implications that can trigger the organization’s immune system.
The trigger is the organization’s “governance,” and results in a similar outcome—removal of
the project manager, but probably not before harm is done to the project in terms of
wasted resources and damaged reputation.
23
New Insights into Project Management Research: A Natural Sciences Comparative
There are two other environmental factors described in the model, which would also act as
moderator variables: organization culture and external market environment. Depending on
the culture and the state of the external market environment (stable or volatile), both can
either positively or negatively impact the project during the embryonic stages and final
project outcome.
The progenotype contains many units of knowledge that relate to different parts (elements
or subelements) of a project, for example, financial, planning, scheduling, or risk aspects.
When a project manager leaves out one or more units of knowledge from the progenotype,
then the resulting project traits should be traceable back to the cause of the problem.
However, when all the environmental factors impact the project in some way, for example,
through inexperienced actions of project managers, closed environments, or volatile
markets, etc., this will impact multiple project traits and will make it difficult to determine
which project traits are symptoms and which are root causes. The determination of the root
cause(s) may be further complicated because each unit of the progenotype will have varying
degrees of impact on the project traits (called pleiotropic effect). Projects that are out-of-
control are often misdiagnosed when symptoms are addressed and root cause(s) are
ignored. This happens due to a lack of understanding of the cascading cause-and-effect
issues in complex environments. In the project world and in the natural science world, most
issues can be traced back to a maximum of one or two root-cause issues. The challenge is to
quickly find them before there is irreparable damage to the project.
Until now, the project manager has been described as an environmental factor where the
unit of analysis is the impact of the progenotype on the project outcome. However, the
project manager is also an organism driven by his or her own genes’ need for survival. This
gives rise to a second level of comparison: Level 2 in Figure 3 between the human
(organism) and the project outcome. The unit of analysis now becomes the impact of the
project manager (and his or her team) on the project outcome.
With both levels (1 and 2) in the comparative, the real world of project management is more
accurately modelled; however, the downside is added complexity in applying the
comparative.
Two example questions are posed here where the answers are derived by the Level 2
mapping shown in Figure 3:
24
New Insights into Project Management Research: A Natural Sciences Comparative
These project management related questions are discussed using the proposed perspective.
One explanation taken from the natural science perspective is that organisms are driven by
survival instincts. A human (in this case, the project manager), strives to survive in the world
he or she knows and will use all available resources that are believed to provide him or her
with the maximum advantage. Taking something that has been developed by someone or a
group of people does not necessarily provide an advantage nor does it differentiate because
the project manager is genetically driven to succeed by competing in the same environment.
Humans have intelligence and the ability to understand the implications of risks. However,
achieving success in a workplace (irrespective of how success is measured) often overrides
the implications of the risk events especially when the environment is new and the risks are
not fully understood. Lessons not learned in projects do not lead to a fatality, unlike in the
animal world where this would inevitably lead to a fatal mistake. If the implications were
the same in the project world, then every lesson would be learned based on the assumption
that the project manager is capable of assimilating and integrating the new knowledge.
25
New Insights into Project Management Research: A Natural Sciences Comparative
Discussion
Comparatives have been made over the past decades between natural and social sciences
providing new ways to view and compare the items being compared, but few comparatives
have gone past the juxtaposition. Developing a contemporary method to observe a
phenomena can be ridiculed, but the findings in using the new approach, soon offset the
skepticism (Kuhn, 1970).
The two-level comparative that is based on well-defined terminology, set assumptions, and
detailed mapping tables goes further than many comparatives. This is because the
apparently separate disciplines do have many similar characteristics in terms of complexity,
design, impact of changing environments, and lineage. The underlying concepts of the
comparative (Universal Darwinism, evolutionary stable strategy, phenotyping/genotyping)
allow for a rich comparative that can be extended to encompass existing concepts within
natural sciences such as eusocial organisms (Kramer & Schaible, 2013).
CAS, an area of great interest in the academic community that is also well researched since
the 1980s, has helped to provide the theory building and support for the constructs of the
comparative.
26
New Insights into Project Management Research: A Natural Sciences Comparative
The comparative can be used to not only provide alternative insights into project
management research questions, but it can be also used to identify phenomena.
Table 1 provides examples of phenomena that were identified using the comparative
including the level that they are relevant within the comparative.
27
New Insights into Project Management Research: A Natural Sciences Comparative
Selfish projects Level 2 Projects compete for resources such as management time,
funding, and skills; therefore there is no interest to work with
other projects unless a mutual interest exists.
Lessons not Level 2 Lessons are intentionally not learned as project managers cannot
learned differentiate themselves or prove their intellectual ability (fitness).
Impotent Level 1 A methodology not designed for any project type or environment.
(generic) When competing against other methodologies that are adapted, it
methodologies will have a reduced chance of its own survival and that of its
project outcome.
Lesson learned Level 2 Lessons learned are reified with the objective of being consumed
fighting for by management so they are learned. This takes the perspective of
management the lessons needed to achieve the objectives
attention
Naturally aging Level 2 Projects like organisms age and in doing so become less effective.
projects Understanding the attributes of aging and the implications of
project efficiency and effectiveness, as well as traits in the project
outcome, will provide insight on how to setup and structure
projects.
The following are examples of research questions that can provide an idea of what can be
addressed by the comparative:
28
New Insights into Project Management Research: A Natural Sciences Comparative
• Are customized project methodologies more appropriate for projects that deliver
products?
• What is the impact of a rapidly changing environment on a project’s methodology
effectiveness?
• Are the performances of foreign (nonlocal) project managers better or worse than
local project managers (in what areas) and does their performance substantially
improve when compared to local project managers over time (adaption).
Any research question that has the potential to be answered in part from an evolutionary,
altruistic or methodological perspective could benefit from using the comparative or an
extension of it.
Conclusion
This study shows how the comparatives within and across disciplines are able to answer
questions as well as provide new insights that may not be possible with existing research
techniques. A great deal can be learned by modeling and mapping the natural science world
to bring new perspectives on topics that conform to natural order.
The two-level comparative model developed in this study shows how a natural science
perspective can be used in understanding social science phenomena and how well-
established research areas such as CAS can be used in the theory building to support a new
comparative.
The strengths of the findings show that using a new perspective through the lens of natural
science is likely to bring insights that challenge conventional thinking in project
management. The weaknesses in the findings are that all comparisons must go beyond the
juxtaposition of phenomena that are potentially comparable, requiring further research into
the explicit contrasts and explanations. Also, the use and extension of this model requires
proficient knowledge in both sciences, plus an understanding of the implications of the
mapping as well as in identifying and mapping new attributes.
The authors believe that most project management themes could be applied to the model
which will provide new and interesting observations in project management research.
29
New Insights into Project Management Research: A Natural Sciences Comparative
Future Research
This study contributes to transformative research by suggesting a particular empirical
natural science perspective for social science phenomena, such as research in project
methodologies, reifying projects, and project outcomes as a comparative to existing
perspectives. This study should help project practitioners take a new perspective on how
they view projects in terms of progenotype and how the elements of the progenotype are
assembled to create a project outcome most suited to its environment. Any deviation from
the perspective or its implementation will result in a suboptimal project and project
outcome performance.
Bibliography
Adami, C., Ofria, C., & Collier, T. (2000). Evolution of biological complexity. Proceedings of
the National Academy of Sciences of the United States, 2000(10). Retrieved from http://
www.pnas.org/content/97/9/4463.long
Alvesson, M., & Sköldberg, K. (2009). Reflexive Methodology (2nd ed.). London: Sage
Publications.
Andrus, D. (2005). The wiki and the blog. Intelligence, (September).
Ashby, W. (1957). An introduction to cybernetics. London: Chapman & Hall Ltd.
Bianconi, E., Piovesan, A., Facchin, F., Beraudi, A., Casadei, R., Frabetti, F., … Canaider, S.
(2013). An estimation of the number of cells in the human body. Annals of Human Biology,
40(6), 463–71.
Boddewyn, J. (1965). The comparative approach to the study of business administration.
Academy of Management Journal, 8(4), 261–267.
30
New Insights into Project Management Research: A Natural Sciences Comparative
31
New Insights into Project Management Research: A Natural Sciences Comparative
32
New Insights into Project Management Research: A Natural Sciences Comparative
Lamarck, J. B. P. A. (1838). Histoire naturelle des animaux sans vertäbres. Histoire (Vol. V,
pp. 1-232). J.B. Bailliäre. Retrieved from http://www.biodiversitylibrary.org/bibliography.
Lewtas, J., Walsh, D., Williams, R., & Dobiáš, L. (1997). Air pollution exposure-DNA adduct
dosimetry in humans and rodents: Evidence for non-linearity at high doses. Mutation
Research/Fundamental and Molecular Mechanisms of Mutagenesis, 378(1-2), 51–63.
Loewe, L. (2008). Genetic Mutation. Retrieved December 16, 2012.
Malcom, S., & Goodship, T. H. J. (Eds.). (2001). From Genotype to Phenotype (2nd ed.).
Oxford, England: BIOS Scientific Publishers Ltd.
Martins, E. P., & Garland, T. (1991). Phylgentic analyses of the correlated evolution of
continuous characters—A simulation study. Evolution, 45, 534–557.
McShea, D. (1991). Complexity and evolution: What everybody knows. Biology and
Philosophy, 6, 303–324.
Mendel, G. (1865). Experiments in plant hybridization.New York: Cosimo Inc.
Miles, R., Snow, C., Mathews, J., & Miles, G. (1997). Organizing in the knowledge age:
Anticipating the cellular form. Academy of Management Executive, 11(4), 7–20.
Morgan, G. (1997). Images of organization. London: SAGE Publications.
National Science Foundation. (2007). Enhancing Support of Transformative Research at the
National Science Foundation. Arlington, VA: Author. Retrieved from http://www.nsf.gov/
nsb/documents/2007/tr_report.pdf
Nelson, R. (2006). Evolutionary social science and universal Darwinism. Journal of
Evolutionary Economics, 16(5), 491–510.
Nikolic, I., & Davis, C. (2012). 6. Self-Organization in Wikis. In T. M. Egyedi & D. C. Mehos
(Eds.), Inverse Infrastructures: Disrupting Networks from Below. Cheltenham, England:
Edward Elgar Publishing.
Nowak, M., & Sigmund, K. (1993). A strategy of win-stay, lose-shift that outperforms tit- for-
tat in the Prisoner’s Dilemma game. Nature. 364, 56–58.
OGC. (2002). Managing Successful Projects with PRINCE2. (2nd Ed.). London: The Stationery
Office.
Pearsall, J., Soanes, C., & Stevenson, A. (2011). The Concise Oxford English Dictionary (12th
ed.). Oxford, England: Oxford University Press, Oxford, England.
Pearson, J. C., Lemons, D., & McGinnis, W. (2005). Modulating Hox gene functions during
animal body patterning. Nature Reviews Genetics, 6(12), 893–904.
Peterson, R. A. (2005). Problems in comparative research: The example of omnivorousness.
Poetics, 33(5-6), 257–282.
Project Management Institute. (2013). A guide to the project management body of
knowledge (PMBOK® Guide) (5th ed.). Newtown Square, PA: Author.
Pray, L. (2008). DNA replication and causes of mutation. Nature Education, 1(1). Retrieved
from http://www.nature.com/scitable/topicpage/dna-replication-and-causes-of-mutation.
33
New Insights into Project Management Research: A Natural Sciences Comparative
Rammel, C., Stagl, S., & Wilfing, H. (2007). Managing complex adaptive systems—A co-
evolutionary perspective on natural resource management. Ecological Economics, 63(1), 9–
21.
Schneider, M., & Somers, M. (2006). Organizations as complex adaptive systems:
Implications of complexity theory for leadership research. The Leadership Quarterly, 17(4),
351–365.
Shan, Y., & Yang, A. (2008). Applications of complex adaptive systems. Hershey, PA: IGI
Publishing.
Shenhar, A., & Bonen, Z. (1997). The new taxonomy of systems: Toward an adaptive systems
engineering framework. IEEE Transactions on Systems Man and Cybernetics – Part A Systems
and Humans,4. doi:10.1109/3468.554678
Simon, H. (1993). Alturism and Economics. The Americian Economic Review, 8(2), 156–161.
Simon, W. (1960). Herbert Spencer and the “Social Organism.” Journal of the History of
Ideas, 21(2), 294–299.
Smith, J. M. (1982). Evolution and the Theory of Games. Cambridge, MA: Cambridge
University Press.
Van de Ven, A. Poole, M. S., & Van de Ven, A. H. (2005). Alternative approaches for studying
organizational change. Organization Studies, 26(9), 1377–1404.
Vidal, L.-A., Marle, F., & Bocquet, J.-C. (2011). Measuring project complexity using the
Analytic Hierarchy Process. International Journal of Project Management, 29(6), 718–727.
Wickler, W. (1968). Mimicry in plants and animals. New York: McGraw Hill.
Williams, M., & Vogt, P. (2011). Introduction: Innovation in Social Research Methods. In M.
Williams & P. Vogt (Eds.), The SAGE Handbook of Innovation in Social Research. London:
Sage Publications.
Williams, S. E., Shoo, L. P., Isaac, J. L., Hoffmann, A. A, & Langham, G. (2008). Towards an
integrated framework for assessing the vulnerability of species to climate change. PLoS
Biology, 6(12), 2621–2626.
Wright, S. (1932). The roles of mutation, inbreeding, crossbreeding and selection in
evolution. Proceedings of 6th Int. Congress on Genetics, 1, pp. 356–366.
Yerushalmi, S., & Green, R. M. (2009). Evidence for the adaptive significance of circadian
rhythms. Ecology Letters, 12(9), 970–81.
34
New Insights into Project Management Research: A Natural Sciences Comparative
Appendix—Definitions of Terms
Term Definition Source
Altruism A disinterested and selfless concern for the well-being of others. Oxford Dictionary
Complex CAS involve many components that adapt or learn as they interact John Holland
Adaptive System and exhibit emergent behavior.
(CAS) Santa Fe Institute,
New Mexico
Cell In biology, the smallest structural and functional unit of an Oxford Dictionary
organism, which is typically microscopic and consists of cytoplasm
and a nucleus enclosed in a membrane.
Chromosome A threadlike structure of nucleic acids and protein found in the Oxford Dictionary
nucleus of most living cells, carrying genetic information in the
form of genes.
Evolutionary In game theory, behavioral ecology, and evolutionary psychology, John Maynard Smith
stable strategy an evolutionarily stable strategy (ESS) is a strategy which explains
(ESS) why altruism is not sustainable.
Fidelity The degree of exactness with which something is copied or Oxford Dictionary
reproduced.
Fitness landscape In evolutionary biology, fitness landscapes or adaptive landscapes Sewall Green Wright
are used to visualize the relationship between genotypes (or
phenotypes) and reproductive success.
Gene Informal use: A unit of heredity which is transferred from a parent Oxford Dictionary
to offspring and is held to determine some characteristic of the
offspring.
35
New Insights into Project Management Research: A Natural Sciences Comparative
Methodology A system of practices, techniques, procedures, and rules used by Project Management
those who work in a discipline. Institute
Nucleus A dense organelle present in most eukaryotic cells, typically a Oxford Dictionary
single rounded structure bounded by a double membrane,
containing the genetic material.
Phenotype Organism’s phenotype is its observable characteristics or traits (Malcom & Goodship,
that are both physical and behavioral. 2001)
Pleiotropic The production by a single gene of two or more apparently Oxford Dictionary
unrelated effects.
Progenotype A term used to denote the project core makeup (project Authors
methodology and the methodology elements).
®
Project A temporary endeavor untaken to create a product, service, or PMI PMBOK Guide—
result. Fifth Edition
Project outcome The results of the project in terms of deliverables and Authors
nondeliverables, irrespective of whether the original project
success criteria were achieved.
Unit of The smallest unit of information that is able to take on the state of Authors
Knowledge being true of false.
36
Appendix II
The Impact of Project Methodologies on Project Success in
Different Project Environments
Abstract
Purpose – To qualitatively validate the constructs of a theoretically derived research model
whilst gaining insights to steer the direction of a greater study on methodologies, their
elements, and their impact on project success. In doing so, to investigate whether different
project environments, notably project governance, impacts the relationship between
methodologies and project success.
Findings – There is a positive relationship between project methodology elements and the
characteristics of project success; however, environmental factors, notably project
governance, influence the use and effectiveness of a project methodology and its elements
with a resulting impact on the characteristics of project success.
Research implications – Project governance plays a major role in the moderating effect of
a project methodology’s effectiveness. Contingency theory is applicable to a project’s
methodology’s selection and its customization according to the project environment.
1
The Impact of Project Methodologies on Project Success in Different Project Environments
Introduction
Project failures are estimated to cost hundreds of billions of euros yearly (McManus & Wood-
Harper, 2008) and are not limited to any specific region or industry (Flyvbjerg, Bruzelius, &
Rothengatter, 2003; Nichols, Sharma, & Spires, 2011; Pinto & Mantel, 1990).
Project methodologies have been developed specifically to help address low success rates
using project-related knowledge (The Standish Group, 2010; Wysocki, 2006). Government
bodies have helped to establish standards in methodologies and guidelines, with their tools,
techniques, processes, and procedures (Morris, Crawford, Hodgson, Shepherd, & Thomas,
2006). The term project methodology implies a homogeneous entity, instead is it a
heterogeneous collection of practices that vary from organization to organization (Harrington,
Voehl, Zlotin, & Zusman, 2012). To understand the impact of relationship between
methodology and success, the building blocks of a methodology need to be understood. The
building blocks of a methodology are not defined or agreed upon to an extent that it is
commonly accepted; therefore, we define the building blocks of a methodology as
methodology elements that can include processes, tools, techniques, methods, capability
profiles, and knowledge areas.
The reference to processes within the above definition is not to be confused with the project
life cycle. A process is defined as a structured set of activities to accomplish a specific
objective (TSO, 2009), whereas a project life cycle is defined as the series of phases that a
project passes through from its initiation to its closure (PMI, 2013).
2
The Impact of Project Methodologies on Project Success in Different Project Environments
Pinto & Mantel, 1990). Research has shown that projects where methodologies are used
provide more predictable and higher success rates (Lehtonen & Martinsuo, 2006; Wells,
2012). However, there are still high project failure rates for projects that do use project
methodologies (Wells, 2012).
More research is required to better understand how project methodologies impact success,
but it would be naive to assume that phenomena occur without the influence of context. This
is also implied in the literature, for example, there is much research to determine whether
standardized or customized project methodologies lead to greater project success.
The purpose of this study is to investigate whether there is a relationship between a project
methodology, including its elements, and project success, and if this relationship is impacted
by the project environment (e.g., project governance or culture). This will provide the
knowledge for organizations to customize project methodologies to their environment,
thereby minimizing the risk of methodology elements being used suboptimally while also
allowing “at-risk” methodology elements to be proactively monitored.
The unit of analysis is the relationship between project methodology and project success.
The overall methodological approach of the study is deductive. The authors qualitatively
validate the research model (see Figure 1) through interviews that are inductively analyzed.
3
The Impact of Project Methodologies on Project Success in Different Project Environments
Results from this research should qualitatively validate the constructs of a theoretically
derived research model by clarifying terminology to gain insights for a future study on
methodologies, their elements, and their impact on project success.
The next section provides a literature review of the research subject, followed by a
description of the methodology in this study, an analysis section, a discussion, and
conclusions. The appendices provide the interview questions and analysis data.
Literature Review
This section reviews the literature on project methodologies, the possible moderating effect
of the project environment on the relationship between methodology and success, and the
definition and measure of project success.
Project Success
The classification of a project as a success or a failure is, to a degree, subjective (Ika, 2009).
Müller and Jugdev (2012) describe project success as “predominately in the eyes of
beholder” meaning one stakeholder may consider a project successful, where another
stakeholder would consider it a failure. To reduce the subjectivity relating to project success,
a common understanding is required. To achieve this, success criteria should be defined in
the initiating phase of the project (PMI, 2013, p. 51). Morris and Hough (1987) define
success criteria as the measures used to judge the success or failure of a project; these are
dependent variables that measure success.
It is worth mentioning that even with comprehensive definitions for project success criteria,
some project criteria remain subjective by nature, for example, product usability or the
acceptance of new processes. The methods and techniques aimed at quantifying subjective
measures reduce subjectivity. However, when subjective criteria are mixed with objective
criteria, which collectively determine whether a project is considered a success, projects with
diverse groups of stakeholders are unlikely to reach unanimous agreements (Ika, 2009).
Project success criteria have evolved from simple quantifiable time, scope, and cost
measures (iron triangle), which primarily are related to project efficiency (Bryde, 2005), to
measures that have a longer term perspective directly relating to effectiveness and
organizational impact (Belout, 1998; Jugdev, Thomas, & Delisle, 2001; Shenhar, Levy, &
Dvir, 1997). Project success is a multidimensional construct where project stakeholders can
select a number of project success criteria they believe are important to judge success.
4
The Impact of Project Methodologies on Project Success in Different Project Environments
For each project, not only should success criteria be defined from the beginning of the
project, but the relevant success factors also need to be identified and incorporated in a
timely manner across the project life cycle (Pinto & Prescott, 1988).
Neither Prince2 nor A Guide to the Project Management Body of Knowledge (PMBOK®
Guide)—(Fifth Edition) (PMI, 2013) define the term success factors, but both standards
make use of the term. Turner (2007) defines project success factors as elements of a
project, which when influenced increase the likelihood of success; these are the independent
variables that make success more likely.
These definitions for project success factors and project success criteria will be used in the
interviews as well as the quantitative research to ensure a common understanding of
terminology.
The selection process for determining relevant success factors is not without risk. When
success factors that have absolutely no impact on the project outcome are implemented,
then both management time and cost is wasted (Atkinson, 1999). The selection and/or
timing of the implementation for nonrelevant success factors are called Type 2 errors
(Atkinson, 1999). Type 1 errors are success factors that are important but incorrectly
implemented. Attention should be given not only to the selection of individual success factors
but also to the combination or grouping of related success factors that are contingent on the
project life cycle (Belassi & Tukel, 1996). To understand the complex interaction of success
factors throughout the project life cycle, success factor frameworks were developed (Belassi
& Tukel, 1996). A framework is defined as a basic structure underlying a system or context
(Pearsall, Soanes, & Stevenson, 2011). Therefore, a success framework can be defined as
a basic structure, underlying system, or context that supports the project life cycle to meet
the project’s success criteria.
5
The Impact of Project Methodologies on Project Success in Different Project Environments
Project Methodologies
During the past 40 years, attention has shifted from individual tools and methods to
methodologies that encompass multiple methods and tools (Lehtonen & Martinsuo, 2005).
However the transition to methodologies has created inconsistencies in how the terms
method and methodology are sometimes used. For example, Prince 2, which is a process-
oriented project methodology is described as “a method that supports some aspects of
project management” (TSO, 2009), and PMI’s body of knowledge is often referred to by
practitioners as a project methodology, which academics point out is a body of knowledge.
Anderson and Merna (2003) have helped to categorize the methodologies into process
models, knowledge models, practice models, and baseline models.
Research on project methodologies is limited, and the results are somewhat contradictory.
For example, literature is split on whether project methodologies directly contribute to goals
(Cooke-Davies, 2002; Fortune & White, 2006; White & Fortune, 2002) or to the perceived
appropriateness of project management (Lehtonen & Martinsuo, 2006). Another example is
in some cases, the existence of positive attitudes toward project methodologies, and in other
cases, unrealistic expectations are directed toward project methodologies (Lehtonen &
Martinsuo, 2005). However, if these methodologies do not produce the expected results,
they are replaced by other methodologies and often with methodologies with other limitations
(White & Fortune, 2002). A third example is a critical attitude towards methodologies
because they sometimes do not seem to fit, for example, complex project environments;
however, when methodologies are customized they tend to be too complex to be
maintained, and the organization may switch from an overly formal, rigid control to chaotic
freedom (Lehtonen & Martinsuo, 2005). Thomas and Mullaly (2007) explain this dilemma by
6
The Impact of Project Methodologies on Project Success in Different Project Environments
stating “the multiplicity of potential benefits that executives, practitioners, and consultants
associate with implementing project management [methodologies], but they make no effort
to quantify these values […] where empirical evidence exists it is tantalizing fragmented and
incomplete.” Perhaps this problem is a result of something that lies deeper in the elements of
a methodology. Busby & Hughes (2004) have an interesting notion that methodologies are
being infected with pathogens especially in the tools and systems employed that impact
project success. This implies that, irrespective of configuration, when the tools and systems
used in a methodology are infected with pathogens, the methodology never achieves its
intended purpose of supporting project success.
Methodologies are either referenced in the literature as a whole (The Standish Group, 2010),
or by one or more aspects of project management practice methodology element(s) and
investigating the impact of these practices on project success (Cooke-Davies & Arzymanow,
2003; Cooke-Davies, 2002; Milosevic & Patanakul, 2005). To understand how
methodologies and their elements collectively support achieving project success, viewing
methodologies at too high a level or on a singular element basis may not be sufficient.
Guidance may come from looking at project success factors which are described at the level
of the methodology elements. The difference between a methodology element and a
success factor is in the description. A success factor contains an adjective used to describe
its syntactic role to qualify the underlying methodology element. For example, project
scheduling is a methodology element, whereas efficient project scheduling is a success
factor.
Taking one methodology element at a time and determining its impact on project success
does not give a holistic picture of how the elements of a methodology impact the
characteristics of the project success. Some methodology elements may have a greater
collective impact on project success characteristics than others.
There is a gap in the research regarding whether the elements within any given methodology
collectively impact the characteristics of project success.
7
The Impact of Project Methodologies on Project Success in Different Project Environments
the rate of project failure (19%) and projects that partly met their project success criteria
using project methodologies (46%). The conclusion is that closer attention should be given
to the correct choice and application of the methodology and tools. Cooper (2007) observed
that many organizations are mismanaging projects because they are using tools and
techniques that are not appropriate for the project type or applying financial selection criteria
that are not appropriate for the project type.
Lehtonen and Martinsuo (2006) sum up the research dilemma on project methodologies by
stating “The confusion in research results is reflected also in companies’ swing between
standardized and customized systems, and between formal and chaotic methodologies.” A
conclusion can be drawn from the literature that the effective use of a methodology is
contingent upon the project environment. This statement may at first appear contrary to the
term standardized methodologies, but it is unclear from the literature as to the origins of
implemented standardized methodologies. Regardless of whether a standardized
methodology is derived from an international standard or alternatively developed in-house,
both examples suggest degrees of customization even though they are classified in the
literature as standardized methodologies. Therefore to fully understand whether a
methodology is standardized or customized, the origin of the methodology needs to be
understood.
The extensive research on success factors topics, such as leadership competency profiles
(Müller & Turner, 2010), stakeholder management (Turner & Müller, 2004), risks addressed
(Cooke-Davies, 2002), realistic schedule (Morris & Hough, 1987), and HR management
(Belout & Gauvreau, 2004), all take into consideration the project context, which may or may
not be reflected and/or used within in the respective organizations’ project methodologies.
There is a research gap regarding the impact of the project environment on the relationship
between an applied project methodology and its elements on project success.
8
The Impact of Project Methodologies on Project Success in Different Project Environments
been applied to project context research with the first studies in the late 1980’s (Donaldson,
2006).
The application of contingency theory in the field of project management has been applied to
various areas, including topology of projects with minor and major impacts (Blake, 1978),
innovation types in business (Steele, 1975), product development project types (Wheelwright
& Clark, 1992), leadership styles for project and functional managers in organization change
(Turner, Müller, & Dulewicz, 2009), project procedures customized to context (Payne &
Turner, 1999), leadership styles per project type (Müller & Turner, 2007), and project type
and the ability to select appropriate management methods linked to project success (Boehm
& Turner, 2004; Shenhar & Dvir, 1996). Contingency theory will be used to help explain
observed phenomena relating to the influence of environmental factors, notably project
governance on the relationship between project methodology and project success.
The literature implies the relationships shown in Figure 1 but does not indicate these
relationships have been tested. The literature review also indicates a lack of understanding
about the relationship between methodology elements and their impact on success
characteristics, and the possible moderation by the project environment, notably project
governance.
Research Methodology
A philosophical stance of critical realism was used in the study. Critical realism assumes
reality is mostly objective, however social constructions are recognized which must be
outlined in an objectivist way (Alvesson, 2009). This paradigm combines people’s subjective
interpretations framed by their experiences and their view of reality with objective
mechanisms and events (Bhaskar, 1975).
A deductive approach was taken to validate the model shown in (Figure 1). Data collection
was done through semistructured interviews. Interviews were used so as to gain a greater
depth of understanding as to how the interviewees understood the way in which project
methodologies performed within their environment in terms of impacting the characteristics
of project success and whether the project environment influenced the relationship of project
methodology and project success. Project methodologies are described using different
terminologies; therefore, a definition was required to create a generic understanding of the
parts of a methodology. The findings will be used for a follow-up larger study to achieve
generalizable results.
9
The Impact of Project Methodologies on Project Success in Different Project Environments
1. Nature of the organization and the type of projects run within the organization.
2. Project methodology(s); how it was originally developed and evolved, project types
supported, strengths, and weaknesses.
3. Project success; organization definition.
4. Impact of a project methodology (including its elements) on project success.
5. Impact of the project environment (including project governance) on the relationship
between methodology and the characteristics of project success.
6. Other comments from the interviewees rating to project methodology(s), project
environment, and project success.
The first set of questions was used to obtain an understanding about the organization’s
business area; core business; and size and types of projects, including complexity, technical
challenge, and pace. The questions relating to project types and characteristics (urgency,
complexity, and technology), were taken from (Shenhar & Dvir, 2007; TSO, 2009) and are
included in Appendix 2. These questions should provide some context regarding the choice
of the organization’s methodology(s) and level of customization.
The second set of questions relates to the methodology(s) within the organization, in order to
understand whether methodology is based on an international or internally developed
standard, whether there are variations of the methodology for different project types, and
what are its strengths and weaknesses.
The third set of questions concerns the definition and interpretation of project success, that
is, whether project success criteria were defined within the organization, and whether there
is any written data.
The fourth set of questions addresses the impact of project methodology and its elements on
project success.
The fifth set of questions refers to the moderating effect of project environmental factors on
methodology and project success and then focuses on one moderating environmental factor,
which is, project governance.
10
The Impact of Project Methodologies on Project Success in Different Project Environments
Sampling
Convenience sampling was used to determine the interviewees’ list, meaning the
interviewees who have the best knowledge of the research subject. The number of
interviews was determined by theoretical saturation (Miles & Huberman, 1994). The data
was collected from several industries and geographies so as to find commonalities and
differences in order to understand the relationship between the variables (see Figure 1).
Data Collection
The authors conducted 19 semistructured interviews at which point theoretical saturation
was reached. Participants were from 19 different organizations in 11 industrial sectors
including research/exploration, telecommunications services, industrial services, oil and gas
related, equipment and services, software and IT services, commercial printing services,
insurance, food and beverage, banking and investment services, and logistics, which were
categorized using the Reuters categorization system (Reuters, 2013) and the interviews
spanned four countries (Switzerland, USA, UK, and Germany). The participant roles
included CTO director/program manager, PMO lead, project manager, delivery IT manager,
systems engineer lead, head of R&D research, CFO/COO, and general manager.
The interviews were semistructured and lasted between 60 and 90 minutes. Interview notes
and recordings were written up and compared for cross validation. When additional
questions or clarity were required, follow-up was done using Skype sessions and email.
11
The Impact of Project Methodologies on Project Success in Different Project Environments
• Reliability:
o Interview protocols were reviewed by peers and the data collected from a
spread of industries and countries (USA, Switzerland, Germany and the UK).
o Identified patterns were cross-validated for reliability.
• Internal Validity:
o Concept validity was provided through the theoretically derived model, which
was built on existing literature, and from which the propositions were drawn.
Construct validity was achieved through convergence of the interviewee data.
12
The Impact of Project Methodologies on Project Success in Different Project Environments
such as scheduling or risk management and its impact on project success. This study looks
at all of the parts of the methodology where the independent variable, project methodology,
includes processes, tools, techniques, methods, capability profiles, and knowledge areas.
Interviewees were asked to provide a term that encompasses all parts of their methodology;
the majority believed that “elements” was the appropriate term to use.
Project success. To understand what project success is, success criteria need to be
defined; otherwise success could mean something different to each person. The
interviewees were asked whether project success is defined within the organization. None of
the 19 interviewees said their organization has a standard definition for project success.
When asked how their performance was evaluated on projects, the majority mentioned time,
cost, scope, and sometimes customer satisfaction. For the research organizations, success
was described in terms of the number of ideas, the number of ideas moved to development,
and the number that were industrialized.
The interviewees were asked whether project methodology within the organization impacts
the characteristics of project success. Figure 2 shows that project methodology does impact
the project success characteristics where the highest references were to time, cost, and
scope.
One of the interviews stated “Yes, 100%” and then described method elements that if not
executed correctly, would impact the characteristics of project success, “Requirements
management not followed through results in insufficient scope development and insufficient
project governance around changes.”
13
The Impact of Project Methodologies on Project Success in Different Project Environments
and Pinto describe this by writing “it’s time to move on project management from a rather
tired and dated positivist or normative origin stemming with its roots firmed in engineering
companies to perhaps where it needs to reflect much more in a complex reality, such as
organizational change-type projects where interpretive views of the reason for change are
more appropriate” (Morris & Pinto, 2004). The international standards, such as PMI’s A
Guide to the Project Management Body of Knowledge (PMBOK® Guide) (PMI, 2013) or the
UK Office of Government’s Commerce (OGC) Prince2, are updated every few years and
include extensions for government, construction, defense, and the software industries.
Figure 3 was developed from the interviews to help structure the source and levels of
methodology customization. Of the organizations interviewed, 65% of the methodologies
were based on an international standard, and of these organizations, 75% customized the
international standards to varying degrees. It is interesting to note that 35% of the
organizations interviewed had more than one methodology that was customizable per
project type. Two of the interviewees in the software consulting business, explained that their
organizations had over 40 methodologies that were used for different applications,
industries, and project types. This shows the apparent need and benefit for some
organizations to employ specialized methodologies according to application, project type,
and business area. None of the organizations interviewed indicated that their project
methodologies were customized at the level of the project team and skills, however this may
be implicitly done by the project teams in organizations that allow further levels of
customization.
14
The Impact of Project Methodologies on Project Success in Different Project Environments
These findings indicate that environmental factors have a moderating effect on the
relationship between project methodology and project success, because the interviewees’
organizations are invested into creating and maintaining customized/tailored methodologies.
One of the interviewees said that “the company culture impacted whether the elements of
the methodology were used or not; typically change management, risk management, and
issue management were not used or done properly,” reiterating the moderating effect of
environmental factors.
Sponsor
Internal Political-senior Pressure to Understanding the
Leadership Skills and resource understanding Understanding
Environmental Governance management Culture reduce need for good
maturity constraints need for a project requirements
factors decisions project costs project management
methodology
Number of
interviewees 10 4 4 4 4 4 3 3 1
mentioned
Referring to Figure 5, the interviewees were asked which external environmental factors
have an impact on the relationship or way in which methodology elements are used to
achieve project success. Only a few interviewees mentioned external environmental factors,
probably because the roles of these interviewees were in supporting government institutions
or in the general consulting area. There was no single external environmental factor that was
more prominent than others. These external factors were as important for the impact of the
effectiveness of the project methodology, as the internal factors are, for those interviewees
15
The Impact of Project Methodologies on Project Success in Different Project Environments
whose project environment was primarily internal. One interviewee stated that “when dealing
with the government, things are never clear from the beginning” and another interviewee
stated that “government can suddenly change priorities immediately” and provided examples
such as the government shutdown or regulations on hiring. Interviewees working in
consulting positions for companies raised the issue of “client culture” that is not conducive
for projects, in addition to a lack of understanding of what is required in project management.
External
Regulatory and legal Governance Client's understanding of Changes in
Environmental Client culture Funding
requirements structure(s) project management policy, priorities
factors
Number of
interviewees 2 2 1 1 1 1
mentioned
Metholodology
Stakeholder Change Risk Cost QA - Benefits Configuration Issue Technical Technical Stagegate Procure-
elements Cost control Testing Reporting
management management management estimating assessments management management management estimating reviews reviews ment
impacted
Number of
interviewees 11 10 8 8 7 3 3 3 2 2 1 1 1 1 1
mentioned
16
The Impact of Project Methodologies on Project Success in Different Project Environments
The interviewees were then asked to take project governance as the environmental factor
and identify which elements of their project methodology(s) related to project success were
impacted (moderated) by project governance. Referring to Figure 7, cost and stakeholder
management were mentioned the most as being impacted by project governance. The
references to the impact on the stakeholder management methodology element were
positive and negative. On the positive side, some interviewees, primarily in the consulting
area, designed stakeholder involvement and decision making around the project governance
structures to ensure a full alignment with all decisions made. On the negative side, others
mentioned that stakeholders were excluded from critical parts of the project management life
cycle mainly due to ill-fitting project governance structures.
Governance
Change Risk QA - Benefits Issue
moderation Stakeholder Cost Cost Configuration Technical Technical Stagegate Procure-
manage- manage- Testing assess- manage- manage- Reporting
effect on the management control
ment
estimating
ment ments ment ment
management reviews estimating reviews ment
unit of analysis
Number of
interviewees 8 7 5 5 3 2 2 2 2 1 1 1 0 0 0
mentioned
One of the interviewees involved in software consulting said that “during the process of
bidding for the work, which can last for months, the project governance structures are well
defined before the contract is signed so that any decision made to deviate from the plan in
terms of using the elements of the methodology are agreed upon in writing by the various
levels.” Another interviewee explained that “project governance is used at the setup of the
project where the project manager is required to justify why specific elements of a
methodology will not be used.” This was the only reference provided where every
methodology element must be used unless there is justification on for not using an element.
Two methodology elements—cost estimating and cost control—were raised in both the
positive and negative contexts. Projects in control use proper cost estimation (using the cost
control element) and projects out of cost control are due to lack of project governance
impacting the use of the cost control element.
The findings from the interviews support proposition 2: There is a moderating effect of the
project environment on the relationship of methodology usage and project success.
Discussion
The interview results showed the importance of project methodologies and their elements as
they directly impact the characteristics of project success. This is consistent with the finding
17
The Impact of Project Methodologies on Project Success in Different Project Environments
in the literature at the methodology level (Belassi & Tukel, 1996; Pinto & Prescott, 1988;
Zwikael & Unger-Aviram, 2010).
An applied project methodology consists of a number of elements that collectively impact the
characteristics of project success. The interviewees mentioned 15 methodology elements
that impacted project success and of these 15 elements, they discussed 13 elements which
they believed their effectiveness in supporting project success was influenced by project
governance.
Therefore, the nature of the relationship between project methodology elements and project
success seems to be contingent on the project environment, notably project governance.
Discussions on the impact of project governance were mainly from a positive perspective.
Therefore the influence of project governance on the elements of a project methodology was
based on the premise that project governance was supportive of project success. However,
if project governance was misaligned or suboptimal with respect to supporting the project,
the positive impact of trying to apply a methodology would be reduced or could be
detrimental to project success. This can be explained by the effect of Type 1 and Type 2
errors (Atkinson, 1999), which was not directly discussed during the interviews but was
implied by the discussion of suboptimally implemented methodology elements. For example,
one of the interviewees stated that a project with a poor governance structure resulted in
suboptimal and delayed decision making which impacted project success (a Type 1 error).
Not all methodology elements are equal, meaning, some of the methodology elements may
have a greater impact on project success than others. Literature describes these as project
success factors (Pinto & Slevin, 1987). Success factors may be linked to one or more
underlying methodology elements, but the determination of which elements or groups of
elements are highly correlated to project success requires further research.
We continue with the theme of evolving and adapting methodologies but take a different
perspective on project methodologies to provide additional insight. Some elements of a
methodology have a greater impact on the characteristics of project success than others. A
18
The Impact of Project Methodologies on Project Success in Different Project Environments
natural science comparative model of Joslin and Müller (2013) compares project
methodology elements to the genes of an organism. The genes of an organism are the
building blocks of the organism (including the observable characteristics) called a phenotype
(Malcom & Goodship, 2001). Genes are switched on and off throughout the life of an
organism, which the authors argue is the same concept as the elements of a methodology
being applied, when required (switched on), to a project throughout its life cycle, then
switched off when not required. The nature science comparative reifies a project
methodology that is considered as the core makeup of a project and, therefore, is
responsible for the switching on and off of methodology elements. The project manager is
considered to be an environmental variable. Some of the genes in an organism are highly
pleiotropic, meaning their impact can be seen in the organism’s phenotype, for example, hair
color, eyes, and height (Stearns, 2010). The comparative explains that the same is true for
elements of the applied project methodology. The highly pleiotropic methodology elements
noticeably impact the characteristics of project success. Returning to the interviews, some
interviewees discussed the impact on project success of certain methodology elements
when they were not used, due to the impact of environmental factors. The examples given
included change requests, risk management, and deliverable sign-off procedures. The
resulting consequences on the characteristics of project success included increased costs,
quality issues, and reduced customer satisfaction. These examples could be indicators of
highly pleiotropic methodology elements. This alternative perspective of a natural science
comparative may provide new insights that would not be possible using a social science
perspective.
Humans like to rationalize and standardize what is seen by some as falsely assumed as
progress (Habermas & Lawrence, 1990), whereas nature is for specificity and optimization to
the environment (Dawkins, 1974). Methodologies exist within a socially constructed world,
but one could argue that these methodologies coexist within a natural science world—a
world that contends with survival of the fittest (Dennett, 1996); therefore, the concept of
methodologies is likely to show the characteristics of both worlds. For example, some
methodology elements may be considered to be common or core versus other elements that
are considered to be contingent or more impacted, that is, influenced by the environment.
Certain elements should be clear and common, for example, scope definition, clear project
mission/goals, good cost management, and time management, etc. Other elements may be
more variable, for example, acceptance of variation/changes and stakeholder engagement,
etc. Perhaps referring to a core (standardized) and a subsidiary (unique) methodology
elements, where the latter is more influenced by the environment, would be an interesting
perspective of a core makeup of a project. Both core and subsidiary elements are under the
19
The Impact of Project Methodologies on Project Success in Different Project Environments
effect of project governance and, depending on the governance inclination, may converge or
diverge with other methodology elements; thereby challenging whether standardized, partly
standardized and partly customized, or fully customized methodologies best achieve project
success.
Contingency theory within the field of project management offers insight into how to best
adapt project management practices within a given environment to meet the project
management goals (Hanisch & Wald, 2012). Contingency theory applies to selecting and
customizing the project methodology according to the environment. The findings from the
interviews show that the effectiveness of the methodology to achieve project success is
moderated by the project environment. Project governance was the most frequently
mentioned environmental factor impacting the effectiveness of the applied project
methodology. Examples were given of ill-fitting project governance structures that impacted
the ability to follow procedures, to obtain resources, and to finalize requirements, test
strategies, and quality assurance. The findings did not go so far as to suggest actions to
enhance the positive aspects and minimize the negative aspects of the environmental
project governance factor.
This study’s findings show that methodologies should be viewed at the methodology element
level where the elements collectively impact project success. The nature of the relationship
between the methodology elements and project success is dependent on the project
environment, which impacts the effectiveness of the elements to such a degree that Type 1
and Type 2 errors start to occur (Atkinson, 1999). All the organizations interviewed have
either a methodology based on an international standard that has been customized in some
way to the organization in varying degrees or an in-house developed project methodology.
Understanding the origins of a project methodology highlights the significance of
methodology customization, which may not be apparent when the origins of the methodology
are ignored or not understood. Therefore, project methodologies that are termed as
standardized may have gone through several iterations of customization, because they were
first implemented based on the premise that methodology effectiveness is contingent on the
project environment.
Conclusions
This qualitative study interviewed 19 project, program, and senior IT managers from 11
industries across four countries who all have detailed knowledge of their organization’s
methodology(s). A deductive approach was used to validate a theoretically derived research
model.
20
The Impact of Project Methodologies on Project Success in Different Project Environments
The findings show that there is a positive relationship between project methodology
elements and the characteristics of project success; however, the influence of the project
environment, notably project governance, can influence the effectiveness of this relationship.
The findings also show that missing or misaligned governance structures can introduce Type
1 and Type 2 errors.
Contingency theory within the field of project management offers insight as to how to best
adapt project management practices within a given environment to meet the project
management goals. This study has helped to achieve the research aims to qualitatively
validate the constructs of the research model, gain agreement in the use of the terms
methodology elements and project success, and gain additional insights, such as the
importance of understanding the methodology source and levels of customization.
For project managers using a project methodology, there is a risk of suboptimal project
performance, because the effectiveness of methodology elements may be negatively
impacted by environmental factors. The project manager should understand which project
methodology elements are the foundation for success factor variables and understand and
manage the potential reduced effectiveness of those project methodology elements that
could increase the risk of project failure.
21
The Impact of Project Methodologies on Project Success in Different Project Environments
interviewers helped to provide rich data, generating new insights which would not have been
possible from an online survey.
This study is based on interviews of a small sample size, therefore the results cannot be
generalized. Also the lack of theoretical support of the empirical findings (i.e., the terms
used), and depth of the research (i.e., the first and minor part of a larger study).
Future Research
To better understand how generic versus customized methodologies are impacted by
environment factors, for example, is there a commonality between the environmental factors
that impact the elements of a generic methodology and those environmental factors that
impact a highly customized project methodology?
To understand if project type impacts the relationship between project methodology and
project success; and further, to determine whether different environments impact the
completeness of an organization’s methodology? In other words, are some organizations’
methodologies more comprehensive than others and, if so, what are the implications?
Contributions to Knowledge
The value of this study lies in the following:
To provide empirical data for a prestudy in a new field of study using a new method. A
natural to social science comparative was created comparing project methodology elements
to genes of an organism (Joslin & Müller, 2014). The results of this study in conjunction with
a greater study will be used to determine the validity of the new comparative.
22
The Impact of Project Methodologies on Project Success in Different Project Environments
References
Alvesson, M. (2009). (Post-) positivism, social constructionism, critical realism: Three
reference points in the philosophy of science. In M. Alvesson & K. Sköldberg (Eds.),
Reflexive Methodology: New Vistas for Qualitative Research (2nd ed., pp. 15–51).
London: SAGE Publications, Ltd.
Atkinson, R. (1999). Project management: Cost, time and quality, two best guesses and a
phenomenon, it’s time to accept other success criteria. International Journal of Project
Management, 17(6), 337–342.
Belassi, W., & Tukel, O. I. (1996). A new framework for determining critical success/failure
factors in projects. International Journal of Project Management, 14(3), 141–151.
Belout, A., & Gauvreau, C. (2004). Factors influencing project success: the impact of human
resource management. International Journal of Project Management, 22(1), 1–11.
Bhaskar, R. (1975). A Realist Theory of Science. London: Taylor and Francis Group.
Blake, S. (1978). Managing for Responsive Research and Development. San Francisco, CA:
WH Freeman & Co.
Boehm, B., & Turner, R. (2004). Balancing agility and discipline: evaluating and integrating
agile and plan-driven methods. Proceedings of the 26th International Conference on
Software Engineering, May 23-28, Edinburgh, Scotland.
Bryde, D. J. (2005). Methods for managing different perspectives of project success. British
Journal of Management, 16(2), 119–131.
Burns, T., & Stalker, G. (1961). The Management of Innovation. University of Illinois at
Urbana-Champaign’s …. London: Tavistock.
Busby, J. S., & Hughes, E. J. (2004). Projects, pathogens and incubation periods.
International Journal of Project Management, 22(5), 425–434.
23
The Impact of Project Methodologies on Project Success in Different Project Environments
Crawford, L., Hobbs, B., & Turner, J. (2005). Project categorization systems. Project
Management Institute, Newton Square, PA, …. Newton Square, PA, ….
Dawkins, R. (1974). The Selfish Gene (30th ed.). Oxford, England: Oxford University Press.
Dennett, D. C. (1996). Darwin’s Dangerous Idea: Evolution and the Meaning of Life (p. 592).
New York: Simon & Schuster.
Eisenhardt, M. (1989). Building theories from case study research. Academy of Management
Review, 14(4), 532–550.
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003). Megaprojects and Risk: An Anatomy
of Ambition. Cambridge, England: Cambridge University Press.
Fortune, J., & White, D. (2006). Framing of project critical success factors by a systems
model. International Journal of Project Management, 24(1), 53–65.
Habermas, J., & Lawrence, F. (1990). The Philosophical Discourse of Modernity: Twelve
Lectures. Contemporary Sociology, 19(2), 316–317.
Hanisch, B., & Wald, A. (2012). A bibliometric view on the use of contingency theory in
project management research. Project Management Journal, 43(3), 4–23.
Harrington, H., Voehl, F., Zlotin, B., & Zusman, A. (2012). The directed evolution
methodology: A collection of tools, software and methods for creating systemic change.
The TQM Journal, 24(4).
Joslin, R., & Müller, R. (2013). A natural science comparative to develop new insights for
project management research. In Drouin, Müller, & Sankaran (Eds.), Novel Approaches
to Organizational Project Management Research: Translational and Transformational
(pp. 320–345). Copenhagen Business School Press.
Joslin, R., & Müller, R. (2014). New Insights into Project Management Research: A Natural
Sciences Comparative. Project Management Journal (Under Review).
Jugdev, K., Thomas, J., & Delisle, C. (2001). Rethinking project management: Old truths and
new insights. International Project Management Journal, 7(1), 36–43.
24
The Impact of Project Methodologies on Project Success in Different Project Environments
Lechler, T., & Geraldi, J. (2013). Comparing Apples with Apples: Developing a Project Based
Contingency Theory. Retrieved August 20, 2013, from
http://discovery.ucl.ac.uk/1400476/
Lehtonen, P., & Martinsuo, M. (2005). Three ways to fail in project management: Role and
improvement needs of a project management methodology. In 18th Scandinavian
Academy of Management Meeting (pp. 18–20). Aarhus, Denmark.
Lehtonen, P., & Martinsuo, M. (2006). Three ways to fail in project management: The role of
project management methodology. Project Perspectives, XXVIII(1), 6–11.
Malcom, S., & Goodship, T. H. J. (Eds.). (2001). From Genotype to Phenotype (2nd ed., Vol.
2001). Oxford, England: BIOS Scientific Publishers Ltd.
McManus, J., & Wood-Harper, T. (2008). A Study in Project Failure. Retrieved August 10,
2013, from http://www.bcs.org/content/ConWebDoc/19584
Miles, M., & Huberman, A. (1994). Qualitative Data Analysis: An Expanded Sourcebook (2nd
ed.). Thousand Oaks, Ca: SAGE Publications Inc. USA.
Milosevic, D., Inman, L., & Ozbay, A. (2001). Impact of project management standardization
on project effectiveness. Engineering Management Journal, 13(4), 9–16.
Milosevic, D., & Patanakul, P. (2005). Standardized project management may increase
development projects success. International Journal of Project Management, 23(3),
181–192.
Morris, P. W., Crawford, L., Hodgson, D., Shepherd, M., & Thomas, J. (2006). Exploring the
role of formal bodies of knowledge in defining a profession – The case of project
management. International Journal of Project Management, 24(8), 710–721.
Morris, P. W., & Hough, G. (1987). The Anatomy of Major Projects: A Study of the Reality of
Project Management. New York: John Wiley & Sons. New York: Wiley & Sons Inc.
Morris, P. W., & Pinto, J. K. (2004). The Wiley Guide to Managing Projects. Wiley Guide to
Managing Projects (1st ed.). New York: John Wiley & Sons.
Müller, R., & Jugdev, K. (2012). Critical success factors in projects: Pinto, Slevin, and
Prescott – The elucidation of project success. International Journal of Managing
Projects in Business, 5(4), 757–775.
Müller, R., & Turner, J. R. (2007). Matching the project manager’s leadership style to project
type. International Journal of Project Management, 25(1), 21–32.
Müller, R., & Turner, J. R. (2010). Leadership competency profiles of successful project
managers. International Journal of Project Management, 28(5), 437–448.
25
The Impact of Project Methodologies on Project Success in Different Project Environments
Nichols, K., Sharma, S., & Spires, R. (2011). Seven imperatives for success in IT
megaprojects. Retrieved August 20, 2013, from
http://www.mckinsey.com/client_service/public_sector/latest_thinking/mckinsey_on_gov
ernment/seven_imperatives_for_success_in_it_megaprojects
OECD. (2004). OECD Principles of Corporate Governance 2004. Paris: OECD Publishing.
Payne, J., & Turner, J. R. (1999). Company-wide project management: The planning and
control of programmes of projects of different type. International Journal of Project
Management, 17(1), 55–59.
Pearsall, J., Soanes, C., & Stevenson, A. (2011). The Concise Oxford English Dictionary
(12th ed.). Oxford, England: Oxford University Press.
Pinto, J. K., & Mantel, S. (1990). The causes of project failure. IEEE Transactions on
Engineering Management, 37(4), 269–276.
Pinto, J. K., & Prescott, J. (1988). Variations in critical success factors over the stages in the
project life cycle. Journal of Management, 14(I), 5–18.
Pinto, J. K., & Slevin, D. (1987). Critical factors in successful project implementation.
Engineering Management, IEEE …, (1), 22–27.
PMI. (2013). A Guide to the Project Management Body of Knowledge (PMBOK® Guide).
sims.monash.edu.au (5th ed.). Newtown Square, PA, USA: Project Management
Institute.
Reuters. (2013). Thomson Reuters Business Classification (TRBC). New York: Reuters.
Shenhar, A. J., & Dvir, D. (1996). Towards a typological theory of project management.
Research Policy, 25(4), 607–632.
Shenhar, A. J., & Dvir, D. (2007). Reinventing Project Management: The Diamond Approach
to Successful Growth and Innovation. Boston, MA: Harvard Business School Press.
Shenhar, A. J., Dvir, D., Lechler, T., & Ploi, M. (2002). One size does not fit all - True for
projects, true for frameworks. In Proceedings of PMI Research Conference, Seattle,
Washington, USA (pp. 99–106).
Shenhar, A. J., Levy, O., & Dvir, D. (1997). Mapping the dimensions of project success.
Project Management Journal, 28(2), 5–13.
The Standish Group. (2010). Chaos Summary for 2010. The Standish Group. Boston, MA.
Retrieved from www.standishgroup.com
26
The Impact of Project Methodologies on Project Success in Different Project Environments
Thomas, J., & Mullaly, M. (2007). Understanding the value of project management: First
steps on an international investigation in search of value. Project Management Journal,
38(3), 74–89.
TSO. (2009). Managing Successful Projects with PRINCE2. London: Office Of Government
Commerce.
Turner, J. R. (2007). Handbook of Project Management (2nd ed.). London: McGraw Hil.
Turner, J. R., & Müller, R. (2004). Communication and co-operation on projects between the
project qwner as principal and the project manager as agent. European Management
Journal, 22(3), 327–336.
Turner, J. R., Müller, R., & Dulewicz, V. (2009). Comparing the leadership styles of
functional and project managers. International Journal of Project Management, 2(2),
198–216.
Wheelwright, S., & Clark, K. (1992). Revolutionizing New Product Development: Quantum
Leaps in Speed, Efficiency, and Quality. Revolutionizing new product …. New York:
The Free Press.
White, D., & Fortune, J. (2002). Current practice in project management—An empirical
study. International Journal of Project Management, 20(1), 1–11.
Woodward, J., Dawson, S., & Wedderburn, D. (1965). Industrial organization: Theory and
practice. London: Oxford University Press.
Wysocki, R. (2006). Effective software Project management. Indianapolis: Wiley, New York.
Zwikael, O., & Unger-Aviram, E. (2010). HRM in project groups: The effect of project
duration on team development effectiveness. International Journal of Project
Management, 28(5), 413–421.
27
The Impact of Project Methodologies on Project Success in Different Project Environments
• What is the criterion to judge project size in terms of small, medium, and large in your
organization?
A A A B
Application Project Type Internal / Urgency Innovation Size Technology Complexity
External
Engineering, research, internal low, none, small low, medium, task, simple
IT, consulting, medium, incremental, high, project,
external medium
Organizational development, time- breakthrough, normal
extreme
Change, operations, both critical, transformation large project,
Marketing, decommissioning, crisis al daunting
Finance organizational project,
change, service program
improvement,
service
development,
service
decommissioning
A
The ranges of Urgency, Innovation and Technology taken from Shenhar’s Diamond model (Shenhar & Dvir,
2007)
B
The ranges for Complexity are taken from Prince 2 (TSO, 2009)
2. The project methodology(s); how it was originally developed and evolved, project
types supported, strengths, and weaknesses.
Please describe the project methodology or methodologies your organization uses including
whether it is based on an international standard like Prince2, Prompt, or PMBOK® Guide?
If the methodology was based on an international standard, then was the methodology
tailored/customized to your business and, if so, was it tailored/customized per project type or
per business section?
If the methodology was developed within your organization was it developed for a specific
product or service? Please describe its background.
28
The Impact of Project Methodologies on Project Success in Different Project Environments
Are there derivatives of the methodology for different types of projects or business areas
and, if so, describe why?
Are there certain types of projects that your methodology is less or more suited to?
Does your project methodology evolve to meet organizational needs and, if so, how does it
evolve? Also, who is responsible for its evolution?
Looking at the methodology, what word would you use to describe the parts of the
methodology (hierarchical breakdown) in a generic sense?
Does you project methodology for any given project type—integrate the “how to build”
something with the “what to build” or is the “what to build” (requirements specs) kept
separately?
Have you observed the project methodology, including how its elements impact the
characteristics of project success?
5. Project governance paradigm based on Müller (2009) and how it relates to the
goals of the organization/shareholders.
29
The Impact of Project Methodologies on Project Success in Different Project Environments
create profit to satisfy the needs of the shareholders, but this is only one of a variety of
stakeholder groups.
30
The Impact of Project Methodologies on Project Success in Different Project Environments
Director Program Research/ USA Research, space All All Breath through Large High Program
management Exploration exploration Transformational Extreme
Manager, PMO and Telecommunications USA Ultra broadband All but strong Medium, Incremental, Large Emphasis on Program
Implementation Services devices and emphasis on Time breakthrough, Medium, high
services and IP research critical Transformational
routing
Department Head Telecommunications USA Telecomms research, Medium, Incremental, Large Emphasis on Program
Services products development Time breakthrough, Medium, high
critical Transformational
General Manager Industrial Services USA Design and research, Medium, Incremental, Large Medium with Program
development development, Time breakthrough some High
projects - production runs critical
industrial
Director Office of Oil & Gas Related USA Operating All Medium, Low All Low All
Project Management Equipment and petroleum Time
Services reserves critical
Delivery IT Software & IT USA IT Software All Time Incremental All Low Program
Services Services Critical
Systems Engineer Industrial Services USA Consulting and All Medium, Breakthrough/ Large High Program
strategic Time Transformational Extreme
planning critical
Project Manager Telecommunications SCH Air traffic control All Medium, Incremental All High Project,
Time Program
critical
Project Manager Commerical Printing CH Security All All Incremental, All All All
Services solutions, Breakthrough
printing
Project Manager Telecommunications SCH Industrial goods All All All All All All
Delivery Director Software & IT ServicesCH Business IT All All All except for All Low, medium All
Systems transformational
integrator
CTO CH Software Product All Incremental, some All Low, medium All
product Development breakthrough
development Implementatio
Software & IT Services n
Program manager Insurnance CH Insurance All All None, Incremental All Low, medium All
methodology trainer products life and
health
Head of Enterprise Insurance CH Reinsurnace All All Incremental, All Low, medium All
Transformation breakthrough
Innovation, R&D and Food and Beverages CH Food research All Low, All All All All
Operations and production medium,
time
critical
CFO COO | CFO Banking and CH Banking All All Incremental All Low, medium Program
Program Services Investment Services
Project Manager Logistics DE Logistics Service Crisis Incremental Large Medium Program
Development
Project Research DE Research Research, Low, Incremental small, High, Low
Manager/researcher institute development, medium medium Extreme
consulting
PMO Lead Insurance UK Solvency II Development Time None, Incremental Large Low Program
Critical
*CH - Switzerland
USA - United states of America
UK - United Kingdom
DE - Germany
A
The attributes of the business classification column is taken from Reuters Business classification (Reuters, 2013)
B
The attributes of the Project types column are derived from project categorization systems (Crawford, Hobbs, & Turner, 2005)
C
The attributes of the Urgency and Technology columns are taken from Shenhar’s Diamond model (Shenhar & Dvir, 2007)
D
The attributes of the complexity column are taken from the Prince2 definition of complexity (TSO, 2009)
E
The scaling of small, medium and large was dependent on the interviewees’ responses. The numbers were normalized into small,
medium and large.
31
Appendix III
Relationships Between a Project Management Methodology and
Project Success in Different Project Governance Contexts
Abstract
This study looks at the relationship between the use of a project management methodology (PMM)
and project success, and the impact of project governance context on this relationship. A cross-
sectional, world-wide, online survey yielded 254 responses. Analysis was done through factor
analysis and moderated hierarchical regression analysis. The results of the study show that the
application of a PMM accounts for 22.3% of the variation in project success, and PMMs that are
considered sufficiently comprehensive to manage the project lead to higher levels of project
success than PMMs that need to be supplemented for use by the project manager.
Project governance acts as a quasi-moderator in this relationship. The findings should benefit
project management practitioners by providing insights into the choice of PMM in different
governance contexts. Academics should benefit from insights into PMMs’ role as a success factors
in projects.
Introduction
Project success is one of the most researched topics in project management, but the meaning of
the term “success” varies substantially (Judgev & Müller, 2005). Cooke-Davies (2002) makes the
distinction between project success which is measured against the overall objectives of the project,
and accomplished through the use of the project’s output, and project management success which
is measured at the end of the project against success criteria, such as those relating to internal
efficiency, typically cost, time, and quality (Atkinson, 1999). The accomplishment of these criteria
can be influenced throughout the project life cycle through success factors (Müller & Turner, 2007).
1
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
One of these factors is the project management methodology (PMM), which is meant to enhance
project effectiveness and increase chances of success (Vaskimo, 2011). Thus, PMMs were
developed to support project managers in achieving more predictable project success rates.
However, the extent that this objective is reached is unknown as projects still fail to reach their
goals (Lehtonen & Martinsuo, 2006; Wells, 2013) and a quantification of the impact of PMMs on
project success is still missing.
A related perspective is the comprehensiveness of a PMM and its impact on project success
(Fortune, White, Judgev, & Walker, 2011; Wells, 2013; White & Fortune, 2002). The premise of
being able to standardize and/or customize a methodology is the underlying assumption that the
PMM will then become comprehensive that is, sufficient for any given project.
Wells (2013) and Joslin and Müller (2014a) found that PMMs vary in completeness and
appropriateness from organization to organization. Some are considered inadequate for certain
types of projects. These reported issues suggest that it is not sufficient to look at a PMM as a whole,
especially as every PMM is a heterogeneous collection of practices that vary from organization to
organization (Harrington, Voehl, Zlotin, & Zusman, 2012). In this paper, we first define the elements
of a PMM and then investigate their collective impact on project success in governance contexts.
2
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
The aim of this study is to further investigate the relationship between a PMM and its elements
with project success, and how this relationship is impacted by different project governance
contexts. For that the following research question is posed:
What is the nature of the relationship between a PMM and project success and is this
relationship influenced by project governance?
The unit of analysis is the relationship between the PMM and project success. In line with nature of
the research question, the study takes a contingency theory perspective.
The results of the study will provide a better understanding of an organization’s PMM in terms of
the impact of a PMM on project success, and how different project governance contexts influence
the selection, effectiveness, and comprehensiveness in the use of PMMs.
These findings help organizations to understand how to align their PMMs to optimize effectiveness
in use, which should result in higher project success rates and reduce the complaints about ill-fitting
PMMs.
This paper continues by reviewing the related literature, which is followed by the methodology and
analysis sections. The paper finishes with a discussion and conclusions and provides the survey
questions in the Appendix.
3
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Project Success
For more than 40 years, academics have tried to understand what project success is and which
factors contribute to it (Ika, 2009). However, its meaning is still not generally agreed upon (Judgev
& Müller, 2005). Project success is a multidimensional construct that includes both the short-term
project management success efficiency and the longer-term achievement of desired results from
the project, that is, effectiveness and impact (Judgev, Thomas, & Delisle, 2001; Shenhar, Levy, &
Dvir, 1997).
To achieve a common understanding of what project success is, it should be measurable and
therefore defined in terms of success criteria (Müller & Turner, 2007). The understanding of project
success criteria has evolved from the simplistic triple constraint concept, known as the iron triangle
(time, scope, and cost), to something that encompasses many more success criteria (Atkinson,
1999; Judgev & Müller, 2005; Müller & Jugdev, 2012; Shenhar & Dvir, 2007). Measurement models
for success that are applicable for different types of projects or different aspects of project success
were developed by Pinto and Slevin (1988a), Shenhar, Tishler, Dvir, Lipovetsky, and Lechler (2002),
Hoegl and Gemuenden (2001), and Turner and Müller (2006).
At the same time, project success factors became a popular theme in research (e.g. Belassi & Tukel,
1996; Cooke-Davies & Arzymanow, 2002; Pinto & Slevin, 1988a; Tishler, Dvir, Shenhar, &
Lipovetsky, 1996; White & Fortune, 2002). Factors can be categorized into environmentally related
(meaning where the project resides) (Fortune & White, 2006; Hyväri, 2006; Jha & Iyer, 2006),
people-related (Tishler et al., 1996), processes- and tools-related, (Jessen & Andersen, 2000; Khang,
2008; Shenhar, Tishler, Dvir, Lipovetsky, & Lechler, 2002), and context-related (Sauser, Reilly, &
Shenhar, 2009). In absence of a formal definition for project context, the definition of the term
“context” has been adapted from Abowd, Dey, & Brown (1999): Project context is any information
that can be used to characterize the situation of project which includes physical and mental aspects.
The physical aspects of project context include previous projects as well as the project environment
where the project actually resides, whereas the mental aspects includes social, emotional, or
informational states.
4
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Schultz, Slevin, and Pinto (1987) suggested that the relative importance of success factors varies
over the project life cycle. Shenhar, Dvir, Levy, and Maltz (2001) described the importance of
success factors not just on the project life cycle but also on the product life cycle from project
completion to production, and then to preparation for project/service replacement. Researchers
soon realized that success factors without structure, grouping, and context would result in
increased project risks; therefore, success factor frameworks were introduced (Judgev & Müller,
2005). Pinto developed a success framework covering organizational effectiveness, technical
validity, and organizational validity (Pinto & Slevin, 1988b). Freeman and Beale’s (1992) success
framework included efficiency of execution, technical performance, managerial and organizational
implications, manufacturability, personal growth, and business performance. Shenhar et al (2001)
described that no one-size-fits-all exists by using a four-dimensional framework, showing how
different types of projects require different success factors, determined by the strategic nature and
the short- and long-term project objectives.
Khan, Turner, and Maqsood (2013) developed a model of success factors derived from a literature
review of the past 40 years. Their model offers a balance between hard and soft factors and
measures success using 25 variables organized in five dimensions. The model contains the three
criteria for the iron triangle (dimension 1) plus four additional project success criteria dimensions:
1. Project efficiency,
2. Organizational benefits,
3. Project impact,
4. Stakeholder satisfaction, and
5. Future potential.
Their model was selected for this study as it is based on the latest literature which is a superset of
the success criteria from the leading researchers on project success.
5
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Customization. Shenhar and Dvir (1996) were the first proponents of customization in
showing that projects exhibit considerable variation, which, at that time, went against the literature
trend which assumed all projects were fundamentally similar. In repeating Shenhar et al’s mantra
Wysocki (2011) stated that the often-used term “one size fits all” does not work in project
management. This is supported by Payne & Turner (1999) who found that project managers often
report better results when they can tailor procedures to the type and size of the project they are
working on or the type of resource used on the project. Russo, and Stolterman noted that the most
successful PMMs are those developed for the industry/organization which are aligned to the
context factors (2002).
6
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
The literature on PMMs is divided on whether standardized or highly customized PMMs are more
effective in supporting project success, but the research implies the importance of context albeit in
varying degrees. In this paper, we look at the impact of context on the effectiveness of a PMM.
To understand what constitutes a PMM, several international standards were reviewed. The Project
Management Institute (2013) describes a PMM as “a system of practices, techniques, and
procedures, and rules,” whereas Prince II is not described as a PMM, but rather as a method (Office
of Government Commerce (OGC), 2002) that contains processes but not techniques. 1 Ericsson’s
PROPS PMM does not call itself a PMM but a model, where the model describes all of the project
management activities and documentation (Ericsson, 2013). In absence of a consistent description
for the elements of a PMM, this study uses the definition of PMM elements from Joslin and Müller
(2014b) which defines PMM elements as processes, tools, techniques, knowledge areas, and
comprehensive capability profiles.
1
The Office of Government Commerce (OCG) leaves it up to the project manager to decide on the relevant techniques
to use during the project life cycle.
7
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
A PMM should take into account different levels of scope and comprehensiveness where the term
comprehensiveness is taken to mean including or dealing with all or nearly all elements or aspects
of something “comprehensiveness” (OxfordDictionaries, 2014). PMMs that are not comprehensive
are considered incomplete in this study and therefore will need to be supplemented during project
execution.
Each organization must decide on the level of PMM comprehensiveness, where the more
comprehensive the PMM, the less need for it to be supplemented when it is applied to a project. In
this study, the term “organization’s comprehensive PMM” means the implemented PMM within an
organization and its ability to support all of the project types without the need to be supplemented
with missing elements (Mengel, Cowan-Sahadath, & Follert, 2009). Some organizations may choose
not to invest in a comprehensive PMM or training and instead assume that their project PMM will
always need to be supplemented, thereby leaving this decision to the user of the PMM. This is
called “supplementing missing elements.”
Irrespective of whether a PMM is supplemented or not, the user may still decide to apply only a
subset of the PMM. This is done in an attempt to apply only those elements of a PMM required for
achieving the desired project outcome. We refer to this as “applying relevant PMM elements”
throughout the paper.
Studies showed that organizations experience limitations in their PMMs irrespective of whether it is
an in-house or an off-the-shelf PMM (Fortune, White, Jugdev, & Walker, 2011; Joslin & Müller,
2014; White & Fortune, 2002). Wells (2013) found that when the selection of PMMs at the
organizational level did not address the needs of the departments and projects, project managers
would tailor their organizational PMMs specifically for their projects.
The literature review indicates a knowledge gap regarding the collective impact of a project’s PMM
elements on project success.
H1.1 There is a positive relationship between a comprehensive set of PMM elements and project
success.
8
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
H1.2: There is a positive relationship between supplementing missing PMM elements and project
success.
H1.3: There is a positive relationship between applying relevant PMM elements and project
success.
In projects, governance takes place at different levels, for example, groups of projects, such as
programs or portfolios of projects, where the emphasis is on collective governance, which is viewed
as governance of projects (Müller & Lecoeuvre, 2014). This differs from governance of individual
projects, which we defined earlier in this paper using Pinto’s (2014) definition.
The governance of projects combined with project governance coexist within the corporate
governance framework, and both cover portfolio, program, and project management governance
(Müller et al., 2014). The literature on project governance addresses several contexts, such as
project governance for risk allocation (Abednego & Ogunlana, 2006), a framework for analyzing the
development and delivery of large capital projects (Miller & Hobbs, 2005), NASA-specific framework
for projects (Shenhar et al., 2005), governing the project process (Winch, 2001), mechanisms of
governance in project organizations (Turner & Keegan, 2001), normalization of deviance (Pinto,
2014), and governance in project-based organizations (functional, matrix, or projectized) (Müller et
al., 2014). The literature on governance does not cover either the direct influence of governance on
a project PMM or the impact of governance on the nature of the relationship between a project
PMM and project success. Hence, there is a knowledge gap in the literature for understanding the
9
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
impact of project governance on the nature of the relationship between a project PMM and project
success.
The reason for considering project governance as the context factor is because corporate
governance exists from the point of creation of an organization. Project governance has influenced
the way individuals have viewed project management because it provides the structure through
which projects are set up, run, and reported (Turner, 2006). Therefore, project governance is likely
to influence the choices taken in selecting, applying, and evolving a PMM. Project governance may
also influence the relationship between PMM and project success, which is one of the hypotheses
in this paper. For these reasons, project governance was selected as the moderator factor for the
research model (see Figure 1).
To understand the impact of project governance on the relationship between PMM and project
success, a framework to categorize each organization’s governance is required. Governance models
are developed from different perspectives using either a top-down or bottom-up approach (Klakegg
et al., 2009). Top-down approaches are developed from a shareholder-outcome perspective
whereas bottom-up approaches take a process control perspective and can be considered as an
extension of a PMM (Müller, 2009). This study requires a governance model that considers
perspectives of shareholder versus stakeholder, and a “follow the process” behavior approach
versus a “get it done” outcome approach. This is required because the governance model
perspectives map to the overall objective of a project, that is, a successful outcome, with the
10
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
objective of a PMM (structured approach to deliver a project), all within an environment that is
influenced by shareholders and stakeholders.
Governance models that incorporate topics such as ethics, corporate citizenship, roles, and
responsibilities (Dinsmore & Rocha, 2012; Renz, 2008; Turner, 2008; Walker, Segon, & Rowlingson,
2008) were excluded because the emphasis of this study is on shareholder-stakeholder and
behavior-outcome aspects of the organization. Therefore, the most relevant model was Müller’s
governance model (2009) which draws on the theories of transaction cost economics, agency
theory, and institutional theory using legitimacy to emphasize conformance.
The governance model by Müller (2009) uses categories, called governance paradigms, where an
organization governing a particular project fits into one of four paradigms. It addresses corporate
governance orientation (shareholder-stakeholder orientation) and the organizational approach to
control (behavior versus outcome control). The corporate governance dimension builds on models
from Clarke (2004) and Hernandez (2012) who claim that a corporation's governance orientation
can be found on a continuum from shareholder to stakeholder orientation. The second dimension
“control” represents the control exercised by the governing institution over the project and its
manager. This distinguishes between organizational control, which focuses on goal accomplishment
by controlling outcomes (e.g., reaching a set of objectives), versus compliance with a focus on
employees’ behavior (e.g., following a process, such as a project management PMM) (Brown &
Eisenhardt, 1997; Ouchi & Price, 1978; Ouchi, 1980).
To address the second part of the research question, based on the literature review we hypothesize
that:
Hypotheses 2: The relationship between the project PMM and project success is moderated by
project governance.
H2.1: The impact of a comprehensive set of PMM elements on project success is moderated by
project governance.
H2.2: The impact of supplementing missing PMM elements on project success is moderated by
project governance.
11
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
H2.3: The impact of application of relevant PMM elements on project success is moderated by
project governance.
A recent bibliographical review of contingency theory in the field of project management showed it
is increasingly used in research with a noticeable increase since 2005 (Hanisch & Wald, 2012).
Fitzgerald, Russo, and Stolterman (2002) noted that the most successful PMMs are those developed
for industries or organizations that are aligned to context factors. Lehtonen and Martinsuo’s study
of project failure and the role of project management PMM concluded “some contingency variables
may have an impact on the relation between PMM and success” (Lehtonen & Martinsuo, 2006).
This supports the notion of contingency theory where the independent variable “PMM” and the
dependent variable “success” are influenced by a third variable.
Contingency theory is being used as the theoretical lens for this study to help understand the
impact of project PMM on project success in the context of governance paradigms.
Research Methodology
We took a post-positivist perspective in the sense of Tashakkori and Teddlie (2009), who see post-
positivism as ‘currently the predominant philosophy for quantitative research in the human
sciences’ (p.69). Post-positivism ‘assumes that the world is mainly driven by generalizable (natural)
laws, but their application and results are often situational dependent. Post-positivist researchers
therefore identify trends, that is, theories which hold in certain situations, but cannot be
generalized Biedenbach and Müller(2011). Tashakkori and Teddlie (2009, p. 87) suggest that “‘post-
positivists prefer using either quantitatively oriented experimental or survey research to assess
relationships among variables and to explain those relationships statistically.” This study uses a
deductive approach and cross-sectional questionnaire to validate the model shown in Figure 1.
12
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Questionnaire Development
Five sets of questions were included in the questionnaire. The first set included information about
the last project; the next three sets covered project PMM, governance paradigms, and project
success; and the last set collected the respondents’ demographic information. The questionnaire,
followed the suggestions of Cooper and Schindler (2011) to ensure the scales, criteria, and wording
were consistent and clear. The questions relating to PMM were developed based on prior work by
Joslin and Müller (2014c). The PMM dimensions and questions are shown in Appendix 2. The
project context questions were based on the governance paradigms from Müller (2009), which
were then operationalized in Müller and Lecoeuvre (2014). The governance paradigms were
selected as they have been used successfully in several project management related studies and
reflect an organization’s governance positioning with regard to two continuums: (1) shareholder-
stakeholder and (2) behavior-outcome. The project success dimensions were based on Khan and
Turner (2013). The five dimensions (project efficiency, organizational benefits, project impact,
stakeholder satisfaction, and future potential), cover short- and long-term implications of project
success. A pilot test was done with ten respondents. Based on the feedback, minor wording
changes were made for understandability. The pilot answers were not used in the analysis.
The recommendations from Podsakoff and Organ (1986) were followed to minimize potential
common methods bias, including confirmed anonymity in the introductory text, different layout
and scales, and randomizing of the questions. To avoid biases introduced by the respondent’s
choice of project, for example, providing information about their most successful project, the
survey asked respondents to report on their most recently completed project.
Data collection
Data collection was performed through a worldwide, cross-sectional questionnaire to collect
quantitative data for generalizable results. The respondents were contacted using email with a link
to the web survey. In addition, the survey details were placed on project management LinkedIn
forums. An email with the survey link was sent to PMI chapters. Data were collected in a period of
14 days in April 2014. The following filter question was asked to identify qualified respondents: “Do
you have an understanding of your organization’s or client’s project PMM, where you have been
involved as a project stakeholder, that is, someone working in or impacted by projects? By asking
this question, 132 responses were disqualified. This resulted in 254 full responses that could be
13
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
used for analysis. Responses came from 41 different countries with 24% from Europe, 38% from
North America, 22% from Australasia, and 16% from other countries. ANOVA analyses on
differences between the early and late respondents, as well as between demographic regions
showed no significant differences (p=0.149 and 0.249 respectively). Average work experience was
22 years and average project-related work experience was 15 years. Sample demographics are
shown in Table 1.
Table 1: Demographics
Characteristic N % Characteristic N %
Sector: Gender
Research & Development 31 12.2 Male 194 76.4
Engineering/construction 46 18.0 Female 56 22.0
Information 120 47.1 Other 1 0.4
technology/telecom
Media/arts 9 3.5 Total 251 98.8
Relief aid 16 6.3 Missing 3 1.2
Other 29 11.4
Total 251 98.4 Geography - working
Missing 4 1.6 North America 96 37.8
Europe 61 24.0
Position held Australasia 56 22.0
CIO 3 1.2 Other 38 15.0
CTO 2 0.8 Total 251 98.8
Project portfolio manager 17 6.7 Missing 3 1.2
PMO 10 3.9
Program manager 65 25.6 Project-related experience
Project manager 82 32.3 1 to 5 years 36 14.6
Team member 24 9.4 6 to 10 years 63 25.6
Architect/advisor 6 2.4 11 to 15 years 53 21.5
QA/audit function 3 1.2 16 to 20 years 45 18.3
Technical stakeholder 2 0.8 20 years plus 46 18.7
Business stakeholder 4 1.6 Total 243 98.8
Other 35 13.8 Missing 3 1.2
Total 253 99.6
Missing 1 0.4 Work experience
1 to 5 years 36 14.6
6 to 10 years 60 24.4
11 to 15 years 46 18.7
16 to 20 years 49 19.9
20 years plus 52 21.1
Total 243 98.8
Missing 3 1.2
The respondents’ last project information is shown in Table 2. Approximately 48% of the projects
were less than 1 million Euros and 96% of the projects were either of medium to high urgency. 42%
14
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
of projects were executed in matrix organizations and only 21% were executed in functional
organizations.
Characteristic N % Characteristic N %
Urgency of Last
Duration of last project Project
Under six months 44 17.3 Low 11 4.3
6 months to less than 1 year 67 26.4 Medium 107 42.1
1 to 2 years 76 29.9 High 135 53.1
Over 2 years 66 26.0 Total 253 99.6
Total 253 99.6 Missing 1 0.4
Missing 1 0.4
Last Project Executed in the following
Organizational Structure
Projectized
Level of Last Project Complexity Organization 81 31.9
Functional Organization
Low 24 9.4 (Department) 55 21.7
Matrix
Medium 117 46.1 Organization 106 41.7
High 111 43.7 Other 11 4.3
Total 252 99.2 Total 253 99.6
Missing 2 0.8 Missing 1 0.4
Exploratory factor analysis using principle component analysis was used on PMM, governance, and
success variables to identify underlying structures and reduce the number of variables to a
manageable size while retaining as much of the original information as possible (Field, 2009).
Validity was tested through unrotated factor analysis for each dimension, which also served as the
15
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Haman test to exclude common method bias-related issues, as suggested by Podsakoff and Organ
(1986). The results for each of the three concepts gave a Kaiser-Meyer-Olkin (KMO) sampling
adequacy value of 0.8 or higher (p < 0.001), indicating the data’s appropriateness for this analysis.
Following Sharma, Durand, and Gur-Arie (1981), hierarchical regression analysis was used to test
the relationship between PMM and success (hypothesis 1) and to test the moderating influence of
governance on the relationship between PMM and success (hypothesis 2). Finally, a number of
ANOVA tests compared the means of three or more groups to determine additional information
pertaining to two or more of the research model variables. The results are shown in the following
sections.
“Years of project experience” was used as a control variable to filter out spurious effects and
improve internal validity by reducing the confounding effect of variations in a third variable that
could also affect the value of the dependent variable.
Item-to-item and item-to-total correlations below 0.3 and 0.5, respectively, showed internal
consistency. Reliability was tested using Cronbach’s alpha. All constructs showed reliability with
their respective values over 0.70 (Hair et al 2010).
Methodology (PMM). Operationalization was carried out by using a five-point Likert scale
ranging from strongly disagree to strongly agree. The three factors “comprehensive set of
methodology elements” labeled MF01, “supplemented missing methodology elements” labeled
MF02, and “applied relevant methodology elements” labeled MF03 were reliable at 0.75 to 0.77
(Hair et al., 2010) (see Table 3).
16
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Factor analysis with Varimax rotation (eigenvalue > 1, KMO=0.800, p=0.000) on the methodology
questions showed sampling adequacy (Field, 2009) as shown in Table 4. Four factors were originally
identified, explaining 62% of the variance in methodology. However, the mix of loaded variables
was impossible to interpret; therefore five, three, and two-factor solutions were tested, and the
decision for a three-factor solution was taken because of interpretability (Hair et al., 2010). The
factors were determined using a cut-off of 0.5 for loadings. A Haman test (Podsakoff & Organ,
1986) showed that all variables loaded on their predicted factor, thus no issues with common
methods bias were detected.
17
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Governance. Similar analyses were done for the governance questions. The data were
adequate for factor analysis (normal assumptions met (KMO 0.812, p<0.001). Principle component
analysis with Varimax rotation at a cut-off Eigenvalue of 1.0 for factor acceptance (Field, 2009)
resulted in two factors, which explained 53% of the variance: GOVCorpGov (shareholder versus
stakeholder) and GOVCorp (behavior versus outcome control). Both were reliable at Cronbach
alpha’s of 0.743 and 0.802, respectively.
Results
Impact of PMM Elements on Project Success
The correlation matrix (Table 5) indicates positive correlations between the variables, which
provides for further analysis. Hierarchical regression analysis was performed using the previously
mentioned control variable and the three independent variables for a comprehensive set of
methodology elements (MF01), supplemented missing methodology elements (MF02), and applied
relevant methodology elements (MF03) using project success as the dependent variable, with a
significance level set at 0.05. Results are shown in Table 6 under Step 2. All independent variables
18
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
correlate significantly with project success with an R2 of 22.3%. Thus, giving support for Hypothesis
1 and its subhypotheses H1.1, H1.2, and H1.3.
The results are shown in Tables 5 and 6. Variance inflation factors (VIF) with values under 2 indicate
no issues of multicolinearity among the independent variables. The control variable (DEM06) had
no significant effect on the dependent variable (project success). As stated above, MF01, MF02, and
MF03 had a significant direct effect in step 2 of Table 6, with R2 = 22.3%.
The moderating variables GOVControl and GOVCorpGov were inserted in step 3 (see Table 6).
GOVCorpGOV significantly correlates with project success. The interaction effect is tested in step 4
by inserting the product of independent variables and moderator variables. It shows that the
interaction of MF03 with GOVCorpGOV is significantly correlated with project success, thus a quasi-
moderator (Sharma et al., 1981). However, the F for change in step 4 of Table 6 is not significant;
therefore GOVCorpGOV can be considered as a quasi-moderator (Sharma et al., 1981).
The other governance dimension, GOVControl, does not interact with any of the independent
variables but is related to MF01 and MF02. Therefore, the visual binning was carried out for MF03
by dividing the data into four groups to determine whether there is a significant difference between
groups. The results showed no significant difference between the four bins (groups); therefore,
according to Sharma, Durand, & Gur-Arie (1981), GOVcontrol is possibly an exogenous, predicator,
intervening, antecedent, or a suppressor variable. This warrants further investigation.
19
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
ProjectSucess Project Work Comprehensive Supplemented Applied Relevant GOVControl GOVCorpGoV MF01 MF02 MF03 MF01 MF02 MF03
REGR Factor Experience Set of Missing Methodology Goverance Corporate x x x x x x
Score 1 for (Years) Methodology Methology Elements "Behavior- Goverance GOVControl GOVControl GOVControl GOVCorpGov GOVCorpGov GOVCorpGov
Analysis 1 DEM06 Elements Elements MF03 Outcome "Shareholder-
MF01 MF02 Orientation" Stakeholder
Orientation"
ProjectSucess REGR factor 1.000
score 1 for analysis 1
DEM06 Project work experience -0.063 1.000
(Years)
Comprehensive set of 0.196**** -0.094 1.000
methodology elements (MF01)
Supplemented missing 0.168*** 0.089 -0.002 1.000
methology elements (MF02)
Applied revelevant methodology 0.385**** 0.059 -0.006 0.000 1.000
elements (MF03)
GOVControl Goverance 0.019 0.092 -0.157** 0.174*** -0.073 1.000
'Behavior-> Outcome
Orientation'
GOVCorpGoV Corporate 0.270**** -0.050 0.090 -0.034 0.104* -0.013 1.000
Goverance (Shareholder-
>Stakeholder) Orientation
MF01xGOVControl -0.009 0.101* 0.026 0.066 -0.041 0.016 0.116* 1.000
MF02xGOVControl 0.041 0.023 0.061 -0.357**** 0.116* 0.023 0.089 -0.076 1.000
MF03xGOVControl 0.017 0.098 -0.045 0.134* -0.071 0.110* -0.051 -0.040 -0.009 1.000
MF01xGOVCorpGov 0.036 0.136* 0.176*** 0.030 0.014 0.109* -0.080 -0.233**** 0.051 0.105* 1.000
MF02xGOVCorpGov 0.139* 0.135* 0.040 0.227**** -0.012 0.110* 0.145** 0.074 -0.092 0.025 -0.121* 1.000
MF03xGOVCorpGov 0.107* 0.043 0.018 -0.015 -0.077 -0.056 0.058 0.127* 0.009 0.137* -0.311**** 0.286**** 1.000
*p≤0.05; **p≤0.01; ***p≤0.005; ****p≤0.001
Table 6: Hierarchical regression with PMM as independent variables, project success as dependent variable, and
governance as moderator variable
20
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
GOVControl was now the independent variable and was tested against MF01 (a comprehensive set
of methodology elements, MF02 (supplemented missing methodology elements), and MF03
(applied relevant methodology elements). The results showed that the relationship between
GOVControl and MF01 was significant (p<=0.01) with a beta of -0.163. This indicates that
organizations that are more behavior/compliance-oriented are more likely to have a complete set
of methodology elements. The second set of results showed that relationship between GOVControl
and MF02 was significant (p<0.005) with a beta of 0.184. This shows that organizations that are
more outcome-oriented are more likely to supplement missing methodology elements, as required,
than those that are more compliance-oriented who use a complete methodology. The third set of
results showed that the relationship between GOVControl and MF03 was insignificant, therefore
GOVcontrol (behavior versus outcome) has no impact on how the methodology elements are used.
Other Findings
We examined project success on the basis of demographics and additional methodology data.
These tests were conducted using ANOVA to examine the difference between the means of
different groups selected using demographic data. There were significant differences where p =
0.05:
• Respondents who said they used PMMs designed for services had significantly higher
project success rates than those that said PMMs were developed for products or both
products and services.
• Respondents who said their PMM required a higher level of project management
experience reported significantly higher project success rates.
• Respondents who said they used an international PMM were significantly more likely to
report that their methodology was comprehensive.
21
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Discussion
The three independent factors (MF01, MF02, and MF03) represent completeness,
supplementation, and application of the elements of a PMM, respectively. All three factors are
significantly correlated to project success and 22.3% of the variation in project success can be
explained by applying the relevant PMM elements (MF03) throughout the project life cycle.
The results support the findings of White and Fortune (2002) and Shenhar et al. (2002) and show
that the experience of using a PMM and the correct choice of tools, techniques, and processes are
both success factors.
The results show that one of the two moderator factors, GOVCorpGov, which is the shareholder
versus stakeholder continuum, acts as a quasi-moderator. This means it has an indeterminate
impact on the relationship between applied methodology elements (MF03) and project success,
because in this constellation “each of the independent variables can, in turn, be interpreted as a
moderator” itself (Cohen, 1988, p. 294).The other two independent variables, comprehensive set of
methodology elements (MF01) and supplemented methodology elements (MF02), are not
moderated by either of the two moderator factors.
From this point, the study turns from deductive to exploratory as we look to see if there is a direct
relationship between the other moderator variable (GOVCorp) and the independent variables
(MF01 to MF03). We find a significant relationship with the independent variable, comprehensive
set of methodology elements (MF01), and also the supplemented methodology elements (MF02).
This implies that governance not only acts as a quasi-moderator (GOVCorpGov) between the
applied PMM and project success, but it also may influence the development or selection of the
PMM, whether it is comprehensive or not. If an organization is more behavior-oriented, then the
incumbent PMM is more likely to be enhanced over time, thereby not requiring supplementation
by the project manager. However, for organizations that are more outcome-oriented, there is a
likelihood that the PMM will not be complete and will require supplementation by the project
manager. This may be a deliberate intention to allow the project manager to tailor the PMM for the
project needs.
Contingency theory within the field of project management offers insight into how to best adapt
project management practices within a given environment to meet the project management goals
22
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
(Donaldson, 2006; Müller, Geraldi, & Turner, 2012; Turner, Müller, & Dulewicz, 2009; Wheelwright
& Clark, 1992). A PMM’s completeness is contingent on governance and suggests that using
contingency theory as a theoretical lens supports the premise that PMMs are impacted by context.
Conclusions
This study is the second part of a mixed-methods study that investigates the effect of governance
on the relationship between a PMM and project success using a contingency theory perspective. A
deductive approach validated a theoretically derived research model. The data were collected
through a web-based questionnaire with 246 respondents from six industry sectors evenly
distributed across North America, Europe, and Australasia. PMM impact on project success was
analyzed, including the quasi-moderating effect of governance on this relationship.
The two research questions can now be answered. For the first question, we found there is a
positive relationship between PMM and project success. Regarding project success, 22.3% of the
variation is accounted for by the PMM, supporting Hypothesis 1. H1.1 is supported whereby having
a comprehensive set of PMM elements including tools, techniques, process capability profiles, and
knowledge areas (MF01) is linked to project success. Also project PMMs that are comprehensive
have higher success rates than PMMs that need to be supplemented; but supplementing with PMM
elements (MF02) is also linked to success, therefore, H1.2 is supported. Applying the relevant PMM
elements (MF03) is also positively correlated with success, supporting H1.3.
For the second research question—project governance as a moderator on the relationship between
PMM and success—we observed one of the two moderating factors GOVCorpGov (shareholder–
stakeholder) acting as a quasi-moderator and not as a full moderator. The role of the second
proposed moderator, GOVControl (behavior–outcome), was also indeterminable because results
indicate that it can be either an exogenous, predicator, intervening, antecedent, or suppressor
23
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
variable (Sharma et al., 1981). Therefore hypothesis 2 is only partly supported and need further
investigation.
Several researchers (Fortune & White, 2006; Shenhar, Tishler, et al., 2002) show that it is not the
use of a PMM that leads to project success; it is the experience of using a project PMM and the
ability to tailor it to the context of a project links to project success. This results of this study
indicate the importance of having a comprehensive PMM and the experience to tailor a PMM are
two success factors in the context of the organizational environment. Therefore, the understanding
of the organization’s governance paradigm is part of the contextual positioning of how to apply the
PMM.
After testing the research model, the study switched from confirmatory to exploratory research to
understand whether governance has a direct impact on a project PMM. The findings suggest that
project governance may also influence the selection of a PMM and how it evolves. For example,
when an organization is more behavior oriented, the findings show that an organization’s PMM is
more likely to be comprehensive. The opposite is true for organizations that are more outcome
oriented. Therefore, organizations that make a decision to develop their own PMM or adopt an
international standard will have different starting points as well as different paths to whether and
how their PMM evolves depending on their governance paradigm.
Practical Implications
A manager responsible for several projects who knows the governance paradigms and their
implications on current and future projects may help influence, shift, or create local project
governance paradigms that are more conducive to success. Organizations that have a more
comprehensive PMM need experienced project managers to ensure they achieve high success
rates. By understanding the governance paradigm and state of the evolution of the organization’s
PMM, a program or project portfolio manager will have insight into the project management skills
and especially the experience necessary for a successful project outcome. When project success
rates are dropping and lessons learned indicate the possibility of an unsuitable PMM,
understanding the governance paradigms and the risks associated with the evolution of a PMM
within each governance paradigm may provide valuable information as to the root cause of the
problems.
24
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Theoretical Implications
The study provided several new insights that can inform further theory development. First, PMM
can now be added as a success factor to the project success literature, as it stands for 22.3% of the
project’s success. This constitutes a major effect of practical significance (Cohen, 1988). Second, the
study showed the importance of distinguishing between the presence of and use of PMMs. The
presence of PMMs in form of comprehensiveness (MF01) or the need for supplementation (MF02)
carry less weigh than the application of a PMM (MF03) in the success equation. Accordingly, further
research on project success needs to take this difference into account by being observant of the
application of PMM (or other success factors) and not its mere presence. This warrants further
investigation for other nonhuman-related project success factors, such as the presence versus the
use of mission statements, plans, or schedules, to name a few. The results of these studies
potentially change our understanding of success factors to a large extent. Third, the selection of a
project PMM and its evolution is influenced by governance. As with PMM elements, a distinction
between presence and application prevails in governance. Behavior-controlled organizations prefer
comprehensive PMMs and outcome-controlled organizations prefer supplementable PMMs when
being successful. However, it should be noted that application is not influenced by governance.
Related theoretical implications are that governance is mainly confined to the procedural aspects
such as form selections and provisions of PMMs, but does not influence the project manager’s
behavior in terms of the appropriate usage thereof. Again, the project manager’s work appears to
be decoupled from the procedures and processes provided to him or her, which should be
investigated further.
Further Research
Future research could provide insights into determining the effectiveness of a PMM and its
elements in achieving project success by evaluating:
• Are there other moderating or mediating factors that influence the relationship between
project PMM and project success?
• Which factors influence an organization to develop its own PMM or adopt a certain type of
PMM and how do these factors influence how a PMM evolves within the organization?
25
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Contributions to Knowledge
This paper contributes to the understanding that the effectiveness of a PMM is not only
determined by the manner in which it is applied, but in the way organizational governance
paradigms influence the selection and evolution of a PMM.
The effectiveness of a PMM that contributes to project success is influenced potentially by many
factors where governance directly impacts a PMM but is only a quasi-moderating factor in the
relationship between PMM and project success.
PMMs need to continually evolve by adapting to the organizational environment within the
governance paradigm; otherwise these PMMs will be misaligned with the project contexts and
hence reduce their contribution to project success.
26
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
References
Abednego, M. P., & Ogunlana, S. O. (2006). Good project governance for proper risk allocation in
public-private partnerships in Indonesia. International Journal of Project Management, 24(7),
622–634.
Abowd, G. D., Dey, A. K., Brown, P. J., Davies, N., Smith, M., & Steggles, P. (1999). Towards a better
understanding of context and context-awareness. In H.-W. Gellersen (Ed.), Handheld and
Ubiquitous Computing (pp. 304–307). Berlin: Springer.
Atkinson, R. (1999). Project management: Cost, time and quality, two best guesses and a
phenomenon, it’s time to accept other success criteria. International Journal of Project
Management, 17(6), 337–342.
Aubry, M., Müller, R., Hobbs, B., & Blomquist, T. (2010). Project management offices in transition.
International Journal of Project Management, 28(8), 766–778.
Belassi, W., & Tukel, O. I. (1996). A new framework for determining critical success/failure factors in
projects. International Journal of Project Management, 14(3), 141–151.
Biedenbach, T., & Müller, R. (2011). Paradigms in project management research: Examples from 15
years of IRNOP conferences. International Journal of Managing Projects in Business, 4(1), 82–
104.
Biesenthal, C., & Wilden, R. (2014). Multi-level project governance: Trends and opportunities.
International Journal of Project Management, 32(8), 1291–1309.
Brown, S., & Eisenhardt, K. M. (1997). The art of continuous change: Linking complexity theory and
time-paced evolution in relentlessly shifting organizations. Administrative Science Quarterly,
42(1), 1–34.
Burns, T., & Stalker, G. (1961). The Management of Innovation. University of Illinois at Urbana-
Champaign’s …. London: Tavistock.
Clegg, S. R. (1994). Weber and Foucault: Social theory for the study of organizations. Organization,
1(1).
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Statistical Power Analysis for
the Behavioral Sciences (2nd ed., Vol. 2nd, p. 567). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cooke-Davies, T. J. (2002). The “real” success factors on projects. International Journal of Project
Management, 20(3), 185–190.
27
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Cooper, D., & Schindler, P. (2011). Business Research Methods (11th ed.). Berkshire: McGraw Hill
Education.
Crawford, L., & Pollack, J. (2007). How generic are project management knowledge and practice?
Project Management Journal, 38(1), 87–97.
Curlee, W. (2008). Modern virtual project management: The effects of a centralized and
decentralized project management office. Project Management Journal, 39(Supplement), S83–
S96.
Dinsmore, P. C., & Rocha, L. (2012). Enterprise Project Governance: A Guide to the Successful
Management of Projects Across the Organization. Enterprise Project Governance. New York:
AMACOM Books.
Donaldson, L. (2001). The Contingency Theory of Organizational Design: Challenges. Thousand Oaks,
CA: SAGE Publications Inc.
Ericsson. (2013). PROPS Manual for Project Managers. Stockholm, Sweden: Ericsson.
Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). Thousand Oaks, CA: SAGE Publications.
Fitzgerald, B., Russo, N., & Stolterman, E. (2002). Information Systems Development: Methods in
Action. Berkshire, England: McGraw Hill Education.
Fortune, J., & White, D. (2006). Framing of project critical success factors by a systems model.
International Journal of Project Management, 24(1), 53–65.
Fortune, J., White, D., Judgev, K., & Walker, D. (2011). Looking again at current practice in project
management. International Journal of Managing Projects in Business, 4(4), 553–572.
Foucault, M. (1980). Power/Knowledge: Selected Interviews and Other Writings, 1972-1977. New
York: Random House LLC.
Freeman, M., & Beale, P. (1992). Measuring project success. Project Management Journal, 23(1), 8–
17.
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis. vectors (7th ed.).
Upper Saddle River, NJ: Prentice Hall Inc.
Hanisch, B., & Wald, A. (2012). A bibliometric view on the use of contingency theory in project
management research. Project Management Journal, 43(3), 4–23.
28
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Harrington, H., Voehl, F., Zlotin, B., & Zusman, A. (2012). The directed evolution methodology: A
collection of tools, software and methods for creating systemic change. The TQM Journal,
24(4).
Hobbs, B., Aubry, M., & Thuillier, D. (2008). The project management office as an organisational
innovation. International Journal of Project Management, 26(5), 547–555.
Hoegl, M., & Gemünden, H. G. (2001). Teamwork quality and the success of innovative projects: A
theoretical concept and empirical evidence. Organization Science, 12(4), 435–449.
Ika, L. (2009). Project success as a topic in project management journals. Project Management
Journal, 40(4), 6–19.
Jessen, S. A., & Andersen, E. (2000). Project evaluation scheme: A tool for evaluating project status
and predicting project results. Project Management, 6(1), 61–67.
Jha, K. N., & Iyer, K. C. (2006). Critical determinants of project coordination. International Journal of
Project Management, 24(4), 314–322.
Joslin, R., & Müller, R. (2014a). Relationships between project methodology and success in different
governance contexts. International Journal of Project Management, In Review.
Joslin, R., & Müller, R. (2014b). The impact of project methodologies on project success in different
contexts. In PMI Research and Education Conference, July 28-29, 2014 (pp. 1–29). Portland,
OR, OR, USA: Project Management Institute.
Joslin, R., & Müller, R. (2014c). The impact of project methodologies on project success in different
project environments. International Journal of Managing Projects in Business, In Review.
Judgev, K., & Müller, R. (2005). A retrospective look at our evolving understanding of project
success. Project Management Journal, 36(4), 19–31.
Judgev, K., Thomas, J., & Delisle, C. L. (2001). Rethinking project management: Old truths and new
insights. International Project Management Journal, 7(1), 36–43.
Khan, K., Turner, J. R., & Maqsood, T. (2013). Factors that influence the success of public sector
projects in Pakistan. In Proceedings of IRNOP 2013 Conference, June 17-19, 2013. Oslo,
Norway: BI Norwegian Business School.
Khang, D., & Moe, T. (2008). Success criteria and factors for international development projects.
Project Management Journal, 39(1), 72–84.
29
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Klakegg, O. J., Williams, T., & Magnussen, O. M. (2009). Governance Frameworks for Public Project
Development and Estimation. Project Management Journal (Vol. 39). Newtown Square, PA:
Project Management Institute.
Lehtonen, P., & Martinsuo, M. (2006). Three ways to fail in project management: The role of project
management methodology. Project Perspectives, XXVIII(1), 6–11.
Mengel, T., Cowan-Sahadath, K., & Follert, F. (2009). The value of project management to
organizations in Canada and Germany, or do values add value? Five case studies. Project
Management Journal, 40(1), 28–41.
Miller, R., & Hobbs, B. (2005). Governance Regimes for Large Complex Projects. Project
Management Journal, 36(3), 42–50.
Milosevic, D., & Patanakul, P. (2005). Standardized project management may increase development
projects success. International Journal of Project Management, 23(3), 181–192.
Müller, R. (2009). Project Governance. In R. Müller & D. Dalcher (Eds.), Fundamentals of Project
Management. Farnham, Surrey, UK: Gower Publishing.
Müller, R., Andersen, E. S., Kvalnes, Ø., Shao, J., Sankaran, S., Turner, J. R., … Gudergan, S. (2013).
The interrelationship of governance, trust, and ethics in temporary organizations. Project
Management Journal, 44(4), 26–44.
Müller, R., Geraldi, J. G., & Turner, J. R. (2012). Relationships between leadership and success in
different types of project complexities. IEEE Transactions on Engineering Management, 59(1),
77–90.
Müller, R., & Judgev, K. (2012). Critical success factors in projects: Pinto, Slevin, and Prescott – The
elucidation of project success. International Journal of Managing Projects in Business, 5(4),
757–775.
Müller, R., & Lecoeuvre, L. (2014). Operationalizing governance categories of projects. International
Journal of Project Management, 32(8), 1346–1357.
Müller, R., Pemsel, S., & Shao, J. (2014). Organizational enablers for governance and
governmentality of projects: A literature review. International Journal of Project Management,
32(8), 1309–1320.
Müller, R., & Turner, J. R. (2007). The influence of project managers on project success criteria and
project success by type of project. European Management Journal, 25(4), 298–309.
OGC. (2002). Managing Successful Projects with PRINCE2 (2nd ed.). London: The Stationery office.
30
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Ouchi, W. (1980). Markets, bureaucracies, and clans. Administrative Science Quarterly, 25(1), 129–
141.
Ouchi, W., & Price, R. (1978). Hierarchies, clans, and Theory Z: A new perspective on organization
development. Organizational Dynamics, 21(4), 2–78.
OxfordDictionaries. (2014). The Concise Oxford English Dictionary (12th ed.). Oxford, England:
Oxford University Press.
Packendorff, J. (1995). Inquiring into the temporary organization: New directions for project
management research. Scandinavian Journal of Management, 11(4), 319–333.
Payne, J., & Turner, J. R. (1999). Company-wide project management: The planning and control of
programmes of projects of different type. International Journal of Project Management, 17(1),
55–59.
Pinto, J. K., & Prescott, J. (1988). Variations in critical success factors over the stages in the project
life cycle. Journal of Management, 14(1), 5–18.
Pinto, J. K., & Slevin, D. P. (1988). Project success: Definitions and measurement techniques. Project
Management Journal, 19(1), 67–73.
PMI. (2013). A Guide to the Project Management Body of Knowledge (PMBOK® Guide).
sims.monash.edu.au (5th ed.). Newtown Square, PA: Project Management Institute.
Podsakoff, P. M., & Organ, D. (1986). Self-reports in organizational research: Problems and
prospects. Journal of Management, 12(4), 531–544.
Renz, P. (2008). Project governance: Implementing corporate governance and business ethics in
nonprofit organizations. Journal of Management & Governance, 13(4), 355–363.
Sauser, B. J., Reilly, R. R., & Shenhar, A. (2009). Why projects fail? How contingency theory can
provide new insights: A comparative analysis of NASA’s Mars Climate Orbiter loss.
International Journal of Project Management, 27(7), 665–679.
Schultz, R., Slevin, D. P., & Pinto, J. K. (1987). Strategy and tactics in a process model of project
implementation. Interfaces, 17(3), 34–46.
Sharma, S., Durand, R., & Gur-Arie, O. (1981). Identification and analysis of moderator variables.
Journal of Marketing Research, 18(3), 291–300.
Shenhar, A., & Dvir, D. (1996). Towards a typological theory of project management. Research
Policy, 25(4), 607–632.
31
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Shenhar, A., & Dvir, D. (2007). Reinventing Project Management: The Diamond Approach to
Successful Growth and Innovation. Boston, MA: Harvard Business School Press.
Shenhar, A., Dvir, D., Lechler, T., & Ploi, M. (2002). One size does not fit all–True for projects, true
for frameworks. In Proceedings of PMI Research Conference, Seattle, Washington, USA (pp.
99–106).
Shenhar, A., Dvir, D., Levy, O., & Maltz, A. A. C. (2001). Project success: A multidimensional strategic
concept. Long Range Planning, 34(6), 699–725.
Shenhar, A., Dvir, D., Milosevic, D., Mulenburg, J., Patanakul, P., Reilly, R. R., … Thamhain, H. J.
(2005). Toward a NASA-specific project management framework. Engineering Management
Journal, 17(4), 8–16.
Shenhar, A., Levy, O., & Dvir, D. (1997). Mapping the dimensions of project success. Project
Management Journal, 28(2), 5–13.
Shenhar, A., Tishler, A., Dvir, D., Lipovetsky, S., & Lechler, T. (2002). Refining the search for project
success factors: A multivariate, typological approach. R&D Management, 32(2), 111–126.
Tashakkori, A., & Teddlie, C. (2009). Foundations of Mixed Methods Research. Integrating
Quantitative and Qualitative. Thousand Oaks, CA: SAGE Publications Inc, USA.
Tishler, A., Dvir, D., Shenhar, A., & Lipovetsky, S. (1996). Identifying critical success factors in
defense development projects: A multivariate analysis. Technological Forecasting and Social
Change, 51(2), 151–171.
Turner, J. R. (2006). Towards a theory of project management: The nature of the project
governance and project management. International Journal of Project Management, 24(2),
93–95.
Turner, J. R., & Keegan, A. E. (2001). Mechanisms of governance in the project-based organization:
Roles of the broker and steward. European Management Journal, 19(3), 254–267.
Turner, J. R., Ledwith, A., & Kelly, J. (2010). Project management in small to medium-sized
enterprises: Matching processes to the nature of the firm. International Journal of Project
Management, 28(8), 744–755.
Turner, J. R., & Müller, R. (2006). Choosing Appropriate Project Managers: Matching their
Leadership Style to the Type of Project. Newtown Square, PA: Project Management Institute.
Turner, J. R., Müller, R., & Dulewicz, V. (2009). Comparing the leadership styles of functional and
project managers. International Journal of Project Management, 2(2), 198–216.
32
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Vaskimo, J. (2011). Project management methodologies: An Invitation for research. In IPMA World
Congress 2011 on October 12, 2011 in Brisbane, Queensland. Amsterdam, The Netherlands:
International Project Management Association.
Walker, D., Segon, M., & Rowlingson, S. (2008). Business ethics and corporate citizenship. In D. H.
Walker & S. Rowlinson (Eds.), Procurement Systems: A Cross Industry Project Management
Perspective (Vol. 27, pp. 101–139). London: Taylor & Francis.
Wells, H. (2012). How effective are project management methodologies: An explorative evaluation
of their benefits in practice. Project Management Journal, 43(6), 43–58.
Wells, H. (2013). An exploratory examination into the implications of type-agnostic selection and
application of project management methodologies (PMMs ) for managing and delivering IT/IS
projects. In Proceedings IRNOP 2013 Conference, June 17-19, 2013, Oslo, Norway (pp. 1–27).
Wheelwright, S., & Clark, K. (1992). Revolutionizing New Product Development: Quantum Leaps in
Speed, Efficiency, and Quality. Revolutionizing new product …. New York: The Free Press.
White, D., & Fortune, J. (2002). Current practice in project management—An empirical study.
International Journal of Project Management, 20(1), 1–11.
Woodward, J., Dawson, S., & Wedderburn, D. (1965). Industrial organization: Theory and practice.
London: Oxford University Press.
Wysocki, R. K. (2011). Effective Software Project Management (6th ed.). Hoboken, NJ: Wiley.
33
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
34
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
In my last project...
35
Relationship Between Project Management Methodology (PMM) and Project Success in Different Project Governance
Contexts
Applied relevant I applied the relevant tools during the project life cycle
PMM elements
I applied the relevant techniques during the project life cycle
36
Appendix IV
Does Project Governance Impact Project Success?
Abstract
Project governance is associated with responsibilities, processes, and policies that allow projects to
achieve organizational objectives. This implies project governance is in some way linked to project
success. This study looks at the impact of project governance on project success. A cross-sectional,
worldwide, online survey yielded 254 responses. Analysis was done through factor and regression
analyses. The findings show that requiring people to follow project processes does not necessarily
lead to better project results. Instead, understanding and managing the diverse needs of project
stakeholders, which is reflected in a stakeholder-orientated governance structure, leads to the
highest chance for project success.
Introduction
A reoccurring theme in project management research is that of project success. Forty years of
research have brought up a variety of new success factors (i.e. those elements that, when applied
during a project’s life cycle, increase the project’s chances to be successful) and extended the
number of success criteria (i.e. those measures applied at the end of the project to judge on the
project’s success), but success rates still do not meet expectations (Judgev & Müller, 2005). Project
success is hereby seen as the achievement of a particular combination of objective and subjective
measures, manifested in the success criteria and measured at the end of a project (Müller &
Judgev, 2012). Because of these low success rates, researchers have started to widen the scope of
possible success factors and focus more on the structural characteristics of the project context and
its impact on success. Examples include studies on the autonomy of projects (Gemünden, Salomo,
& Krieger, 2005) or the differences in levels of success in organizations and their appearance in
different time horizons (Lipovetsky, Tishler, Dvir, & Shenhar, 1997; Maltz, Shenhar, & Reilly, 2003;
1
Does Project Governance Impact Project Success?
Shenhar, Levy, & Dvir, 1997) or the impact of teamwork quality (Hoegl & Gemünden, 2001) or core
competencies and interfirm collaborations on project success (Ritter & Gemünden, 2004).
Simultaneously, the literature on project governance has grown exponentially since 2005
(Biesenthal & Wilden, 2014). This stream of literature identifies the particular structural
characteristics needed for successful project execution (Müller & Lecoeuvre, 2014). Project
governance, that is, “the use of systems, structures of authority, and processes to allocate
resources and coordinate or control activity in a project” (Pinto, 2014, p. 383), coexists within the
corporate governance framework with the objective to support projects in achieving their
organizational objectives (Müller, 2009). Interestingly, to the best of the authors’ knowledge, there
is no empirical study that quantitatively measures the impact of different types of project
governance on project success. While the link between corporate governance, management
performance, and shareholder value is well researched (Amzaleg, Azar, Ben-Zion, & Rosenfeld,
2014; Core, Holthausen, & Larcker, 1999; Lazonick & O’Sullivan, 2000; Maher & Andersson, 2000), a
similar insight at the level of projects is missing. As project governance is aligned with corporate
governance and good corporate governance is associated with management performance, a link
between project governance and project success can be assumed.
The purpose of this study is to investigate the relationship between project governance and project
success. The aim is to understand which forms of project governance are correlated with higher
project success rates. To achieve this, the following research question is posed:
The unit of analysis is the relationship between project governance and project success. The study
takes an agency and stewardship theory perspective, whereby the former is seen as explaining
behavior in more shareholder-oriented governance structures and the latter explaining behavior in
more stakeholder-oriented governance structures.
The results of this study will provide a better understanding as to what types of governance impacts
project success, thereby allowing managers to influence and/or optimize their project governance
for higher success rates.
2
Does Project Governance Impact Project Success?
The next section reviews literature on governance, project success, and agency and stewardship
theories from which the hypothesis is derived, followed by the research methodology and results
sections. The paper finishes with the study’s conclusions and its implications.
Project Success
The importance of understanding the meaning of project success, how it is measured, and the
factors that contribute to project success has been the subject of many research papers (Ika, 2009).
Despite this, the term project success still remains diffuse and often in the eye of the beholder
(Judgev & Müller, 2005). Project success is a multidimensional construct that includes both the
short-term project management success efficiency, which looks at how well a project is managed
and is typically measured by hard factors relating to the iron triangle (time, cost, and scope) (Bryde,
2005), and the longer-term achievement of desired results from the project, that is, effectiveness
and impact, meaning achieving the goals or objectives (Belout, 1998; Judgev, Thomas, & Delisle,
2001; Shenhar et al., 1997).
To achieve a common understanding of what project success is, it should be measurable and,
therefore, defined in terms of success criteria (Müller & Turner, 2007). Success criteria are the
dependent variables that measure success (Morris & Hough, 1987).
The understanding of project success criteria has evolved from the simplistic triple constraint
concept, known as the iron triangle to something that encompasses many additional success
criteria such as quality, stakeholder satisfaction, and knowledge management. (Atkinson, 1999;
Judgev & Müller, 2005; Müller & Judgev, 2012; Shenhar & Dvir, 2007).
Project success criteria are used to determine whether a project on project completion is
considered successful or not, while project success factors are a set of actions used to increase the
probability of success during the execution of the project (Cooke-Davies, 2002). “Project success
3
Does Project Governance Impact Project Success?
factors are elements of a project, which, when influenced, increase the likelihood of success; these
are the independent variables that make success more likely”(Payne & Turner, 1999).
Project success factors have been the focus of several researchers in the past (Belassi & Tukel,
1996; Cooke-Davies, 2002; Pinto & Slevin, 1988; Tishler, Dvir, Shenhar, & Lipovetsky, 1996; White &
Fortune, 2002). Schultz, Slevin and Pinto (Schultz, Slevin, & Pinto, 1987) suggested that the relative
importance of success factors varies over the project life cycle. Shenhar, Dvir, Levy, and Maltz
(2001) described the importance of success factors not only on the project life cycle but also on the
product life cycle from project completion to production, and then to preparation for
project/service replacement. Researchers soon realized that success factors without structure,
grouping, and context would result in increased project risks; therefore, success factor frameworks
were introduced (Judgev & Müller, 2005). Pinto developed a success framework covering
organizational effectiveness and technical validity (Pinto & Slevin, 1988). Freeman and Beale’s
(1992) success framework included efficiency of execution, technical performance, managerial and
organizational implications, manufacturability, personal growth, and business performance.
Shenhar et al (2001) describes how there is no-one-size fits-all; then using a four-dimensional
framework, he shows how different types of projects require different success factors and
describes the strategic nature of projects where project success should be determined according to
short- and long-term project objectives. The literature on success factors and frameworks does not
include research into how project governance impacts project success and whether it is a success
factor. Literature that investigates project governance as part of a success framework does not
exist.
In terms of measuring success, Pinto and Prescott (Pinto & Prescott, 1988), Shenhar, Tishler, Dvir,
Lipovetsky, and Lechler (2002), Hoegl and Gemünden (2001), and Turner and Müller (2006)
developed different measurement models for success that are applicable for different types of
projects or different aspects of project success.
Khan, Turner, and Maqsood (2013) analyzed the factors that influenced the success of using a
success-factor model derived from a recent literature review of the past 40 years of success factor
criteria. Their model was selected for this study as it is based on the latest literature, which is a
superset of the success criteria from the leading researchers on project success. Their model offers
a balance between hard and soft factors and measures success using 25 success criteria variables
4
Does Project Governance Impact Project Success?
organized in the five dimensions. The model contains the three criteria, which are typically termed
the iron triangle (dimension 1), plus four additional project success criteria dimensions:
1. Project efficiency,
2. Organizational benefits,
3. Project impact,
5. Future potential.
Project Governance
Project governance, governance of projects, and governmentality are three governance
components that belong to the realm of projects (Müller, Pemsel, & Shao, 2014a).
Governance is the way managers are held responsible for their actions. Within the realm of projects
“Governance, as it applies to portfolios, programs, projects, and project management, coexists
within the corporate governance framework. It comprises the value system, responsibilities,
processes, and policies that allow projects to achieve organizational objectives and foster
implementation that is in the best interests of all the stakeholders, internal and external, and the
corporation itself.” (Müller, 2009)
According to Klakegg et al. (2009), it is important that governance covers all levels of the
organization, starting with corporate governance flowing from the board level to the management
level responsible for execution, and down to the project level of governance. The definition of
corporate governance from the Organization for Economic Co-operation and Development (OECD)
is:
“Involving a set of relationships between a company’s management, its board, its shareholders and
other stakeholders [...] and should provide proper incentives for the board and management to
5
Does Project Governance Impact Project Success?
pursue objectives that are in the interests of the company and its shareholders and should facilitate
effective monitoring OECD (2004, p. 11)”.
Project-related governance is based on and aligned to corporate governance; but focused on the
governance of individual projects. The Project Management Institute (PMI®) defines project
governance as “an oversight function that is aligned with the organization’s governance model and
that encompasses the project lifecycle [and provides] a consistent method of controlling the project
and ensuring its success by defining and documenting and communicating reliable, repeatable
project practices” (PMI, 2013a, p. 34). Whereas, project governance looks at the governance of
individual projects, the governance of projects looks at a group of projects within a program or
portfolio and therefore has a broader perspective (Müller, Pemsel, & Shao, 2014b).
Before going into more detail on project governance, it is important to understand the history and
application of management theories in the corporate governance world, because many of them
apply to and are used in project governance.
Before the 1980’s corporate governance was largely in the realm of lawyers until economists
became interested in how organizations make decisions (Gilson, 1996). Gilson went on to say the
economists perceived a connection between organizational governance and organizational
performance. From this point, researchers started to apply management theories to help
understand the factors that influence corporate governance and organizational performance
(Maher & Andersson, 2000). The theories applied to corporate governance include agency theory,
transaction cost economics, stakeholder theory, shareholder theory, stewardship theory, and
resource dependency theory (Yusoff & Alhaji, 2012). One of the motivations for using general
management theories to ground theories in governance of corporations was to help frame,
understand, and address the issues associated with poor corporate governance (Hirschey, Kose, &
Anil, 2009). Agency theory, which is based on Jensen and Meckling’s (1976) view of the shareholder
and manager relationship in companies and its exemplification as principle-agent relationship has
had a large impact on corporate governance, because it explains some of the reasons for poor
corporate governance, which has plagued, and continues to plague organizations. Agency theorists
argued that the corporate managers (agents) may use their control over the allocation of corporate
resources opportunistically in order to pursue objectives contrary to the interests of the
shareholders (principle) (Jensen & Meckling, 1976).The formal definition of agency theory states
6
Does Project Governance Impact Project Success?
that an agency relationship exists between two parties (the principal and the agent) in
organizations where both actors are perceived as rational economic actors that act in a self-
interested manner (Mitnick, 1973). Since the late 1970’s, the issues associated with poor corporate
governance and the impact on shareholder value has been well researched across the major
economies (S. Basu, Hwang, Mitsudome, & Weintrop, 2007; Hirschey et al., 2009). Resolving issues
associated with corporate governance has shown to consistently increase shareholder gains
(Gompers, Ishii, & Metrick, 2003). Other theories that apply to corporate governance, which
provide different insights include: stewardship theory, which states that the actors (managers) are
stewards whose motives are aligned with the objectives of their principles rather than their own
goals (L. Donaldson & Davis, 1991); stakeholder theory, which states that the actors (managers)
focus on a variety of stakeholders including the shareholders (T. Donaldson & Preston, 1995);
resource dependency theory, where managers are able to prioritize internal and external resources
needed to achieve the corporate objectives (Pfeffer & Salancik, 1978); and transaction cost
economics, where organizations achieve the lowest transaction costs to produce a product or
service and adapt their governance structures to achieve this (Williamson, 1979). When applied, all
of these theories have helped to improve the corporate governance within organizations,
underpinning ethical values and moral choices (Cameron, Post, Preston, & Stanford, 2004). Two of
the six theories, notably agency theory and stewardship theory have been used as the theoretical
perspectives in this study, which are described in more detail in the section on Research
Methodology.
Returning to governance within the realm of projects, two of the three elements that constitute
governance are project governance (governance of individual projects) and the governance of
projects (governance of a group of projects such as a program or portfolio) (Müller et al., 2014b).
Both elements are aligned with the Project Management Institute (PMI) definitions and governance
structures of projects, programs, and portfolios PMI (PMI, 2013a, 2013c, 2013d).
The literature on project governance shows the diversity of governance approaches (Müller et al.,
2014b), covering topics such as the optimization of the management of projects (Too & Weaver,
2014); interrelationship of governance, trust, and ethics in temporary organizations (Müller &
Andersen et al., 2013); risk, uncertainty, and governance in megaprojects (Sanderson, 2012);
governance in particular sectors such as information technology (Weill & Ross, 2004); and the
normalization of deviance (Pinto, 2014). Papers on governance within the realm of projects have
7
Does Project Governance Impact Project Success?
utilized to a greater or lesser extent the same management theories used in corporate governance
(Biesenthal & Wilden, 2014). However, only some of the literature has provided some sort of
governance related context to governance categorization. The most notable governance
categorization system is by Müller who defined four governance paradigms and their individual
characteristics (Müller, 2009). The governance paradigms provide a categorization that explains the
governance approach for organizations and then explains the respective behavior of individuals
within the organizations’ governance structure. Shareholder and stakeholder theory are used to
explain the governance approach of the organization and are positioned at the opposite end of a
shareholder to stakeholder orientation continuum (called corporate governance continuum).
Agency and stewardship theory explains the respective behavior of individuals within this
continuum. This is overlaid with a second continuum which represents the control approach of the
organization owning a project. This continuum ranges from behavior control (i.e., following the
process) to outcome control (i.e., meeting preestablished expectations).The operationalization of
the paradigms was researched by Müller and Lecoeuvre (2014) and allows a quantitative
assessment of a project parent organization’s governance position (Müller & Lecoeuvre, 2014). The
present study will use the Müller and Lecoeuvre (2014) governance paradigms as a categorization
system to understand organizations’ adopted project governance paradigm and if some
paradigm(s) are more akin to project success than others.
There is extensive literature on the link between corporate governance and corporate performance
which shows that: weaker governance mechanisms have greater agency problems resulting in
lower corporate performance (Hart, 1995; Hirschey et al., 2009; John & Senbet, 1998; Ozkan, 2007);
greater shareholder rights have a positive impact on corporate performance (Hirschey et al., 2009);
and independent boards lead to higher corporate performance (Millstein & MacAvoy, 1998). The
link between governance and project performance (success) is implied where project governance is
seen as important in ensuring successful project delivery (Biesenthal & Wilden, 2014). Hence:
The project management literature has historically emphasized the importance of stakeholders in
and for project success (Eskerod & Huemann, 2013). Project managers view stakeholders as the
ultimate receivers of project outcome and rank their satisfaction very high. Research showed that
project managers in North America rank the importance of stakeholders highest among all success
8
Does Project Governance Impact Project Success?
criteria, whereas project managers in other regions rank its importance consistently among the top
10 of the success criteria (Müller & Turner, 2007). Thus we hypothesize:
However, the nature of the link between control orientation (behavior versus outcome) and project
success is unclear from the literature. While the literature on project management maturity models
(e.g., Project Management Institute, OPM3®, (PMI, 2013b), and the literature on the governance of
large-scale investment projects e.g., Klakkegg & Haavaldson,(2011), emphasize the importance of
following processes for successful project implementation, other research shows a more diversified
picture, such as that by Crawford et al (2008) who showed the need for situational contingency of
structures, or (Turner & Müller, 2004) showing that that control through methodology must find
the balance between being too process-focused (i.e., behavior control) or too laissez-faire, because
both lead to project failure. All of these studies imply a correlation between control structure and
success, but their direction is unclear. Therefore we hypothesize a correlation between control and
success, but rely on the empirical data to show the direction of the correlation.
H1.2: There is a relationship between governance control (behavior-outcome) and project success.
Figure 1 shows the related research model with the two governance dimensions as independent
variables (IV) and project success as dependent variables (DV).
9
Does Project Governance Impact Project Success?
Agency theory has been used by researchers in traditional finance and economic, for example,
accounting (Demski & Feltham, 1978), economics (Spence & Zeckhauser, 1971), and finance (Fama,
1980), then applied to marketing (A. K. Basu, Lal, Srinivasan, & Staelin, 1985), political science (e.g.,
Mitnick, 1995), organizational behavior (Eisenhardt, 1985), sociology (Kaiser, 2006), corporate
governance (John & Senbet, 1998), and project governance (Turner & Müller, 2003). Agency
relationships are referred to between two parties, that is, the principle and the agent, but there can
be several principle agents in a project process, such as procurement of resources or change
request processes (Toivonen & Toivonen, 2014). Corporate and project governance, when designed
correctly within the context of the organization, should minimize the risks and issues associated
with agency theory. Agency theory based on Jensen and Meckling’s (1976) view of principle agent
models have been criticized because they neglect to consider that the principle-agent transitions
are socially embedded and therefore impacted by broader institutional contexts (Davis, Schoorman,
& Donaldson, 1997b; Wiseman, Cuevas-Rodríguez, & Gomez-Mejia, 2012).
Stewardship theory arose in response to the criticism regarding the generalizability of agency
theory, which states that the actors (managers) are stewards whose motives are aligned with the
objectives of their principles, rather than being motivated by their own goals (L. Donaldson & Davis,
1991). The steward differs from the agent in that the steward is trustworthy and will make
decisions in the best interests of the organization. This is achieved by meeting the organizational
demands as well as the steward’s personal needs. The steward aligns the personal and
organizational interests by prioritizing the long-term goals over short-term gains (Davis, Schoorman,
& Donaldson, 1997a). Stewardship theory has been criticized, because it views the organization in a
static way and does not account for stewards resorting back to an agent position when their
positions are threatened (Pastoriza & Ariño, 2008).
Neither agency theory or stewardship theory is more valid than the other, as each may be valid for
different types of phenomena (Davis et al., 1997a). This study investigates some of these
phenomena.
10
Does Project Governance Impact Project Success?
Research Methodology
Postpositivism serves as the underlying paradigm in this deductive study. Postpositivism assumes
an objective and extrinsic reality (facts and laws) exist (Tekin & Kotaman, 2013). However, the
perspective of post-positivist research is not to establish generalizations about the phenomenon
under observation, but rather the focus is “on meaning and understanding of the situation or
phenomenon under examination” (Crossan, 2003, p. 54). Project governance and project success
are both socially constructed phenomena; therefore, the impact of project governance on project
success is investigated to provide conditional knowledge that can be used to understand when and
how to improve project governance’s positive impact on project success.
Questionnaire Development
Four sets of questions were included in the questionnaire. The first set included information about
the last project; the next two sets covered governance paradigms and project success; and the last
set collected the respondents’ demographic information. The questionnaire followed the
suggestions of Cooper & Schindler (2011) to ensure that the scales, criteria, and wording were
consistent and clear. The project governance questions were taken from Müller and Lecoeuvre
(2014). The governance paradigms were selected as they have been used successfully in several
project governance related studies before and reflect the organization’s governance positioning
with regard to two continuums: (1) shareholder-stakeholder and (2) behavior-outcome. The project
success dimensions were based on Khan and Turner (2013). Its five dimensions (project efficiency,
organizational benefits, project impact, stakeholder satisfaction, and future potential), cover short-
and long-term implications of project success. A five-point Likert scale was used with low values
representing low levels of stakeholder orientation, outcome control, and success. A pilot test was
done with ten respondents. Based on the feedback, minor wording changes were made for
understandability. The pilot answers were not used in the analysis.
Questionnaires collect individuals’ attitudes or opinions on a subject, which will inevitably introduce
bias in the responses due to self-reporting. The recommendations from Podsakoff and Organ (1986)
were followed to minimize this bias, including confirmed anonymity in the introductory text,
different layouts and scales, and randomizing of the questions.
11
Does Project Governance Impact Project Success?
Data Collection
Data collection was performed through a worldwide, cross-sectional questionnaire to collect
quantitative data for generalizable results. The respondents were contacted using email with a link
to the web survey. In addition, the survey details were placed on project management LinkedIn
forums. An email with the survey link was sent to a number of PMI chapters. The survey ran for a
period of 14 days during April 2014. The 254 complete responses were used for analysis. Responses
came from 41 different countries: 38% from North America 24% from Europe, 22% from
Australasia, and 16% from other countries. ANOVA analysis showed no difference between early
and late respondents. The average respondents’ work experience was 22 years and the average
project-related work experience was 15 years. Sample demographics are shown in Table 1.
Table 1: Demographics
Characteristic N % Characteristic N %
Sector: Gender
Research & Development 31 12.2 Male 194 76.4
Engineering/construction 46 18.0 Female 56 22.0
Information 120 47.1 Other 1 0.4
technology/telecom
Media/arts 9 3.5 Total 251 98.8
Relief aid 16 6.3 Missing 3 1.2
Other 29 11.4
Total 251 98.4 Geography - working
Missing 4 1.6 North America 96 37.8
Europe 61 24.0
Position held Australasia 56 22.0
CIO 3 1.2 Other 38 15.0
CTO 2 0.8 Total 251 98.8
Project portfolio manager 17 6.7 Missing 3 1.2
PMO 10 3.9
Program manager 65 25.6 Project-related experience
Project manager 82 32.3 1 to 5 years 36 14.6
Team member 24 9.4 6 to 10 years 63 25.6
Architect/advisor 6 2.4 11 to 15 years 53 21.5
QA/audit function 3 1.2 16 to 20 years 45 18.3
Technical stakeholder 2 0.8 20 years plus 46 18.7
Business stakeholder 4 1.6 Total 243 98.8
Other 35 13.8 Missing 3 1.2
Total 253 99.6
Missing 1 0.4 Work experience
1 to 5 years 36 14.6
6 to 10 years 60 24.4
11 to 15 years 46 18.7
16 to 20 years 49 19.9
20 years plus 52 21.1
Total 243 98.8
Missing 3 1.2
An ANOVA test between the demographic regions showed no statistical differences (p = 0.249).
12
Does Project Governance Impact Project Success?
Project information is shown in Table 2. Approximately 48% of the projects were less than 1 million
euros in cost. 96% of the projects were of either medium to high urgency. 42% of projects were
executed in matrix organizations and 21% were executed in functional organizations.
Characteristic N % Characteristic N %
Urgency of Last
Duration of last project Project
Under six months 44 17.3 Low 11 4.3
6 months to less than 1 year 67 26.4 Medium 107 42.1
1 to 2 years 76 29.9 High 135 53.1
Over 2 years 66 26.0 Total 253 99.6
Total 253 99.6 Missing 1 0.4
Missing 1 0.4
Last Project Executed in the following
Organizational Structure
Projectized
Level of Last Project Complexity Organization 81 31.9
Functional Organization
Low 24 9.4 (Department) 55 21.7
Matrix
Medium 117 46.1 Organization 106 41.7
High 111 43.7 Other 11 4.3
Total 252 99.2 Total 253 99.6
Missing 2 0.8 Missing 1 0.4
Principle component analysis was used on the governance and success variables to test for internal
consistency of the constructs (Field, 2009).
13
Does Project Governance Impact Project Success?
Item-to-item and item-to-total correlations were below 0.3 and 0.5, respectively, showing internal
consistency. Reliability was tested using Cronbach’s alpha. All constructs showed reliability with
their respective values over 0.70 (Hair et al., 2010).
Multivariate regression analysis was used to test the relationship between project governance and
project success (hypothesis 1). The results are shown in the following sections.
Original Scale
Standard
Measure N Mean Range Number of Reliability Skewness Kurtosis
Deviaton
Dimensions (Alpha)
Governance
Shareholder-stakeholder 246 2.87 4.05 4.46 5 0.741 0.419 -0.462
Governance. The same analysis approach was applied for the governance questions, which
were taken from Müller and Lecoeuvre (2014), The data were adequate for factor analysis
(normality assumptions met, KMO 0.812, p<0.001). Principle component analysis with Varimax
14
Does Project Governance Impact Project Success?
rotation at a cut-off Eigenvalue of 1.0 for factor acceptance (Field, 2009) resulted in two factors,
which explained 53% of the variance in GOVorientation (shareholder-stakeholder) and GOVcontrol
(behavior-outcome). Both were reliable with Cronbach’s of 0.743 and 0.802, respectively.
Results
ProjectSucess SA01 Project SA02 SA03 Project SA04 Future SA05 GOVControl GOVorientation
(5 combined Efficiency Organizational Impact Potential Stakeholder Goverance (Shareholder-
dimensions) (Dimension 1) Benefits (Dimension 3) (Dimension 4) satisfaction 'Behavior-> >Stakeholder)
DV DV (Dimension 2) DV DV (Dimension 5) Outcome Orientation IV
DV DV Orientation' IV
The R2 showed that governance accounts for 6.3% of the variation in project success (p<0.000).
Results showed a positive and significant (p<0.001, beta=0.250) correlation between
GOVorientation (shareholder-stakeholder) and project success, supporting H1.1 and partly H1,
whereas GOVControl (behavior-outcome) was not significantly correlated to project success at
p=0.05.
15
Does Project Governance Impact Project Success?
Subsequently an exploratory analysis was done to analyze the nature of the impact of
GOVorienation on project success. GOVorientation was regressed against the five dimensions of
project success (project efficiency, organizational benefits, project impact, future potential, and
stakeholder satisfaction). The results showed that GOVorientation (shareholder-stakeholder) was
positively and significantly correlated with all five success dimensions. The details are shown in
Figure 2.
The success dimension future potential has the strongest correlation with GOVorientation
(Adjusted R2 =0.063; Beta 0.258****), whereas stakeholder satisfaction has the weakest correlation
of the five dimensions with an adjusted R2 =0.022; Beta 0.162**.
Figure 2: Independent variable (GOVorientation) impact on the five dimensions of project success
Discussion
16
Does Project Governance Impact Project Success?
The finding challenges the governance aspects of frameworks such as Carnegie Mellon University’s
Capability Maturity Model Integration (CMMI), or the governance process/outcome orientation
behind the Project Management Institute’s Organizational Project Management Maturity Model
(OPM3®) (Project Management Institute, (PMI, 2013b) where the premise is that a stronger process
control leads to better organizational results. In line with that, Yazici (2009) showed that maturity
models have only helped to improve project success on a repeatable basis in certain organizational
cultures. Using the competing values framework (Cameron & Quinn, 2006), Yazici demonstrated
that the clan culture, which represents the importance of stakeholder participation, cohesion,
shared values, and commitment is the model most linked to project success. This is aligned with
stewardship theory, which proposes that the behavior of individuals in organizations is aligned and
supportive to the organizational and collectivistic goals instead of individualistic and self-serving
goals. Hierarchical culture, which is characterized by a structured workplace with formal rules,
policies, and controls, is not correlated to project success. Project managers (agents) are tasked
with complex projects and need to get things done, therefore flexibility and trust is required from
their principle (Turner & Müller, 2004). Organizational structures that inhibit the progress of
projects will undoubtedly create frustration and project delays unless ways to mitigate the blocks
are found. These mitigating actions may result in the principle losing trust and imposing more
controls creating a downward spiral, which is often termed “under the management eye,” a
euphemism for loss of trust.
17
Does Project Governance Impact Project Success?
The dimensions of project success used in this study (project efficiency, organizational benefits,
project impact, future potential, and stakeholder satisfaction) were all correlated (hence impacted
by) the independent variable GOVorientation (shareholder-stakeholder).
Referring to Figure 2, the success dimension “future potential” is the dimension most strongly
correlated with project success (adjusted R2 =0.063; Beta 0.258****). An interpretation of this is
that shareholder-orientated governance through project success improves the organizational
capability by fully utilizing its resources; and by successful completion, enables future projects to be
selected, resourced, and completed successfully. This drives motivation for future projects, hence
improving the organizational capability which, in turn, improves the future potential of the
organization. The lowest correlated success dimension to governance is stakeholder satisfaction
(adjusted R2 =0.022; Beta 0.162**). The explanation for this is that not all of the stakeholders will
personally benefit from the projects nor will all of the stakeholders approve of the way projects are
run, which is in part impacted by the governance approach adopted and the acceptance of the
governance by the culture (governmentality) of the organization. In addition to this, the unlikely
prospect of obtaining agreement among the stakeholders on project success (Müller & Judgev,
2012) impacts stakeholder satisfaction. The success dimensions of project efficiency and
organizational benefits (adjusted R2 =0.052; Beta 0.236**) have the same correlations with project
success. When implemented correctly for any given project, project governance should act as a
project enabler, thereby increasing efficiency whilst ensuring alignment with the organization’s
governance model (Klakegg et al., 2009, p. 52). Taking the definition of the term “benefit” and
applying it to the context of an organization, hence the term organizational benefits can be defined
as “an advantage or profit gained from something” (OxfordDictionaries, 2014). In a project or
program perspective, PMI defines benefits as “an outcome of actions, behaviors, products, or
services that provide utility to the sponsoring organization as well as to the program or [project’s]
intended beneficiaries” (PMI, 2013d).
Organizational benefits are typically identified as part of the project initiation process (PMI, 2013a,
p. 53). However, during the execution of a project unknown benefits may be identified. A project
governance structure that allows new benefits to be identified, approved and realized will
contribute more so to the organizational benefits, than an inflexible non-responsive project
governance structure.
18
Does Project Governance Impact Project Success?
Certain types of projects such as research, or development projects with a high degree of
innovation, are often executed in specially constructed environments which may be different to the
organization’s governance paradigm (Dougherty & Hardy, 1996). This is done so as to increase the
project efficiency as well as to increase the potential for organizational benefits. The project impact
dimension has the second lowest correlation of the five success dimensions (adjusted R2 =0.038;
Beta 0.204**). This may be due in part to some of the success variables in the dimension such as
project has a good reputation, or project impact on beneficiaries are visible, being marginally
influenced by project governance.
In summary, all five project success dimensions are positively impacted in varying degrees by a
GOVorientation (shareholder-stakeholder) project governance.
Conclusions
This study investigated the effect of project governance on project success. A deductive approach
tested a theoretically derived research model. Two theoretical lenses were used in the study:
agency theory and stewardship theory. The data were collected through a web-based questionnaire
with 246 respondents from 11 industry sectors evenly distributed across North America, Europe,
and Australasia. The research question can now be answered—there is a positive relationship
between project governance orientation and project success. Hypothesis 1 is supported as there is
a positive relationship between project governance and project success. H1.1 is supported whereby
there is a positive relationship between the governance corporate orientation (shareholder-
stakeholder) and project success. However H1.2 is not supported for the relationship between
governance control orientation (behavior–outcome) and project success. Therefore, organizations
with governance orientations towards process control and/or behavior control are not correlated
with project success. Approximately 6.3% of the variation of project success is accounted for by a
stakeholder-oriented governance structure. According to Cohen (1988) this is of a small, but
significant practical significance (R2 of 0.02 – 0.12 = small; 0.13 - 0.25 = medium; >0.25 = large
effect).
This study’s results indicate the importance of understanding the governance orientation of the
organization and the potential enabling effect of a stakeholder-orientated governance on project
success. Yazici (2009) found that culture impacts project success; organizations that are more
19
Does Project Governance Impact Project Success?
stakeholder-participative, cohesive, and have shared values and commitment are most likely to
achieve project success. Stakeholder-oriented organizations that have shared values suggest
stewardship relationships are in place. However, this can only occur when the necessary situational
factors and structures are present, including individuals with the appropriate psychological profiles
(Toivonen & Toivonen, 2014). When there is a change of culture in the organization due to external
pressures, for example, a push for short-term benefits, where management trust turns into
excessive control will lead to agency tendencies (Clases, Bachmann, & Wehner, 2003). Determining
the appropriate governance structures must take into consideration the implications resulting from
agency and stewardship theories.
Practical Implications
Managers influencing the design of project governance should ensure a stakeholder orientation to
increase the chances of project success and need to understand that governance which is oriented
to “controlling,” irrespective of whether it is behavior- or outcome-orientated, is not correlated
with project success. An additional issue of control-orientated project governance is the risk of
introducing agency characteristics into the project team. Instead, project governance should be
underpinned with the principles of ethics and trust to ensure the conditions of encouraging a
stewardship environment.
Recruitment managers should understand the personality traits of project team applicants to
ensure that their personalities are aligned to a stewardship role within the project governance
environment.
Project managers should understand the organization’s governance procedures and work with the
authority that defines project governance procedures to tailor the procedures to the project
environment and/or project type.
Theoretical Implications
The use of agency theory and stewardship theory in project governance design can be used as a
theoretical lens to provide insights into the findings.
The study shows that project governance can positively influence project success depending upon
the governance orientation. The control orientation, irrespective of whether it is behavioral- or
20
Does Project Governance Impact Project Success?
outcome-positioned, has no impact on project success. The results show the importance of
understanding and adopting a stakeholder-oriented project governance structure which may or
may not be fully aligned with the overall corporate governance structure. The implications for
developing a broader theory of project governance is whether a project governance stakeholder
orientation that endorses a stewardship approach can exist and flourish within a corporate
governance structure that is more shareholder-oriented without creating conflicts or friction points.
This is especially significant when agency issues exist in the wider context of the organization.
The use of professional associations such as IPMA and PMI for distribution of the questionnaire
limited the pool of respondents to only their members. A further limitation of the study was the use
of one particular governance model. Other governance models should be used for similar analyses
to get a more holistic picture of the relationship between governance and success.
Further Research
Future research could include understanding the impact of project governance environments that
have agency issues and/or benefit from a stewardship environment from both the qualitative and
quantitative perspectives. Further research is needed to investigate whether project governance
orientation structures optimized for project success can exist and thrive throughout an organization
and under what conditions, even though the main organization’s governance orientation may be
different.
Finally, is the impact of the governance paradigms on the governance of projects the same at the
project portfolio level and if not, what insights could be obtained as to which paradigm(s) are the
most correlated to project portfolio success?
21
Does Project Governance Impact Project Success?
success, and when too extreme, the control aspects may even create an agency environment to the
detriment of the agent’s principles.
22
Does Project Governance Impact Project Success?
References
Amzaleg, Y., Azar, O. H., Ben-Zion, U., & Rosenfeld, A. (2014). CEO control, corporate performance
and pay-performance sensitivity. Journal of Economic Behavior & Organization, 106, 166–174.
Atkinson, R. (1999). Project management: Cost, time and quality, two best guesses and a
phenomenon, it’s time to accept other success criteria. International Journal of Project
Management, 17(6), 337–342.
Basu, A. K., Lal, R., Srinivasan, V., & Staelin, R. (1985). Salesforce compensation plans: An agency
theoretic perspective. Marketing Science, 4(4), 267–291.
Basu, S., Hwang, L.-S., Mitsudome, T., & Weintrop, J. (2007). Corporate governance, top executive
compensation and firm performance in Japan. Pacific-Basin Finance Journal, 15(1), 56–79.
Belassi, W., & Tukel, O. I. (1996). A new framework for determining critical success/failure factors in
projects. International Journal of Project Management, 14(3), 141–151.
Belout, A. (1998). Effects of human resource management on project effectiveness and success:
Toward a new conceptual framework. International Journal of Project Management, 16(1), 21–
26.
Biesenthal, C., & Wilden, R. (2014). Multi-level project governance: Trends and opportunities.
International Journal of Project Management, 32(8), 1291–1309.
Bryde, D. J. (2005). Methods for managing different perspectives of project success. British Journal
of Management, 16(2), 119–131.
Cameron, K. S., Post, J. E., Preston, L. E., & Stanford, S. (2004). Book Review Essay : Effective
governance in managing change: Common perspective from two lenses. The Academy of
Management Review, 29(2), 296–301.
Cameron, K. S., & Quinn, R. E. (2006). Diagnosing and Changing Organizational Culture. Bk:
Addison-Wesley Publishing Company (2nd ed.). San Francisco, CA: Jossy-Bass. Retrieved from
http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:Diagnosing+and+Changing+
Organizational+Culture#8
Clases, C., Bachmann, R., & Wehner, T. (2003). Studying trust in virtual organizations. International
Studies of Management and Organization, 33(3), 7–27.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Statistical Power Analysis for
the Behavioral Sciences (2nd ed., Vol. 2nd, p. 567). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cooke-Davies, T. J. (2002). The “real” success factors on projects. International Journal of Project
Management, 20(3), 185–190.
23
Does Project Governance Impact Project Success?
Cooper, D., & Schindler, P. (2011). Business Research Methods (11th ed.). Berkshire: McGraw Hill
Education.
Core, J., Holthausen, R., & Larcker, D. (1999). Corporate governance, chief executive officer
compensation, and firm performance. Journal of Financial Economics, 51(3), 371–406.
Crawford, L., & Cooke-Davies, T. J. (2008). Governance and support in the sponsoring of projects
and programs. Project Management Journal, 39, S43–S55.
Crossan, F. (2003). Research philosophy: Towards an understanding. Nurse Researcher, 11(1), 46–
55.
Davis, J. H., Schoorman, F. D., & Donaldson, L. (1997a). Davis, Schoorman, and Donaldson Reply:
The distinctiveness of agency theory and stewardship theory. Academy of Management
Review, 22(3), 611–613.
Davis, J. H., Schoorman, F. D., & Donaldson, L. (1997b). Towards a stewardship theory of
management. Academy of Management Review, 22(1), 20–47.
Demski, J., & Feltham, G. (1978). Economic incentives in budgetary control systems. The Accounting
Review, 53(2), 336–359.
Donaldson, L., & Davis, J. H. (1991). Stewardship theory or agency theory: CEO governance and
shareholder returns. Australian Journal of Management, 16(1), 49–65.
Donaldson, T., & Preston, L. E. (1995). The stakeholder theory of the corporation: Concepts,
evidence, and implications. The Academy of Management Review, 20(1), 65–91.
Dougherty, D., & Hardy, C. (1996). Sustained product innovation in large, mature organizations:
Overcoming innovation-to-organization problems. Academy of Management Journal, 39(5),
1120–1153.
Eskerod, P., & Huemann, M. (2013). Sustainable development and project stakeholder
management: what standards say. International Journal of Managing Projects in Business, 6(1),
36–50.
Fama, E. (1980). Agency problems and the theory of the firm. The Journal of Political Economy,
88(2), 288–307.
Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). Thousand Oaks, CA: SAGE Publications.
Freeman, M., & Beale, P. (1992). Measuring project success. Project Management Journal, 23(1), 8–
17.
24
Does Project Governance Impact Project Success?
Gemünden, H. G., Salomo, S., & Krieger, A. (2005). The influence of project autonomy on project
success. International Journal of Project Management, 23(5), 366–373.
Gilson, R. (1996). Corporate governance and economic efficiency: When do institutions matter.
Washington University Law Review, 74(2).
Gompers, P., Ishii, J., & Metrick, A. (2003). Corporate governance and equity prices. Quarterly
Journal of Economics, 118(1), 107–155.
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis. vectors (7th ed.).
Upper Saddle River, NJ: Prentice Hall Inc.
Hart, O. (1995). Corporate governance: Some theory and implications. The Economic Journal,
105(430), 678–689.
Hirschey, M., Kose, J., & Anil, M. (Eds.). (2009). Corporate Governance and Firm Performance.
Journal of Corporate Finance (Vol. 6). Bingley, UK: JAI Press.
Hoegl, M., & Gemünden, H. G. (2001). Teamwork quality and the success of innovative projects: A
theoretical concept and empirical evidence. Organization Science, 12(4), 435–449.
Ika, L. (2009). Project success as a topic in project management journals. Project Management
Journal, 40(4), 6–19.
Jensen, M., & Meckling, W. (1976). Theory of the firm: Managerial behavior, agency costs, and
ownership structure. Journal of Financial Economics, 3(4), 305–360.
John, K., & Senbet, L. (1998). Corporate governance and board effectiveness. Journal of Banking &
Finance, 22(4), 371–403.
Joslin, R., & Müller, R. (2014a). The impact of project methodologies on project success in different
contexts. In PMI Research and Education Conference, July 28-29, 2014 (pp. 1–29). Portland,
OR, OR, USA: Project Management Institute.
Joslin, R., & Müller, R. (2014b). The impact of project methodologies on project success in different
project environments. International Journal of Managing Projects in Business, In Review.
Judgev, K., & Müller, R. (2005). A retrospective look at our evolving understanding of project
success. Project Management Journal, 36(4), 19–31.
Judgev, K., Thomas, J., & Delisle, C. L. (2001). Rethinking project management: Old truths and new
insights. International Project Management Journal, 7(1), 36–43.
Kaiser, L. (2006). Agency relationship and transfer pricing inefficiency. Acta Oeconomica Pragensia,
3, 73–81. Retrieved from http://www.vse.cz/polek/download.php?jnl=aop&pdf=94.pdf
25
Does Project Governance Impact Project Success?
Khan, K., Turner, J. R., & Maqsood, T. (2013). Factors that influence the success of public sector
projects in Pakistan. In Proceedings of IRNOP 2013 Conference, June 17-19, 2013. Oslo,
Norway: BI Norwegian Business School.
Klakegg, O. J., & Haavaldsen, T. (2011). Governance of major public investment projects: in pursuit
of relevance and sustainability. International Journal of Managing Projects in Business.
doi:10.1108/17538371111096953
Klakegg, O. J., Williams, T., & Magnussen, O. M. (2009). Governance Frameworks for Public Project
Development and Estimation. Project Management Journal (Vol. 39). Newtown Square, PA:
Project Management Institute.
Lazonick, W., & O’Sullivan, M. (2000). Maximizing shareholder value: A new ideology for corporate
governance. Economy and Society, 29(1), 13–35.
Lipovetsky, S., Tishler, A., Dvir, D., & Shenhar, A. (1997). The relative importance of project success
dimensions. R&D Management, 27(2), 97–106.
Maher, M., & Andersson, T. (2000). Corporate governance: Effects on firm performance and
economic growth. In L. Renneboog, P. McCahery, P. Moerland, & T. Raaijmakers (Eds.),
Convergence and Diversity of Corporate Governance Regimes and Capital Markets. Oxford,
England, UK: Oxford University Press.
Maltz, A. A. C., Shenhar, A., & Reilly, R. R. R. (2003). Beyond the balanced scorecard: Refining the
search for organizational success measures. Long Range Planning, 36(2), 187–204.
Millstein, I., & MacAvoy, P. (1998). The active board of directors and performance of the large
publicly traded corporation. Columbia Law Review, 98(5), 1283–1322.
Mitnick, B. M. (1973). Fiduciary rationality and public policy: The theory of agency and some
consequences. In Annual General Meeting of the Americian Political Science Association. New
Orleans, LA: American Political Science Association.
Mitnick, B. M. (1995). The Theory of Agency: The policing “paradox” and regulatory behavior. Public
Choice, 24(1), 27–42.
Morris, P. W., & Hough, G. (1987). The Anatomy of Major Projects: A Study of the Reality of Project
Management. New York: John Wiley & Sons. New York: Wiley & Sons Inc.
Müller, R. (2009). Project Governance. In R. Müller & D. Dalcher (Eds.), Fundamentals of Project
Management. Farnham, Surrey, UK: Gower Publishing.
Müller, R., Andersen, E. S., Kvalnes, Ø., Shao, J., Sankaran, S., Turner, J. R., … Gudergan, S. (2013).
The interrelationship of governance, trust, and ethics in temporary organizations. Project
Management Journal, 44(4), 26–44.
26
Does Project Governance Impact Project Success?
Müller, R., & Judgev, K. (2012). Critical success factors in projects: Pinto, Slevin, and Prescott – The
elucidation of project success. International Journal of Managing Projects in Business, 5(4),
757–775.
Müller, R., & Lecoeuvre, L. (2014). Operationalizing governance categories of projects. International
Journal of Project Management, 32(8), 1346–1357.
Müller, R., Pemsel, S., & Shao, J. (2014a). Organizational enablers for governance and
governmentality of projects: A literature review. International Journal of Project Management,
32(8), 1309–1320.
Müller, R., Pemsel, S., & Shao, J. (2014b). Organizational enablers for project governance and
governmentality in project-based organizations. International Journal of Project Management,
In press.
Müller, R., & Turner, J. R. (2007). The influence of project managers on project success criteria and
project success by type of project. European Management Journal, 25(4), 298–309.
OECD. (2004). OECD Principles of Corporate Governance 2004. Paris: OECD Publishing.
OxfordDictionaries. (2014). The Concise Oxford English Dictionary (12th ed.). Oxford, England:
Oxford University Press.
Pastoriza, D., & Ariño, M. (2008). When agents become stewards: Introducing learning in the
stewardship theory. In 1st IESE Conference on Humanizing the Firm & Management Profession,
June 30-July 2, 2008 (pp. 1–16). Barcelona: IESE Business School.
Payne, J., & Turner, J. R. (1999). Company-wide project management: The planning and control of
programmes of projects of different type. International Journal of Project Management, 17(1),
55–59.
Pfeffer, J., & Salancik, G. (1978). The External Control of Organizations: A Resource Dependence
Perspective. The External Control of Organizations: A Resource Dependence Perspective. New
York: Harper & Row, Publishers.
Pinto, J. K., & Prescott, J. (1988). Variations in critical success factors over the stages in the project
life cycle. Journal of Management, 14(1), 5–18.
Pinto, J. K., & Slevin, D. P. (1988). Project success: Definitions and measurement techniques. Project
Management Journal, 19(1), 67–73.
27
Does Project Governance Impact Project Success?
PMI. (2013a). A Guide to the Project Management Body of Knowledge (PMBOK® Guide).
sims.monash.edu.au (5th ed.). Newtown Square, PA: Project Management Institute.
PMI. (2013b). Organizational Project Management Maturity Model (OPM3®) (3rd ed.). Newtown
Square, PA, USA: Project Management Institute.
PMI. (2013c). The Standard For Portfolio Management (3rd ed.). Newtown Square, PA, USA: Project
Management Institute.
PMI. (2013d). The Standard For Program Management (3rd ed.). Newtown Square, PA, USA: Project
Management Institute.
Podsakoff, P. M., & Organ, D. (1986). Self-reports in organizational research: Problems and
prospects. Journal of Management, 12(4), 531–544.
Ritter, T., & Gemünden, H. G. (2004). The impact of a company’s business strategy on its
technological competence, network competence and innovation success. Journal of Business
Research, 57(5), 548–556.
Schultz, R., Slevin, D. P., & Pinto, J. K. (1987). Strategy and tactics in a process model of project
implementation. Interfaces, 17(3), 34–46.
Shenhar, A., & Dvir, D. (2007). Reinventing Project Management: The Diamond Approach to
Successful Growth and Innovation. Boston, MA: Harvard Business School Press.
Shenhar, A., Dvir, D., Levy, O., & Maltz, A. A. C. (2001). Project success: A multidimensional strategic
concept. Long Range Planning, 34(6), 699–725.
Shenhar, A., Levy, O., & Dvir, D. (1997). Mapping the dimensions of project success. Project
Management Journal, 28(2), 5–13.
Shenhar, A., Tishler, A., Dvir, D., Lipovetsky, S., & Lechler, T. (2002). Refining the search for project
success factors: A multivariate, typological approach. R&D Management, 32(2), 111–126.
Spence, M., & Zeckhauser, R. (1971). Insurance, information, and individual action. The American
Economic Review, 61(2), 380–391.
Tekin, A. K., & Kotaman, H. (2013). The epistemological perspectives on action research. Journal of
Educational and Social Research, 3(1), 81–91.
Tishler, A., Dvir, D., Shenhar, A., & Lipovetsky, S. (1996). Identifying critical success factors in
defense development projects: A multivariate analysis. Technological Forecasting and Social
Change, 51(2), 151–171.
28
Does Project Governance Impact Project Success?
Toivonen, A., & Toivonen, P. U. (2014). The transformative effect of top management governance
choices on project team identity and relationship with the organization — An agency and
stewardship approach. International Journal of Project Management, 32(8), 1358–1370.
Too, E. G., & Weaver, P. (2014). The management of project management: A conceptual framework
for project governance. International Journal of Project Management, 32(8), 1382–1394.
Turner, J. R., & Müller, R. (2003). On the nature of the project as a temporary organization.
International Journal of Project Management, 21(1), 1–7.
Turner, J. R., & Müller, R. (2004). Communication and co-operation on projects between the project
owner as principal and the project manager as agent. European Management Journal, 22(3),
327–336.
Turner, J. R., & Müller, R. (2006). Choosing Appropriate Project Managers: Matching their
Leadership Style to the Type of Project. Newtown Square, PA: Project Management Institute.
Weill, P., & Ross, J. (2004). IT Governance: How Top Performers Manage IT Decision Rights for
Superior Results (Vol. 1, pp. 63–67). Watertown, MA: Harvard Business Review Press.
White, D., & Fortune, J. (2002). Current practice in project management—An empirical study.
International Journal of Project Management, 20(1), 1–11.
Wiseman, R. M., Cuevas-Rodríguez, G., & Gomez-Mejia, L. R. (2012). Towards a social theory of
agency. Journal of Management Studies, 49(1), 202–222.
Yazici, H. (2009). The role of project management maturity and organizational culture in perceived
performance. Project Management Journal, 40(3), 14–33.
Yusoff, W., & Alhaji, I. (2012). Insight of corporate governance theories. Journal of Business &
Management, 1(1), 52–63.
29
Does Project Governance Impact Project Success?
30
Appendix V
Interview Questions for the Qualitative Study
Engineering, IT, research, internal low, medium, none, small low, medium, task, simple
Organizational consulting, time-critical, incremental, high, project,
external medium
Change, development, crisis breakthrough, normal
extreme
Marketing, operations, both transformational large project,
Finance decommissioning, daunting
organizational project,
change, service program
improvement,
service
development,
service
decommissioning
A
The ranges of Urgency, Innovation, and Technology taken from Shenhar’s Diamond model (Shenhar & Dvir, 2007).
B
The ranges for complexity are taken from Prince 2 (TSO, 2009).
2. The project methodology(s); how it was originally developed and evolved, project
types supported, strengths, and weaknesses.
• Please describe the project methodology or methodologies your company uses
including whether it is based on an international standard like Prince2, Prompt, or
PMBOK® Guide?
• If the methodology was based on an international standard, then was the
methodology tailored to your business and, if so, was it tailored per project type or
per business section?
• If the methodology was developed within your company was it developed for a
specific product or service? Please describe its background.
• Are there derivatives of the methodology for different types of projects or business
areas and, if so, describe why?
• Please describe the strengths and weaknesses of your project methodology
1
Interview Questions
• Are there certain types of projects that your methodology is less or more suited to?
• Does your project methodology evolve to meet organizational needs and, if so, how
does it evolve? Also, who is responsible for its evolution?
• What would you recommend to improve the value of your organization’s
methodology?
• Looking at the methodology, what word would you use to describe the parts of the
methodology (hierarchical breakdown) in a generic sense?
• Does you project methodology for any given project type—integrate the “how to
build” something with the “what to build” or is the “what to build” (requirements
specs) kept separately?
• Would there be any advantages or disadvantages in combining a methodology, and
what needs to be built into one integrated approach?
3. Project success (success)
• Is there a definition of project success in your organization?
• Is there a definition of project success for your project(s)?
• Are there any numbers published on project success rates?
4. Impact of a project methodology on project success.
• Have you observed the project methodology, including how its elements impact the
characteristics of project success?
5. Project governance paradigm based on Müller (2009) and how it relates to the goals of
the organization/shareholders.
Background: The corporate governance of a company can be modeled on a continuum from
shareholder orientation to stakeholder orientation. In shareholder-oriented companies, all
decisions that are made are driven by the underlying desire to maximize the wealth of the
company’s shareholders. In stakeholder-oriented companies, there is still a need to create
profit to satisfy the needs of the shareholders, but this is only one of a variety of stakeholder
groups.
• Where on this continuum would you place your company?
• Is there a management philosophy with emphasis on always getting personnel to follow
the formally laid-down procedures or a strong emphasis on getting things done even
when this means disregarding formal procedures?
• Is the project manager responsible for time, cost, budget and/or any other measure?
• Is the reason why the project manager is responsible or not for something due, in some
way, to the governance paradigm used within your company?
2
Appendix VI
ONLINE
SURVEY
QUESTIONNAIRE
I.
Introduction
Thank
you
for
taking
the
time
to
participate.
The
research
is
to
understand
the
impact
of
a
project
methodology
on
project
success
and
how
this
relationship
is
influenced
by
difference
governance
paradigms
(models).
The
survey
is
targeted
at
Project
and
Program
Managers,
team
members,
Project
Management
Office
(PMO)
members
and
Project
Stakeholders
who
are
involved
with
projects
and
have
a
good
understanding
of
their
organization’s
or
client's
project
methodology.
Your
answers
should
be
based
on
your
experience
with
your
last
project.
The
questionnaire
will
take
about
20
minutes.
Please
make
sure
that
you
complete
the
full
survey
otherwise
it
cannot
be
used
as
part
of
the
overall
research.
There
are
also
some
mandatory
questions
you
must
answer
in
the
survey
before
you
can
progress
on
with
the
next
pages.
Participation
in
this
survey
is
voluntary
and
anonymous.
If
you
wish
to
receive
the
results
of
the
research
send
an
email
to
the
address
given
at
the
end
of
the
survey.
As
a
small
thank
you
at
the
end
of
the
survey
are
links
to
newly
published
research
papers
and
training
material
and
diagrams
that
have
helped
many
people
pass
their
PMI
PgMP
and
PMP
exams.
It
also
helps
to
visually
understand
how
project,
programs,
and
portfolios
integrate
from
different
perspectives.
Lastly,
please
forward
the
link
to
survey
if
you
know
other
suitable
people
who
would
like
to
participate
in
the
survey.
Kind regards
Robert
Online
Survey
Questionnaire
II.
Survey
Qualification
Question:
Do
you
have
an
understanding
of
your
organization's
or
client's
methodology
where
you
have
been
involved
as
a
project
stakeholder
i.e.,
someone
working
in
or
impacted
by
the
project(s)?*
*This
question
is
required.
Yes
No
1. My last project predominantly involved the following (please select one)
Under
6
months
6
months
to
less
than
1
year
1
to
2
years
Over
2
years
Low
Medium
High
2
Online
Survey
Questionnaire
4.
The
value
of
my
last
project
was:
Low
Medium
High
6. My last project was executed using the following organization structure:
Projectized
Organization
Functional
Organization
(Department)
Matrix
Organization
7. The level of technology sophistication (used to create the product or service) of my last project was:
Low
tech
Medium
tech
High
tech
Super
high
tech
3
Online
Survey
Questionnaire
IV
Methodology
Questions
Definition:
The
elements
(or
parts)
of
a
methodology
comprises
of
processes,
tools,
techniques,
capability
profiles
and
knowledge
areas.
Note:
Some
methodology
elements
exist
within
other
elements
e.g.,
a
process
contains
tools
and
techniques;
a
knowledge
area
contains
methods,
processes,
tools,
techniques
and
capability
profiles.
The
section
describes
the
five
methodology
elements
and
provides
examples
for
guidance.
Mandatory
questions
in
this
section
must
be
answered
before
you
can
progress!
Strongly
Strongly
Disagree
Undecided
Agree
disagree
Agree
The
organization's
project
methodology
had
a
comprehensive
set
of
processes
4
Online
Survey
Questionnaire
9.
The
methodology
element—Tool
Definition
of
Tool:
A
tool
is
tangible,
such
as
templates
or
software
programs,
used
in
performing
an
activity
to
produce
a
product
or
result.
Examples
include:
Project
Management
information
system,
questionnaires,
surveys,
scheduling
tool,
project
estimating
tool,
Quality
assurance
and
control
tool,
system
configuration
tool,
time
reporting
system.
In
my
last
project...*
*This
question
is
required.
Strongly
Strongly
Disagree
Undecided
Agree
disagree
Agree
The
organization's
project
methodology
had
a
comprehensive
set
of
tools
Strongly
Strongly
Disagree
Undecided
Agree
disagree
Agree
5
Online
Survey
Questionnaire
11.
The
methodology
element—Capability
profile
Definition
of
Capability
Profile:
A
capability
profile
is
a
description
of
attributes
including
personal,
technical
and
business
that
are
required
to
complete
a
set
task
and/or
to
perform
a
project
role.
In
my
last
project...*
*This
question
is
required.
Strongly
Strongly
Disagree
Undecided
Agree
disagree
Agree
Strongly
Strongly
Disagree
Undecided
Agree
disagree
Agree
The
organization's
project
methodology
had
a
comprehensive
set
of
knowledge
areas
6
Online
Survey
Questionnaire
13.
Is
your
organization’s
methodology
based
on
an
international
standard
(please
select
one)?
Note: If developed in-‐house, select "No-‐ it was developed in-‐house"
PMBOK
Prince2
IPMA
ISO9001
PROPS
Product
Service
Both
Not
applicable
(as
it
was
based
on
an
international
standard)
16. Are there derivatives (more than one methodology) of your organization’s methodology?
No
7
Online
Survey
Questionnaire
17.
How
experienced
does
a
project
manager
need
to
be
to
use
your
organization’s
methodology?
Not
experience
Partly
experienced
Moderately
experienced
Highly
experienced
Expert
18. Please list up to 3 strengths and weakness of your organization’s methodology...
Strength
1:
Strength
2:
Strength
3:
Weakness
1:
Weakness
2:
Weakness
3:
19.
Does
your
organization’s
methodology
evolve
(adapt)
in
a
controlled
and
timely
manner
to
meet
organizational
needs,
e.g.,
new
polices,
techniques,
processes,
tools,
and
capabilities?
20.
Does
you
organization’s
methodology
for
any
given
project
type:
integrate
the
‘how
to
build’
something
with
the
‘what
to
build’
or
is
the
‘what
to
build’
(requirements
specifications)
kept
separately?
Not
integrated
Slightly
integrated
Moderately
integrated
Highly
integrated
Completely
integrated
8
Online
Survey
Questionnaire
V.
Importance
of
Project
Success
Criteria
21.
In
my
last
project,
the
following
factors
were
important
for
overall
project
success*
*This
question
is
required.
New
understanding/knowledge
gained
Finished on-‐time
Sponsor satisfied
End-‐User satisfaction
9
Online
Survey
Questionnaire
VI
Project
Success
Achieved
22.
My
last
project
was
successful
in
terms
of:*
*This
question
is
required.
New
understanding/knowledge
gained
Finished on-‐time
End-‐user satisfaction
10
Online
Survey
Questionnaire
VII
Governance
Please
tick-‐off
what
best
approximates
the
actual
conditions
in
the
parent
organization
of
your
last
project.
One
answer
per
question.
+2
+1
0
+1
+2
…decisions
are
made
in
the
best
interest
…decisions
are
made
in
the
best
interest
of
of
the
shareholders
and
owners
of
the
the
wider
stakeholder
community
organization
and
their
Return
on
+2
+1
0
+1
+2
…the
remuneration
system
includes
…the
remuneration
system
provides
incentives
stock-‐options
for
employees
and
for
community,
environmental,
humanitarian
similar
incentives
that
foster
+2
+1
0
+1
+2
…I
am
sometimes
asked
to
sacrifice
…I
am
sometimes
asked
to
sacrifice
the
stakeholder
satisfaction
for
the
achievement
of
financial
objectives
for
achievement
of
financial
objectives
improvement
of
stakeholder
satisfaction
+2
+1
0
+1
+2
…the
long
term
objective
is
to
maximize
value
for
…the
long
term
objective
is
to
the
owners
of
the
organization
+2
+1
0
+1
+2
…a
strong
emphasis
on
always
getting
…a
strong
emphasis
on
getting
things
personnel
to
follow
the
formally
laid
done
even
if
it
means
disregarding
formal
down
procedures
procedures
11
Online
Survey
Questionnaire
29.
The
management
philosophy
in
my
organization
favors…*
*This
question
is
required.
+2
+1
0
+1
+2
…tight
formal
control
of
most
…loose,
informal
control;
heavy
dependence
operations
by
means
of
sophisticated
on
informal
relationships
and
the
norm
of
control
and
information
systems
cooperation
for
getting
things
done
+2
+1
0
+1
+2
…a
strong
emphasis
on
getting
…a
strong
emphasis
to
let
the
requirements
of
personnel
to
adhere
closely
to
the
situation
and
the
individual’s
personality
formal
job
descriptions
define
proper
on-‐job
behavior
+2
+1
0
+1
+2
…support
institutions
(like
a
PMO)
should
…support
institutions
(like
a
PMO)
ensure
compliance
with
the
organization’s
should
collect
performance
data
in
order
project
management
methodology
to
identify
skills
and
knowledge
gaps
+2
+1
0
+1
+2
…prioritization
of
methodology
…prioritization
of
people’s
own
compliance
over
people’s
own
experiences
in
doing
their
work
over
experiences
in
doing
their
work
methodology
compliance
33.
In
your
last
project
were
the
use
of
the
methodology
elements
(including
subelements)
influenced
by
the
project
governance
structure?*
*This
question
is
required.
Note:
Methodology
elements
contains
subelements,
e.g.,
the
tools
element
has
subelements
which
are
the
tools
themselves;
the
same
for
process
element
where
the
subelements
are
the
processes;.
This
is
also
true
for
techniques,
capabilities
profiles
and
knowledge
areas.
Strongly
Disagree
Neutral
Agree
Fully
Agree
Disagree
Process
element
Tool element
Techniques element
12
Online
Survey
Questionnaire
VIII
Demographics
34.
Your
title
in
the
organization
CIO
CTO
Project
Portfolio
manager
PMO
Program
manager
Project
manager
Team
member
Architect/Advisor
QA/
audit
function
Technical
stakeholder
Business
stakeholder
Other
(Please
specify)
35. Gender
Female
Male
Other
-- Please Select --
40. Please select whether your last project was internal or external to your organization
13
Online
Survey
Questionnaire
41.
How
many
employees
has
the
organization
you
are
working
for?
1
-‐
4
5
-‐
9
10
-‐
19
20
-‐
99
100
-‐
499
500
-‐
1000
1001
-‐
5000
5001
-‐
9,999
10,000+
PhD/doctorate
MBA
Masters
Bachelor
Other
Not
certified
14
Online
Survey
Questionnaire
Thank
You!
For
information...
this
is
the
third
and
last
part
of
the
research,
where
the
first
part
(pre-‐
study)
resulted
in
a
book
chapter
called
“A
natural
science
comparative
to
develop
new
insights
for
project
management
research.”
A
research
paper
on
this
topic
was
accepted
for
the
EURAM
2014
conference
in
June.
The
second
part
of
the
research
resulted
in
a
research
paper
which
will
be
presented
in
July
at
the
2014
PMI
research
conference
in
Portland,
USA.
This
third
and
final
part
should
result
in
a
research
paper
and
input
into
a
new
book
titled
Project
Program
and
Portfolio
Success
Factors.
If
you
would
like
to
receive
a
copy
of
the
research
paper
resulting
from
this
study,
please
send
an
email.
Email
address
is
below.
Please
find
a
link
to
PMP
and
PGMP
study
material
as
well
as
material
useful
to
understand
your
project,
program
and
portfolio
work
environment
https://app.box.com/pmi-‐study-‐
material
Also
included
is
project
management
research
tips
(Masters
and
PhD
level)
https://app.box.com/phd
Finally,
a
new
research
paper
on
"Societal
structures
and
the
impact
on
project,
program
and
functional
management
competencies"
https://app.box.com/s/d6rbnpuha2oo6ndiih1e
Robert
15