A Survey of Maturity Models in Data Management 1
A Survey of Maturity Models in Data Management 1
net/publication/353200612
CITATIONS READS
3 1,146
4 authors, including:
Syrine Ferjaoui
IEEE Computer Society
3 PUBLICATIONS 10 CITATIONS
SEE PROFILE
All content following this page was uploaded by Oumaïma Belghith on 16 November 2022.
Abstract—Digitalization is taking businesses to a whole needed to manage and deploy the massive influx of
new era as they are becoming data-driven and creating data, due to being unaware of where they stand in
the most wealth by mastering their data and gaining a terms of data management maturity.
competitive advantage. To the best of our knowledge,
very few survey papers are available on data Therefore, the assessment of the digital
management maturity models in academia, from transformation’s progress is an important step that
which we studied their data and findings. every organization needs to understand and go
Consequently, our paper summarizes and organizes a through via the tracking of processes’ improvements
variety of researches that are related to or encompass
and the evaluation of the level of maturity in terms
the data management field. In this context, this paper
is of interest both for scientists as well as practitioners
of growth and capabilities. And thus, to figure out
from different industries and fields as it aims to how to evolve from their current state to become
highlight the importance of such a critically acclaimed mature, gain competitive advantage, and maximize
tool that is a maturity model in the field of data their business value at the same time, while keeping
management. Maturity models are helpful business the focus on the business needs and strategic goals,
tools that refine and develop the way organizations these organizations should benefit from maturity
conduct their businesses and benchmark their models.
maturity status against a scale or with industry peers.
The aim is to better prioritize the actions for There is extensive literature produced by various
improvement and to control the progress in reaching authors in the past decade as well as the
the target maturity stage. From an academic development that led to the current thinking and
perspective, it delivers a thorough literature review as practices of maturity models and their significance
it investigates maturity models that are either for or as assessment and improvement tools, for several
related to data management. Moreover, it offers a
business domains [48][49]. However, for the data
comparative analysis in terms of the main concepts
and features associated with these models through a management field, according to what we reportedly
developed metamodel. This proposed framework believe, we focus and highlight in our study only the
describes the functional coverage of data management most relevant literature works which were
maturity models where models can be compared and conducted throughout the years, while offering new
evaluated based on their approaches to identifying and perspectives in terms of analysis and presentation on
categorizing the data management related functions. this area that requires additional investigation and
Finally, this metamodel can serve as a tool for research in the future.
researchers who can use this framework to position
future maturity models. The following section further clarifies the general
context of our research from a business perspective
Keywords—maturity models, data management, and provides the key concepts and terms related to
maturity assessment, digital transformation maturity models in the field of data management. A
third section is dedicated to the research
methodology adopted to analyze the studied models,
I. INTRODUCTION
using a set of assessment criteria, and in the
Enterprises are currently facing an increasingly elaboration of a metamodel that illustrates some of
competitive and erratic global business the conceptual similarities and differences between
environment, aligning data projects at the edge of them. Afterward, the results of the survey are
technical and organizational projects. They, presented through an overview of a sample of
consequently, encounter changes in IT organization models and then a discussion of the findings from
as well as in the operating models and organizational the extensive analysis is presented. Lastly, a
structure. Moreover, organizations struggle to conclusion on the entire process is drawn and
identify and build the appropriate capabilities contributions are mentioned.
II. BACKGROUND With that being a research trigger, and to further
To maintain a competitive advantage, companies discuss maturity models, the next section will firstly
strive to provide the best experience for their give an outlook on data management and data
customers and employees. This is achieved through governance, followed by the evolution of the
the modernization and automation of processes and capability maturity concept and maturity models.
operations through digital platforms [1]. Thus, the
key factor is data as described in this context as “The 1) Data Management
Gold” in this current era by Everest Group’s CEO Organizations recognize their data as vital assets, a
who shared that the global market for data and data valuable tool that helps businesses bring not only
analytics is expected to explode [1]. This was further innovative but also strategic goals. Despite its
affirmed by a research report on the enterprise data importance and recognition, data management is
management market which was published by still deemed one of the most vital issues in the
MarketsandMarkets [2]. The study showed that the current technological landscape, and few businesses
size of this market will considerably witness successfully derive value from it [6].
significant growth from USD 77.9 billion in 2020 to Previous research debated on the identification of
USD 122.9 billion by 2025. Nowadays, the reasoning behind the failure of businesses to
organizations strive to sustain a certain level of manage their information assets, hence several
advantage by adopting new technologies and barriers were found to inhibit the issue. Some of
integrating them in their transactional and analytical them were associated more with the people and
operations as well as their customer experience [2]. culture of an organization, such as lack of
Consequently, companies need to monitor and communication, knowledge-sharing initiatives, and
benchmark their data analytics capabilities proficiency and motivation [7]. While others, [8],
regularly, which requires the measurement of their debated that the barriers relate mostly to the
business value and comparison with similar systems incompetent organizational management and
in other companies. As data are useful only when put leadership, organization culture, oblivion towards
into context, another crucial key factor for success is costs, value, and benefits. However, to overcome all,
matching the current maturity level within the regardless of their grounds, data, and information
organization to the appropriate metrics and pacing needed to be recognized as fundamental assets to
its growth via the integrated maturity model. Only day-to-day operations. Nowadays, they are the key
then, the benefit of having a competitive advantage assets for organizations to rely on in their decision-
will be the highest [3]. Thus, it is most crucial for an making process and operational processes. But for
organization to realize this correlation and be aware them to be potent assets, they need to be of good
of the current maturity level of data management quality and well-managed [9].
and of what needs to be achieved to reach the next It has been agreed that data management needs to
level. encompass all major disciplines involved in making
Therefore, employing the right tools to assess the the data accessible, reliable, and appropriate for
level of data management maturity is a critical step internal as well as external use. Nevertheless, it is
in the digital transformation journey of most data- ought to balance the strategic needs of an enterprise
driven companies. In this context, maturity models with its operational ones. Thus, as mentioned in
serve as tools that define levels of efficiency, DAMA International [5], the best way to achieve
definition, manageability, and measurement of the this balance is by embracing dedication towards the
monitored environment selected by the organization successful and effective execution of the
[4]. management of data.
1
https://drive.google.com/file/d/1fF06NcBUw16sswATD9to4W
Z3u8G2QvfE/view
Fig. 1. Data Management Metamodel.
Hence, through this approach, the metamodel culture capability in the Enterprise and Intent
illustrates similarities and commonalities, and how domain. The two models differ in all others, such as
each model is still connected with another by relating their system and technology capabilities
sharing their practicality, feature, or focus domain, separately, as Deloitte’s DMM specifies in Business
despite some of them having differently structured and/or Technology Architecture, while EIM
attributes and functions. As depicted in our considers the latter as Infrastructure.
metamodel, some conceptual differences can be
The model DAMA DMBOK2 [5] also, alters from
spotted between the models when it comes to
the other models as it does not have any practicality
interpretations and perspectives.
in the Enterprise and Intent domain, nor the
A prime example of this is the variation in defining supporting capabilities. However, it contributes by
functions such as “data governance” as described by focusing on attributes that none of the depicted
DCAM V2 [31] [32] as a “Business Capability”, models have, such as Data Operations in the
while CMMI’s [43] DMM labels it as a “Category”. Systems and Technology area, and Business
Although some of the data management functions’ intelligence management in the Methodology
roles are similar in some models, others are entirely function.
different. This becomes obvious when considering
A further case in point is DELL BDBM [42],
the function “Integration” which is regarded as a
which distinguishes itself from the other models by
data management “Process Area”, that operates in
adopting different approaches to the different
the “Architecture” category in the CMMI’s DMM
domains. The model instigates the monetization
[43]. While it is separated from “Architecture” by
function as a support capability, with introducing
the DataFlux MDM [33] and is treated as an
Data monitoring as a separate attribute in the Data
independent data management “Component”. Some
domain, unlike the majority of the other models,
models also differ in recognizing which functions
which define this latter as a subordinate in the prime
are deliverables of other functions.
capabilities, Data/Information management or
Another example is Deloitte’s DMM [24][27] and Data/Information Governance.
Gartner’s EIM [28][36][40], even though they share
the same domains, they only have one common
attribute, which is Organizational structure and
Therefore, this metamodel can serve as the starting IV. RESULTS
point for building a new data management maturity
A. Overview of Maturity Models for Data
model. By regrouping most of the capabilities and
Management available in the literature
sub-capabilities used by the depicted models, with
five key components for data management having In total, 22 models have met our selection criteria.
been determined. The components can establish the We used them to form the metamodel that served as
basis for deciding on the number and labels of the a highlight to their commonalities and differences
capabilities, sub-capabilities, and criteria used as regarding focus domains, capabilities, and sub-
well. capabilities, and they were also grouped in families
according to their practicality and assessment focus,
as illustrated in TABLE I.
Capability Maturity Model in Scientific Data CMM-SDM 2010 School of Information Studies [6]
Management Syracuse University
DataFlux Master Data Management Model MDM 2010 DataFlux Company [33]
Data Research Data Management Maturity Model RDM 2014 School of Information Studies [54]
Management Syracuse University
Data Management Capability Assessment Model DCAM v2 2019 The Enterprise Data [31][32]
Management Council
The “Orange” Data Management Maturity Model DMMM 2019 Data Crossroad [18]
IBM Data Governance Council Maturity Model DGMM 2007 IBM [29][34][37]
DataFlux Data Governance Maturity Model DGMM 2007 DataFlux Company [33]
Data/Information Stanford Data Governance Maturity Model DGMM 2011 Stanford University’s Data [35]
Governance Governance Office
Analytics TDWI: IoT Data Readiness Assessment TDWI 2018 TDWI - Transforming Data [44]
With Intelligence
TDWI: Advanced Analytics Maturity Model
Data Management Family functions. Moreover, it is the sole model with this
practicality that does not offer training with its
The maturity models of this group share data assessment nor cover the people and culture sides of
management as their assessment focus. Even though organizations.
their specific practicalities may differ, they all serve
TABLE III. COMMUNALITIES OF DATA/INFORMATION
as tools that evaluate the maturity of data assets in GOVERNANCE FAMILY
organizations and how it can be developed. All
models have 5 maturity levels except for DCAMv2 Levels Reactive - Proactive - Managed - Optimized
[31][32] which differs by having an additional level
“Conceptual”. For the “Orange” model, for instance,
its development encompasses the analysis of all the Attributes Information Governance - Data Quality -
Processes - Policies
aforementioned models, from which a metamodel
has been derived to generate the most significant and Approach - Strong & weak points identified
efficient aspects that a maturity model must include. - Inputs diversity
TABLE II. COMMUNALITIES OF DATA MANAGEMENT
FAMILY
- Current State assessment
- Scope definition based on priorities
Levels Ad-hoc/Initial - In development - Defined Strengths - Framework focus on Information
Governance
- Risks & resources allocation
Attributes Data Management - Data Governance - Data
Quality - Data Architecture - Processes
Weaknesses - No workshops
- Identification of strong & weak points
Approach - Assessment Support
- Assessment continuity with roadmap
development strategies Software Development Family
- Flexibility & adaptability to company This family group is composed of two of the most
specifications known and referred to models specialized in
Strengths - Well-defined & enriched frameworks software development. CMM [14] represents a path
- Guidance and details on features of improvements recommended for software
- Best practices, actions & recommendations
for maturity level evolution organizations that aim to increase their software
process capability as it identifies and prioritizes
findings. The CMMI institute also developed the
Weaknesses N/A
successor of the CMM model, CMMI [16], which
provides assessment criteria for the following data
management areas Data Management Strategy, Data
Data/Information Governance Family Governance, Data Quality, Platform, and
Architecture, Data Operations, Supporting Process.
This group includes models that are particularly
focused on the governance of data and information
assets. IBM’s maturity model [29][34][37] was one
of the pioneers to introduce and develop such a
model with this particular focus. It is also the only
model to have 11 attributes that are individually
assessed, of which there are exceptionally risk
management, privacy, and audit information
TABLE IV. COMMUNALITIES OF SOFTWARE TABLE VI. COMMUNALITIES OF ANALYTICS FAMILY
DEVELOPMENT FAMILY
Levels Nascent - Pre-Adoption - Early Adoption -
Levels Initial - Defined - Managed Corporate Adoption - Mature Visionary
2
https://docs.google.com/document/d/1IqFh7WuI4OLLgSoeTbI
9vI6iDUB_BwPv60EXoPlm5Yc/edit?usp=sharing
W. Wang, L. Chen, -C. Ellis, C.-H. Hsu, A. Tsoi, & H. Wang www.ibm.com/industries/government/resources/digital-
(Ed.), Advances in Web and Network Technologies, and transformation-evaluation
Information Management. Lecture Notes in Computer Science. [38] IBM. (n.d.). Industry Data Models. Retrieved from
4537, pp. 384-395. Huang Shan, China: Springer, Berlin, IBM.com: www.ibm.com/analytics
Heidelberg. doi: https://doi.org/10.1007/978-3-540-72909-9_42
[39] István Alföldi, Zsuzsanna Fülöp, Zoltán Szatucsek. (2014,
[20] Khoshgoftar, M., & Osman, O. (2009). Comparison of July 31). E-ARK General Model. European Archival Records and
maturity models. 2009 2nd IEEE International Conference on Knowledge Preservation, 1.3.
Computer Science and Information Technology, (pp. 297-301).
[40] Jennings, M. (2007, March). Developing a Roadmap for an
Beijing. DOI:10.1109/ICCSIT.2009.5234402
Enterprise Information Management Program, 1. (EIMI)
[21] ARMA International. (2013). ARMA International’s Retrieved from EIMInstitute.org:
Information Governance Maturity Model. http://www.eiminstitute.org/library/eimi-archives/volume-1-
[22] ARMA International. (2017). The Principles® Maturity issue-1-march-2007-edition/enterprise-information-
Model. Retrieved from ARMA International. management-primer
[23] Charles M. Dollar, Lori J. Ashley. (2012). Digital [41] Paulk, Mark C; Curtis, Bill; Chrissis, Mary Beth; Weber,
Preservation Capability Maturity Model, Version 2.4. Accessed Charles V. (1993). Capability Maturity Model(SM) for Software,
November 2012 Version 1.1. Software Engineering Institute. Pittsburgh:
[24] Christine Anderson, William Ellerby. (2018, February). CMU/SEI-93-.
Digital Maturity Model. Retrieved from Deloitte LLP: [42] Schmarzo, B. (2014, January 22). “Big Ideas” Big Data
www2.deloitte.com Business Model Maturity Index. Retrieved from InFocus:
[25] Crowston, Kevin, Jian, Qin. (2011). A Capability Maturity infocus.delltechnologies.com
Model for Scientific Data Management: Evidence from the [43] CMMI® Institute. (2019). DATA MANAGEMENT
Literature. (J. Qin, Ed.) ResearchGate, 48, 9. MATURITY (DMM) MODEL. CMMI® Institute.
[26] DAM. (2017). DAM Maturity Model. Retrieved from [44] TDWI. (2014). TDWI Transforming Data With Intelligence.
dammaturitymodel.org: https://www.dammaturitymodel.org/ Retrieved from TDWI Research & Resources: tdwi.org
[27] Deloitte LLP. (2018, August). Deloitte Digital Maturity [45] User. (2018, December 4). Capability Maturity Model
Model. Retrieved from Tmforum: www.tmforum.org (CMM)-CIO Wiki. Retrieved November 18, 2019, from CIO
Wiki: https://cio-
[28] De Simoni, G. (2020, February 24). Implement Enterprise
wiki.org/wiki/Capability_Maturity_Model_(CMM)
Metadata Management to Drive Effective Enterprise Information
Management. (I. a. Gartner, Ed.) Retrieved from gartner.com: [46] User. (2018, December 13). Enterprise Information
https://www.gartner.com/en/documents/3981254 Management (EIM). Retrieved December 26, 2018, from cio-
wiki.org.
[29] Devlin, D. (2019). Models of Digital Transformation-The
role of context, governance, integration, and industry models. [47] White, S. K. (2018, March 16). What is CMMI? A model for
IBM CORPORATION. 9sight Consulting. optimizing development processes. Retrieved from
https://www.cio.com/article/2437864/process-improvement-
[30] Diogo Proença, Ricardo Vieira, José Borbinha, Pável
capability-maturity-model-integration-cmmi-definition-and-
Calado, Bruno Martins. (2017, January 23). A Maturity Model for
solutions.html
Information Governance. Lisbon, Portugal.
[48] Proença, D., & Borbinha, J. (2018, September). Maturity
[31] EDM Council. (n.d.). DCAM Assessments & Support.
Models for Data and Information Management. doi:10.1007/978-
Retrieved from EDMCouncil.org:
3-030-00066-0_7
https://edmcouncil.org/page/dcamassessmentsuppor
[49] Kolukısa - Tarhan, Ayça & Turetken, Oktay & Ilisulu,
[32] EDM Council. (2019). DCAM v2.1.1 Foreword & Fadime. (2015). Business Process Maturity Assessment: State of
Introduction. EDM Council, Inc. the Art and Key Characteristics. 10.1109/SEAA.2015.50
[33] Firican, G. (2018, September 19). Data governance maturity [50]Charles M. Dollar, Lori J. Ashley. (2012). Digital
models - DataFlux. Retrieved from www.lightsondata.com Preservation Capability Maturity Model, Version 2.4. Accessed
[34] Firican, G. (2018, August 8). Data governance maturity November 2012
models – IBM. Retrieved from LightsOnData.com: [51]Preservica Software company. (2014, April). Digital
https://www.lightsondata.com/data-governance-maturity- Preservation Maturity Model. Retrieved from:
models-ibm/ www.preservica.com
[52]Katuu, S. (2013). The Utility of Maturity Models - The ECM
[35] Firican, G. (2018, August 29). Data governance maturity Maturity Model within a South African
models – Stanford. Retrieved from LightsOnData.com: context. Department of Information Science, University of South
https://www.lightsondata.com/data-governance-maturity- Africa, South Africa.
models-stanford/ [53]Gable, J. (2015). The Principles, IG Maturity Model: Tools
[36] Gartner, I. (2014). blogs.gartner.com. Retrieved from for Professional Growth. ARMA Magazine, 3.
gartner.com: [54]S. U. (n.d.). CMM for RDM- A Capability Maturity Model
https://blogs.gartner.com/andrew_white/files/2016/10/On_site_p for Research Data Management. Retrieved from rdm.ischool.syr.:
oster.pdf http://rdm.ischool.syr.edu/
[37] IBM. (n.d.). IBM Government Digital Transformation
Maturity Model. Retrieved from IBM.com: