Reporting and Analytics Framework v1.5
Reporting and Analytics Framework v1.5
Overview.......................................................................................3
Context.........................................................................................4
Objectives.....................................................................................4
Scope..........................................................................................17
Further Information.....................................................................17
Appendix 1.......................................................................................18
Appendix 2.......................................................................................18
DOCUMENT MANAGEMENT
Keywords:
Identifier: BI/Frame/TRIM
doc/14/206875
Issue date:
30th Jun 2014
Authority:
Victorian Government CIO Council
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 2 of 19
1 Overview
This Victorian Government Reporting and Analytics Framework supports the governments
objective that government organisations develop improved reporting and business analytics
capabilities to support the development of evidence-based policy1and the improvement of
client service delivery. The ability to identify, collect, analyse and use data in the course of
service delivery is becoming a vital function that will play an increasingly important role in
organisational performance.
Rationale
Business insight leads to improved decision-making, improved government
Why
do we need a
Framework?
What
How
is the Framework?
do we use the
Framework?
To provide departments
and
agencies
with
guidance
for
establishing
and
maturing
their
reporting and analytics
functions.
The Framework is a
The Framework can be
used
both
as
a
representation of key
areas of focus that are
maturity model and a
roadmap.
required
for
an
organisation
to
Departments,
agencies and divisions
establish an advanced
reporting
and
can
self-assess
specific areas of focus
analytics
function.
Each area of focus is a
and determine what
level of maturity they
building
block
that
collectively
forms
a
will aim to achieve.
To be a reference point
The
tools
and
road
map
for
for departments and
improvements
in
an
techniques
which
agencies
to
improve
support
the
organisations
and increase the use of
reporting
and
framework
assist
the
business analytics as an
analytics capability.
essential element in
1data evidence and statistical analysis that can support policy development and practical
program decisions
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 3 of 19
2 Context
The Victorian Governments Information and Communication Technology (ICT) Strategy 2013 to
2014 states the following:
The Victorian Government will enhance real time reporting and business intelligence
capabilities. Government is largely an information-based enterprise and the value of data
and analytics in developing evidence-based policy and improving service delivery cannot be
underestimated. Government agencies are responsible for delivering outcomes to
Victorians, and are judged on their ability to meet measures of success. We can get a
clearer picture of the status of government programs by analysing these measures more
consistently. Some agencies have already put in place data and analytics programs, but
skills and practice can be further enhanced. The introduction of business intelligence
software is only one part of the process. Agencies need to be sure of the quality and
availability of the underlying data. Key reports and metrics need to be agreed and staff skills
are needed to draw insights from analytics reports.
3 Objectives
This framework has been developed in the context of the Victorian Government ICT Strategy.
The Reporting and Analytics Framework combined with the future Community of Practice will
provide focus for best practice approaches, collaboration and rationalisation of processes and
tools across the government to develop evidence-based policy2and improve client service
delivery.
Within this context key stakeholders throughout the whole Victorian government have been
engaged in order to ensure the framework identifies and builds on existing capability and
provides value to government organisations. The framework is based on the following findings.
Maturity Model
All departments have some level of existing performance reporting and data analytics
capability. There is a broad spectrum of methods, capabilities, tools and organisation maturity.
There is no single step-change that can be uniformly applied across government. Given this
broad spectrum of capabilities and functions, the framework includes a maturity model that
can be used to assist organisations self-assess and develop a plan for improving their analytics
capability. There is no single or right implementation of the framework; the framework can be
applied to different organisational structures and within different organisational constraints. For
example, a single division can use the maturity model to self-assess and develop a plan for
improvement.
2data evidence and statistical analysis that can support policy development and practical
program decisions
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 4 of 19
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 5 of 19
Use
& analyse
Package
Access
Connect
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 6 of 19
Connect
Access
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 7 of 19
The Strategic Management Framework - available from Department of Treasury and Finance
(DTF) http://www.dtf.vic.gov.au/Publications/Government-Financial-Management-publications/StrategicManagement-Framework
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 8 of 19
The framework has been developed to show the types of functions that are currently performed
throughout the government as a guide for organisations to identify the step-change required to
improve data analytics. The framework maturity model is a grid of functions working from left
to right. It is intended that organisations will use this grid to self-assess their existing
capabilities and to identify the step-changes to move up the maturity scale. Self-assessment
materials, including explanations and definitions of the data usage layer components, and
service model options are part of the Tools Techniques material that is provided in a separate
document.
Base review
Long term vision is the
body
of information
required
to if
determine
we of
arethe
tracking?
Develop
thatbody
willWhat
help
the
organisation
succeed.
-- annually
or insightful questions
What is the
of
information
required
to answer
these
questions?
How will we improve?
What
analysishow
as part
strategy
background & supporting reasons
every 3 years
Corporate
Reporting
Targeted
Digital Dashboard
Interactive Dashboard
Consolidated Dashboard
Informed decision-making
Data Usage
Centralised
Centre of Excellence
De-centralised
Client data
Organisational Model
/ Service Model for business analytics
Partially centralised
Project specific
Connect
Package
Access
(see above)
Information Management Principles / Standards / Guidelines
CLASSIFICATION: Unclassified
Data Management
Output
Peripheral service
(at cost)
What happened?
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 10 of 19
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 11 of 19
Share
(consolidated data about similar cohorts across government)
flat data
Data analysis
Data trending Forecasting
Direct correlations
What if analysis
between activities, outputs
What happened
What is theWhy
problem
is this happening
What service should we provide in the future
What will happen next
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 12 of 19
Data
analysis
Client Data
Government provides a diversity of services and has a diversity of clients. For example, the
target client group for Department of Health is the Victorian Citizen, with the main aim being to
improve health and wellbeing. In contrast, the target clients of other departments include
business and industry sectors, agricultural land-holdings, etc. Analytics at a crossdepartmental level (where the client cohort is same) is effective as it is possible to make
informed decisions and map the causal relationships between multiple potential government
programs and potential client results.
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 13 of 19
Connect
Package
Access
Collect& Cleanse
The data collection and cleansing function refers to data management activities. Typically this
is the identification, inputting, collecting, transformation and storing of data. To be able to
mature the use of data the service model needs to be based on data management policies,
standards and guidelines. The core elements are:
Data custodian / data warehousing / data mart. This is the element focussed on collecting,
transforming and optimising data for the analysis and reporting needs for the business.
Data quality / data assurance and advice. This element provides advice on data quality,
data consistency, and data accuracy.
Connect
The data connect function refers to data integration activities. Typically this is the storing and
connection of data to enable repeatability in reported results. To be able to mature the use of
corporate data (and the repeatability and quality of reported results) the service model needs
to be based on data management policies, standards and guidelines. The core elements of
connection are:
Data warehousing / data mart. This is the element focussed on locating common data
elements to enable connection of discrete data sets for the analysis and reporting needs for
the business.
Master data management / data integration. This element focuses on the synchronisation of
data between operational and analytical systems. It also sets enterprise wide guidance and
architecture on data movement and storage.
Metadata management / data standards advice. This element focuses on metadata services
for the purpose of data governance, impact analysis and data lineage.
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 14 of 19
Business rules for data sets and reports (enabling the provision of consistent and
repeatable data for reports)
Business rules engine and business rules custodian / Query and report services / simulation
tools / modelling tools
Predictive and advance analytical tools. Trending and what it scenario design and
development.
Package
The package function refers to how information is produced or assembled to address a business
need. It relates to when the data is distributed, to whom it is distributed, and the quality of the
presentation of the information. This function supports the Information Decision-Making layer of
the framework which includes considerations such as:
Are the information products designed for their audience - targeted?;
do they show a consolidated view?; and
is the consolidated report presented in an easy-to-consume manner - as a Dashboard?
Typical examples range in complexity and coverage depending on the level of maturity. This is
the activity-set that produces enterprise performance reports, client centric analysis reports
and targeted analysis reports/ information sets to support business processes.
Access
The access function represents the way information is accessed, and consumed by the user.
The key elements are as follows:
Digital dashboards / interactive dashboards / personal and enterprise dashboards / data drill
in and discovery / search / self-help reports / alerts.
Information Management
The data management layer is supported by good data management practices, described
within the existing Information Management policies, standards and
guidelineshttp://www.digital.vic.gov.au/policies-standards-guidelines/information-management/ and the
Information Security Policy and Standards at http://www.digital.vic.gov.au/policies-standardsguidelines/information-security/and supported by the Information Management Group (IMG) of the
Victorian government.
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 15 of 19
A step-by-step approach to
understanding and acting on this
framework:
Step 1: Discuss the capability model
internally and carry-out a selfassessment; Identify which activities
are currently being carried-out
Guidelines in how to
progress
Performance Management
KPI dictionaries
Visualisation techniques
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 16 of 19
7 Scope
8 Further
Information
For further information regarding this
standard, please contact Digital
Government Branch in the Department of
State Development, Business and
Innovation, at
[email protected]
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 17 of 19
Appendix 1
Victoria Police
Appendix 2
About other reporting and
analytics frameworks
There is a range of such proprietary
frameworks available (e.g. Gartner, TDWI),
but no standard framework has yet
emerged.
Most of the existing frameworks focus on
the data usage activity and do not show the
linkages with corporate performance
management and service design (refer to
the TDWI example below).
The Data Warehousing Institute (TDWI)
maintains a maturity model and an online
self-assessment tool:
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 18 of 19
CLASSIFICATION: Unclassified
Framework: Victorian Government Reporting and Analytics / Page 19 of 19