ODB 3rdedition GlobalReport
ODB 3rdedition GlobalReport
Third Edition
WWW.OPENDATABAROMETER.ORG
The Barometer was supported by the Open Data for Development (OD4D) program, a partnership funded by
Canadas International Development Research Centre (IDRC), the World Bank, United Kingdoms Department for
International Development (DFID), and Global Affairs Canada (GAC). This was a collaborative work of the network
carried out with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada.
You can contact the Barometer team by emailing: [email protected]
Members of the media can contact and request further information by emailing: [email protected]
2015 Web Foundation - Licensed under a Creative Commons Attribution 4.0 Unported license.
CONTENTS
Executive summary and key findings 05
Readiness 11
Policies and data management approaches
12
14
1
Executive Summary
and Key Findings
Open data is essential to building accountable and effective institutions, and to ensuring public access to information
www.opendatabarometer.org
Covering 92 countries in the present edition, the Barometer ranks nations on:
1.
2.
3.
At a glance, here are this years key findings on the state of open data around the world:
Despite this, theres been little to no progress on the number of truly open datasets
around the world.
Even with the rapid spread of open government
data plans and policies, too much critical data
remains locked in government filing cabinets. For
example, only two countries publish acceptable
detailed open public spending data. Of all 1,380
government datasets surveyed, almost 90% are still
closed roughly the same as in the last edition
of the Open Data Barometer (when only 130 out
of 1,290 datasets, or 10%, were open). What is
more, much of the approximately 10% of data that
meets the open definition is poor quality, making it
difficult for potential data users to access, process,
and work with it effectively.
Data availability
Open Data
10.14%
10.08%
6.58%
76.30%
78.84%
76.19%
25
50
75
100
% of data
3rd edition
2nd edition
1st edition
www.opendatabarometer.org
Position
Country
Score
Income
HDI Rank
UK
100
High Income
Very High
USA
81.89
High Income
Very High
France
81.65
High Income
Very High
Canada
80.35
High Income
Very High
Denmark
76.62
High Income
Very High
New Zealand
76.35
High Income
Very High
Netherlands
75.13
High Income
Very High
Korea
71.19
High Income
Very High
Sweden
69.26
High Income
Very High
10
Australia
67.99
High Income
Very High
OECD
G20
Table 1: Economic and development classifications of the top ten countries in this years Open Data Barometer.
www.opendatabarometer.org
Country
Traditional leaders
New challengers
Global rank
Regional rank
Rank change
UK
no change
USA
no change
France
+1
Canada
+3
South Korea
+9
Mexico
16
+8
Uruguay
19
+6
Philippines
36
+17
Table 2: New generation of open data adopters challenging the usual global and regional ranking leaders.
www.opendatabarometer.org
2
Readiness
Readiness
5.
Government action at the national and subnational level: Is the groundwork being laid
for the benefits of open data to be used at all
levels of government?
6.
7.
Business and entrepreneurship: Are businesses and entrepreneurs able to take advantage
of the economic opportunity offered by open
data?
4.
Number of countries
24
Number of countries
12
16
12
20
10
6
0
Score (0-10)
10
www.opendatabarometer.org
Score (0-10)
10
ODB Edition
17
13
43
30
2nd edition
16
37
29
1st edition
11
0
51
34
3rd edition
15
30
45
60
Number of countries
Countries with
OGD initiative
Countries with
strong OGD initiative
Countries with
strong subnational initiatives
Figure 3: Evolution of Open Government data initiatives at national and subnational level.
www.opendatabarometer.org
Readiness
Government Action
ODB Edition
4.37
2.65
3rd edition
5.50
4.09
2.49
2nd edition
5.40
4.47
2.31
1st edition
0.00
5.80
1.50
3.00
4.50
6.00
Scores (0-10)
OGD initiatives
Subnational initiatives
Online services
Figure 4: Evolution of the average scores for the Government Action indicators.
Open data has not yet become priority for governments at the subnational level. The local and regional initiatives that do exist are primarily concentrated in capital cities in Europe and North America.
This is unfortunate, as local data is an area with
huge potential. Web Foundation research has shown
14
that local government data can have tangible impacts on peoples everyday lives from financing
community schools in the Philippines to verifying
whether public funds have been properly spent
to build public sanitation facilities and can
contribute to achieving the inclusive, resilient, and
sustainable cities called for in SDG 11.
75
50
25
2.5
7.5
10
Figure 5: Correlation between the score of the civil society engagement indicator and final impact.
www.opendatabarometer.org
15
-2.33%
2nd to 3rd edition
ODB Edition
-4.77%
0.78%
1st to 2nd edition
0.13%
Data Protection
Right to Information
www.opendatabarometer.org
Readiness
16
In terms of training, governments remain very focused on general data related issues, such as statistics, data science, geographic information systems
(GIS), visualisation and big data. Academic training on these more general data topics is increasing
at universities in particular. Access to high quality
specialist training for individuals or businesses who
want to increase their technical skills or develop data-driven businesses is on the rise, thanks to the efforts of groups like the Open Data Institute, its global
network and training programs, or Open Knowledge
with their School of Data network, but still relatively
limited. It is difficult to find countries where a full
range of advanced and specialised training on data
analytics and open data issues is available, and finding courses on more specific themes with a sectoral
approach - such as natural resource transparency,
health data management, or improved instruction
through open education data - is equally challenging.
Only one in five countries studied have an advanced
and sustainable programme of support for innovation
that is designed to take advantage of open data for
www.opendatabarometer.org
3
Implementation
Implementation
1.
2.
3.
4.
But there are many critical areas where open datasets are unlikely to be found, for example:
33.70
35.54
3rd edition
25.60
ODB Edition
18
Innovation
43.53
Accountability
34.98
34.94
2nd edition
46.51
27.32
33.26
34.50
1st edition
27.29
0.00
15.00
30.00
Social policy
40.96
45.00
60.00
Figure 8: Evolution of the average scores for each of the datasets groups in the survey.
www.opendatabarometer.org
18%
15%
open
97%
Budget
% data type
available
as fully
Open Data
13%
open
% data
type
available
online
open
99%
% data type
available
as fully
Open Data
National statistics
% data
type
available
online
65%
% data type
available
as fully
Open Data
Public Transport
% data
type
available
online
19
13%
13%
open
88%
Health
% data type
available
as fully
Open Data
12%
open
% data
type
available
online
open
71%
Environment
% data type
available
as fully
Open Data
% data
type
available
online
72%
Maps
% data type
available
as fully
Open Data
% data
type
available
online
www.opendatabarometer.org
Implementation
12%
12%
open
97%
% data type
available
as fully
Open Data
International trade
12%
open
% data
type
available
online
open
80%
% data type
available
as fully
Open Data
Crime
% data
type
available
online
88%
% data type
available
as fully
Open Data
Elections
% data
type
available
online
5, 16
20
11%
8%
open
87%
Education
% data type
available
as fully
Open Data
www.opendatabarometer.org
5%
open
% data
type
available
online
open
82%
Contracting
% data type
available
as fully
Open Data
% data
type
available
online
46%
Land ownership
% data type
available
as fully
Open Data
% data
type
available
online
4%
2%
open
1%
open
open
98%
Legislation
% data type
available
as fully
Open Data
4%
% data
type
available
online
Spending
% data type
available
as fully
Open Data
% data
type
available
online
72%
Companies
% data type
available
as fully
Open Data
% data
type
available
online
Machine
readable
Bulk
Free
Open license
Updated
Sustainable
Discoverable
Linked data
Maps
67%
36%
64%
23%
55%
65%
68%
3%
Land
36%
14%
52%
19%
64%
71%
64%
5%
Statistics
69%
42%
93%
25%
82%
77%
96%
5%
Budgets
47%
33%
99%
20%
96%
89%
87%
2%
Spending
100%
100%
100%
50%
100%
100%
100%
0%
Companies
29%
14%
61%
8%
64%
70%
67%
2%
Legislation
18%
8%
93%
16%
81%
86%
79%
3%
Transport
43%
28%
95%
28%
80%
73%
82%
2%
Trade
70%
35%
99%
20%
75%
81%
80%
1%
Health
65%
27%
95%
31%
47%
51%
65%
1%
Education
63%
34%
96%
23%
59%
64%
68%
0%
Crime
59%
26%
97%
24%
69%
68%
65%
1%
Environment
75%
34%
98%
32%
60%
69%
71%
2%
Elections
54%
32%
99%
21%
94%
78%
80%
1%
Contracts
28%
21%
95%
19%
81%
72%
61%
0%
Average
55%
32%
89%
24%
74%
74%
75%
2%
Dataset
www.opendatabarometer.org
Implementation
22
Properly formatted: Only about half of the government data studied is available in a machine-readable format. And of that machine-readable data,
only half is available for download in bulk. This
makes data re-use complicated and in some cases
impossible for information intermediaries like researchers, academics, civil society and the media.
This is particularly problematic in areas where machine readable data is rarely available (e.g. legislation, companies and contracts) or where the historic
volume of data is very high but bulk downloads are
not available (e.g. maps, contracts, land, census,
companies or legislation).
The most popular machine readable formats (in
order of popularity) continue to be xls(x), csv/tsv,
xml, json and raw dbf/mdb database dumps. There
are also still a significant number of datasets that
are published in other non-reusable formats such as
pdf, plain html, ods or plain txt and plain jpeg/png
images.
More elaborated APIs that facilitate access to data
are still very rare among government data. A number of standard formats are also frequently used in
some specific cases, such as gml/kml/wms for Maps
or pc-axis/sdmx/spss for census and statistics in
general or, to a lesser extent, gtfs for transport data.
Up-to-date: 73% of government data studied were
updated to a regular timetable at the time of the
study, although some of these timetables are quite
long (e.g. every five years). However, there is a large
discrepancy between the most up-to-date data
(budgets - 95% and elections - 94% up-to-date)
www.opendatabarometer.org
and those which are the most outdated (health 47% and maps - 55% up-to-date). The absence of
up-to-date data on topics like health and mapping
could cost lives in the event of an epidemic or natural disaster when this information is particularly
critical.
The publication of data series tends to be irregular
and managed inconsistently and in most cases it is
very difficult to determine how and when any given
data will be available or updated in the future given
the total lack of information to this respect.
Easy to find: When available online, government
data tends to be easy to find at the individual dataset level (75% of all data studied), but complete
data on a topic is often difficult to obtain without
spending a significant amount of time searching, as
different related and complementary datasets tend
to be split among several official sources and/or
governmental agencies.
Sustainable: For one in four of the government data
we studied, there is no guarantee of its future availability on a regular basis. In a few countries there
is at least a general open by default provisions, but
not a timetable or process for regular updates. This
makes the future use of government data, open or
otherwise, very uncertain and subject to political
changes.
Linked: Linked data remains niche and scarce
with only 21 datasets from a total of 1,380 in the
survey (1.5%) being officially available as linked
data. Half of these cases are concentrated in two of
the leading countries in our ranking: USA and UK.
We can find also a number of other extra-official
examples usually driven by academic institutions,
occasionally with the collaboration of governments.
These are mostly reduced to pilot projects that very
rarely replace or supplement the original government data source after the pilot phase. This lack
of connectivity between different related datasets
limits the potential benefits of opening government
data. In practice, this makes it more difficult to
discover the existing relationships between different
datasets.
4
Impact
Impact
2.
3.
3rd edition
ODB Edition
24
1.
9
2nd edition
10
1st edition
10
10
Economy
www.opendatabarometer.org
Impact Evolution
Eciency
Acconuntability
Environment
Inclusion
Economy
Enterpreunership
-6.00%
-3.00%
0.00%
3.00%
6.00%
IMPACT EXAMPLES
As a proxy approach to impact measurement, the
Open Data Barometer team identifies case studies
in the media or academic literature from the last
Health
DATA Uruguay and the Health Ministry in Uruguay launched A tu
servicio, an application allowing citizens to compare different health
providers, helping the Ministry to increase efficiency and effectiveness
and respond to citizen feedback as part of their mission to improve
health centres. This platform not only enabled better informed decisions to be made by citizens, but also revealed some quality issues in
the data provided by the health suppliers.
www.opendatabarometer.org
25
Impact
www.opendatabarometer.org
www.opendatabarometer.org
27
5
Rankings
Rankings
Regional Distribution
10
Total
Readiness
7.5
Implementation
Impact
2.5
0
Global
Sub-Saharan
Africa
Middle East
& North
Africa
East Asia
& Pacic
Europe &
Central Asia
North
America
30
TOP TEN
Countries at the top of the ranking are characterised by strong readiness. Implementation is also
strong - 46% of all open datasets we found are in
Position
Country
Score
Readiness
Implementation
Impact
UK
100
100
100
100
USA
81.89
97
76
76
France
81.65
97
76
74
Canada
80.35
89
84
67
Denmark
76.62
77
77
78
New Zealand
76.35
87
62
87
Netherlands
75.13
90
69
70
Korea
71.19
95
64
58
Sweden
69.26
88
60
64
10
Australia
67.99
84
77
39
78.04
90.04
74.50
71.30
Average top 10
Table 5: Top ten countries in the Open Data Barometer 3rd edition ranking.
www.opendatabarometer.org
BOTTOM TEN
Countries at the bottom of the table are characterised by very weak general readiness, few or no
open datasets available and a lack of demonstrable
impact. As it can be seen in the table, sub-Saharan
Position
Country
Score
Readiness
Implementation
Impact
78
Cameroon
6.57
12
78
Botswana
6.51
18
85
Pakistan
6.22
19
86
Sierra Leone
5.44
19
86
Zambia
4.91
16
88
Mali
3.97
13
88
Myanmar
3.57
11
90
Zimbabwe
3.38
11
91
Yemen
1.43
92
Haiti
4.20
11.50
4.20
0.30
Average
Table 6: Bottom ten countries in the Open Data Barometer 3rd edition ranking.
31
FULL RANKINGS
The table below presents the global rankings of the
Open Data Barometer, including the overall Barometer score, as well as the three main subindexes.
Scaled country scores are rounded to the nearest
whole number before ranks are assigned, meaning a
number of countries receive tied rankings.
Position
Rank
Change
Country
Score
Readiness
Implementation
Impact
UK
100
100
100
100
USA
81.89
97
76
76
France
81.65
97
76
74
Canada
80.35
89
84
67
Denmark
76.62
77
77
78
www.opendatabarometer.org
Rankings
32
Position
Rank
Change
Country
Score
Readiness
Implementation
Impact
-2
New Zealand
76.35
87
62
87
-1
Netherlands
75.13
90
69
70
Korea
71.19
95
64
58
-6
Sweden
69.26
88
60
64
10
Australia
67.99
84
77
39
11
Finland
65.45
90
65
42
11
-1
Germany
64.79
77
71
45
13
Spain
64.35
78
57
63
13
Austria
64.18
81
49
70
13
Japan
63.50
77
53
65
16
Mexico
61.76
69
57
63
17
Brazil
61.16
60
80
36
17
-10
Norway
60.60
80
58
46
19
Uruguay
58.12
68
65
39
20
Switzerland
54.64
74
58
31
21
Italy
53.78
67
52
45
22
Iceland
52.73
64
62
29
22
Belgium
52.62
80
48
33
24
Singapore
51.45
72
51
32
24
-11
Estonia
50.63
75
52
24
26
-9
Czech Republic
49.15
59
43
50
27
Ireland
46.53
81
52
28
12
Colombia
45.39
64
47
26
29
-9
Israel
43.71
60
37
39
www.opendatabarometer.org
Position
Rank
Change
30
-15
31
Country
Score
Readiness
Implementation
Impact
Chile
42.97
64
51
12
-2
Portugal
41.38
59
45
20
32
Poland
39.95
57
42
21
33
-2
Greece
38.48
60
38
18
33
New
38.43
53
44
18
33
New
Macedonia
38.13
52
42
20
36
New
Slovak Republic
37.16
54
33
28
36
17
Philippines
36.94
55
32
28
38
India
33.98
48
39
14
39
Tunisia
33.37
46
34
21
40
-4
Indonesia
31.81
46
36
14
41
-15
Russian Federation
31.49
52
31
13
42
-4
Ecuador
30.29
39
42
42
Kenya
29.87
45
27
21
44
-11
Peru
28.93
43
41
44
-3
Costa Rica
28.52
43
38
46
Rwanda
27.55
35
36
11
47
-6
Turkey
27.06
37
36
47
UAE
27.00
47
29
47
-6
South Africa
26.77
41
20
24
50
-17
Hungary
25.54
35
34
51
-10
Malaysia
24.60
46
17
16
52
-16
Argentina
23.78
42
21
11
53
Mauritius
22.33
38
29
www.opendatabarometer.org
33
Rankings
34
Position
Rank
Change
53
-4
55
Score
Readiness
Implementation
Impact
Jamaica
21.65
36
14
20
-9
China
21.16
45
15
56
-7
Kazakhstan
20.09
29
28
57
Vietnam
18.30
21
23
12
57
Bahrain
18.14
36
20
57
Saudi Arabia
17.72
39
17
60
New
Georgia
16.79
38
15
60
Qatar
16.53
42
12
62
-7
Morocco
16.17
36
13
62
-7
Ukraine
16.07
28
17
62
New
Paraguay
15.99
30
16
62
-5
Thailand
15.99
30
19
66
New
Saint Lucia
14.65
27
14
67
Nigeria
14.13
29
13
68
-7
Nepal
13.09
22
12
69
-1
Tanzania
10.77
21
13
70
Senegal
10.33
22
12
70
-9
Jordan
10.32
27
70
-24
Ghana
10.19
30
70
Burkina Faso
10.12
26
70
-6
Uganda
9.92
24
75
-11
Egypt
8.74
16
11
76
-8
Benin
8.47
14
13
76
-17
Mozambique
8.14
18
www.opendatabarometer.org
Country
Position
Rank
Change
78
-10
78
-1
78
Country
Score
Readiness
Implementation
Impact
Malawi
7.39
12
10
Namibia
7.35
23
-10
Bangladesh
7.05
17
78
-10
Venezuela
6.79
12
10
78
Ethiopia
6.63
20
78
Cameroon
6.57
12
78
Botswana
6.51
18
85
-18
Pakistan
6.23
19
86
-8
Sierra Leone
5.45
19
86
-8
Zambia
4.91
16
88
-4
Mali
3.98
13
88
-2
Myanmar
3.56
11
90
-14
Zimbabwe
3.38
11
91
-9
Yemen
1.43
92
-7
Haiti
Table 7: Complete ranking for the Open Data Barometer 3rd edition.
www.opendatabarometer.org
35
6
Conclusions
and Recommendations
www.opendatabarometer.org
7
Methodology
Methodology
1.
A peer reviewed expert survey carried out between May and September 2015 with a range
of questions about open data contexts, policy,
implementation and impacts and a detailed
dataset survey completed for 15 kinds of data
in each country, which touched on issues of
data availability, format, license, timeliness
and discoverability.
2.
3.
Secondary data selected to complement our expert survey data. This is used in the readiness
section of the Barometer, and is taken from the
World Economic Forum, World Bank, United
Nations e-Government Survey and Freedom
House.
1.
2.
3.
A more detailed and incremental scoring guidance with comprehensive criteria and scoring
thresholds to guide the researcher and improve
consistency of the results.
www.opendatabarometer.org
8
List of tables and gures
www.opendatabarometer.org
Table 1: Human development and economic classifications of the top ten countries in this years Open
Data Barometer (p.8).
Table 2: New generation of open data adopters challenging the usual global and regional ranking leaders
(p. 9).
Table 3: Summary of data availability, openness and
quality. (p. 19)
Table 4: Summary of data quality checklist results (p.
21).
Table 5: Top ten countries in the Open Data Barometer 3rd edition ranking (p. 30).
Table 6: Bottom ten countries in the Open Data Barometer 3rd edition ranking (p. 31).
Table 7: Complete ranking for the Open Data Barometer 3rd edition (p. 31).
9
Acknowledgements
Acknowledgements
www.opendatabarometer.org
Joseph De Guia, Elisabeth Hggquist, Pll Hilmarsson, Julien Hivon, Johann Hchtl, Thar Htet,
Teg-wende Idriss Tinto, Hilary Johnson, Kshitiz
Khanal, Niklas Kossow, Hyeon-suk Lyu, Seember
Nyager, Mary Loitsker, Julio Lopez Pena, Arthur
Glenn Maail, Leonard Mack, Michelle McLeod,
Oscar Francisco Mekler Granillo, Solomon Mekonnen Tekle, Dessalegn Mequanint, Claude Migisha
Kalisa, Linnea Cecilia Mills, Zoran Mitrovic, Alessia
Caterina Neuroni, Iris Bertila Palma Recinos, Juan
Pane, Theodoros Papadopoulos, Iria Puyosa, Adhitya Randy, Igbal Safarov, Rayna Stamboliyska, Iryna
Susha, Thimo Thoeye, Mahadia Tunga, Rose Camille Vincent, Tomoaki Watanabe, Ramda Yanurzha,
Sainan Yu and Soenke Ziesche.
Governments participating in the self-assessment:
Austria, Bangladesh, Belgium, Brazil, Canada, Colombia, Czech Republic, Ecuador, Estonia, Ethiopia,
Finland, France, Georgia, Ghana, Greece, India, Ireland, Italy, Japan, Kazakhstan, Korea, Macedonia,
Malawi, Malaysia, Mexico, Morocco, Netherlands,
New Zealand, Norway, Poland, Portugal, Saint
Lucia, Saudi Arabia, Singapore, Spain, Sweden,
Switzerland, Tanzania, Thailand, Tunisia, United
Kingdom, United States of America and Uruguay.
QA team: Jose M. Alonso, Michael Canares, Frederico Cavazzini, Hania Farhan, Jan Gondol, Felipe
Gonzlez, Carlos Iglesias, Andreas Pawelke and
Hatem Ben Yacoub.
Note: Some other participants, including researchers, reviewers and governments, have asked to
remain anonymous.
Data sources: We are thankful to the following organisations whose data we draw upon in the secondary data portion of the Barometer:
1.
2.
3.
Freedom House
4.
United Nations
Funding: The 3rd edition of the Barometer was supported by the Open Data for Development (OD4D)
programme, a partnership funded by Canadas
International Development Research Centre (IDRC),
the World Bank, United Kingdoms Department
for International Development (DFID), and Global
Affairs Canada (GAC). This work was carried out
with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada.
10
About the
Open Data Barometer
1.
2.
3.
46
1.
www.opendatabarometer.org
2.
3.
Being a member of the Open Data for Development - OD4D - Network to scale effective and
viable open data solutions for economic and
social development.
4.
5.
6.
7.
OD4D supports a global network of leading organizations that are creating locally-driven and sustainable open data ecosystems in in Latin America,
the Caribbean, Africa, and Asia and East Europe.
This network builds knowledge and provides
support to governments and policy-makers in key
issues such as policies, standards, innovation, and
skills development.
47
www.opendatabarometer.org
The OD4D program is managed by Canadas International Development Research Centre (IDRC),
and it is a donor partnership with the World Bank,
United Kingdoms Department for International Development (DFID) and Global Affairs Canada (GAC).
OD4D supports a global network of leading organizations that are creating locally-driven and sustainable open data ecosystems in in Latin America,
the Caribbean, Africa, and Asia and East Europe.
This network builds knowledge and provides
support to governments and policy-makers in key
issues such as policies, standards, innovation, and
skills development.