SlideShare a Scribd company logo
Measuring and Managing Research Outcomes




National Research Policy Forum
Rome, 14th November 2012
Dr Michiel Kolman, Sr. VP Global Academic Relations, Elsevier
                                                                1
Research is pivotal to economic growth and
addressing societal challenges

“ Science is not a luxury which is the preserve of developed countries...
  Technology and innovation are key to achieving long-term economic and
  social development

 Science and innovation are recognised the world over as crucial to economic
 competitiveness.”
                                        The Royal Society: Knowledge, Networks and Nations, 2011




                                    2
The world of research is large and growing
                          Global R&D spending: $1.2 trillion in 2010

 Spending on R&D – OECD countries*
 Indexed values; 100 = Spend in 1981

    350

    300
                                     Annual growth: +4% (real)
    250

    200

    150

    100

      50

       0
        1980            1985       1990       1995       2000          2005   2010

* $PPP, 2000 constant currencies
Source: OECD, Battelle

                                               3
R&D spending as % of GDP has been relatively stable in
   developed markets, and is increasing in developing ones
                                                           GERD as % of GDP – Developed Markets

                                                           3.0
                                                           2.5
                                                           2.0
 Gross Expenditure on R&D (GERD)
 as % of GDP - Total                                       1.5
                                                           1.0
 3.0
                                                           0.5
 2.5                                                       0.0
 2.0                                                          2000   2002   2004   2006   2008   2010

 1.5                                                       GERD as % of GDP – Developing Markets
 1.0                                                       3.0

 0.5                                                       2.5
                                                           2.0
 0.0
    2000     2002     2004     2006     2008    2010       1.5
                                                           1.0
                                                           0.5
                                                           0.0
Source: OECD                                                  2000   2002   2004   2006   2008   2010
Developed markets include US, Japan, and EU27
Developing markets include China and S. Korea
                                                       4
Governments trying to protect R&D funding
         € 25,000.00
                                                GERD of Italy 1996 - 2010



                                                                                           CAGR: 2.3%
         € 20,000.00




         € 15,000.00




         € 10,000.00




          € 5,000.00




              € 0.00
                       1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010


Source: OECD Main Science and Technology Indicators, 2011
                                                         5
Growth in R&D spending drives number of
  researchers and research activity
Number of researchers – OECD countries                    Number of research articles published
Indexed values; 100 = Number of researchers in 1981       Indexed values; 100 = Number of articles in 1981

350                                                       350

300                                                       300

250                                                       250

200                                                       200
               Annual growth: +4%                                        Annual growth: +4%
                                                                         Annual growth: +3-4%
150                                                       150

100                                                       100

 50                                                        50

  0                                                         0
   1980 1985 1990 1995 2000 2005 2010                        1980 1985 1990 1995 2000 2005 2010


        Global number of researchers:                            Number of research articles:
        7 million in 2010                                        >1.5 million in 2010


      Source: OECD; ISI; Scopus                       6
Growth in research inputs drives growth in
          research outputs
                  1,000,000



                                                                                                                                                                                                                           United States


                                                                                                                                                                                                           China


                                     100,000                                                                                                                      United Kingdom               Germany
                                                                                                                                                                                                                   Japan
                                                                                                                                                                          Canada            France
 Number of articles published 2008




                                                                                                                                                                       Italy
                                                                                                                                                                  Spain
                                                                                                                                                         Australia                 India
                                                                                                                                                                        Brazil               Korea
                                                                                                                                                Netherlands
                                                                                                                                                                                 Russian Federation
                                                                                                                                                               Switzerland
                                                                                                                                  Poland      Turkey                Sweden
                                                                                                                                                         Belgium
                                                                                                                                        Iran     Denmark Israel
                                                                                                                  Greece                                     Austria
                                      10,000                                                                                      Czech Republic
                                                                                                                          Hong Kong
                                                                                                                                                         Finland
                                                                                                                                                   Norway Mexico
                                                                                                      New Zealand                          Portugal Singapore
                                                                                                                        Argentina              South Africa
                                                                                                                                      Ireland
                                                                                                         Thailand              Hungary
                                                                                                      Egypt             Romania        Ukraine
                                                                                                                       Chile     Malaysia
                                                                                                 Slovakia                              Pakistan
                                                                                                               Slovenia
                                                                               Serbia     Bulgaria        Croatia
                                                                                                           Tunisia
                                                                                  Saudi Arabia       Colombia
                                                                   Algeria
                                                                                           Lithuania            Morocco
                                                                                 Estonia                             Belarus
                                       1,000                                                       Indonesia
                                                          Kuwait
                                                                                               Philippines
                                                        Cyprus               Uruguay            Iceland
                                                                                           Peru
                                                    Armenia                    Sri Lanka
                                                                 Ethiopia




                                        100
                                               10                100                                           1,000                                    10,000                                        100,000                    1,000,000
                                                                                                 Gross Expenditure on R&D, $m 2008 PPP




Source: Elsevier analysis, Scopus                                                                                      7
Four trends continue to increase the value of
research information

                             1. Inter-
                          disciplinarity




           4. Data     Science is becoming   2. Collabor
           intensity       more global         -ation
                        and more complex     & Mobility




                           3. Emerging
                              Markets



                              8
Trend #1: Research is increasingly interdisciplinary

         Italy Research Strengths (2011)


                                           Interdisciplinarity increases
                                           demand to

                                           • Use information broadly across
                                             disciplines
                                             – Eliminate duplication
                                             – Build on existing findings, data,
                                               models

                                           • Identify new cross-disciplinary
                                             areas

                                           • Nurture and leverage institutions’
                                             inter-disciplinary strengths




Source: SciVal Spotlight, Italy map   9
Trend #2: Research is increasingly internationally
        collaborative
      Percentage of internationally co-authored articles
         increased from 26% in 1996 to 36% in 2008

                                                                            “Collaboration enhances the
                                                                            quality of research, improves its
                                                                            efficiency and effectiveness, and
                                                                            is increasingly necessary as the
                                                                            scale of budgets and research
                                                                            challenges grow”
                                                                                               - The Royal Society, 2011



                                                                            International collaboration
                                                                            drives

                                                                            • Demand to find collaborators to
                                                                              leverage knowledge and
                                                                              equipment, and co-ordinate efforts

                                                                            • Need to map collaboration
                                                                              networks
Source: Scopus; The Royal Society – Knowledge, Networks and Nations, 2011
                                                          10
Trend #3: Emerging markets are rapidly growing
        their research activity
            Number of articles per year (‘000)
3,000
                                                                             CAGR
                                                                             ‘00-’10   Drivers
2,500
                                                                     China     20%
                                                                                       • Emerging economies’
2,000                                                                India    11%        consumption of research
                                                                     Brazil   13%
                                                                     S. Korea 12%
                                                                                         information and
                                                                                         dissemination of results
1,500
                                                                     Italy     6%
                                                                     US        4%      • Developed economies’
1,000                                                                                    need to use those results
                                                                     UK        4%
                                                                     Japan     2%
                                                                                         and collaborate
                                                                     Germany   4%
 500
                                                                     France    4%


   0                                                                 ROW       3%
    1996         2000           2005            2010          2015

Source: Scopus; projections based on trend information


                                                         11
Trend #4: Research is increasingly data intensive

                                                                                Very high importance, very high satisfaction


• Drives demand to host,


                                    Ease of access (Easy or Fairly Easy)
  store, curate and link to
  data sets
  – Subject-specific
  – Across disciplines




                                                                                      High importance, low satisfaction




                                                                                            Importance of access

Source: Publisher Research Council – Global Access vs. Importance Study (3,823 researcher respondents)
                                                                           12
STM information companies have a unique vantage point on research
                                    Each year
                                    •3 million articles submitted
                                    •300,000 peer reviewers
                                    •1.5 million articles published
                                    •30 million readers
                                    •2 billion digital article downloads
                                    •30 million article citations




                                                                           13
Contribution #1: Continue to register, review, disseminate,
and preserve research outputs
Contribution #2: Nurture and leverage cross-disciplinary areas
of research




                                                       15
Contribution #3: Facilitate collaboration




                  citation impact
                  Field-weighted




                                    Less than world average

                                    > world but < UK average


                                    Greater than UK average

                                                               16
Contribution #4: Monitor brain circulation




Migratory researcher = permanent or returnee (2 or more years abroad)   Relative Productivity = articles per year relative to all UK researchers
Transitory researcher = less then 2 years abroad                        Relative Seniority = years of publication activity relative to all UK researchers
Contribution #4: Monitor brain circulation




                                    18
Source: Elsevier analysis, Scopus
Global migration patterns




Study country: UK           Study country: USA          Study country: CHN
 To-country   % migration    To-country   % migration    To-country   % migration
       USA    28.7                  UK    10.6                 USA    50.4
       AUS    6.9                  CAN    9.7                  JPN    8.3
       GER    6.1                  CHN    9.6                  CAN    6.0
       CAN    5.4                  GER    8.6                   UK    5.5
       FRA    4.8           South Korea   5.0                  SGP    5.2
       ITA    3.3                  JPN    4.6                  GER    4.2

                                                                                    19
Contribution #5: Facilitate access to experimental data




        Publishers are working to facilitate access to experimental data sets
           Link data sets to journal articles, e.g. Pangaea, CCDC
           Support and drive guidelines with key partners, e.g. Wellcome Trust, NSF, Bill
             and Melinda Gates Foundation


                                                                                                                   20
Source: 3823 researcher respondents, PRC global access vs. Importance study   http://www.publishingresearch.net/
Contribution #6: Broaden range of research metrics and tools




http://www.projectsnowball.info/                               21
Summary



                                               Quality of life


                            Quality research


          Quality information




                                                    22

More Related Content

PPTX
Research context for libraries and publishers
PDF
Exane BNP Paribas 14th European Seminar in Paris. Presentation by CEO Jouko K...
PDF
Development strategies: middle income countries
PDF
India's international trade and investment
PDF
Le monde en 2050 : les perspectives de PwC (2013)
PDF
AEO 2011: Africa and its emerging partners
PDF
EDM STRATEGY SICAV
Research context for libraries and publishers
Exane BNP Paribas 14th European Seminar in Paris. Presentation by CEO Jouko K...
Development strategies: middle income countries
India's international trade and investment
Le monde en 2050 : les perspectives de PwC (2013)
AEO 2011: Africa and its emerging partners
EDM STRATEGY SICAV

What's hot (12)

PDF
Investor Day 2012: Europe, Middle East & Africa
PDF
Pw c size of_emerging_economies-march_2006
PDF
Do Readers Dream of Electronic Books?
PDF
Peter Clinch
PDF
Electrolux Capital Markets Day 2012 - Presentation Alberto Zanata
PDF
EDM STRATEGY SICAV
PPTX
Ian McCafferty, chief economic adviser, CBI
PPTX
2. Impulsando el desarrollo a través de la atracción de IED en los sectores d...
PPTX
Blasi alessandro iea
PDF
Factors to Consider in Project Valuation
PDF
WEG 2Q10 Results Conference Call Presentation
 
PDF
2012 TechTalentBC Labour Study
Investor Day 2012: Europe, Middle East & Africa
Pw c size of_emerging_economies-march_2006
Do Readers Dream of Electronic Books?
Peter Clinch
Electrolux Capital Markets Day 2012 - Presentation Alberto Zanata
EDM STRATEGY SICAV
Ian McCafferty, chief economic adviser, CBI
2. Impulsando el desarrollo a través de la atracción de IED en los sectores d...
Blasi alessandro iea
Factors to Consider in Project Valuation
WEG 2Q10 Results Conference Call Presentation
 
2012 TechTalentBC Labour Study
Ad

Viewers also liked (18)

PPT
May 17 editors ag_mexico city
PDF
Measure for Measure: The role of metrics in assessing research performance - ...
PDF
PPT
How to Execute A Research Paper
PDF
ORCID in the research lifecycle, Elsevier: Scopus, PURE, SciVal (L. Schoombee)
PPT
Elsevier - MedicReS World Congress 2011
PDF
How to measure the impact of Research ?
PPTX
How to publish in Elsevier
PDF
Elsevier Author workshop - CNUDST Tunisia
PDF
Scopus: a changing world of Research
PPTX
Natural sciences Methodology
PPTX
Plant symbiotic relations with soil
PPTX
Qualitative research - Research Methodology - Manu Melwin Joy
PPTX
Quantitative research - Research Methodology - Manu Melwin Joy
PPTX
Research Methodology for Design
PPTX
Research for Medical Students: Luxury or Necessity?
PDF
The value of context
 
PPT
Body defense mechanism and immunity
May 17 editors ag_mexico city
Measure for Measure: The role of metrics in assessing research performance - ...
How to Execute A Research Paper
ORCID in the research lifecycle, Elsevier: Scopus, PURE, SciVal (L. Schoombee)
Elsevier - MedicReS World Congress 2011
How to measure the impact of Research ?
How to publish in Elsevier
Elsevier Author workshop - CNUDST Tunisia
Scopus: a changing world of Research
Natural sciences Methodology
Plant symbiotic relations with soil
Qualitative research - Research Methodology - Manu Melwin Joy
Quantitative research - Research Methodology - Manu Melwin Joy
Research Methodology for Design
Research for Medical Students: Luxury or Necessity?
The value of context
 
Body defense mechanism and immunity
Ad

Similar to Mk presentation rome 14 nov 2012 (20)

PDF
Lecture 5 - Indicators of innovation and technological change: R&D and patents
PDF
Technological universities as source of innovation seeram ramakrishna
PDF
International Perspectives on High Growth Entrepreneurship
PPTX
Dial ppp model v5
PDF
Wf gci nl 2011 2012
PDF
Costa rica competitiveness report
PDF
Apresentação Ciro Vasquez | OIS 2011 | Painel: Cooperação internacional e ino...
PDF
YUM 09/23/08
PDF
YUM 09/23/08
PDF
378 sspin2011 ericnewman
PPTX
Ag research and economic development oecd
PDF
Social Infrastructure and Technology in India
PDF
Promoting economic development by research & innovation in tunisia
PDF
PDF
Economia global
PDF
Innovation china india_sep.07_sean_dougherty
PDF
TATA Telecom Represented at The Mobile VAS SUMMIT 2009 by Virtue Insight
PDF
Nestlé in Greater China winning in the new reality
PDF
Standard Chartered Bank BeyondBRIC
Lecture 5 - Indicators of innovation and technological change: R&D and patents
Technological universities as source of innovation seeram ramakrishna
International Perspectives on High Growth Entrepreneurship
Dial ppp model v5
Wf gci nl 2011 2012
Costa rica competitiveness report
Apresentação Ciro Vasquez | OIS 2011 | Painel: Cooperação internacional e ino...
YUM 09/23/08
YUM 09/23/08
378 sspin2011 ericnewman
Ag research and economic development oecd
Social Infrastructure and Technology in India
Promoting economic development by research & innovation in tunisia
Economia global
Innovation china india_sep.07_sean_dougherty
TATA Telecom Represented at The Mobile VAS SUMMIT 2009 by Virtue Insight
Nestlé in Greater China winning in the new reality
Standard Chartered Bank BeyondBRIC

More from Elsevier Events (7)

PDF
Articolo di 9 colonne
PDF
Reale elsevier
PDF
Cvan bochove basic res and growth, rome
PDF
Cnr elsevier workshop nov 14 2012 bonaccorsi
PDF
I saluti della prof. ssa ugolini sottosegretario di stato
PDF
Elsevier e cnr inaugurano i forum nazionali sulle politiche di ricerca
PDF
Hands out for miur meeting 22 05 12
Articolo di 9 colonne
Reale elsevier
Cvan bochove basic res and growth, rome
Cnr elsevier workshop nov 14 2012 bonaccorsi
I saluti della prof. ssa ugolini sottosegretario di stato
Elsevier e cnr inaugurano i forum nazionali sulle politiche di ricerca
Hands out for miur meeting 22 05 12

Mk presentation rome 14 nov 2012

  • 1. Measuring and Managing Research Outcomes National Research Policy Forum Rome, 14th November 2012 Dr Michiel Kolman, Sr. VP Global Academic Relations, Elsevier 1
  • 2. Research is pivotal to economic growth and addressing societal challenges “ Science is not a luxury which is the preserve of developed countries... Technology and innovation are key to achieving long-term economic and social development Science and innovation are recognised the world over as crucial to economic competitiveness.” The Royal Society: Knowledge, Networks and Nations, 2011 2
  • 3. The world of research is large and growing Global R&D spending: $1.2 trillion in 2010 Spending on R&D – OECD countries* Indexed values; 100 = Spend in 1981 350 300 Annual growth: +4% (real) 250 200 150 100 50 0 1980 1985 1990 1995 2000 2005 2010 * $PPP, 2000 constant currencies Source: OECD, Battelle 3
  • 4. R&D spending as % of GDP has been relatively stable in developed markets, and is increasing in developing ones GERD as % of GDP – Developed Markets 3.0 2.5 2.0 Gross Expenditure on R&D (GERD) as % of GDP - Total 1.5 1.0 3.0 0.5 2.5 0.0 2.0 2000 2002 2004 2006 2008 2010 1.5 GERD as % of GDP – Developing Markets 1.0 3.0 0.5 2.5 2.0 0.0 2000 2002 2004 2006 2008 2010 1.5 1.0 0.5 0.0 Source: OECD 2000 2002 2004 2006 2008 2010 Developed markets include US, Japan, and EU27 Developing markets include China and S. Korea 4
  • 5. Governments trying to protect R&D funding € 25,000.00 GERD of Italy 1996 - 2010 CAGR: 2.3% € 20,000.00 € 15,000.00 € 10,000.00 € 5,000.00 € 0.00 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 Source: OECD Main Science and Technology Indicators, 2011 5
  • 6. Growth in R&D spending drives number of researchers and research activity Number of researchers – OECD countries Number of research articles published Indexed values; 100 = Number of researchers in 1981 Indexed values; 100 = Number of articles in 1981 350 350 300 300 250 250 200 200 Annual growth: +4% Annual growth: +4% Annual growth: +3-4% 150 150 100 100 50 50 0 0 1980 1985 1990 1995 2000 2005 2010 1980 1985 1990 1995 2000 2005 2010 Global number of researchers: Number of research articles: 7 million in 2010 >1.5 million in 2010 Source: OECD; ISI; Scopus 6
  • 7. Growth in research inputs drives growth in research outputs 1,000,000 United States China 100,000 United Kingdom Germany Japan Canada France Number of articles published 2008 Italy Spain Australia India Brazil Korea Netherlands Russian Federation Switzerland Poland Turkey Sweden Belgium Iran Denmark Israel Greece Austria 10,000 Czech Republic Hong Kong Finland Norway Mexico New Zealand Portugal Singapore Argentina South Africa Ireland Thailand Hungary Egypt Romania Ukraine Chile Malaysia Slovakia Pakistan Slovenia Serbia Bulgaria Croatia Tunisia Saudi Arabia Colombia Algeria Lithuania Morocco Estonia Belarus 1,000 Indonesia Kuwait Philippines Cyprus Uruguay Iceland Peru Armenia Sri Lanka Ethiopia 100 10 100 1,000 10,000 100,000 1,000,000 Gross Expenditure on R&D, $m 2008 PPP Source: Elsevier analysis, Scopus 7
  • 8. Four trends continue to increase the value of research information 1. Inter- disciplinarity 4. Data Science is becoming 2. Collabor intensity more global -ation and more complex & Mobility 3. Emerging Markets 8
  • 9. Trend #1: Research is increasingly interdisciplinary Italy Research Strengths (2011) Interdisciplinarity increases demand to • Use information broadly across disciplines – Eliminate duplication – Build on existing findings, data, models • Identify new cross-disciplinary areas • Nurture and leverage institutions’ inter-disciplinary strengths Source: SciVal Spotlight, Italy map 9
  • 10. Trend #2: Research is increasingly internationally collaborative Percentage of internationally co-authored articles increased from 26% in 1996 to 36% in 2008 “Collaboration enhances the quality of research, improves its efficiency and effectiveness, and is increasingly necessary as the scale of budgets and research challenges grow” - The Royal Society, 2011 International collaboration drives • Demand to find collaborators to leverage knowledge and equipment, and co-ordinate efforts • Need to map collaboration networks Source: Scopus; The Royal Society – Knowledge, Networks and Nations, 2011 10
  • 11. Trend #3: Emerging markets are rapidly growing their research activity Number of articles per year (‘000) 3,000 CAGR ‘00-’10 Drivers 2,500 China 20% • Emerging economies’ 2,000 India 11% consumption of research Brazil 13% S. Korea 12% information and dissemination of results 1,500 Italy 6% US 4% • Developed economies’ 1,000 need to use those results UK 4% Japan 2% and collaborate Germany 4% 500 France 4% 0 ROW 3% 1996 2000 2005 2010 2015 Source: Scopus; projections based on trend information 11
  • 12. Trend #4: Research is increasingly data intensive Very high importance, very high satisfaction • Drives demand to host, Ease of access (Easy or Fairly Easy) store, curate and link to data sets – Subject-specific – Across disciplines High importance, low satisfaction Importance of access Source: Publisher Research Council – Global Access vs. Importance Study (3,823 researcher respondents) 12
  • 13. STM information companies have a unique vantage point on research Each year •3 million articles submitted •300,000 peer reviewers •1.5 million articles published •30 million readers •2 billion digital article downloads •30 million article citations 13
  • 14. Contribution #1: Continue to register, review, disseminate, and preserve research outputs
  • 15. Contribution #2: Nurture and leverage cross-disciplinary areas of research 15
  • 16. Contribution #3: Facilitate collaboration citation impact Field-weighted Less than world average > world but < UK average Greater than UK average 16
  • 17. Contribution #4: Monitor brain circulation Migratory researcher = permanent or returnee (2 or more years abroad) Relative Productivity = articles per year relative to all UK researchers Transitory researcher = less then 2 years abroad Relative Seniority = years of publication activity relative to all UK researchers
  • 18. Contribution #4: Monitor brain circulation 18 Source: Elsevier analysis, Scopus
  • 19. Global migration patterns Study country: UK Study country: USA Study country: CHN To-country % migration To-country % migration To-country % migration USA 28.7 UK 10.6 USA 50.4 AUS 6.9 CAN 9.7 JPN 8.3 GER 6.1 CHN 9.6 CAN 6.0 CAN 5.4 GER 8.6 UK 5.5 FRA 4.8 South Korea 5.0 SGP 5.2 ITA 3.3 JPN 4.6 GER 4.2 19
  • 20. Contribution #5: Facilitate access to experimental data Publishers are working to facilitate access to experimental data sets  Link data sets to journal articles, e.g. Pangaea, CCDC  Support and drive guidelines with key partners, e.g. Wellcome Trust, NSF, Bill and Melinda Gates Foundation 20 Source: 3823 researcher respondents, PRC global access vs. Importance study http://www.publishingresearch.net/
  • 21. Contribution #6: Broaden range of research metrics and tools http://www.projectsnowball.info/ 21
  • 22. Summary Quality of life Quality research Quality information 22