tmp6DE5 TMP
tmp6DE5 TMP
ABSTRACT
The Thomson Reuters marketing tool, the Impact Factor (IF), is currently the only global quantitative system of assessing the impact
(indirectly the quality) of a journal (therein the manuscript and the authors associated with it), solely as a function of referencing and/or
indexing frequency. Despite its simplistic brilliance, as for any other monopolistic system in any sector of society, the IF is now beginning
to have profound (negative) effects on how science is being selected, funds are being allocated and this in turn is driving science in an
unnatural way, not driven any longer by core scientific values and principles, but rather by the inherent (implicit and explicit) benefits
underlying the IF score of a scientific journal. This survey aspired to ascertain the notions that exist among plant scientists (n = 162)
regarding the IF and how this system of quality assessment in the bio-medical sciences affects their way of conducting science and the
niche in which they work and study. Twelve questions were posed and respondents could respond online with the possibility of also freely
adding any additional comments. Except for one question, all other questions stowed an extremely polarized response, with 10/11
questions showing a YES: NO response ratio of 7:3. Almost all respondents (93%) had published in an IF journal, and 72% supported
the IF. Of all respondents, 60% were made to (= forced by implicit or explicit rules and regulations) publish in an IF journal. Just over half
of all respondents (51%) are compensated for publishing in an IF journal while a shocking amount (70%) are reprimanded, or suffer some
form of negative consequence (by their Department, Institute, Funding Agency or Government) should they not publish in an IF journal.
73% of respondents felt that the IF should not be held in the hands of a media company or publisher (i.e., Thomson Reuters) and 91% felt
that they had the right to know how an IF is assigned and calculated and to freely request the IF of any publication from any year, i.e. the
IF history of a journal. Even though 85% felt that an alternative system to the IF was required, only 24% knew of such a system, although
most of these were local and not global, or had their inherent problems and limitations. Closely related to the IF, most (70%) respondents
felt that print versions of journals were still important, 94% felt that publication of a manuscript should be free, while 80% felt that papers
should be Open Access. Without a doubt, the IF is here to stay. However, the great displeasure, exhibited by 91% of respondents who felt
that an alternative system of quantitative measurement is required, points towards a desperate need for the (plant) scientific community to
act towards countering the monopolistic activities of a single company, Thomson Reuters, by providing one or more competitive,
alternative systems of assessing and quantifying the quality of science.
_____________________________________________________________________________________________________________
Keywords: Impact Factor, IF, monopoly, quality of research, publishing values
INTRODUCTION
The Impact Factor (IF) is the brainchild of Dr. Eugene
Garfield, who devised a system of quantifying the number
of times a manuscript is referenced in the literature. As
indicated
by
Thomson
Reuters
(http://
thomsonreuters.com/products_services/science/free/essays/i
mpact_factor/), the IF is calculated as an extremely simple
equation (the dates have been adjusted to give a more
realistic and modern representation):
A = total cites in 2012
B = 2012 cites to articles published in 2010-2011 (this is a
subset of A)
C = number of articles published in 2010-2011
D = B/C = 2012 impact factor
Very briefly, The Institute for Scientific Information
(ISI) was the former entity of Thomson Reuters. According to Thomson Reuters, using journal statistical
data in-house to compile the Science Citation Index (SCI)
for many years, Thomson Reuters began to publish Journal
Citation Reports (JCR) in 1975 as part of the SCI and the
Social Sciences Citation Index (SSCI). The remaining
equations used to calculate IFs, cumulative IFs, and the
Received: 1 October, 2011. Accepted: 29 October, 2012.
Research Note
The Asian and Australasian Journal of Plant Science and Biotechnology 7 (Special Issue 1), 84-91 2013 Global Science Books
Q1
Q2
40%
7%
93%
Q3
51%
60%
Q4
49%
Q5
70%
Q6
28%
73%
72%
30%
Q7
27%
Q8
91%
4%
Q10
Q9
15%
76%
85%
24%
Q11
30%
Q12
20%
6%
94%
80%
70%
Fig. 1 Quantitative response by survey respondents (n = 162) to 12 questions, represented graphically as pie-charts. Q = question (e.g., Q1 =
Question 1 in the Appendix). Values are represented as the absolute number of respondents in square brackets e.g. [150] = 150 respondents. The absolute
percentage of respondents responding to each question is also indicated, i.e., 150 respondents = 93%.
end of the survey. At least 1000 leading plant scientists from various fields of plant science were contacted by e-mail, and invited to
participate voluntarily in the survey. All questions had to be
answered and the survey could not be returned unless all questions
were completed (default setting) to ensure that no imbalance result.
We estimated that each survey to take between 10 and 15 min to
complete. Incomplete surveys could not be submitted, thus total
number of respondents = total number of valid survey results.
After a 3-month waiting period (January-March, 2011), survey
results established from 162 respondents from 49 countries (Table
1) were assessed. Names, institutional associations, e-mails and
countries were determined. Age and gender were felt to be unnecessary and irrelevant to our discussion, and thus were not
monitored. All respondents were confirmed to be plant scientists
with at least a PhD and with publishing experience in international
journals, 93% of which had published in IF journals. Final results
were shown in the form of simple, easy to understand pie-charts
and summary table of opinions. All respondents were informed
that the survey results and their opinions would be published and
100% of respondents provided full consent to publish this data, a
pre-requisite for completing the survey.
The Impact Factor: what plant scientists think. Teixeira da Silva and Van
Table 1 Personalized information provided by survey respondents regarding the Impact Factor (IF).
Country
Absolute Relative Ranking Pertinent comments (Question 12, open question)*,**
No.
%
India
29
17.90
1
1. The IF is one of the important parameter to check the quality of work. I strongly feel that the IF
is necessary, including for GSB journals. IF also gives importance to the journals. 2. I firmly
believe that, through the IF, we will be able to asses the quality of work! 3. Publishing in IF
journals is mandatory (in India) to receive grants for research, as well as for self-appraisals and
for promotions in careers. The articles published in non-IF journals are not counted or considered
for promotions or research funding. Also, Indian University regulations require that every PhD
student publish at least two papers prior to submission of their thesis in IF journals. Hence in such
cases, it is mandatory that our research be sent to journals with an IF, although personally, I am
sure that papers published even in several non-IF journals are of very good quality. Recently, our
university provides funding when research publications are published in high IF journals. Hence,
it is but natural that we are asked to publish in IF journals. Moreover, students also build up their
bio-data with such publications for their future. If the scientific community comes out with a
better alternative, it will be highly appreciated. The so-called open access journals charge a huge
publication fee, which is totally out of reach of researchers from poor countries, hence even that
practice is not fair. Publications should be charged, if the research funding allows it, or else, it
should be free of cost. 4. Publications with an IF will be helpful for the career of researchers and
academicians. 5. In India publications in agricultural science are evaluated by a set of IF as a
score out of 10 as specified by NAAS (http://naasindia.org/rating.html). 6. The IF of Journals is
very important for any one who wants to publish his/her research because nowadays, in India,
when a scientist approaches a funding agency or attends an interview for a job, he or she is asked
by the board that how many articles he or she has published in journals with an IF. Journals
without an IF are not considered to be good publications. 7. Of course, the IF helps in the
evaluation of the standards of a journal. However, the review process of some IF journals is
biased. The referee(s) or reviewer(s) sometimes show partial behaviour in publication towards
some known authors / labs / countries. For example, in the Journal of Basic Microbiology
published in Germany I have come across the one of the editors who favours some particular
groups of persons for publication whereas other articles of good quality are rejected. 8. The IF
should be given to all journals and if possible to each paper. The IF must be given by a reputed
expert committee or organization other than the media or printing association (i.e., publisher). It
should be open to know how an IF was assigned and calculated and free to request the IF of any
publication from any year. 9. Publication in IF journals impresses the biodata of a researcher.
However, many government jobs and R&D units select candidates with publication in peer
reviewed, indexed as well as IF journals. 10. Clearly, the IF of papers in journals has become one
the means of gauging the quality of research. 11. Although the IF is good and important, more
emphasis on IF journals tend to provide a researcher a bias to publish in an IF journal. In fact, it
should not. One should be able to publish in a good, standard, peer reviewed journal, even though
it may not carry an IF. An alternative system to the IF should be made available. 12. Science
Citation Indexed journals are recognized by Govt. of India's agencies. It is a pity that all journals
are not provided IF and some narrow segment journals are left out altogether.
Italy
14
8.64
2
1. I support the IF system because in principle allows a standardized assessment of the quality of
published research. My Institute grants more funds to groups that publish a large number of IF
papers. 2. I support the IF because is the parameter most commonly adopted by the scientific
community to qualify a scientific journal. It is also considered by public Universities in Italy to
select (in the context of public competitions) new research personnel to be hired. 3. I think an
optimal way to weigh papers does not exist. It hopefully ranges according to the reader. However,
in this imperfect world, a way to weight journals could be helpful, with all mistakes that it
includes. ISI is a private company that replies to needs of the scientific community. You can
accept their guidelines or reject them according to your and your institutional needs. 4. The Italian
system allocates funding to research according to a score depending on scientific publications. For
instance, Palermo University permits to gain a maximum of 15 points with papers published in
non-IF journals. After 15 points only IF papers can be considered, thus allowing unlimited scores.
5. I support the IF because I think that it is important to differentiate the scientific value of
different journals. 6. I want to clarify my position about IF, that may seem too favourable. I think
that IF does not necessarily reflect the quality of a scientific work, but only the most read
journals: is a bit like evaluating music or movie quality on the basis of copies sold. However, an
evaluation of the scientific work is necessary, but now I am not able of imagine what. 7. In Italy,
the total IF of the publications is essential for participation in competitions for public and private'
institution and for project approval. 8. Although being unfair and questionable, at present the IF is
important in that it is the only means to evaluate the relevance of scientific publications.
USA
12
7.41
3
1. More and more researchers want to publish in journals with an IF. If a journal does not have an
IF or is not listed in PubMed, I may get discouraged to publish. It is very important that FOB
(GSB journal) has an IF. 2. The best alternative system of quantifying the quality of scientific
publications is the well-established peer-reviewer system. Beyond having that firmly in place, the
IF is completely useless all it does is tell you how many times an article has been cited, which
is incredibly self-centered for egotistical scientists or administrators. Who cares how many times
something has been cited? The point is, it is science, and is useful forever! 3. The IF is considered
as a measure of the quality of research and many institutions use this as a tool to evaluate their
scientists performance. Therefore, I have been publishing in Journals with IF like many
researchers. Citation index (CI) is yet another measure of publication quality, I suppose. However,
IF and CI are not without drawbacks. It would be better if the IF and CI could be openly available
on public domains. 4. The IF system so far fairly measures the importance of a published article
and a journal's quality, most of the times.
86
The Asian and Australasian Journal of Plant Science and Biotechnology 7 (Special Issue 1), 84-91 2013 Global Science Books
Table 1 (Cont.)
Country
Ranking
Nigeria
Absolute Relative
No.
%
9
5.56
Japan
4.94
Egypt
4.32
Brazil
3.70
Pakistan
3.09
South Korea
2.47
Australia
2.47
1. I think a high IF journal should not based on a large number of publication but on the quality of
the journal. I believe journals that are free of page charges have the highest impact. Also, partial
access is good for scientists to assess the quality of a journal. 2. I support the IF because it
expresses the popularity of a journal in its field of coverage and in some countries, the IF is the
main yardstick to evaluate a journal's worth. So GSB should work on getting an IF for its journals.
3. It is important that editors and publishers come together to agree on a structure that would
evaluate, assess and score journals in a way that everyone would know the ratings are justified.
Also publishing in journals should be free for researchers to be able to publish their work at no
cost. 4. IF has alot of prejudices!! 5. "Yes" with regards to supporting the IF, since I do not know
an alternative and so widely accepted method to do so, I also disagree with the way on how the IF
is actually elaborated and the real consequences on the quality of scientific production it has. For
example, a typical negative consequence in Nigeria is that publication in local journals, which are
expected to deal with problems of more locally relevant interest, is "punished" because of their
low IF. Unfortunately, at present, I am not in a position of exerting a significant influence on this
topic (nor to developing an alternative option) and, in this sense, I am literally "forced", at least by
now, to publish in IF journals to better guarantee my work position. But it is evident that there is
an increasing number of colleagues worried about the real consequences of this system of
evaluation of scientific quality, and undoubtedly a serious debate and alternative options are
expected to come. 6. Open access increases visibility, reduces fraud and enhances impact. 7. I
support the IF because I feel there should be a way of assessing scientific publications. However
undue importance need not be placed on this IF since in my estimation, there are high quality
journals that do not have an IF. My personal feeling is that the number of organizations/bodies
abstracting a journal could be a fair tool for assessing the journal.
1. Alternative systems: RAE; Journal Ranking. 2. I am working in the field of horticulture. There
are few (or exactly no) journals with high IF. But, even so, horticulture is important as science and
technology for human welfare. I think other criteria are necessary to evaluate science papers in the
fields like horticulture. 3. IF should be needed for sciences because it partly guarantees the quality
of the paper. 4. Counting system of published book copies is essential.
1. The IF is currently essential for academia to present among their scientific research work, at
least two papers that possesses an IF, to the national promotion committee in Egypt, in particular
for their promotion to a higher scientific position i.e., associate Prof. or Prof. at the relevant
department / faculty / university. Non-IF papers will be subjected to a scientific evaluation, once
again, for scoring by the promotion board committee. As an academic, I am rather concerned to
publish my work in an outstanding journal in the field of the work that was presented in the paper,
regardless whether it holds an IF or not. But again, the need of the academia to pursue further
with their academic positions is the main concern, nowadays. I have no information about the
other systems or polices that are implemented in other countries. This survey can assist in
gathering information relevant to these issues at the global level. An international scientific board
should be initiated to coordinate among the different polices (if there are exist) for the benefit of
science / welfare at the global level. In addition to enhance and promote new generations of
researchers / scientists, especially in developing countries like Egypt, and others sharing similar
polices, to disseminate their work, without discrimination. 2. Publishing in IF journals (at least
one paper) is very important to improve our scientific position. 3. In my institute, when I submit
to improve my research position if I have published a paper in a journal with an IF I will get
higher scores and the number of papers I have to submit could be reduced in number. I do not
support the IF because I see many good papers published in journals that do not have an IF. I
think it depends on the paper not the journal; in addition, most of the journals with IFs are very
expensive and take long period of time for reviewing and accepting.
1. I do support the IF as a means of evaluate the quality of a journal chosen for publication. It
serves as other important information for the database where my CV is published. 2. I support the
IF because it is the only objective way to measure the quality of a journal? Until now there is no
other way to compare journals apart from this one!!!
http://fr.wikipedia.org/wiki/Facteur_d%27impact. 3. Q3: Yes. See the criteria for proposals
received by CNPq (Brazil) requesting financial support for research or Research Productivity
Scholarships: http://www.cnpq.br/; http://www.cnpq.br/cas/ca-bf.htm#criterios; Q5: No. The
criteria of calculation are unfair because it does not determine the quality of the publication, and it
takes into account only the last 2 years. This evaluation period is short.
1. I think all publications should be IF journals. 2. Most IF journals are not publishing high
quality papers, sometimes it's like business and your interaction with members of that journal. I
have seen many high quality papers in non-IF journals so IF should not be the sole criterion for
the quality of a publication.
I attended a few job interviews but the selection committee chose a person who had a high total IF
for their publications. So, I feel the IF is necessary for me to get a good job.
1. IF is about scientists talking to peers. Science impact is often more about scientists talking to
policy-makers, technologists, extension. This important outcome of research is not currently
captured by IF. 2. At top universities in Australia publication in journals with a high IF is essential
for career progression. Problem with the IF is the fact that some research areas fit well with it
(e.g. molecular biology) and get a high IF easily but others (e.g. agricultural work) don't simply
because of the turn-around time between planning, conducting and writing up experiments and
therefore citing papers that lead to the hypothesis in the first place.
87
The Impact Factor: what plant scientists think. Teixeira da Silva and Van
Table 1 (Cont.)
Country
Absolute Relative
No.
%
Ranking
Malaysia
2.47
UK
1.85
12
Spain
1.85
12
Belgium
1.85
12
Canada
1.85
12
Slovakia
1.85
12
88
The Asian and Australasian Journal of Plant Science and Biotechnology 7 (Special Issue 1), 84-91 2013 Global Science Books
Table 1 (Cont.)
Country
Absolute Relative
No.
%
Ranking
Cameroon
France
3
3
1.85
1.85
12
12
Iran
1.23
19
Argentina
Hungary
2
2
1.23
1.23
19
19
Croatia
1.23
19
The Netherlands
Turkey
Russia
Vietnam
Uzbekistan
Mauritius
Bangladesh
Lebanon
Germany
New Zealand
Bulgaria
Taiwan
Greece
2
2
2
2
1
1
1
1
1
1
1
1
1
1.23
1.23
1.23
1.23
0.62
0.62
0.62
0.62
0.62
0.62
0.62
0.62
0.62
19
19
19
19
27
27
27
27
27
27
27
27
27
Sweden
0.62
27
Venezuela
0.62
27
Finland
Portugal
1
1
0.62
0.62
27
27
Sri Lanka
0.62
27
Norway
Serbia
1
1
0.62
0.62
27
27
IF is quite important as its the main and crucial point for evaluation in academic position and/or
research. Thus, the IF is a key factor that I am looking for my publications.
I support IF because today it is the only (as I know of) system to get some guidance of the quality
of a scientific journal.
Compensation system: http://www.oncti.gob.ve (National) and
http://www2.ula.ve/cdcht/index.php?option=content&task=view&id=281 (Universidad de Los
Andes). Lack of support for IF: because many efforts are not acknowledged due to a system
imposed for those who promote only IF the way it is.
IF allows some to evaluate the quality of a work. However, the number of citations is also
important as it gives an idea of the impact of the work in the scientific community. These aspects
are considered in the H-index.
I am a university academic. In our system, publications in indexed journals such as Science
Citation Index Expanded, Social Sciences Citation Index and Arts and Humanities Citation
Index (all incidentally belonging to Thomson Reuterss Web of Science***) journals are highly
recognized and additional marks are given when considering promotions to Professor grade. A
publication in an indexed journal will earn two more marks. Moreover, publication in journals
published more than two issues per year has more marks than those of less than two issues per
year. It is clearly written in Commission Circular no. 916, UNIVERSITY GRANTS
COMMISSION, Sri Lanka. Therefore, my first attempt is to publish in an indexed journal.
Me and my colleagues in Serbia are currently paid according to the number of points scored in a
relevant period (4 or 5 years). We get points only for papers published in journals that have an IF.
Papers in journals without an IF are ignored - no points at all (nada). Thus I got no points for my
Brassica review in TPJ, and only few points for reviews on potato - which were counted as book
publications. No hard feelings, I knew in advance that I would get no points and I wrote these
reviews for the love of science. My next door colleague, also Serbian, also had the same kind of
trouble. IF seems to be used in many countries as the most suitable way to evaluate not only
journals but also individual scientific achievements. But this way of comparison can be used only
for people within the same science. Comparing Cytology and Zoology is nonsense because there
are ca. 2.5X difference in the average IF values. Thus the whole botany, plant biology or plant
physiology have very low IF scores in comparison to lets say immunology. That is the catch 22.
89
The Impact Factor: what plant scientists think. Teixeira da Silva and Van
Table 1 (Cont.)
Country
Absolute Relative
No.
%
Ranking
Tunisia
South Africa
Mexico
1
1
1
0.62
0.62
0.62
27
27
27
Colombia
0.62
27
Burundi
1
Democratic
1
Republic of Congo
Burkina Faso
1
0.62
0.62
27
27
0.62
27
Here in Mexico, if the journal has no IF, it is as if the manuscript did not count for anything. I
suggest that Plant Stress make strategies as they did for the journal Plant Signaling and Behavior,
whereby addendas, the first numbers are reaching the quota to publish 4 times per year, although
that system is transitory, and so to achieve an IF. I think that with the great effort made by Plant
Stress, soon it would have an IF, with both invitations to addendas and revisions, and also could
include genes report notes.
The IF is important because the manuscript is visible for many people. In Colombia, in
Colciencias and in my university a paper is highly valued if it is published in an IF journal.
I support the IF, if it can improve the time between abstract submission and publication.
I propose to GSB to open other domains of science in agriculture and environment.
The evaluation of researchers like me requires publications in journals with an IF to obtain a
higher degree. The IF is a necessary criterion that needs to be re-examined. The cost of
publications can also give place to unhealthy speculations within the community scientific,
unfortunately.
* Comments have been used, wherever possible, exactly as written by respondents. Only grammar, spelling, etc. have been corrected to provide clarity to the reader.
** Different numbers indicate specific responses given by different scientists. So, for example, in India, 10 responses were given by 10 different scientists, as indicated by 1.
to 12.
*** Comment inserted by the first author.
ACKNOWLEDGEMENTS
The authors thank the structural and philosophical support of Global Science Books (Japan) (www.globalsciencebooks.info) to conduct and complete this survey.
REFERENCES
Thomson Reuters (2012) Available online:
http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
90
The Asian and Australasian Journal of Plant Science and Biotechnology 7 (Special Issue 1), 84-91 2013 Global Science Books
Appendix
All questions were a simple YES/NO choice.
Question 1
Have you ever published in IF journals?
Sub-question: What percentage of total papers published have been in IF journals?
Question 2
Does your Department, Institute, Funding Agency or Government make you publish in IF journals?
Question 3
Does your Institute have a compensation or bonus system (such as increased research funding, salary, or improved position) to reward scientists who
publish in IF journals?
Question 4
If you do not publish in an IF journal, is there any negative consequence, reprimand or penalty handed out by your Department, Institute, Funding
Agency or Government?
Question 5
Do you support the IF?
Question 6
Do you think that the IF should be in the hands of a publishing or media company?
Question 7
Should it be open to know how an IF was assigned and calculated and free to request the IF of any publication from any year?
Question 8
Do you feel that an alternative system to measuring the quality of science and science publishing is necessary?
Question 9
Are you aware of any other alternative system of quantifying the quality of a journal, science publishing or science?
Question 10
Are print journals and paper reprints important for your publishing curriculum?
Question 11
Should submission and publication of a manuscript be free?
Question 12
Should manuscripts be open access, i.e. free for all to view?
91