Crietaria of Evaluation of Refence Sources
Crietaria of Evaluation of Refence Sources
Structure
4.0 Objectives
4.1 Introduction
4.2 Checklist of Evaluation
4.2.1 Past Record
4.2.2 Authority
4.2.3 Scope
4.2.4 Treatment
4.2.5 Arrangement
4.2.6 Special Features
4.2.7 Format
4.2.8 Book Reviews
4.2.9 Limitations
4.2.10 Conclusion
4.3 Reference Sources
4.3.1 Bibliographies, Abstracting and Indexing Periodicals
4.3.2 Dictionaries
4.3.3 Encyclopaedias
4.3.4 Yearbooks and Almanacs
4.3.5 Directories
4.3.6 Geographical Sources
4.3.7 Biographical Sources
4.4 Other Sources
4.4.1 Textbooks
4.4.2 Handbooks and Manuals
4.4.3 Trade Catalogues
4.4.4 Statistical Information Sources
4.4.5 Sources of Information on Current Affairs
4.4.6 Primary Periodicals
4.4.7 Reviewing Periodicals
4.5 Summary
4.6 Answers to Self Check Exercises
4.7 Keywords
4.8 References and Further Reading
4.0 OBJECTIVES
After reading this Unit, you will be able to:
• explain that evaluation of a book is a systematic intellectual process;
• state that librarian’s evaluation of a book is different from the reviewers
evaluation; and
• describe the process involved in evaluating the reference books.
69
Documentary
Sources 4.1 INTRODUCTION
A library receives various types of documents. Of these documents, some are
in printed form, some in electronic form, some in typed or mimeographed
form, etc. These documents are received through purchase, exchange and gift.
Some libraries which have been declared legal depositories by virtue of an act
passed by the government to receive documents from publishers free of cost.
University libraries usually receive a copy of the thesis free of cost which is
submitted for PhD or such other degree by a student.
The question arises whether all documents being received by the library are to
be evaluated. The answer is – No. Suppose, the manuscripts of all books
written by a famous author are being donated to a library with the consent of
the library authority. In such a case the librarian is to accept all the
manuscripts – even if some of them are incomplete or damaged, for the
simple reason that they are of national importance. Similarly, a college or
university library is to procure the textbooks that have been prescribed for a
particular course by the authority. There is little choice for evaluation. While
working in a library you will find numerous practical cases where there is no
option for evaluation. You are simply to go for the book.
In most cases readers fill in book selection slips for the procurement of books.
Some slips are also prepared by the library staff going through book reviews
or bibliographies. A list is prepared based on these slips and the same is
placed before the selection committee. Order is placed for the books that are
selected by the book selection committee. Thereafter, the books are received
and processed. Only after the book reaches the library, the librarian gets a
chance to see the book. There is practically no chance for evaluation of any of
these books. A librarian does not have the choice or the time to evaluate all
documents being procured for the library.
For evaluating a book you are not to read the whole book like a book
reviewer. You are to follow the checklist and gather relevant data. Based on
the data gathered you are to give your conclusion.
The question that may generally crop up in the mind of a student is that why
do we undertake evaluation of reference books at all? The information
provided in a reference book may be (i) backdated, (ii) inadequate, (iii)
biased, and (iv) wrong. The book may be (i) very highly priced, (ii) poorly
printed or bound, (iii) written in a difficult language, (iv) without an index,
etc. For example, India 2010 – A Reference Annual (New Delhi: Publications
Division, 2010) – a vital and authentic reference source of information on
70 India is without an index. As a result, to ferret out a piece of information from
this book of about 1300 pages proves to be extremely difficult and time Criteria of
consuming. Often, a reference librarian fails to retrieve the information even Evaluation
though the information is available. However, it is still the most authentic and
heavily used source.
4.2.2 Authority
The authoritativeness of a reference book is usually judged on the basis of the
qualifications, reputation, and experience of the author, compiler, and the
editor responsible for the book, and the reputation, experience, and the past
record of the publisher/corporate body. For example, Encyclopaedia
Britannica, Inc. is publishing The Encyclopaedia Britannica since 1768. The
publisher is in existance for about 250 years. During this period it has brought
out 15 official editions of the Britannica and various versions of Britannica
such as Children’s Britannica and Encyclopaedia Britannica India. The 15th
edition of the Britannica brought out under the title The New Encyclopaedia
Britannica in 1974 was in 30 volumes. All encyclopaedias brought out by this
publisher are considered to be top grade encyclopaedias. Whenever a new
encyclopaedia or any other reference book is brought out by this publisher, the
librarians all over the world will naturally consider it a standard publication
and would like to go for it. For the publication of standard reference books,
the well-known publishers employ knowledgeable compilers, experienced
editors and reputed authors. For example, some of the articles of the
Britannica are written by Nobel laureates.
71
Documentary
Sources
4.2.3 Scope
When we talk of scope, we generally take into account the subject,
geographical area, time span, forms of documents, language, target user, etc.
We shall clarify these points with an example. Let us take for example, Indian
National Bibliography (INB) [Kolkata, Central Reference Library, 1958-.].
This bibliography covers publications on all subjects, published from India. It
includes mainly books published during a particular period in major Indian
languages. For example, in INB 2010, books published in 2010 will be
generally covered. Mostly librarians, publishers, distributors, etc. are the
target users of INB. From this you find that the scope of INB relates to books
published from India in Indian languages during a particular period. It does
not cover periodicals other than the first issue, patents, standards, etc. Neither
it covers books published from India in tribal languages. A librarian has to
examine whether the book adheres to its stated scope. There may be cases
where the declared scope may be global, in reality the book may cover a
particular country only and provide some sketchy information about other
parts of the world.
4.2.4 Treatment
Here the term ‘treatment’ implies thoroughness, completeness, reliability,
bias, style, illustrations, etc. Let us take two dictionaries – The Concise Oxford
Dictionary [10th ed. Oxford: OUP, 1999] and Webster’s Third New
International Dictionary of the English Language [2nd ed. Springfield,
Webster’s, 1971] popularly known COD and Webster’s Third International
respectively. COD contains 240,000 words, phrases and definitions, and
Webster’s Third International contains 450,000 entries. The first edition of
Webster’s dictionary published in 1934 included 600,000 entries. From the
data we find that Webster’s Third International is more thorough and
complete compared to COD. The aforesaid two dictionaries include only
words. On the other hand The Random House Dictionary of the English
Language [Unabridged edition New York, Random House, 1966] includes not
only words but also important personages, place names, important biblical and
other characters as well as illustrations. In this way the treatment of reference
books differs and no two reference books will be the same.
72
4.2.5 Arrangement Criteria of
Evaluation
Variety of arrangements are noticed in reference books. Alphabetical
arrangement is quite common. You should know that there are two types of
alphabetical arrangement: letter-by-letter, and word-by-word. Let us take the
following terms — back bench, backbone, backdate, backdoor, back
focus, backpack, and back pass and arrange them in both the ways. On
arranging they will be in the following order:
4.2.7 Format
Format takes into account binding, quality of paper, font, page makeup, and
illustrations. We shall consider all these points one by one.
73
Documentary Binding – There are various types of binding such as paper binding, cloth
Sources
binding, Rexine binding, half leather binding, full leather binding, etc. Books
that are used heavily and for a longer period of time require durable binding,
such as half leather binding or full leather binding. On the other hand books
that are used less often and for a shorter period of time, for example, a railway
time table, usually require less costly binding such as paper binding. Here the
librarian has to decide which binding s/he would prefer for which type of
books. Suppose a dictionary is available in card-board binding as well as in
leather binding. As a dictionary is heavily used for a longer period of time, it
is preferable to go for leather binding.
Font – Fonts of numerous types and sizes are used for printing. Books printed
with such fonts which are soothing to the eye should be preferred. Smaller
font size strains the eyes and therefore, a book printed with smaller fonts
cannot be read for long. Similarly all types of font are not soothing to the
eyes. For example, the font called Courier New of size 9 is quite soothing to
the eye but the same size of Times New Roman is not. For this type of font,
bigger size is preferable.
In every printed page there are left margin, right margin, top margin and
bottom margin. The margin should be sufficiently wide. If the left margin is
too narrow, then some portion of the matter or illustration may not be visible
if the pages are sewn for rebinding. During binding, the top, bottom and right
margins are also cut off to make the edges totally uniform. If the margins are
narrow, some portion of the matter may get cut. Thus, books with wide
margins are preferable compared to books with narrow margins.
4.2.9 Limitations
All reference books have some limitations however comprehensive they may
be. Take for example, Webster’s Third International. This dictionary is one of
the most comprehensive English language dictionaries currently available. Yet
this dictionary does not contain any phrase or idiom. Moreover a dictionary
cannot cover all the words that have come into use very recently.
Encyclopaedias are also not free from limitations. The comprehensive
encyclopaedias that are published in many volumes cannot be updated at short
intervals. The 14th edition of the Encyclopaedia Britannica was brought out in
1929, and the 15th edition in 1974. The gap between the two editions is 45
years.
In this way, examples of limitations can be given for all types of reference
books. This very particular phenomenon obliges libraries to procure more than
one reference book of the same type with the hope that what is missing in one
will be found in the other.
4.2.10 Conclusion
The overall judgment on a reference source is to be reflected in the conclusion
whereby the authorities concerned will be able to take a decision about its
procurement. The conclusion may be written point-wise.
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
75
Documentary 2) Differentiate between letter-by-letter and word-by-word arrangement
Sources
with suitable examples.
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
Past record – For one-off bibliographies, the question of past record does not
arise. It applies to indexing and abstracting periodicals which are published
periodically, at regular intervals, and generally continue for long. For the
purpose of selection, the past record may be examined to see whether there
have been frequent changes in the periodicity, or frequent interruptions in the
publication, etc.
Authority – In this case the publisher and sponsor are to be examined. In the
three examples given above, in all the cases, the publishers/sponsors are
famous. If need be, any of the above mentioned publications can be
purchased/subscribed without any difficulty. The problem will arise if the
bibliography is recent or not. Abstracting and indexing periodicals with
international scope are usually costly publications. If these periodicals are
brought out by a less known publisher or sponsor, adequate care has to taken
before finally selecting the periodical for a library.
Scope – The scope of bibliographies varies. For example, the scope of Indian
Science Abstracts is national, and that of Chemical Abstracts is international.
Many bibliographies cover various types of documents in diverse languages.
76 For example, Chemical Abstracts covers journal articles, patent specifications,
technical reports, conference proceedings, monographs, reviews, dissertations, Criteria of
etc. in about 50 languages of the world. Evaluation
4.3.2 Dictionaries
For the evaluation of dictionaries we shall discuss past record of a dictionary,
authority, scope, arrangement, word treatment, specific features, revision,
format and conclusion.
Past record – Some authors have dubbed ‘past record’ as ‘history’. We have
chosen ‘past record’ because we feel it is more expressive than ‘history’.
Most dictionaries of the world have got a past record. Many dictionaries have
started in a modest way and gradually became more voluminous. In some
cases, utilising the same base sprang up different dictionaries. Quite contrary
to this, Oxford English Dictionary abbreviated as OED [Oxford: Clarendon
Press, 1933. 12 vols. + Suppl.] started in a big way. Originally it appeared as
New English Dictionary on Historical Principles between 1888 and 1933 in
10 volumes. Supplements were issued thereafter to keep it updated. Using the
same base came out Shorter Oxford English Dictionary in two volumes in
1971. Now there are a variety of Oxford dictionaries such as The Concise
Oxford Dictionary (COD), Oxford Dictionary and Thesaurus, Oxford
Advanced Learner’s Dictionary, The Oxford English Mini Dictionary, etc.
Now ‘Oxford Dictionary’ has become a well-known brand name in the world.
Because of the brand name, any new Oxford Dictionary will attract the
attention of the user.
79
Documentary Usage label – In the usage label it is indicated whether the word pertains to
Sources
slang, colloquial or some other usage.
Phrases and idioms – Many dictionaries include phrases and idioms which
occur under the headwords.
Etymology – It provides ‘an account of the origin and the history of the
developments in meaning of a word’ For example, the word ‘zero’ has
originated from the Arabic word ‘sifr’.
Gender – In certain languages like Hindi, the gender of the word is usually
mentioned in dictionaries.
Revision – Every now and then, new words are springing up. Hence, keeping
a printed dictionary updated is a difficult task. Usually new editions of
dictionaries are issued after long intervals. The 1st edition of COD was
published in 1911, and the 10th edition in 1999. On an average, ten years have
elapsed before the advent of a new edition. Dictionaries are in great demand.
To meet the demand a number of reprints are printed before bringing out a
new edition.
Format – The points discussed under Section 4.2.7 are also applicable in the
case of dictionaries.
80
4.3.3 Encyclopaedias Criteria of
Evaluation
Encyclopaedias are generally costly publications. The number of
encyclopaedias are also many. The multi-volume general encyclopaedias in
English are quite a few in the market such as The New Encyclopaedia
Britannica [15th ed. Chicago: Encyclopaedia Britannica, 1974. 30 vols.],
Encyclopedia Americana [New York: Grolier, 1976. 30 vols.], World Book
Encyclopedia [Chicago: World Book, 2009. 22 vols.], Chambers’s
Encyclopaedia [London: International Learning Systems, 1969. 15 vols.],
Collier’s Encyclopedia [New York: Macmillan Educational, 1976. 24 vols.],
etc. The cost of all these encyclopaedias run into thousands of dollars which
most libraries cannot afford to purchase all of them. In such a situation,
checklist for the evaluation of encyclopaedias is of real help.
Past record – It has been already discussed under Dictionaries. The way it is
applicable for dictionaries, the same way it is applicable for encyclopaedias.
Possibly, it is more applicable in the case of encyclopaedias.
Authority – It has already been discussed in Section 4.2.1 which is very much
applicable for encyclopaedias. Moreover, in standard encyclopaedias, the
name and qualifications of the contributors, editors, editorial board members
are given. All the articles in such encyclopaedias are signed. Going through
the names of the authors of some articles, and the names and qualifications of
the editors, it is possible to decide roughly to what extent the articles in the
encyclopaedia will be authoritative.
Treatment – In the treatment you are to see to what extent the information
provided is thorough, authentic and complete in terms of facts and figures,
whether the article is free from bias, and the user group the article has
targeted. Here you can also attempt a test. Compare the biography of a person,
say William Shakespeare, in two encyclopaedias. Immediately you will realise
how the matter has been treated in both the sources.
81
Documentary Special features – Each encyclopaedia has some special features. For
Sources
example, The New Webster’s International Encyclopedia has a separate
section of maps and an index of place names figuring in the maps, illustrative
survey of world history, declaration of independence [of the United States],
the Constitution of United States of America, list of the Presidents of the
United States, U.S. Supreme court justices, national parks of the United
States, chemical elements, electrical resistivity and temperature coefficients of
elements, periodic table, and metric measurement conversions.
82
Other checking elements like authority, format, etc. as described in Section Criteria of
4.2. are applicable in the case of yearbooks and almanacs also. Evaluation
4.3.5 Directories
Past record – Some directories are coming out for a long time. For example
Ulrich’s International Periodicals Directory [New York: Bowker, 1932-.],
and World of Learning [London: Europa, 1947-.]. Such directories have
earned a name for themselves in the world. Not many directories appear every
year. Usually, they appear after short or long intervals. If several editions of a
directory had already come out, it gives an indication that the directory is
popular. If required, it may be acquired for the library.
Special features – Some directories have some special features. For example,
Ulrich’s International Periodicals Directory includes information on
abstracting and indexing services, money symbols, and list of periodicals that
had ceased publication, etc.
Format and conclusion as described under Section 4.2 are also applicable
here.
Past record – Many publishing houses in the world have earned a name as
publishers of gazetteers (Columbia University Press), guidebooks (Fodor’s),
atlases and maps (Hammond, Rand McNally, etc.), etc. They are publishing
standard geographical sources for many decades or centuries. If any of them
bring out a new geographical reference book, it will be considered of value.
Hence, for geographical sources as well the past record of the publisher is
worth examining.
Special features – In all geographical sources, black and white and colourful
maps are usually provided. The more the number of maps, the more useful
will be the source. This should be borne in mind while selecting a source.
Format – Maps, atlases and globes are usually produced in colour. Maps in
many cases are of big size and meant for hanging on the wall. A map of Delhi
brought out by T. T. Maps and Publications Ltd. in 1991 measures 27 inches x
40 inches. Usually these maps are stored in the form of rolls. Oversize maps
provided with books are usually folded. Atlases, almost in all cases, are
oversized. Special shelves are needed to store them. A globe is a miniaturised
85
Documentary form of the earth. Hence, it is always spherical in shape. In some globes and
Sources
maps you may find even relief features showing mountains, hills, etc.
Past record – Some publishers in the world such as Wilson, Europa, Adam
and Charles Black, Charles Scribner’s, G&C Merriam and Marquis have
excelled in bringing out biographical sources. They are bringing out
biographical sources since long, some of them at regular intervals. If such a
publisher brings out a new biographical source, it is expected that the source
will be of good quality.
87
Documentary Limitations – All biographical sources have some limitations. The coverage
Sources
of none of these sources can be considered to be comprehensive. One has to
select biographees on the basis of some criteria, whereby, many others are left
out. There is also bias in selection. An international who’s who produced from
UK will obviously try to cover more celebrities from UK. There is no single
source wherefrom biographical details of all the celebrities of the world can be
obtained. To a certain extent the World Wide Web is fulfilling this need.
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
……………………………………………………………………………
88
4.4 OTHER SOURCES Criteria of
Evaluation
4.4.1 Textbooks
Textbooks are the backbone of school, college, university and other
educational institution libraries. Numerous authors write textbooks and
known, little-known and well-known publishers publish them. As such, they
are of varying quality.
The first thing that should be checked in a textbook is whether the textbook
covers the prescribed syllabus adequately. This apart authors, publishers, the
edition, and error-freeness are to be given greater importance. About 50 years
ago, many of us studied J C Nesfield’s English Grammar. S. L. Loni’s
Trigonometry, Hall and Stevens Geometry, K.P.Basu’s Algebra, Shanti
Narayan’s Calculus, etc. Even today, these books are used by school and
college students. Gray’s Anatomy is a bible for MBBS students. Who can
forget Krishan Kumar’s textbooks that we all studied while doing BLIS or
MLIS.
Students know textbooks by the name of the authors. Hence, for procuring a
textbook for a library, the first checking element is the author. If the author is
famous, the textbook may be procured without any problem. The corporate
body is no less important. You all know that National Council of Educational
Research and Training (NCERT) brings out a large number of textbooks every
year. It has earned a name as a publisher of good textbooks for school
education. Any book by NCERT and other similar bodies may be selected for
purchase without much scrutiny. If several editions of a textbook have already
been published, the textbook is worth procuring.
The problem arises in selecting the first edition of a textbook by a new author
and a new publisher. It may contain lot of grammatical and factual errors. A
glance through the first few pages may reveal the quality of the book. If you
fail to judge the purchase-worthiness of a book, take the help of a good
teacher. The judgment of a teacher will be valuable for making a decision. A
glance through the reviews may also help.
All such sources can be evaluated using the checking elements given under
Section 4.2.
To a certain extent these periodicals can also be evaluated using the checklist
described under Section 4.2. However, using bibliometric methods they can
be evaluated much better. Sometimes expert opinion may be necessary before
finally selecting such a periodical for a library.
90
Self Check Exercise Criteria of
Evaluation
Note: i) Write your answer in the space given below.
ii) Check your answer with the answer given at the end of this Unit.
5) How will you evaluate a textbook?
…………………………………………………………………………….
…………………………………………………………………………….
…………………………………………………………………………….
…………………………………………………………………………….
…………………………………………………………………………….
…………………………………………………………………………….
4.5 SUMMARY
In this Unit, we have dealt mainly with the evaluation of documentary
reference sources. For evaluation, authorities have decided certain points
which are to be checked while evaluating a book. The points that are generally
applicable for all types of reference books, are, past record of the publisher,
authority, scope, treatment, arrangement, special features, format, book
reviews, limitations and conclusion. The writers of reference books have not
considered book reviews as one of the elements of evaluation. This has been
included here as book reviews at times help a lot in the evaluation of a book.
All these have been discussed generally in the beginning in one section and
then under each type of reference sources. Certain points like method of
selection, method of compilation, items of information, etc. have been
described at relevant places. The types of reference sources covered are:
bibliographies including indexing and abstracting periodicals, dictionaries,
encyclopaedias, yearbooks and almanacs, directories, geographical sources
and biographical sources. In addition, handbooks and manuals, trade
catalogues, statistical information sources, sources for current affairs have
also been touched upon. Evaluation is usually discussed in books on reference
service, where evaluation of reference books are only discussed. It has been
thought that librarians of academic libraries are to purchase a large number of
textbooks every year. Keeping this in view, evaluation of textbooks has been
briefly discussed. Using bibliometric methods, primary periodicals and
reviewing periodicals are evaluated. Bibliometric methods are beyond the
scope of BLIS curriculum, hence only a brief mention about bibliometric
evaluation has been made.
4.7 KEYWORDS
Biographee : One about whom a biography is written,
the subject of a biography.
Collation : It comprises of pagination, illustration,
size and series.
Diacritical Mark : It is a sign placed above or below a letter
to indicate a different pronunciation of the
letter. For example, ā is pronounced as आ.
The bar above a is the diacritical mark.
Encyclopaedic Dictionary : A dictionary having some features of an
encyclopaedia.
Frontispiece : An illustration that faces the title page of a
book.
Headword : A word with which a separate entry is
made in a reference work. For example,
the phrase by heart will be found under
the headword heart in a dictionary.
Headwords in dictionaries are normally
printed in bold letters.
Imprint : It includes place of publication, publisher
and year of publication.
Inter-line Space : Space between two consecutive lines.
Inter-word Space : Space between two consecutive words.
Necrology : A list of persons who died during a
particular period.
---. “Dictionaries”. BLIS 05 -Unit 6. New Delhi: Indira Gandhi National Open
University, 1999. Print.
---. “Geographical Sources”. BLIS 05 -Unit 10. New Delhi: Indira Gandhi
National Open University, 1999. Print.
93
Documentary ---. “Statistical Information Sources”. BLIS 05 -Unit 12. New Delhi: Indira
Sources
Gandhi National Open University, 1999. Print.
“Etymology”. The Concise Oxford Dictionary. 10th ed. Oxford: OUP, 1999.
Print.
Krishan Kumar. Reference Service. 5th ed. New Delhi: Vikas, 1996. Print.
94