A Normative Study of The Raven Coloured Progressive Matrices Test For Omani Children Aged 5-11 Years
A Normative Study of The Raven Coloured Progressive Matrices Test For Omani Children Aged 5-11 Years
ABSTRACT
Ravens Coloured Progressive Matrices test has been extensively used across a
wide variety of settings in different countries all over the world as a fair culture
measure of non-verbal intelligence. The objective of the present study is to
extract norms of the test for Omani children. The test was applied on an
individual basis on a random sample of 1042 children from different age groups
ranging from 5 to 11 years old. All of the estimated psychometric properties
including validity, reliability, and norms indicate that the test could be
practically utilized when applied in several situations. The study has a number
of implications including that the Ministry of Education may use it to diagnose
and detect those children with learning difficulties; the Ministry of Health may
use it in hospitals to measure the IQ of certain patients in order to make
medical decisions. In addition, researchers in psychological and social areas
would be able to conduct studies aiming at measuring the intelligence of
children.
ABSTRAK
Ujian matrik Ravens Coloured Progressive telah diguna pakai secara meluas
dalam pelbagai situasi di pelbagai negara di seluruh dunia kerana ia adalah
satu ukuran kecerdasan bukan verbal yang adil daripada segi budaya. Objektif
*
This research is funded by Sultan Qaboos University and carries No: IG/EDU/PSYC/05/01
38 Jurnal Pendidikan Malaysia 34(1)
kajian ini ialah untuk menghasilkan norma untuk ujian tersebut bagi pelajar
di negara Oman. Kajian telah dijalankan secara rawak kepada 1042 pelajar
daripada pelbagai umur, iaitu dari 5 hingga 11 tahun. Semua penggunaan
psikometrik termasuk kesahan kebolehpercayaan dan norma yang dapat
menunjukkan ujian adalah praktikal dan digunakan dalam pelbagai situasi.
Kajian ini mempunyai pelbagai implikasi termasuk Kementerian Pelajaran
dapat menggunakan ujian di hospital untuk mengukur IQ pesakit bagi
membantu membuat keputusan pengkaji dalam bidang psikologikal dan sosial
juga dapat menjalankan kajian mengukur kecerdasan kanak-kanak.
INTRODUCTION
standard and reputation, which in turn may help in comparing their norms with
those established in other cultures.
The need for the standardization of intelligence tests plays a crucial role in
the history of psychology, namely its recent history (Abu Hatab 1979; Kassin
2003). Like other third world countries, the Arab countries are in great need of
standardized tests. There are many reasons behind this claim.
1. There is a paucity of standardized tests in most of the third world countries,
including countries of the Arab world. In the Sultanate of Oman, at least two
Western tests were standardized: the standard progressive matrices (Yahya,
Ibrahim & Jalal 2003) and the emotional intelligence test (Al-Hinaie 2002).
Possible reasons for the shortage of standardized tests are lack of funding,
paucity of specialized experts in measurement and testing, and lack of
awareness of the importance of using such tests.
2. The application of the tests may be needed in different contexts other than
those indicated in Western culture research. However, their application in
Western culture in evaluation, diagnosis, and categorization may also be
useful everywhere.
3. Such attempts may encourage researchers to develop their own tests, and
eventually scholars in the third world may manage to contribute to the
development of psychology especially in psychological testing.
4. Like previous research elsewhere all over the world, the results of such
standardized tests are expected not only to diagnose and pinpoint the
problems, but also to suggest possible solutions when used for this
particular purpose. Such tests are much needed in different walks of life,
where decision-making is relevant, including but not limited to education,
the military, health core delivery, industry, and politics.
5. There seems to be a great need for the standardization of universally
recognized tests in our Arab world since the design and development of
intelligence tests are costly.
There have been some disagreements during the 1960s about the validity of
the concept of culture fairness, and it has been asserted that it is impossible to
develop a truly culture fair test (Jensen 1973). However, Jensen (1980) has
argued at length that it is possible to look upon some nonverbal tests of
intelligence as being what he refers to as status free. Among these tests, he
singles out Ravens progressive matrices (RPM) test as the most appropriate
measure. In line with the 1960s outlook, Benson (2003) thinks that simply
translating a Western test into the local language is not enough. Instead, it is
critical to tailor each test to the needs and values of the culture in which it is to
be used. The present study is concerned with this criticism because it refers to
tests using language.
Kaplan and Saccuzzo (1997) mentioned that the progressive matrices reduce
the effect of language and culture. For example, Mexican Americans and African
40 Jurnal Pendidikan Malaysia 34(1)
METHODOLOGY
SAMPLE OF STANDARDIZATION
A random sample of 1042 Omani children was selected for standardization from
70 schools in all regions of the Sultanate of Oman. Table 2 shows characteristics
of the sample.
TABLE 1. Psychometric properties for Ravens coloured progressive matrix test as presented in previous studies
RESEARCH INSTRUMENTS
Ravens coloured progressive matrices test was used to achieve the goal of the
research. To obtain indices of test validity, the Omani version of Otis Lennon
test was used, and a teachers checklist of the childs intelligence was designed.
Ravens Coloured Progressive Matrices Test. Ravens coloured progressive
matrices test consists of 36 matrices divided equally into three sets (A, AB, B). In
each matrix, there are six choices (answer alternatives). The matrices in set A
depend on the childs ability to complete the missing parts. The matrices in set
AB depend on the childs ability to perceive the relationships and relations
between the matrices and the six answer alternatives. The matrices in set B
depend on the development of the childs ability in abstract thinking. The correct
A Normative Study of the Raven Coloured Progressive Matrices Test 43
answer is given one score whereas the wrong answer is given zero. Thus, the
raw score on the coloured progressive matrices test ranges between zero and 36.
The psychometric properties of the test are acceptable in most of the studies
(Raven, Court & Raven 1990, 2002). In the Arab world, the test has been
standardized in many countries including: the United Arab Emirates (Eid 1999),
Sudan (Al-Khateeb et al. 2006), Iraq (Al-Ani 1989), Kuwait (Al-Qurashi 1987),
and Yemen (Al-Heeti et al. 1995), and its psychometric properties were acceptable,
too.
Otis Lennon Test. For the purpose of establishing the concurrent validity of the
coloured progressive matrices test, the Omani version of the Otis Lennon test
for general mental ability, the modified K version (Al-Shukri 2002) was used. The
test consists of 80 items, divided into three sections by 20 items in each of the
sections I and II, and 40 items in Section III. The correct answer is given a score
of one, and the wrong answers are given zero. Thus, the raw score on the test
ranges between zero and 80. The test is used to measure the intelligence of
school children aged 7-10 years. The Omani version of the test has acceptable
psychometric properties. The Cronbachs alpha reliability coefficient was .90,
the stability coefficient after 14 days was .71, and the split-half coefficient was
.82. The validity of the test was supported by several methods including item
difficulty and discrimination indexes, concurrent validity, and discriminate
validity.
Teachers Checklist of the Students Intelligence. For the purpose of verifying
the concurrent validity of the coloured progressive matrices test and in light of
the theoretical framework of the progressive matrices test, especially the
assumptions of the Spearmans theory of intelligence, a teachers checklist was
developed to assess the intelligence of children. The checklist consists of 15
items on a 5-point rating scale (never, rarely, sometimes, often, always). The
answers (never, rarely, sometimes, often, always) are given the scores (1, 2, 3, 4,
5), respectively. Thus, the raw score on the list ranges between 15 and 75.
Teachers rating depends on his/her observation of the childs behavior during
teaching for a period of not less than six months. The content of the checklists
items was validated by three experts in educational psychology. Also, the item
total correlation was calculated, and the Pearson correlation coefficients ranged
from .74 to .92. In terms of reliability, the Cronbachs alpha coefficient was .98
(Kazem et al. 2007).
The research team obtained the approval of the Ministry of Education to apply
the coloured progressive matrices test on school children. The application of
the coloured progressive matrices test on the standardization sample was
individually applied by some members of the team, and through the use of two
44 Jurnal Pendidikan Malaysia 34(1)
members having a masters degree in education from the Technical Office for
Studies and Development at the Ministry of Education, and two graduate students
in educational psychology, and one expert of the Adults Center who has a
doctorate degree in measurement and evaluation. The application process lasted
nearly three months.
RESULTS
DESCRIPTIVE STATISTICS
The research team found that it is suitable to calculate some important statistical
indices such as: least score, highest score, the mean, the standard deviation,
skewness, and kurtosis. Table 3 below includes a display of these statistical
indices. As shown in Table 3, the skewness and kurtosis values were within
acceptable range of normality. Also, the average CPMs test score tended to
increase as age increases.
RELIABILITY INDICES
VALIDITY INDICES
The researchers calculated the validity indices using the concurrent validity and
the construct validity:
46 Jurnal Pendidikan Malaysia 34(1)
Concurrent Validity
Overall achievement. To test the assumption concerning relationship of
intelligence to academic achievement, the relationship between the scores in the
CPM test and the general academic achievement in four taught courses (Arabic
Language, English Language, Mathematics, and Science) was calculated in this
study. Pearsons correlation coefficient was found to be 0.405, and it was
statistically significant at p < 0.01.
Otis-Linone test. To test the assumption concerning relationship of performance
on the Raven CPM test and performance on other mental ability tests, the
relationship between students scores in the Raven CPM test and their scores on
the Otis-Linone test was calculated in this study. Pearsons correlation coefficient
was 0.641, and it was statistically significant at p < 0.01.
Teachers ratings. To test the hypothesis regarding the relationship between
performance on the Ravens CPM test and teachers ratings of the childs
intelligence, students scores on the Ravens CPM test were correlated with their
teachers ratings of the intelligence. Pearson correlation coefficient was found
to be 0.412, and it was statistically significant at p < 0.01.
Construct Validity
Gradual difficulty of the test groups. A t-test for two correlated samples was
performed for the scores of the two test groups (A) and (AB), and between the
scores of the two test groups (AB) and (B) according to each age group. Table 6
shows the summary of the t-test results. As revealed by Table 6, all calculated t-
values were statistically significant. This result confirms that the hypothesis
regarding the differences between the scores of the children in group (A) and
their scores in group (AB), and also between their scores in group (AB) and their
scores in group (B).
TABLE 6. T-Test results comparing the subset scores of the Ravens CPM
across age groups
Age Differentiation. To test the hypothesis which states that individuals show
systematic progress in their scores in Ravens Matrices tests with increasing
age, one-way ANOVA was used. The calculated F value was found to be
statistically significant at p < 0.001, with an effect size of 0.224. Following this,
Sheffees test for multiple comparisons revealed statistically significant
differences for all dual comparisons between each age group and its subsequent
elder category (6 and 7), (7 and 8), (8 and 9), (9 and 10), (10 and 11), except for the
first comparison between the categories (5 and 6) which was not statistically
significant. This result is an indication of the availability of the construct validity
in the test. Table 7 summarizes the ANOVA results; and Figure 1 shows a graph of
the raw scores means of the standardization sample according to age.
27.50
25.00
Raw Scores
22.50
20.00
17.50
15.00
4 5 6 7 8 9 10 11 12
Age Categories
NORMS
Percentile ranks were extracted as norms for the raw scores of the standardization
sample (n = 1042), as they are the most spread norms in intelligence tests in
general) Nitko & Brookhart 2007), and particularly in the progressive matrices
test (e.g Al-Khateeb et al. 2006; Al-Ani 1989; Eid 1999; Al-Qurashi 1987; Al-Heeti
et al. 1995; Cotton et al. 2005; Costenbader & Ngari 2001; Linstrom 2002). Percentile
ranks are also good indicators of the individuals relative position in his group.
Furthermore, percentile ranks are used because they are easy to calculate and
interpret (Anastasi & Urbina 1997). Table 9 shows the percentile ranks for each
age group. The norms are available with the first author upon request.
DISCUSSION
CONCLUSION
The present study provides normative data regarding the performance of Omani
children aged 5-11 years on Ravens CPM. As in previous research, the study
yielded reliable data and valid inferences could be made from them. For example,
the Ministry of Education may use it to diagnose and detect those children with
learning difficulties; the Ministry of Health may use it in hospitals to measure
the IQ of certain patients in order to make medical decisions. This line of research
could be extended to further investigate the psychometric properties of the CPM
for Omani children with special needs.
REFERENCES
Abu Hatab, F. 1979. Mental abilities. Cairo, Egypt: Alangolo Almasria. (In Arabic).
Al-Ani, A. 1989. Construction Iraqi norms of the Ravens coloured progressive matrices.
Unpublished Master thesis, Baghdad University, Iraq. (In Arabic).
Al-Heeti, K. N., Ganim, A., Al-Zubaidi, A. & Alnood, Y. 1995. The standardization of
Ravens coloured progressive matrices for basic education children between 6-11
years old in the Republic of Yemen. Unpublished manuscript presented to the UNCIF.
(in Arabic).
Al-Hinaie, T. Z. 2002. The Psychometric properties of the emotional intelligence test in
the Omani context. Unpublished Master thesis, Sultan Qaboos University, Oman.
(In Arabic).
Al-Khateeb, M. A. M. & Al-Mutawakil. 2001. The standardization of Ravens coloured
progressive matrices test for basic education students in the Khartoum City. Khartoum:
Sudan Press Company Limited. (In Arabic).
Al-Khateeb, M. A. M., Mustaafa, M. M. A. & Hussein, A. M. 2006. User guied of
Raven standard progressive matrices test in the Sudans culture. Khartoum: Money
Press Company Limited. (In Arabic).
Al-Qurashi, A. 1987. Ravens coloured progressive matrices test: user guide. Kuwait:
Dar Alqalam. (In Arabic).
Al-Shukri, H. A. S. 2002. Standardization of Otis-Lennon Mental Ability Test, Elementary
Level, Form K, in the Muscats District Students. Unpublished masters thesis,
Sultan Qaboos University, Oman. (In Arabic).
Anastasi, A. & Urbina, S. 1997. Psychological testing (7th ed.). New Jersey: Prentice Hall.
Barnabas, I., P., Kapur, M. & Rao, S. 1995. Norm development and reliability of coloured
progressive matrices test. Journal of Personality and Clinical Studies, 11 (1-2), 17-
22.
Benson, F. 2003. Intelligence across cultures. Monitor on Psychology, 34 (2). Retrieved
March 29, 2006, from http://www. apa. org/ monitor/2003/ intelligence. htm.
Costenbader, V. & Ngari, S. M. 2001. A Kenyan standardization of Ravens coloured
progressive matrices. School Psychology International, 22(3), 258-268.
Cotton, S. M., Kiely, P. M., Crewther, D. P., Thomson, B., Laycock, R. & Crewther, S.
G. 2005. A normative and reliability study for the Ravens Coloured Progressive
Matrices for primary school aged children from Victoria, Australia. Personality and
Individual Differences, 39, 647-659.
A Normative Study of the Raven Coloured Progressive Matrices Test 51
Eid, A. 1999. The application manual for Ravens coloured progressive matrices.
Unpublished manuscript, Ministry of Education, United Arab Emirates. (In Arabic).
Jensen, A. R. 1973. Educability and group differences. New York: Free Press.
Jensen, A. R. 1980. Bias in mental testing. New York: Free Press.
Kaplan, R. M. & Saccuzzo, D. P. 1997. Psychological testing: Principles, applications
and issues (4th ed.). Pacific Grove: Brooks/ Cole.
Kassin, S.2003. Essentials of psychology. Upper Saddler River, New Jersey: Prentice
Hall.
Kazem, A. M., Alzubidi, A. S., Yousif, Y. H., Aljamali, F. A., Al-Mashhdany, S. I.,
Alkharusi, H. A., Al-Busaidi, O. B., Alsarmi, A. M., Al-Bulushi, S. S., Al-Bahrani,
W. A. & Al-Fori, S. M. 2007. Psychometric Properties of Ravens Coloured
Progressive Matrices for Omani Children Aged 5 through 11 Years. Social Behavior
and Personality, New Zealand, 35(10), 1385-1398.
Linstrom, A. 2002. Variance in coloured progressive matrices (CPM) scores with ethnicity,
economics circumstances and living conditions in South Africa. Paper presented at
the 25th International Congress of Applied Psychology in Singapore.
Lynn, R.1994. Sex differences in intelligence and brain size: A paradox resoled. Personality
and Intelligence, 20, 271-273.
Lynn, R., Allik, J., Pullman, H. & Laidra, K. 2004. Sex differences on the progressive
matrices among adolescents: Some data from Estonia. Personality and Individual
Differences, 36, 1249-1255.
Murphy, K. R. & Davidshofer, C. O. 1998. Psychological testing: Principal and
applications (4th ed.). Upper Saddle River, New Jersey: Prentice Hall.
Nitko, A. J. & Brookhart, S. 2007. Educational assessment of students. New Jersey:
Pearson Education, Inc., Upper Saddle River.
Raven, J. 2000. The Ravens Progressive Matrices: change and stability over culture and
time. Cognitive Psychology, 41, 1-48.
Raven, J. C., Court, J. H. & Raven, J. 1990. Manual for Ravens progressive matrices
and vocabulary scales: American and international norms. Oxford, England: Oxford
Psychological Press.
Raven, J. C., Court, J. H. & Raven, J. 2002. Ravens colored progressive matrices.
Austria: Dr. G. Schuhfried Ges M. B. H.
Schaie, K. W. 1986. The Seattle Longitudinal studies of adult intelligence, Current Direction
in Psychological Science, 2, 171-175.
Yahya, A. M., Ibrahim, A. M. & Jalal, S. 2003. Standardization of Ravens Progressive
Matrices Test in the Omani culture: Muscat region. A Series of Psychological and
Educational Studies-SQU, 6, 35-58. (In Arabic).