T19 Assessment Frameworks Chapter 4
T19 Assessment Frameworks Chapter 4
TIMSS 2019
Assessment Design
TIMSS is designed to provide countries with information about their students’ mathematics and science
achievement that can be used to inform evidence-based decisions for improving educational policy
and practice. At the heart of TIMSS is a wide ranging student assessment of mathematics and science
achievement conducted at four year intervals at fourth and eighth grades, together with questionnaires
for parents, students, teachers, school principals, and curriculum experts that gather information about
the social and educational contexts for learning.
Central to TIMSS’ mission is the measurement of student achievement in mathematics and
science in a way that does justice to the breadth and richness of these subjects as they are taught in the
participating countries, and that monitors countries’ improvements or declines by tracking trends in
student performance from one assessment cycle to the next. This requires an assessment that is wide
ranging in its coverage of mathematics and science and innovative in its measurement approach.
Conducted every four years since 1995, with each assessment linked to the one that preceded
it, TIMSS provides regular and timely data for educators and policymakers on trends in students’
mathematics and science achievement. As an additional advantage, administering TIMSS at the fourth
and eighth grades every four years provides the opportunity to monitor achievement changes within
a grade cohort, as the fourth grade students in one TIMSS cycle become the eighth grade students in
the next cycle.
The seventh in the TIMSS series of assessments, TIMSS 2019 continues the TIMSS tradition of
innovation by beginning the transition to the eTIMSS digital format. For the first time, about half the
countries will transition to administering the assessment via computer, while the rest will administer
TIMSS in a paper and pencil format as in previous assessments.
1 See Foy and Yin (2016) for a description of the scaling of the TIMSS 2015 achievement data.
Mathematics Science
Source of Items Source of Items
Blocks Blocks
M01 Trend Block M13 from TIMSS 2015 S01 Trend Block S13 from
TIMSS 2015
M02 New items for TIMSS 2019 S02 New items for TIMSS 2019
M03 Trend Block M08 from TIMSS 2015 S03 Trend Block S08 from
TIMSS 2015
M04 New items for TIMSS 2019 S04 New items for TIMSS 2019
M05 Trend Block M09 from
TIMSS 2015 S05 Trend Block S09 from TIMSS 2015
M06 Trend Block M10 from
TIMSS 2015 S06 Trend Block S10 from
TIMSS 2015
M07 Trend Block M11 from TIMSS 2015 S07 Trend Block S11 from TIMSS 2015
M08 New items for
TIMSS 2019 S08 New items for TIMSS 2019
M09 Trend Block M04 from
TIMSS 2015 S09 Trend Block S04 from TIMSS 2015
M10 New items for TIMSS 2019 S10 New items for TIMSS 2019
M11 Trend Block M12 from TIMSS 2015 S11 Trend Block S12 from
TIMSS 2015
M12 New items for TIMSS 2019 S12 New items for TIMSS 2019
M13 Trend Block M14 from
TIMSS 2015 S13 Trend Block S14 from TIMSS 2015
M14 New items for
TIMSS 2019 S14 New items for TIMSS 2019
Fourth grade students are expected to spend, on average, 18 minutes on each item block, and eighth
grade students, 22½ minutes. Consequently, the 28 blocks of fourth grade items are estimated to contain
almost 8½ hours of testing time and the eighth grade blocks about 10½ hours. In previous TIMSS cycles,
National Research Coordinators from participating countries agreed that the testing time for any one
student should not be increased from previous assessments. Thus, as in the past, the assessment time for
each student booklet must fit into 72 minutes for the fourth grade and 90 minutes for the eighth grade.
An additional 30 minutes for a student questionnaire also was planned at each grade level.
In choosing how to distribute assessment blocks across student achievement booklets, the major
goal was to maximize coverage of the framework while ensuring that every student responded to
sufficient items to provide reliable measurement of trends in both mathematics and science. A further
goal was to ensure that achievement in the mathematics and science content and cognitive domains
could be measured reliably. To enable linking among booklets while keeping the number of booklets to
a minimum, each block appears in two booklets. TIMSS has used the same booklet design since 2007.
The TIMSS 2019 booklet design shows how the 28 assessment blocks are distributed across
14 student achievement booklets (see Exhibit 4.2). The fourth and eighth grade booklet designs are
identical, although the fourth grade blocks contain 18 minutes of assessment items and the eighth grade
blocks 22½ minutes. Each student booklet consists of four blocks of items: two blocks of mathematics
Exhibit 4.2: TIMSS 2019 Student Achievement Booklet Design—Fourth and Eighth Grades
Assessment Blocks
Student
Achievement Part 1 Part 2
Booklet
Booklet 1 M01 M02 S01 S02
Booklet 2 S02 S03 M02 M03
Booklet 3 M03 M04 S03 S04
Booklet 4 S04 S05 M04 M05
Booklet 5 M05 M06 S05 S06
Booklet 6 S06 S07 M06 M07
Booklet 7 M07 M08 S07 S08
Booklet 8 S08 S09 M08 M09
Booklet 9 M09 M10 S09 S10
Booklet 10 S10 S11 M10 M11
Booklet 11 M11 M12 S11 S12
Booklet 12 S12 S13 M12 M13
Booklet 13 M13 M14 S13 S14
Booklet 14 S14 S01 M14 M01
Exhibit 4.3: TIMSS 2019 Fourth Grade Less Difficult Mathematics—Item Blocks
Mathematics Science
Source of Items Source of Items
Blocks Blocks
Trend Block M13 from TIMSS 2015: Trend Block S13 from TIMSS 2015:
ET19DCM01 ET19DCS01
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM02 ET19DCS02
format format
Trend Block M08 from TIMSS 2015: Trend Block S08 from TIMSS 2015:
ET19DCM03 ET19DCS03
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM04 ET19DCS04
format format
Trend Block M09 from
TIMSS 2015: Trend Block S09 from
TIMSS 2015:
ET19DCM05 ET19DCS05
digital format digital format
Trend Block M10 from
TIMSS 2015: Trend Block S10 from
TIMSS 2015:
ET19DCM06 ET19DCS06
digital format digital format
Trend Block M11 from TIMSS 2015: Trend Block S11 from TIMSS 2015:
ET19DCM07 ET19DCS07
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM08 ET19DCS08
format format
Mathematics Science
Source of Items Source of Items
Blocks Blocks
Trend Block M04 from
TIMSS 2015: Trend Block S04 from
TIMSS 2015:
ET19DCM09 ET19DCS09
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM10 ET19DCS10
format format
Trend Block M12 from TIMSS 2015: Trend Block S12 from TIMSS 2015:
ET19DCM11 ET19DCS11
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM12 ET19DCS12
format format
Trend Block M14 from
TIMSS 2015: Trend Block S14 from
TIMSS 2015:
ET19DCM13 ET19DCS13
digital format digital format
New items for TIMSS 2019: digital New items for TIMSS 2019: digital
ET19DCM14 ET19DCS14
format format
New Math PSI tasks TIMSS 2019: digital New Science PSI tasks
ET19DPSIM1 ET19DPSIS1
format TIMSS 2019: digital format
New Math PSI tasks TIMSS 2019: digital New Science PSI tasks
ET19DPSIM2 ET19DPSIS2
format TIMSS 2019: digital format
Exhibit 4.5 shows the eTIMSS block combinations (as student booklets are known in eTIMSS)
that are assigned to individual students, and as such is the eTIMSS counterpart to Exhibit 4.2 for
paperTIMSS. For example, block combination ET19DCBC01 for eTIMSS includes mathematics blocks
ET19DCM01 and ET19DCM02 and science blocks ET19DCS01 and ET19DCS02, just as Booklet 1
contains blocks M01, M02, S01, and S02 for paperTIMSS. The eTIMSS design contains two extra block
combinations, ET19DCBC15 and ET19DCBC16, to accommodate the PSI tasks. Similar to paper
TIMSS, the 16 eTIMSS block combinations are distributed among students in each sampled classroom
according to assignments predetermined by the within-school sampling software.
Assessment Blocks
Student Block
Part 1 Part 2
Combination
ET19DCBC01 ET19DCM01 ET19DCM02 ET19DCS01 ET19DCS02
ET19DCBC02 ET19DCS02 ET19DCS03 ET19DCM02 ET19DCM03
ET19DCBC03 ET19DCM03 ET19DCM04 ET19DCS03 ET19DCS04
ET19DCBC04 ET19DCS04 ET19DCS05 ET19DCM04 ET19DCM05
ET19DCBC05 ET19DCM05 ET19DCM06 ET19DCS05 ET19DCS06
ET19DCBC06 ET19DCS06 ET19DCS07 ET19DCM06 ET19DCM07
ET19DCBC07 ET19DCM07 ET19DCM08 ET19DCS07 ET19DCS08
ET19DCBC08 ET19DCS08 ET19DCS09 ET19DCM08 ET19DCM09
ET19DCBC09 ET19DCM09 ET19DCM10 ET19DCS09 ET19DCS10
ET19DCBC10 ET19DCS10 ET19DCS11 ET19DCM10 ET19DCM11
ET19DCBC11 ET19DCM11 ET19DCM12 ET19DCS11 ET19DCS12
ET19DCBC12 ET19DCS12 ET19DCS13 ET19DCM12 ET19DCM13
ET19DCBC13 ET19DCM13 ET19DCM14 ET19DCS13 ET19DCS14
ET19DCBC14 ET19DCS14 ET19DCS01 ET19DCM14 ET19DCM01
ET19DCBC15 ET19DPSIM1 ET19DPSIM2 ET19DPSIS1 ET19DPSIS2
ET19DCBC16 ET19DPSIS2 ET19DPSIS1 ET19DPSIM2 ET19DPSIM1
References
Foy, P., & Yin, L. (2016). Scaling the TIMSS 2015 achievement data. In M.O. Martin, I.V.S. Mullis, & M. Hooper (Eds.),
Methods and Procedures in TIMSS 2015 (pp. 13.1–13.62). Retrieved from Boston College, TIMSS & PIRLS International
Study Center website: http://timss.bc.edu/publications/timss/2015-methods/chapter-13.html
UNESCO. (2012). International Standard Classification of Education ISCED 2011. Montreal: UNESCO Institute of
Statistics. Retrieved from http://uis.unesco.org/sites/default/files/documents/international-standard-classification-of-
education-isced-2011-en.pdf