Multple - Choice Format
Multple - Choice Format
format
Multiple Choice Format
◦ or objective response is a form of an objective assessment
in which respondents are asked to select only correct
answers from the choices offered as a list
◦ usually consist of a question or statement to which you
respond by selecting the best answer from among a
number of choices.
◦ is most frequently used in educational testing
Parts
◦ the stem, which asks the question, poses a problem, or
presents an incomplete sentence;
◦ the correct response;
◦ and four alternative responses which are incorrect, these
are often called "distracters."
WRITING GOOD
MULTIPLE-CHOICE
QUESTIONS
Constructing an Effective Stem
1. The stem should be meaningful by itself and should present a
definite problem.
Constructing an Effective Stem
2. The stem should not contain irrelevant material, which
can decrease the reliability and the validity of the test scores
(Haldyna and Downing 1989).
Constructing an Effective Stem
3. The stem should be negatively stated only when significant
learning outcomes require it.
Constructing an Effective Stem
4. The stem should be a question or a partial sentence.
Constructing Effective Alternatives
1. All alternatives should be plausible.
Constructing Effective Alternatives
2. Alternatives should be stated clearly and concisely
Constructing Effective Alternatives
3. Alternatives should
be mutually exclusive.
Alternatives with
overlapping content
may be considered
“trick” items.
Constructing Effective Alternatives
4. Alternatives should be homogenous in content.
Constructing Effective Alternatives
◦ 5. Alternatives should be free from clues about which response
is correct. Sophisticated test-takers are alert to inadvertent clues to
the correct answer, such differences in grammar, length, formatting,
and language choice in the alternatives. It’s therefore important that
alternatives
◦ have grammar consistent with the stem.
◦ are parallel in form.
◦ are similar in length.
◦ use similar language
Constructing Effective Alternatives
6. The alternatives “all of the above” and “none of the above”
should not be used. When “all of the above” is used as an answer,
test-takers who can identify more than one alternative as correct can
select the correct answer even if unsure about other alternative(s).
When “none of the above” is used as an alternative, test-takers who
can eliminate a single option can thereby eliminate a second option.
In either case, students can use partial knowledge to arrive at a
correct answer.
Constructing Effective Alternatives
7. The alternatives should be presented in a logical order (e.g.,
alphabetical or numerical) to avoid a bias toward certain positions.
Constructing Effective Alternatives
8. The number of alternatives can vary among items as long as
all alternatives are plausible.
Plausible alternatives serve as functional distractors, which are those
chosen by students that have not achieved the objective but ignored
by students that have achieved the objective. There is little difference
in difficulty, discrimination, and test score reliability among items
containing two, three, and four distractors.
Additional Guidelines
1. Avoid complex multiple choice items,
in which some or all of the alternatives
consist of different
Combinations of options. As
with “all of the above”
answers, a sophisticated
test-taker can use partial
knowledge to achieve
a correct answer.
Additional Guidelines
2. Keep the specific content of items independent of one
another. Savvy test-takers can use information in one question
to answer another question, reducing the validity of the test.