Standards-Based Learning in Action CH 9
Standards-Based Learning in Action CH 9
Action
The genius of rubrics is that they are descriptive and not evaluative. Of course, rubrics can
be used to evaluate, but the operating principle is you match the performance to the
description rather than “judge” it.
—Susan M. Brookhart
The Research
The research we explore in the following sections focuses on making
criteria transparent, interpreting accurately, using student-friendly language,
moving from simple to sophisticated, choosing a format, and deciding
between general and task-specific criteria.
Interpreting Accurately
Clearly articulated criteria are also essential for teachers. Within a
criterion-referenced, standards-based learning environment, it is necessary
that teachers have (or develop) the confidence that the judgments they’re
making about students’ performances are similar to the judgments their
colleagues would make (Guskey & Jung, 2016). While this consistency in
applying success criteria (inter-rater reliability) takes time to develop, it is
important because so many standards require teachers to infer quality. There
is, for example, no completely objective way to assess argumentative
writing. There are aspects of quality, but success is a matter of interpretation
in which the teacher has to match the quality of the writing to the specific
level of qualities the criteria outline.
The research is mixed on whether teachers in general are skilled at
accurately summarizing student achievement. Some claim that teachers are
the best sources for judging student performances because they have more
experience with their students (Meisels, Bickel, Nicholson, Xue, & Atkins-
Burnett, 2001); however, others claim that an inability to distinguish
between student achievement and student traits can cloud teacher judgments
(Moss, 2013), especially when teachers are assessing students with diverse
backgrounds (Martínez & Mastergeorge, 2002; Tiedemann, 2002). If the
former is true, rubrics and scales will only strengthen that skill; if the latter
is true, then rubrics and scales are necessary to ensure achievement and
traits do not intermingle in the assessment process. According to Catherine
Welch (2006), reliable scoring rubrics must meet the following five
characteristics.
1. Be consistent with the decisions and inferences teachers make with
the results.
2. Define the characteristics of the response that teachers will evaluate
along a continuum.
3. Convey performance criteria in an understandable way.
4. Use items that elicit a range of performance.
5. Align with the content standards that teachers are assessing.
While rubrics and scales appear in a variety of structural formats, the
reliability of the scoring inferences derived from the rubric or scale is a
non-negotiable feature (Parkes, 2013).
Choosing a Format
While it is possible to use all rubric or scale formats for either formative
or summative assessment, an assessment’s function drives the most
favorable format to align an assessment with its subsequent action. Analytic
rubrics provide unique, separate descriptions on multiple aspects of
qualities for any given performance (Balch et al., 2016; Brookhart, 2013c).
This is advantageous for formative assessment because it asks for a more
granular analysis. Describing each criterion separately makes it easier for
teachers and students to recognize both strengths and areas in need of
strengthening. This can allow teachers to make instructional decisions that
help them differentiate what’s next.
Holistic rubrics, on the other hand, ask the teacher or student to make a
single overall judgment of quality along the performance levels (Balch et
al., 2016; Brookhart, 2013c). Rather than describing separately the aspects
of quality along each level, teachers would holistically describe each level
in its totality. This is advantageous for summative assessment because it
often requires a single determination despite some specific deficiencies.
Teachers do not ignore specific criteria; rather, they synthesize all the
criteria into a singular description that outlines what a novice through
exemplary demonstration might look like. While most teachers will likely
spend the majority of time using analytic rubrics, they optimize the
relationship between analytic and holistic rubrics when they use an analytic
rubric for instruction, and then synthesize it into a holistic rubric for
grading.
In Action
Teachers employ both proficiency scales and rubrics in standards-based
learning environments, but with slightly different definitions and uses.
Again, proficiency scales in this book are the holistically described levels
that teachers use to communicate proficiency across grade levels and
content areas. Proficiency scales tend to be applied school- or districtwide
to provide consistent language with the descriptors. Descriptor labels are
usually one or a few words. Rubrics, on the other hand, have more robust
descriptions. Rubrics are for particular assignments, assessments, or
specific standards to give feedback about the proficiency level. If a
descriptor for a level 3 is proficient, then a rubric for that standard or
standards would describe what proficiency looks like. This chapter helps
teachers understand and develop quality proficiency scales and rubrics.
Additional sections are devoted to inter-rater reliability and student
involvement.
Defining Success
No matter how many levels a scale or rubric includes, each must have a
clear and concise description. These descriptions foster a process for
teachers to guide not only their instruction but also practice and assessment
for students. They also prompt teachers to reflect, learn, and improve.
The description for a scale or rubric should be succinct. Lengthy text is
more difficult for students to consume or comprehend. In addition, long and
very detailed descriptors can close the door to the variety of ways a student
can show his or her mastery of the standards. When a description gives too
many specific details, students will only rise to that description. Clarity
versus specificity is an important distinction when writing success criteria.
Creating quality success criteria should move beyond quantifiable
requirements and guidelines of compliance to a true description of learning.
Requiring a specific number of words or pages in a paper does not ensure
proficiency because quantity and quality can be quite different; simply
writing seven pages does not mean the student has met the standard. Only a
minimal quantity of evidence may be necessary to reach proficiency and
receive feedback.
Proficiency Scales
Consider the scale in figure 9.1, which takes the levels and pairs them
with percentage-based increments.
Rubrics
Examine the rubric in figure 9.3, which lists requirements in checklist
style.
Figure 9.3: Low-quality rubric.
Figure 9.5 does not include descriptors for a 0 level, which many
schools and districts will include as a fifth level. This fifth level typically
indicates lack of evidence or insufficient evidence. Both communicate that
the teacher (and even the student via self-assessment) does not have enough
evidence to make a decision about proficiency. Insufficient evidence could
also be indicated as a 1 on a four-level scale. These descriptors can stand
alone for reporting or be paired with a number.
Regardless of whether the words or numbers will be used for reporting,
clear meaning and consistent application are paramount. Once developed
among teachers, a common understanding can be transferred to students and
parents. This proficiency scale language also guides rubric development,
with scale descriptors providing the overarching ideas for each proficiency
level.
Crafting Rubrics
For consistency, rubrics should contain the same number of levels as the
proficiency scale. Common sense dictates that having a different number of
levels between the scale and the rubric increases the potential for confusion
among students and parents.
Well-crafted rubrics, no matter in what content area or skill, have some
common characteristics. They use language that is positive (stating what the
evidence should look like instead of focusing on missing elements or
characteristics), as well as student friendly. Some explanation may be
necessary with examples of student work, but a rubric’s language should
not be a barrier to student understanding. When using the rubric, students
should be able to identify their current proficiency level and see what it
takes to move to the next level.
Teachers can generate two types of rubrics to use in the classroom.
Skill-specific rubrics can span multiple assignments, assessments, and units.
Teachers can most easily use them with standards that do not have specific
content tied to them. A language arts standard that requires students to cite
textual evidence can go with a rubric that the teacher uses each time he or
she addresses that standard. Other rubrics are specific to a particular content
area or unit of study. These provide a more detailed description of the
evidence that students produce with the content as a guide for the skill. An
example is a rubric that a teacher develops for a mathematics standard, such
as knowing the formulas for circumference and area of a circle and using
them to solve problems.
When creating a rubric, begin with the proficient level. Considering the
standard or standards and their essential verbs, describe what evidence
would look like to meet them. For some teachers, a rubric’s proficient level
is very similar to the standard itself. The next task is to work on the
surrounding levels (levels 4, 2, and 1 on a four-level scale). What would
evidence look like on a more complex level or if a student delved more
deeply? What would the evidence look like when a student is working
toward proficiency but has not yet achieved it? What would evidence look
like for a student in the beginning stages of learning with the standard?
The most difficult level for many teachers to describe on a rubric is the
most sophisticated level (a level 4, for example) of proficiency. What is a
4? looms large for some. There are a variety of ways to write the
description of a level 4 on a rubric. For example, examine student work on
a standard that is very high quality. Consider what characteristics of the
work make this so. Determine the level of sophistication given the cognitive
complexity and the students’ developmental stage. Another approach is to
illustrate how a student could transfer the knowledge and skill to a new
situation. An important consideration when writing the highest-level
descriptions on a rubric is that a larger quantity of work does not mean that
the student has shown a more advanced proficiency. Rather than upping the
number of requirements, change the demands or sophistication.
Figure 9.6 offers a rubric from a physical education class; it has four
proficiency levels and four standards. It is for the entire unit of study related
to dance that students will complete over multiple weeks.
Figure 9.6: Four-level rubric.
Visit go.SolutionTree.com/instruction for a free reproducible version of
this figure.
Figure 9.7 is from an ecosystems unit with one standard that the teacher
broke down into two skills. There are only three proficiency levels, and the
teacher has left the Excels level open for the first skill; the students are to
prove how they have created a model that moves beyond the proficient
level.
Source: © 2016 by K. Budrow. Source for standard: NGSS Lead States,
2013.
Figure 9.7: Three proficiency levels plus student participation.
Visit go.SolutionTree.com/assessment for a free reproducible version of
this figure.
Involving Students
Teachers should actively involve students with both proficiency scales
and rubrics. Both are created for students and teachers, so if a disconnect
exists, the scale or rubric has lost value. The rubric opens the discussion of
what is possible with the standard and makes plain the expectations,
increasing the opportunity to involve students from the outset.
Students can also help create rubrics. Doing so can increase their
understanding of the standards and help them consider what quality
evidence looks like. Teachers will still need to remain involved in the
process, as there will be times that the student knowledge base and
understanding are not developed enough to consider the variances in work
levels. Working together, students and the teacher can start the rubric and
then revise as student knowledge and understanding grow. Having the
students actively involved in writing rubrics will make self-assessment and
peer review opportunities more effective and efficient.
PERSONAL NARRATIVE
Katie Budrow
Sixth-Grade Science Teacher, Charles J. Caruso Middle School, Deerfield, Illinois
In my second year of teaching, one of my amazing mentors suggested that I look into
student-created assessment tools. Obviously, I had more than a few concerns as the
process got started. As it turns out, my fears were completely unfounded.
We started as a whole group, putting the standard at the top of a page and creating
boxes underneath for each level. Students developed the information in small groups,
reporting back to the whole class so we could capture it together. They debated over
details and fiddled with the wording. They argued over how to format the rubric,
suggesting that bullet points would be easier to read but sentences might be clearer.
They even asked if we could delete the lowest level, arguing that because they had the
opportunity to revise, nobody would end up at the bottom level anyway. They
questioned all kinds of things, like whether they should include neatness or if coloring
mattered. I would gently step in with a question and coach them back to the verbiage
of the standard when necessary, but for the most part, they ran the show. Eventually,
they would guide each other to reference the standard, and the healthy debate
continued.
After a lengthy conversation, we all came to a consensus. We had a good, solid rubric.
Not perfect, but good. We then repeated the process with the other three classes, and I
merged all those rubrics together to create a final one. To my surprise, all the classes
had a similar process and came up with similar results. I made a few small changes as
their four rubrics were bundled into one, but nothing major had to change. Their work
didn’t need it. When I presented it the next day, the rubric had more clarity and more
detail than anything I could have created alone.
However, what we didn’t know at the time was that first rubric really just ended up
being a rough draft. That was arguably the best part—the rubric wasn’t something
static. It was a living document, and we could change it at any time. It was ours. Not
my rubric full of my expectations, not the students’ rubric filled with whatever they
wanted, but our rubric that we owned.
Talking to Learners
Students may think that both scales and rubrics are for teacher use only,
which means they may not pay attention to their impact on their own
learning. Teachers need to help learners change their perception by
presenting scales and rubrics as shared tools that support learning. Often,
how teachers grade or what teachers are looking for is opaque at best,
which leaves students guessing. It is important for students to know that
there is no gotcha with the success criteria—what is outlined is what is
expected. Teachers reassure students that transparency leading to their
success is the goal, and that this is a we venture rather than a teacher versus
learner one.
Learners will ask questions about how the levels and rubrics translate to
grades. Share that while proficiency levels are a kind of grade per se, the
purpose of proficiency levels is not to equate levels to a percentage-based
score or contribute to accumulating points. Students must come to know
that a proficiency level is the description of evidence of learning in relation
to the standard. Although teachers may use them to determine a final grade,
students must know that their purpose is to describe what success with the
standards looks like.
Students need to know that scales and rubrics provide guidance
throughout the learning progression. If success criteria are unclear to
students, teachers must provide a means to better communicate them.
Whether it is showing quality work exemplars or changing the scale or
rubric to more student-friendly language, clarity is the priority. How to
progress through the different levels and understanding should be
straightforward so students can take ownership of their learning. Knowing
where their proficiencies lie and what the next level looks like motivates
learners to continue toward the goal.
Teachers who maintain a positive attitude when speaking about
proficiency scales and rubrics will transfer that to their students. Talk with
learners about the value of knowing success criteria from the beginning to
the end of a unit. When students can see that a rubric guides them through
the complex demands of the standards, it builds trust and students learn to
appreciate their value.
Figure 9.9 offers questions students might ask when it comes to
proficiency scales and rubrics and possible teacher responses.
Figure 9.9: Student questions and teacher responses about proficiency
scales and rubrics.
Talking to Parents
Once they have developed rubrics and scales, teachers share that
common understanding with parents. When talking to parents, it is helpful
to bring or show examples. A hands-on example is an effective way to
introduce what parents will potentially view as a new use for these tools.
Examples such as movie ratings and business ratings on websites like Yelp
(www.yelp.com) can show how scales are already present in their daily
lives.
Let parents know how they will find the scales and rubrics that teachers
will use—online, in a portfolio, or on paper. Sharing scales and rubrics
plays a huge role in facilitating effective parent involvement. Provide
parents with questions they can ask their children about their work and
where it currently falls. Sample questions follow.
• Can you show me what you are working on right now or tell me
about it?
• Tell me about the assignment’s requirements. What are the
assessment’s demands?
• Where would you place your work on the scale or rubric right now?
• What can you do to improve your proficiency and show it?
Once the teacher scores the evidence of learning, he or she can share it
with parents. This sharing can be facilitated by the student or teacher. For
example, a teacher can have students go home and talk with their parents
about their learning and proficiency levels, and to hold them accountable,
the parents can email the teacher with a quick summary of the discussion.
Not everyone will participate, but teachers expect students to go home and
talk about their learning.
If teachers will report rubric and scale levels as grades, communicate
that process as well. Parents need to know that if their child claims to not
know why his or her score is at a certain level, they can counter and
facilitate a productive conversation.
OceanofPDF.com