Increasing The STEM Pipeline Through Problem-Based
Increasing The STEM Pipeline Through Problem-Based
net/publication/267381600
Article
CITATIONS READS
14 121
5 authors, including:
Nicholas M. Massa
Springfield Technical Community College
33 PUBLICATIONS 102 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Nicholas M. Massa on 18 December 2014.
In “Problem Based Learning for Sustainable Technologies: Increasing the STEM Pipeline”
(STEM PBL), the principles of PBL are being used to develop innovative, standards-based
curricula with the aim of increasing students' interest and preparedness in pursuing STEM-
related careers. STEM PBL is a project of the New England Board of Higher Education and
is funded by the National Science Foundation. Currently, the project PIs are working with
industry collaborators breaking new ground in “green” technologies to create a
comprehensive series of online multimedia PBL resources focused on sustainability.
Referred to as “STEM PBL Challenges,” these instructional materials are designed to engage
secondary and post-secondary students in real-world problem-solving.
The project teams STEM teachers from high schools with faculty from two- and four-year
institutions of higher education from New England and across the country. In addition to
providing professional development in both on-site and online formats to in-service teachers,
the STEM PBL project will also create a model course in PBL methodology for pre-service
middle and secondary school teachers. As a capstone project, these pre-service teachers will
develop an original multimedia PBL Challenge on a STEM topic of their choosing. As a
result, a collection of STEM-related PBL learning tools will evolve and be disseminated
along with the details of the project and the results of research on its outcomes.
Introduction
Long-term growth in the number of positions in science and engineering has far exceeded
that of the general workforce, with more than four times the annual growth rate of all
If the U.S. is to maintain its competitive edge in the global economy, the pipeline of
interested and qualified students prepared to enter STEM careers must be increased. Yet
recent results from a survey by the American Society for Quality (ASQ) revealed that more
than 85% of students today are not considering careers in engineering and that more parents
encourage their daughters to become actresses than engineers. Forty-four percent of survey
respondents cited a lack of knowledge around engineering as the top reason they would not
pursue such jobs. Another 30% listed the “geek” perception as their top reason, indicating
that “engineering would be a boring career,” according to the ASQ [5]. This is one of the
most serious issues our nation will face over the next decade, as the current science and
technology workforce retires without a pipeline of workers to replace them.
Thus, improving the preparation of STEM teachers in the United States and the number of
effective teaching tools available to them is critical if American students are going to keep
pace with their counterparts internationally. Furthermore, the characteristics of instruction
that best serve diverse student populations is a research area of particular need [7].
Problem-Based Learning
Overwhelming evidence exists that students from all backgrounds have the capacity to
become proficient in math and science, and that children of all ages can and do engage in
complex reasoning about the world [8, 9]. The National Academies reported in its recent
publication, Taking Science to School: Learning and Teaching Science in Grades K-8, that
“Comparisons of science standards and curricula in the U.S. with that of countries that
perform well on international science tests reveal overly broad and superficial coverage of
science topics in U.S. classrooms … an overemphasis on recipes for data collection
One of the reasons for declining enrollment in many STEM programs is that students are
often turned off by the way these subjects are typically taught, with traditional classroom
lectures followed by “cook-book” type laboratory experiences that provide little opportunity
to actively engage in creative, real-world problem solving. In 2008, the National Academy of
Engineering identified “Advance personalized learning” as one of the “Grand Challenges for
Engineering in the 21st Century,” pointing out that “Throughout the educational system,
teaching has traditionally followed a one-size-fits-all approach to learning, with a single set
of instructions provided identically to everybody in a given class, regardless of differences in
aptitude or interest. … In recent years, a growing appreciation of individual preferences and
aptitudes has led toward more ‘personalized learning,’ in which instruction is tailored to a
student’s individual needs [10].”
Engineers and scientists are problem solvers— individuals who skillfully apply their
knowledge to tackle real-world problems by designing experiments, building and
troubleshooting prototypes, analyzing and interpreting data, and presenting experimental
results to peers, supervisors and customers. It follows that to attract more students into STEM
careers, students must be provided with more meaningful learning experiences in order to
motivate and excite them—learning-experiences that relate directly to the world in which
they live. They want and need active hands-on learning experiences that challenge them to
explore new and emerging technologies that provide opportunities to “think outside the box”
and apply their knowledge, skills and creativity in solving authentic real-world problems [11-
14]. Problem-Based Learning (PBL) is capable of providing this type of learning experience.
In PBL, students actively participate in their own learning by solving real-world problems in
which the parameters are ill-defined and ambiguous. Unlike traditional instruction in which
students attend lectures and solve well-defined end-of-chapter homework problems, PBL is
open-ended and contextualized, and student learning is driven by the problem itself. With
PBL, students learn the process of learning in addition to course content by engaging in a
systematic and iterative process that begins with problem analysis, carefully and
methodically dissecting a problem by reflecting on prior knowledge to identify knowledge
gaps, situational constraints, and other pertinent problem features required to formulate a
solution. Once the problem has been properly framed, students engage in self-directed
learning to acquire the knowledge and skills needed to solve the problem. This is followed by
PBL has been used extensively in medical education since the early 1970’s and research has
shown that PBL improves student understanding and retention of ideas, critical thinking and
problem-solving skills, motivation and learning engagement, and the ability to adapt their
learning to new situations [16-19]. While PBL has been adopted in other fields of higher
education including business and law, it is only beginning to emerge as an alternative to more
traditional approaches in K-12 STEM education. Though not abundant, results from studies
of PBL in K-12 STEM education are also promising. In a recent review article published in
the Journal of Engineering Education, Litzinger et al. state “it is clear that [engineering]
students would benefit from a greater number of opportunities to address authentic problems”
and recommend PBL as an instructional approach that can be used to achieve this goal [20].
Some research even suggests an increased likelihood that at-risk students will succeed
academically when provided with alternative learning environments such as PBL. A study of
girls at risk of failing middle school math or science showed that all study participants had
positive reactions to PBL, as evidenced by improvements in students’ learning processes and
self-efficacy [21]. A separate study compared the effectiveness of PBL and traditional
instructional approaches in developing high school students’ macroeconomics knowledge
and found PBL to be more effective overall [22]. Interestingly, the results from this study
also showed that PBL was particularly effective with students of average verbal ability and
below, students who were more interested in learning economics and students who were most
and least confident in their ability to solve problems.
While there is substantial evidence to suggest that PBL can be a valuable supplement to
traditional, lecture-based instruction, its effectiveness depends on a variety of factors
including variations in the implementation of PBL methodology and assessment of learning
outcomes, as well as teachers’ knowledge skills and attitudes towards PBL [23, 24]. A recent
case study described the outcomes of one high school science teacher’s exploration of PBL
methods in her classroom [25].
For many teachers who have not experienced new methodologies as teachers or
as learners, trying a new approach can be intimidating. If PBL is to become more
prevalent in K-12 contexts, assuming this is a desirable goal, then teachers will
need support and encouragement to try it. Deidre, who should be praised for her
willingness to try something new in support of her students' learning, was
uncomfortable with letting go of the control offered by her usual methods of
instruction. She overcame this barrier, but completed the project still questioning
the efficacy of PBL. Many teachers are driven to cover the curriculum, and
adopting this more time-consuming approach is not consistent with coverage.
Additional research into the factors affecting teachers’ adoption of PBL may prove valuable
in promoting more widespread use of this promising pedagogical approach.
To improve the readiness of teachers, including in-service and pre-service K-12 STEM
educators, to incorporate PBL into their instructional methodologies, the STEM PBL project
will build upon the successes of PHOTON PBL, a project of the New England Board of
Higher Education (NEBHE) that was launched in 2006. Funded by the National Science
Foundation (NSF), the PHOTON PBL project led to the development of eight multimedia
PBL “Challenges” which were created in partnership with photonics industry and university
partners and field-tested by more than 50 STEM educators from secondary and post
secondary institutions across the U.S.. The PHOTON PBL Challenges are self-contained
multimedia instructional modules designed to develop students’ problem solving ability and
understanding of photonics concepts and applications. The eight PHOTON PBL Challenges
are listed below and are currently available at NEBHE’s PBL web site
(http://pblprojects.org), along with an Implementation Guide for Teachers and several related
conference publications and resources which provide a complete description of this prior
work.
Results of pilot tests revealed that with increased experience with the PBL Challenges,
students’ conceptual knowledge and problem-solving ability improved markedly. While pre-
post measures of student content knowledge were not available for the study, instructor
observations and comparisons of student performance in aggregate using traditional measures
(homework, quizzes, and exams) for PBL students with performance of non-PBL students in
the past showed that PBL students performed at least as well as non-PBL students. Results
also revealed statistically significant increases in intrinsic motivation, self-efficacy, and
metacognitive self-regulation. Finally, results showed a statistically significant increase in
Building on the success of PHOTON PBL, the STEM PBL project will develop six
additional PBL Challenges focusing on sustainable technologies to bring real-world problem
solving experiences into an even broader range of STEM classrooms in an effort to develop
students’ critical thinking and problem solving skills and to expose them to the exciting
career possibilities in sustainable technologies. Professional development opportunities for
in-service and pre-service STEM educators will develop teachers’ capacity for incorporating
PBL instructional methods in their classrooms.
Four of the six STEM PBL Challenges have been completed and are listed below. The
remaining two are still in development.
Each PBL Challenge contains five main sections (Figure 1): (1) Introduction - An overview
of the particular topic to be explored; (2) Company/University Overview - An overview of
the organization that solved the problem to set the context of the problem; (3) Problem
Statement - A reenactment of an authentic real-world photonics problem as originally
Solution - A detailed description of the organization’s solution to the problem. The Problem
Discussion and Problem Solution sections are password-protected allowing instructors to
control the flow of information and pace of instruction. Each of the five main sections
contains additional information and resources (i.e., scripts, websites, spec sheets, etc.)
intended to guide the student through the problem-solving process. Designed to be
implemented using three levels of structure ranging from Structured (instructor led), to
Guided (instructor guided), to Open-ended (instructor as consultant), the PBL Challenges
provide the necessary scaffolding to assist students in the development of their problem-
solving skills through a developmental continuum. By allowing students to gradually
progress through the PBL Challenges along a developmental continuum, students can
develop the knowledge, skills, and confidence to take responsibility for their own learning.
Likewise, providing instructors with control over the learning process and user-friendly
technical and pedagogical resources make it easy to implement PBL in their classrooms.
Another unique feature of the PBL Challenges is the “Problem-Solvers Toolbox.” The
Problem Solvers Toolbox is a resource designed to help students develop a systematic
approach to problem solving through a four-stage recursive process as illustrated in Figure 2.
Figure 3. The STEM PBL Whiteboards for (clockwise from upper left) Problem Analysis,
Independent Research, Brainstorming and Solution Testing.
until they converge on an optimal solution. For instructional purposes, the Whiteboards can
either be printed or projected/copied onto an actual classroom whiteboard. (see Figure 4).
For instructors, a comprehensive “Teacher Resource” section is included (see Figure 5) that
provides technical background on the main concepts introduced, assessment strategies,
implementation stories detailing how other instructors at different educational levels have
implemented the PBL Challenge, a guide for standards alignment and a “PBL How-To
Video” illustrating the use of the PBL Challenges in the classroom.
Assessing student learning in PBL often presents a unique challenge for educators
accustomed to traditional assessment methods used in lecture-based instruction. The method
used to assess student learning in the PBL Challenges is based on a three-pronged “adaptive
Figure 6). A weighted average calculated for the three measures results in a final composite
score. Specific weights may be assigned by the instructor depending on the specific course
format.
To assess content knowledge, the PBL Challenges include a test bank consisting of multiple-
choice questions, closed-ended problems, and higher-level thought provoking questions
centered on specific technical content associated with the particular problem. Conceptual
knowledge refers to a student’s understanding of and relationship between key concepts
underlying a particular domain of knowledge. To assess conceptual knowledge, the PBL
Challenges include a list of main concepts related to the topic being explored, a reference or
“expert” concept map for instructors, detailed instructions for students on how to construct a
concept map, and a concept map scoring rubric. Assessing problem solving ability involves
both formative and summative assessments. Formative or in-process assessment is
accomplished via the Whiteboards. As students collaboratively engage a problem by
completing the four Whiteboards, they reflect upon and elucidate their current state of
understanding, their thought processes, and problem solving strategies. Research shows that
verbalizing the thought process while engaging in problem solving improves metacognition,
which is essential for effective problem solving [28]. Summative or post-process assessment
is accomplished through a Final Challenge Report. The Final Challenge Report is a reflective
journal that requires students to provide a detailed summary and critical analysis of the
problem-solving process employed in solving the PBL Challenge. Researchers maintain that
this final reflective exercise is essential in the development of effective problem-solving
skills [29]. A scoring rubric is provided to grade the Final Challenge Report.
Over the 2009-2010 academic year, thirty secondary, community college, and four-year
college and university in-service STEM educators were recruited nationwide to take part in a
15-week online course. The online course is being conducted in three 5-week sessions in fall
Experienced PBL instructors from the PHOTON PBL project have also enrolled in the
course as mentors who monitor discussions and provide guidance to new faculty. Course
participants work in small teams of 3-4 teachers to model the dynamics of how the PBL
Challenges will be used in their classrooms. Using Blackboard Vista® as a course delivery
platform, participants work to solve three STEM PBL Challenges, beginning with a
Structured format (Session I), then a Guided format (Session II), and finally an Open-ended
format (Session III) through threaded discussions and online chats. From session to session,
the participants are given greater autonomy as more responsibility is placed on them to self-
direct their own learning. The course structure, from highly structured to open-ended will
emulate the way instructors will use Challenges with their own students. Between online
class sessions, participants will collaborate with each other, PHOTON PBL mentors and the
STEM PBL project team to explore how best to incorporate the PBL Challenges into their
own classroom and curriculum.
Prior to the online course, a two-day introductory workshop was held in early fall 2010 at a
central location to acquaint participants with the online learning environment and the PBL
Challenges, and to create a learning community to foster online collaboration. All
participants were added to the PBL listserv; an email listserv managed by the New England
Board of Higher Education (NEBHE) and composed of a nationwide network of PBL
educators, educational researchers, and industry mentors. Employees of partner industries
and research universities also participate in the listserv to provide ongoing technical support
to educators.
Research Methods
As demonstrated by the literature cited previously, there is a great deal of evidence to suggest
that there are multiple benefits to be realized by using PBL. The research also shows,
however, that PBL requires time and effort in gaining acceptance and that more work is
necessary to improve teachers’ skills in facilitation and attitudes toward self-directed
learning. To address this need, the STEM PBL project is currently conducting quantitative
and qualitative research into teachers’ knowledge, skills and attitudes concerning PBL and
their self-efficacy with regard to its implementation. The project will also examine the extent
to which specific online professional development activities contribute to changes in teaching
practices (i.e., transfer of training) among participating in-service teachers and compare these
results with the outcomes of the pre-service course.
To accomplish this, the Motivated Strategies for Learning Questionnaire (MSLQ) will be
administered to the in- and pre-service teachers at the beginning and end of their respective
courses. The MSLQ is an online survey consisting of 81 statements regarding motivation for
learning and learning strategies to which students are asked to respond using a 7-point scale,
from 1 ("Not true of me at alI") to 7 ("Very true of me") [31]. The questionnaire, which takes
approximately 20 minutes to complete, will be customized in order to specifically assess
teachers’ perceptions of PBL. The results from the MSLQ surveys will be triangulated with
data from pre- and post-tests on PBL content knowledge as well as samples of course work
and comments from focus groups. Informed consent will be required of all participants.
Conclusion
In this paper, we presented the STEM PBL project, a three-year NSF-funded project aimed at
increasing the STEM pipeline through PBL focused on sustainable technologies. We
discussed how the STEM PBL project team, building on their prior work on the NSF-funded
PHOTON PBL project, is now working with industry and research universities breaking new
ground in sustainable and green technologies to create a comprehensive series of multimedia
PBL Challenges designed to engage students in real-world problem solving. A detailed
summary of the PBL Challenge model was presented as well as a description of the online
professional development course currently being offered over the 2010-2011 academic year
for in-service teachers in PBL instructional methods using the STEM PBL Challenges. We
also described the development of new classroom course in PBL instructional methods for
pre-service TEE teachers scheduled for implementation in spring 2011. Finally, we presented
a discussion on the research activities scheduled to take place to evaluate the efficacy of the
new multimedia STEM PBL Challenges with regard to the learning outcomes and transfer of
training among participating faculty.
[1] Report of the National Science Board Committee on Education and Human Resources
Task Force on National Workforce Policies for Science and Engineering, NSB 03-69.
2003. p. 61-61.
[2] Bureau of Labor Statistics, National Industry-Occupation Employment Projections
2004-2014. 2006, Department of Labor: Washington, DC.
[3] National Science Board, Science and Engineering Indicators, 2008. Volume 1. NSB-08-
01. 2008, National Science Foundation: Arlington, VA.
[4] Rising Above the Gathering Storm: Energizing and Employing America to a Brighter
Economic Future. 2005, National Academy of Sciences, National Academy of
Engineering and Institute of Medicine of the National Academies: Washington, DC.
[5] (2009) Mommas don't let their babies grow up to be engineers. ITworld. Accessed
February 13, 2009, http://www.itworld.com/career/62315/mommas-dont-let-their-
babies-grow-be-engineers.
[6] National Center for Education Statistics, International Outcomes of Learning in
Mathematics Literacy and Problem Solving: PISA 2003 Results From the U.S.
Perspective: Highlights. NCES 2005-003. 2004, U.S. Department of Education:
Washington, DC.
[7] Richard A. Duschl, Heidi A. Schweingruber, and Andrew W. Shouse, eds. Taking
Science to School:Learning and Teaching Science in Grades K-8. ed. C.o.S. Learning.
2007, National Academies Press: Washington, DC.
[8] Taking Science to School:Learning and Teaching Science in Grades K-8, R.A. Duschl,
H.A. Schweingruber, and A.W. Shouse, Editors. 2007, National Research Council:
Washington, DC.
[9] How People Learn: Brain, Mind, Experience, and School, C.o.D.i.t.S.o. Learning, et
al., Editors. 2000, National Research Council: Washington, DC.
[10] National Academy of Engineering: Grand Challenges for Engineering. Available from:
http://www.engineeringchallenges.org/.
[11] Strengthening the Science and Mathematics Pipeline for a Better America, in Policy Matters.
2005.
[12] M.J. Johnson and S.D. Sheppard, Students Entering and Exiting the Engineering
Pipeline – Identifying Key Decision Points and Trends, in Frontiers In Education
Conference. 2002.
[13] H. Kimmel and R. Cano, K-12 and Beyond: The Extended Engineering Pipeline in
Frontiers in Education Conference. 2001.
[14] T. Camp, The Incredible Shrinking Pipeline. Inroads: SIGCSE Bulletin, 2002. 34(2): p.
129-134.
[15] Howard Barrows, Is it Truly Possible to Have Such a Thing as dPBL? Distance
Education, 2002. 23(1): p. 119-122.
[16] J.R. Savery and T.M. Duffey, Problem-based learning: An instructional model and its
constructivist framework, in Constructivist learning environments: Case studies in
instructional design, B.G. Wilson, Editor. 1996, Educational Technology Publications:
Englewood Cliffs, NJ.
[17] H.S. Barrow, A Taxonomy of Problem-based Learning Methods. Medical Education,
1986. 20: p. 481-486.
Biographical Information
FENNA HANES is Senior Director of Professional & Resource Development for the New
England Board of Higher Education in Boston. She holds a B.S. degree in Liberal
Arts/Business Administration from Northeastern University and an M.S. degree in Public
Affairs from the University of Massachusetts.