CSCapacity PDF
CSCapacity PDF
Since the 1970s, the number of students graduating with bachelor’s degrees in computer
science has fluctuated significantly. As shown in Figure 1, computer science degree
production in the United States has experienced two episodes of rapid increase followed
in each case by a precipitous collapse. The first peak occurred in 1986, the second in
2005, and we are once again on a steep upward trajectory, which began in 2009.1
If you look at the graph in Figure 1, the first conclusion that jumps to mind is that
student interest in computer science is cyclical. That interpretation, however, is
insufficient. Most importantly, it fails to recognize the fact that the downturns in the mid
1 Unfortunately, the most recent digest from the National Center for Education Statistics includes data only
through 2012. To offer a more informative picture of the current situation, Figure 1 uses growth rates
recorded in the Computing Research Association’s Taulbee surveys to estimate the broader numbers for
2013 and 2014.
–2–
1980s and the early 2000s happened for different reasons. The more recent downturn
was clearly caused by the dot-com collapse. After the tech bubble burst in 2001, student
interest in computer science waned throughout the United States, a downturn exacerbated
by a popular mythology suggesting—entirely contrary to fact—that all jobs in technology
were about to be shipped offshore to low-wage countries like India and China.
The earlier collapse in the mid 1980s was very different in its origins. The cause of
that decline was the inability of universities to attract enough faculty to meet growing
student demand. Beginning around 1984, most computer science departments were
forced to limit course enrollments and to restrict admission to the computer science
major. These actions led in turn to a steep decline in degree production a few years later.
In order to make any useful predictions about the likely outcome of the current
expansion, it is essential to undertake a more detailed analysis of the reasons for the
variations in degree production that computer science has experienced in the past. To
understand the history from a national perspective, it makes sense to analyze the three
peak periods independently, which gives rise to the following three questions:
The first boom-and-bust cycle in academic computer science began with a steady rise in
bachelor’s degrees throughout the 1970s, which became more rapid at the end of the
decade. This dramatic rate of increase continued until sometime around 1984, when the
number of students entering the field reached its peak. The peak was followed by a
decline in degree production that eventually flattened out in 1994, when degree
production was down by 42 percent from its earlier high. These statistics are illustrated
in Figure 2, which extracts the relevant years from Figure 1 and adds labels showing the
most likely explanations for the changes in direction.
The rapid increase in student demand at the beginning of the cycle is easy to explain.
The late 1970s and early 1980s saw the introduction of the personal computer, which
brought many more people into contact with computing. With the release of the Apple II
in 1977 and the IBM PC in 1981, a large number of prospective college students had
access to computing for the first time in history. The excitement associated with the
advent of personal computers coupled with the widespread availability of well-paying
jobs in computing drew many students into the field.
The cause of the decline in student numbers that began in 1984 is more difficult to
explain. The excitement that fueled the boom was, after all, still growing. January 1984,
for example, marked the release of the Macintosh, heralded in Apple’s Super Bowl
–4–
commercial as “the reason that 1984 won’t be like 1984.” Although the overall U.S.
economy experienced a small recession beginning in 1981, that downturn had a minor
effect on the technology sector. In an article published by the Bureau of Labor Statistics
in 1985, economist John Burgan noted that “employment declines in high-tech industries
were not as deep as those in manufacturing” and that, in particular, those companies with
the largest concentration of highly skilled technical workers were the only ones that
outperformed the rest of the economy.2 There seem to be no economic or technical
reasons to explain a collapse of student interest beginning in 1984.
If one looks closely at the downturn of the 1980s, however, it quickly becomes clear
that the reasons for the collapse in student enrollments had nothing at all to do with
student interest. Student demand for computer science courses and degrees remained
high throughout that period. Students in the mid 1980s did not decide against majoring in
computer science but were instead prohibited from doing so by departments that lacked
the resources to accommodate them.
I believe that what happened in the 1980s is best described as a capacity collapse in
which universities and colleges were simply unable to satisfy the growing level of student
demand. Departments tried a number of strategies to increase their teaching capacity,
including retraining faculty from other disciplines and hiring adjunct faculty from
industry. In the end, however, demand overwhelmed capacity, and colleges and
universities were forced to restrict admission to the computer science major, which gave
rise to the subsequent downturn.
The sections that follow examine the history of this capacity collapse in more detail.
The challenges facing computer science in the 1980s were widely recognized at the
time. Rising enrollments and the shortage of qualified faculty were a central focus of the
fourth Snowbird Conference in 1980.3 The discussions at Snowbird led to a report
entitled A Discipline in Crisis, which was published in the June 1981 issue of
Communications of the ACM. That report begins with the following sentences, which
offer a succinct review of the problem:
2 John Burgan, “Cyclical behavior of high-tech industries,” Monthly Labor Review, May 1985.
3 The Snowbird Conferences are a biennial gathering for the chairs of computer science departments in
research universities. These conferences are sponsored by the Computing Research Association, which was
called the Computer Science Board prior to 1990.
–5–
The report goes on to outline the problems faced by the 83 Ph.D.-granting institutions
included in the Taulbee surveys. All participants agreed that finding faculty to satisfy the
growing demand was a critical challenge. In 1979, for example, American and Canadian
universities produced only 248 Ph.D.s in computer science. The report then noted that
“fewer than 100 of these Ph.D.s chose academic careers, and they had over 650 academic
positions from which to choose.” In other words, there was approximately one applicant
for every seven advertised positions, at least in terms of the new-Ph.D. pipeline. Six of
those seven positions would either go unfilled or be offered to a candidate with less
educational preparation or a degree in another field.
Although the numbers today are of course much higher, reading this assessment from the
early 1980s creates a clear impression of déjà vu.
The community’s awareness of the looming capacity crisis deepened over the next few
years. The Snowbird Conference in 1982 led to the preparation of a new report entitled
Meeting the Crisis in Computer Science, which appeared in Communications of the ACM
in December 1983. Although this follow-on report identified some encouraging signs, it
concluded that “the basic critical situation had not yet been ameliorated. Ph.D.s in
–6–
computer science are still being produced at about 250 per year, while the demand is still
about five times that. The number of undergraduates entering computer science
departments continues to increase, and the number of unfilled computer science faculty
positions is greater than in 1980.”
The last sentence of this paragraph raises the specter of precisely the sort of enrollment
caps that computer science departments were forced to institute beginning around 1984.
Over the next few years, the National Science Foundation continued to assess the
problem of shortages in key technical specialties, including computer science. In 1982,
NSF staffer Kent Curtis presented a report to a meeting of the Computing Research
Board on the labor shortages facing computer science. I believe that the insights Curtis’s
report offers for the situation in the 1980s are of such direct relevance today that I have
scanned his report (previously available only in an extremely poor photocopy) and made
–7–
it available on my web site under its original title, Computer Manpower—Is There a
Crisis? Curtis’s report argues that academic computer science faces special challenges.
Let us consider the conundrum facing the computer field in higher education
first. It is experiencing an exponentially increasing demand for its product with
an inelastic labor supply. How has it reacted? . . . 80% of the universities are
responding by increasing teaching loads, 50% by decreasing course offerings
and concentrating their available faculty on larger but fewer courses, and 66%
are using more graduate-student teaching assistants or part-time faculty. 35%
report reduced research opportunities for faculty as a result. In brief, they are
using a combination of rational management measures to adjust as well as they
can to the severe manpower constraints under which they must operate.
However, these measures make the universities’ environments less attractive for
employment and are exactly counterproductive to their need to maintain and
expand their labor supply. They are also counterproductive to producing more
new faculty since the image graduate students get of academic careers is one of
harassment, frustration, and too few rewards.
A month later, The Chronicle of Higher Education followed up the earlier article with
an essay by Stanley Pogrow at the University of Arizona in which he points out that the
situation facing several applied disciplines is new in the history of academia.5
In previous times, fields that were experiencing rapid expansion of knowledge
generally found it easy to attract new faculty members, and fields where jobs
were plentiful found it easy to attract graduate students. This is no longer true.
A number of fields in applied science, such as computer science, physics, and
electrical engineering, where knowledge frontiers are being rapidly extended,
are experiencing increasing numbers of unfilled faculty positions, a reduced
aging faculty, and declining graduate enrollment.
4 Jack Margarrell, “As students flock to computer science courses, colleges scramble to find professors,”
The Chronicle of Higher Education, February 9, 1981, page 3.
5 Stanley Pogrow, “In an information economy, universities and business compete for workers,” The
Chronicle of Higher Education, March 16, 1981, page 64.
–8–
universities and colleges were forced to adopt other strategies to build their teaching
capacity. These strategies included
All these strategies are described in papers presented at the leading conferences in
computer science education at the time. The strategy of increasing teaching loads is
self-defeating, as indicated in Kent Curtis’s admonition that such measures “make the
universities’ environments less attractive for employment and are exactly
counterproductive to their need to maintain and expand their labor supply.” Hiring
part-time and adjunct faculty was at best a short-term solution that proved difficult to
implement. Given the shortage of computing talent in the industry, adjunct faculty were
also in short supply.
The strategy that had the most significant long-term effect on computer science
education was faculty retraining. Starting in the early 1980s, a number of universities
including the University of Massachusetts, the University of South Carolina, Ohio State
University, Kent State University, the University of Evansville, Brooklyn College,
Clarkson University, California State University at Fresno, Central State University in
Oklahoma, Memphis State University, and James Madison University began to offer
programs to retrain faculty from other disciplines to teach computer science, at least at
the introductory level. These programs are described in an article that appeared in The
Chronicle of Higher Education in July 1984, which begins as follows:6
Nearly 400 faculty members in mathematics, physics, chemistry, and a host of
other disciplines—scientific and nonscientific—are going to colleges and
universities this summer to learn to teach computing.
Some of them see retraining in computer science as an opportunity to move
into an exciting, growing field. Others are getting formal training in courses
they already teach. Still others are going because they recognize—or have been
told—that the future in their present fields is bleak.
The Chronicle article found that the length of the faculty training programs varied
from a high of three part-time years to a low of two weeks. The latter figure “raised
eyebrows” and prompted the author of the article to ask the question, “Can two weeks be
as effective as three years in training a faculty member to teach a computer course?”
William Weber, chairman of the computer science department at Southeast Missouri
State University, admitted that such short programs could of course not be as complete
but added that universities faced no other choice. As the article describes,
None of the 13 faculty members in his department have a doctorate in computer
science. “We couldn’t afford them if they did,” he says. Instead, the university
made a commitment to retraining.
6 Judith Axel Turner, “Growing demand for computer courses spurs retraining of college teachers,” The
Chronicle of Higher Education, July 11, 1984, page 23.
–9–
Although faculty with formal training in computer science remained dominant at the
research universities, faculty members from outside the field, often with minimal training
in computer science, soon filled most of the positions in less prestigious universities and
liberal arts colleges. As I wrote in an article that appeared during the enrollment boom of
the late 1990s (and which reviews the strategies used during the 1980s in more detail than
I do in this section), I am convinced that “academic computer science could not have
survived were it not for the willingness of some faculty to move to a new field. For the
most part, those who migrated to computer science were extremely conscientious about
acquiring the expertise they needed to teach in their adopted discipline. Their efforts
sustained computer science education at many institutions and helped reduce the impact
of the earlier crisis.”7 Even so, the fact that so many computer science faculty came from
outside the field had profound implications for academic computer science that continued
through the next enrollment cycle.
During these years, I was chairing the newly formed Department of Computer Science
at Wellesley College. Although we were more fortunate than many colleges in that we
were able to attract a few applicants in response to our searches, making actual
appointments remained a near impossibility. In 1982-83, Wellesley made six offers
before finding someone who would take the position. Most of our candidates accepted
competing offers elsewhere at higher salaries, both from industry and academia.
Unfortunately, hiring one person in that year was insufficient to keep up with the
increasing student interest in the computer science major. In 1983, Wellesley decided to
restrict access to the major, accepting only students who met a minimum GPA threshold.
Although limiting access to the major did reduce class sizes, it was not effective in
meeting the more general goal of improving working conditions for the faculty.
Enrollment limitations are, naturally enough, unpopular with students—and with their
parents. Imposing such restrictions makes the relationship between faculty and students
adversarial, causing students to become more competitive and, in many cases, angry.
Teaching became considerably less enjoyable, and I ended up leaving Wellesley for a
research lab.
7 Eric Roberts, “Conserving the seed corn: reflections on the academic hiring crisis,” SIGCSE Bulletin,
December 1999, page 4.
– 10 –
The imposition of GPA thresholds and other strategies to reduce enrollment led
naturally to a change in how students perceived computer science. In the 1970s, students
were welcomed eagerly into this new and exciting field. Around 1984, everything
changed. Instead of welcoming students, departments began trying to push them away.
Students got that message and concluded that they weren’t wanted. Over the next few
years, the idea that computer science was competitive and unwelcoming became
widespread and started to have an impact even at institutions that had not imposed
limitations on the major.
– 11 –
In many ways, the second installment in the boom-and-bust history of computer science
is easier to explain than the first. The growth in interest that began in the mid 1990s
coincided with the advent of the web and the elimination of commercial restrictions from
the Internet. These developments ushered in a period of frenetic growth in the computing
industry generally referred to as the dot-com boom or, when it is important to emphasize
its ephemeral nature, the dot-com bubble. The excitement generated by both the new
technologies and the opportunities provided by the startup culture attracted many students
back to the field. In the years of flat enrollments between 1991 and 1996, departments
had been able to rebuild their faculties, which meant that there was capacity—at least at
the beginning—to accommodate a rise in student numbers. When the tech bubble burst
in 2001, students began to move away from computer science, which led in turn to a
multiyear decline. Figure 3 shows the rise and fall during this cycle of history.
Even though the causes of both phases of this cycle are easy to identify, it is still worth
considering this period of history in more detail. From 1997 to 2003, the number of
computer science graduates rose by an average of 15 percent per year, with many
institutions seeing considerably larger increases. That rapid rate of growth raised echoes
of the expansion of the early 1980s. Several committees were formed to study the
problem in the hope that academic computer science could avoid the meltdown it had
suffered a decade and a half before.
– 12 –
In 2000, academic computer science did avoid a meltdown, but not for any reason one
would like to repeat. In a perverse sense, academia got lucky. The industry collapsed
first. Had it not done so, it seems likely that capacity limitations would have forced
universities to restrict enrollment, with all the negative consequences that the field
endured in the late 1980s.
The aspect of the collapse in the early 2000s that seems hardest to explain is why
things took so long for student interest to recover. The industry bounced back very
quickly and was hiring at the pre-crash rate by 2004. The student numbers, however, did
not start to rise substantially until after the subprime mortgage crisis in 2007. Somehow,
a meme arose in the public consciousness in the form of a widespread belief that
computing jobs were in danger of imminent collapse, either because they would be
automated out of existence or because all software development jobs would be shipped
offshore. Although there was no evidence to justify those fears—and ample data to
refute them—that mythology kept students out of computer science until disaster struck
in a different sector of the economy.
The sections that follow look more closely at the effect of the dot-com expansion on
academic capacity and the failure of student interest to recover even after the dot-com
collapse had passed.
During those years, the situation facing computer science departments corresponded
closely to the rapid expansion of the early 1980s and generated a similar set of pressures.
Along with the double-digit annual growth in student numbers, departments faced a
shortage of available faculty. In the December 1998 issue of the SIGCSE Bulletin, Paul
Myers and Henry Walker published a review of academic hiring, which concluded that
there was “a very serious shortage of new Ph.D.s in computer science,” to the point that
in 1997-98 “only about half of the open tenure-track positions were filled.”8 While that
level of undersupply falls far short of the seven-positions-for-every-applicant crisis of the
1980s, it nonetheless generated considerable concern, not only in university departments,
but also in the media, industry, and government.
In 1999, the Computing Research Association published a report entitled The Supply of
Information Technology Workers in the United States, detailing the shortage of workers
in both industry and academia. The report observed that academic institutions faced a
8 Paul Myers and Henry Walker, “The state of academic hiring in computer science: an interim review,”
SIGCSE Bulletin, December 1998, page 32.
– 13 –
As was true in the mid 1980s, the problems of faculty recruitment were noted by the
media. In September 1999, The Chronicle of Higher Education included a news story
entitled “Computer scientists flee academe for industry’s greener pastures” that begins
with the following evocative paragraphs:10
Just as he prepared to leave Cornell University last spring to help start a new
high-technology company, Thorsten von Eicken got word that the computer-
science department at Cornell had voted to grant him tenure.
He left anyway.
Mr. von Eicken is part of a stampede of bright, young Ph.D.s in computer
science who are abandoning academe for the corporate world.
High-paying, fast-paced jobs in the computer industry are attracting both
seasoned academics and newly minted Ph.D.s who, in the past, would have
opted for careers in higher education. The upshot: Computer-science and
computer-engineering departments are suffering a serious shortage of professors
at a time when undergraduate enrollments are booming.
Many departments are losing professors faster than they can hire them. The
University of Illinois at Urbana-Champaign recruited five new professors in
electrical and computer engineering to start this fall, but lost five others who
were already on its faculty. The University of Washington recruited four
scholars to its department of computer science and engineering but lost five.
Cornell hired three but lost six.
The difficulty of faculty recruitment was also picked up by The New York Times,
which ran an article entitled “Computer science departments are depleted as more
professors test entrepreneurial waters” on August 9, 2000.11 The article quotes Ed
Lazowska, then chair of the Computer Science and Engineering Department at the
University of Washington, as follows:
It is difficult to hold a computer science department together these days. You’d
like to keep a lot of that entrepreneurial energy here. Faculty recruiting and
retention are difficult. Ten years ago, industrial research labs were the enemy;
now it’s the lure of startups.
9 Peter Denning, “Eating our seed corn,” Communications of the ACM, June 1981, page 341.
10 Robin Wilson, “Computer scientists flee academe for industry’s greener pastures,” Chronicle of Higher
Education, September 24, 1999, page A16.
11 Rebecca S. Weiner, “Computer science departments are depleted as more professors test entrepreneurial
waters,” The New York Times, August 9, 2000.
– 14 –
In 2001, the National Academies released a major study entitled Building a Workforce
for the Information Economy that looked broadly at the questions of the computing and
information-technology workforce, including several issues concerning education. At the
request of the study panel for the National Academies and with the endorsement of the
ACM Education Board, I submitted a white paper that focused on how the shortage of
faculty candidates was making it impossible for universities and colleges to meet the
demand from employers for graduates with the necessary level of expertise.12 That white
paper was cited several times in the final report, which issued the following conclusion
with respect to higher education:
The academic research enterprise in IT continues to be strong, but industry and
academia are competing for the same small pool of highly productive, creative
individuals. Ph.D. production and faculty recruitment and retention are both
threatened by the lure of the commercial sector. Some faculty and graduate
students are leaving academia for better-compensated positions in industry;
others leave because only industry (especially start-ups supported by venture
capital) offers them the opportunity to pursue their intellectual and research
interests. . . . Compared to the benefits to be found in industry and start-ups,
academic life—with the attendant burdens of low salaries, teaching, and the
need to obtain grant support—is increasingly seen as unattractive to many
graduate students. The long-term significance of these perceptions is at present
unclear, but they do not bode well for the long-term health of the IT field.
Although many of the discussions that led to the National Academies report took place
in 1999 and 2000, the final version was not released until 2001. By that time, the
situation in the computing industry had changed entirely. The speculative bubble that
had fueled the growth of a vast array of dot-com companies collapsed, and the industry
went into a tailspin. The NASDAQ composite index—which had risen from 740.47 at
the beginning of 1995 to a high of 5,132.52 on March 10, 2000—collapsed to 1,108.49
by October 10, 2002. With that collapse, investors lost trillions of dollars, the wide-open
job market of the late 1990s disappeared (if only for a couple of years), and students who
had been lining up to major in computer science, like many faculty members and
graduate students before them, started to look for greener pastures.
What is paradoxical about the downturn in student interest is that it persisted for many
years after the industry had fully recovered. While there was a small dip in overall
employment in the information-technology sector between 2000 and 2002, employment
12 Eric Roberts, “Computing education and the information technology workforce,” SIGCSE Bulletin, June
2000, page 83.
– 15 –
numbers quickly surpassed their pre-crash levels. By 2005, employment prospects for
students completing a bachelor’s degree in computer science and other specialties in
information technology were considerably better than they were for students in any other
discipline. That conclusion is underscored in the following excerpt from a December
2005 publication from the National Science Foundation:13
Continuing a pattern that has been evident for decades, recent bachelor’s and
master’s engineering graduates and computer science graduates at the bachelor’s
level are more likely than graduates in other fields to be employed full time after
graduation, and upon entering the workforce, they are rewarded with higher
salaries.
These conclusions from the Bureau of Labor Statistics were echoed in the popular
press. In May 2006, Money magazine rated “software engineer” as the best job in
America on the basis of a combination of factors including salary, job availability,
potential for growth, flexibility, and creativity.14
One of the best analyses about the shortage of software professionals appears in a talk
by John Sargent, Senior Policy Analyst at the Department of Commerce, which he
presented at the CRA Computing Research Summit in February 2004.15 Although the
entire presentation is worth viewing—in part because it is striking how little things have
changed over the past decade—the talk is particularly memorable for the slide that
appears in Figure 4, which combines data on degree production from the Department of
Education with job projections from the Bureau of Labor Statistics.
13 National Science Foundation, “Recent engineering and computer science graduates continue to earn the
highest salaries,” InfoBrief, December 2005.
14 Money magazine, “Best jobs in America,” May 2006.
15 John Sargent, “The adequacy of the U. S. science and engineering workforce,” CRA Computing
Research Summit, February 23, 2004.
– 16 –
Because of its unusual effectiveness, several people have updated this slide as new
releases of the relevant data become available. The most recent version I’m aware of was
created by my colleague Phil Levis and is available from
http://csl.stanford.edu/~pal/ed/. The take-home message of the graph, however,
has remained constant over the past decade: universities are producing far too few
graduates in computer science to meet industry demand.
The bar that towers over the other data points in Figure 4 makes it immediately clear
that the number of jobs in computing-related disciplines far exceeds the number of
students trained in those fields. If students were responding to market forces, the
imbalance between degree production and job growth would have sparked a stampede
toward computer science. That stampede did not happen. Despite the many economic
advantages available to those with computer science degrees, students shied away from
the field until after the subprime mortgage crash in 2007.
The reasons behind the lingering unpopularity of computer science during the 2000s
are complex. The factors certainly included memories of the pain associated with the
collapse of the dot-com bubble and a widespread fear that computing jobs would soon be
shipped offshore to low-wage countries. The fear of offshoring was particularly intense,
even though a 2006 ACM report entitled Globalization and Offshoring of Software found
no evidence that software jobs were disappearing in developed countries. In fact, the
report found that “despite a significant increase in offshoring over the past five years,
more IT jobs are available today in the U.S. than at the height of the dot-com boom” and,
moreover, that “IT jobs are predicted to be among the fastest-growing occupations over
the next decade.”16
An interesting illustration of the disconnect between the available economic data and
popular perception appears in the online response to a keynote address at the CIO
Leadership Conference by Maria Klawe, then Dean of Engineering at Princeton
University, with the title “Blue skies ahead for IT jobs.”17 The abstract for Klawe’s talk
reads as follows:
Contrary to popular belief, career opportunities in computer science are at an
all-time high. We’ve got to spread that message among students from a rainbow
of backgrounds, or risk becoming a technological backwater.
The comments that Klawe’s talk elicited—which have, unfortunately, vanished along
with the original website at CIO Magazine—ran at least ten-to-one against her
assessment of the sunny outlook for the field. Here are a few typical reactions that I
downloaded at the time:
16 William Aspray, Frank Mayadas, and Moshe Y. Vardi (editors), Globalization and Offshoring of
Software: A Report of the ACM Job Migration Task Force, Association for Computing Machinery,
February 2006.
17 Maria Klawe, “Blue skies ahead for IT jobs,” CIO Leadership Conference, Boston, MA, May 8–10,
2006.
– 17 –
• All this talk about “Blue Skies” ahead just can’t hide the stark fact that Americans who
don’t wish to migrate to India and/or some other offshore haven are going to have a
difficult career.
• Why would any smart American undergrad go into IT when companies like IBM and
HP are talking of stepping up their offshoring efforts in the coming years? They want
cheap labor, no matter the real cost.
• I think the latest figures from the U.S. Department of Labor are not correct.
The last of these comments, which is quoted in its entirety, seems particularly telling.
The reader offers no alternative data, just a deeply seated belief that the optimistic
forecasts of the Labor Department must be wrong. Evidence counted for little in this
debate.
Ironically, popular fears about the tenuous future of the discipline were in some cases
encouraged by comments from within the academic community. In July 2008,
Communications of the ACM published a debate about future directions for the
technology curriculum.18 Professor Stephen Andriole at Villanova University predicted
that the need for programmers would soon diminish:
Of course there will be programming jobs for our students. But the number of
those jobs will decline, become more specialized, and distributed across the
globe. . . . Today, Fortune 1000 companies have far fewer programmers than
they did because of the rise of packaged applications and the labor-rate-driven
sourcing options they now have. This trend will accelerate resulting in fewer
programming jobs for our students. Should we continue to produce more
programmers?
In my response, I argued that Andriole was looking only at one sector of the
technology industry and that the number of jobs across the industry as a whole would
continue to rise, in line with the predictions from the Bureau of Labor Statistics. In
recent years, the sustained increase in the number of software jobs makes it clear that my
analysis was closer to the mark.
Although I never published an analysis of the reasons why students continued to stay
away from computer science long after the industry recovered, I did prepare a report for
the ACM Education Board, which considers this paradox in more detail.19
18 Stephen J. Andriole and Eric Roberts, “Point/counterpoint: Technology curriculum for the early 21st
century,” Communications of the ACM, July 2008, page 27.
19 Eric Roberts, “Understanding the paradox: strategies to rebuild student interest in computing,”
presentation to the ACM Education Board, August 22, 2008.
– 18 –
Since 2007, the number of students taking computer science courses and declaring
computer science majors has been rising rapidly. To a large extent, the expansion mirrors
the earlier expansionary periods that occurred from 1979 to 1984 and from 1994 to 2001,
in the years just before the preceding crashes. In particular, the factors fueling the
increase in student interest are similar. The last seven years have been an extremely
exciting time in computer science, with the proliferation of computing into ever more
facets of everyday life. The ubiquity of smart phones and the applications that run on
them, the enormous successes in machine learning, the rise of big data, and so many other
advances all make computer science extremely attractive. Moreover, the seemingly
boundless opportunities for employment that computing careers offer—particularly when
coupled with the enormous uncertainty facing other aspects of the economy—are certain
to draw more students into computer science, just as those same factors have in the past.
The sections that follow trace the dimensions of the current expansion and its likely
consequences, exploring both the similarities and the differences from the earlier cycles.
More recently, Ed Lazowska from the University of Washington, Jim Kurose at the
National Science Foundation (on leave from the University of Massachusetts), and I have
20 Eric Roberts, “Meeting the challenges of rising enrollments,” ACM Inroads magazine, September 2011,
page 4.
– 19 –
given joint talks in various venues about the growing capacity problem, including the
NSF Future Directions in Computer Science Education summit in January 2014, the
National Center for Women in Information Technology summit in May 2014, and the
Computing Research Association’s biennial conference at Snowbird in July 2014. The
slides from our presentation, entitled “Tsunami or sea change?: Responding to the
explosion of student interest in computer science,” offer an overview of the capacity
crisis and are available from http://lazowska.cs.washington.edu/NCWIT.pdf. The
slides document the rapid growth in the number of computer science majors at several
leading research institutions, both public and private, as shown in Figure 5.
The expansion seen at these institutions is even more rapid than aggregate statistics
show because many universities insulate themselves from changes in demand by
controlling admissions to the major. For example, institutions like Carnegie Mellon and
the University of Washington experience lower variability because those institutions
admit students directly into the computer science program. The number of applicants
changes along with the national pattern of student interest, but the number of students
actually admitted remains much more stable.
The slides also document the continued strength of the job market for graduates with
strong computational backgrounds. Figure 6, for example, shows the projections from
the Bureau of Labor Statistics for job growth and job openings (job growth plus
replacement) for the STEM (science, technology, engineering, and mathematics) sectors
of the economy from 2012-22. By both measures, most of the employment growth over
the decade is in the computing disciplines, which account for 71 percent of job creation
and 57 percent of job openings in STEM.
– 20 –
The “Tsunami or sea change” presentation ends with the warning that “we have seen
this movie before, and it wasn’t pretty.” In previous cycles, “universities did not respond
adequately,” increasing the importance of doing a better job this time around.
Although the ratio of applicants to open positions is less than the one-in-seven shortfall
of the early 1980s, the number of unfilled positions is significantly larger in absolute
terms. If the number of Ph.D.s is sufficient to fill only a quarter of the open positions,
then the number of positions that cannot be filled from this pool is around 750. Unlike
other fields, computer science has no reserve labor force in the form of Ph.D.s who
received their degrees in prior years but who have been unable to find positions. Some
21 Stuart Zweben and Betsy Bizot, “2014 Taulbee survey,” Computing Research News, May 2015.
– 21 –
positions, of course, will attract faculty members from lower-ranked institutions who
“trade up” to more prestigious employment. That flow of existing faculty up the ladder
of institutional prestige, which is usually referred to as churn in discussions of the
academic labor market, means that some of the 750 open positions will indeed be filled,
but only in a way that leaves vacancies in other institutions that will have to be filled in
future years. The only way to ensure stability is for the number of new faculty entering
the workforce to keep pace with the rate of departures and the growth of the field.
Given the uncertainties of economics, it is clear that the answer to the second question
is no: there is no way to predict with confidence exactly how economic forces will play
out in the high-tech industry and how those forces will affect enrollment patterns. Many
analysts believe that the situation in the technology sector is substantially different from
the “irrational exuberance” of the dot-com bubble. As The Economist reported on
July 25,22
Greed, profligacy, tiny companies with outlandish valuations: it is not hard to
detect echoes of the turn of the century, when the dotcom bubble burst
spectacularly and America’s economy stumbled as a result. But to see history as
about to repeat itself is to miss how deeply things have changed. Today’s
technology businesses are selling services and products from which they already
generate income, rather than just saying that one day they might. And the group
of people doing the investing is much smaller now than it was then. The risks
are on fewer shoulders.
There is, however, a reasonable interpretation of history that makes the differences in
the mid 1980s and the early 2000s less important. Rather than looking at the character of
the downturns, I believe it is more productive to focus on the pace of the enrollment
increases that preceded those periods of collapse. In the early 1980s, the late 1990s, and
again today, computer science departments face a rate of expansion that is much faster
22 “To fly, to fall, to fly again,” The Economist, July 25, 2015.
– 22 –
Stein’s principle does not tell us how an unsustainable phenomenon will stop, only that it
will. The unsustainable buildup of the early 1980s ended with a capacity collapse. The
unsustainable expansion of the dot-com era ended with the collapse of the dot-com
bubble, and with it, the enrollment crisis that had threatened to overwhelm academic
departments.
The current rise looks very much like the previous ones and exists against a backdrop
of faculty shortages that bears all the hallmarks of past expansions. Unless new strategies
are implemented at a scale that has not been attempted in the past, this expansion too will
stop. Our foresight may not permit us to understand the precise mechanism of the
collapse, but those details will matter very little to those who suffer from its effects.
Why has a concerted response from the community been so slow in coming?
Despite being several years into the latest period of skyrocketing enrollments, efforts to
address the problems are just now getting off the ground. For those of us who have lived
through past crises, this delay reflects an unfortunate change in the community’s
understanding of the problems. In the early 1980s, academic computer scientists had a
solid appreciation of the dangers they faced from massive increases in enrollment. The
same was true in the late 1990s—an understanding all the more vivid because memories
were still fresh from the capacity collapse of the mid 1980s. This time around, however,
– 23 –
it has been much harder to get universities, departments, and individual faculty to
recognize the risks, despite the accumulation of additional historical experience.
In my view, the failure in this cycle to benefit from the lessons of history arises from a
confluence of several factors:
• Much of the early history lies beyond the Google “event horizon.” In putting together
this history, I was interested to discover that several relevant articles I remembered
from the early 1980s were invisible online because they predate digital archiving for
the journals in which they appear. Looking for evidence about faculty shortages in the
1980s becomes much harder when none of the references from, for example, The
Chronicle of Higher Education, show up in Google searches.
The fact that people who are responsible for making decisions that affect the future of
computer science education are less aware of the problems of the past makes it harder for
the field to act with a common purpose. That historical myopia, however, in no way
reduces the importance of finding a way to forestall a repeat of the capacity collapse of
the 1980s that cut the number of qualified computer scientists nearly in half. Our society
cannot afford to repeat that mistake.