Complex Problem Solving - A Case For Complex Cognition?
Complex Problem Solving - A Case For Complex Cognition?
DOI 10.1007/s10339-009-0345-0
RESEARCH REPORT
Received: 11 January 2009 / Accepted: 21 October 2009 / Published online: 10 November 2009
Marta Olivetti Belardinelli and Springer-Verlag 2009
Abstract Complex problem solving (CPS) emerged in the define complex cognition; second, I introduce conceptually
last 30 years in Europe as a new part of the psychology of related concepts like macrocognition or operative intelli-
thinking and problem solving. This paper introduces into gence to show the overlap of the concepts as well as their
the field and provides a personal view. Also, related con- specific contributions. Third, the assessment of CPS is
cepts like macrocognition or operative intelligence will be illustrated by two measurement approaches, Tailorshop and
explained in this context. Two examples for the assessment MicroDYN. Fourth, I point out the interaction between
of CPS, Tailorshop and MicroDYN, are presented to illus- cognition and emotion in complex situations. Finally, some
trate the concept by means of their measurement devices. conceptual problems with the term ‘‘complex cognition’’
Also, the relation of complex cognition and emotion in the are discussed and an answer to the question in the title will
CPS context is discussed. The question if CPS requires be given.
complex cognition is answered with a tentative ‘‘yes.’’
123
134 Cogn Process (2010) 11:133–142
123
Cogn Process (2010) 11:133–142 135
microworlds have been used in numerous studies (for points to construct options, attention management, and
reviews, see Funke 1991, 1995; Funke and Frensch 2007; uncertainty management. They contrast these issues with
Osman 2009). There is a still ongoing debate if complex topics from microcognition research: puzzle solving,
problem solving is a competence on its own (the related strategies for searching problem spaces, serial versus par-
concept of operative intelligence is presented below), or if allel processing models, or estimating probabilities of
it is merely a subpart of ‘‘intelligence’’ (Dörner and uncertainty values.
Kreuzig 1983; Kluwe et al. 1991; Kröner et al. 2005; Rigas To be clear: the main difference between both types of
and Brehmer 1999; Strohschneider 1991; Süß 1996, 1999; research is not the time axis of the focused processes, but
Süß et al. 1991; Wenke and Frensch 2003; Wittmann and the ill-defined conditions of the tasks and problems under
Hattrup 2004). I will not answer this question here but consideration. And to clear another potential misunder-
point to one central question: Is complex problem solving a standing: both approaches (‘‘types of description’’) are seen
good case for complex cognition? Does dealing with as complementary to each other.
complex environments require a special kind of complex With respect to the question ‘‘inside or outside lab?’’,
cognition or is CPS possible by simply adding elementary proponents of the macrocognition approach seem to
cognitive processes? This question is important, because if believe that these processes can only be analyzed outside
there does exist a second type of cognition besides simple ‘‘in the wild’’—to quote the famous book title from
cognition, then many questions arise—for example, about Hutchins (1995). But is that really true? I do agree that
the applicability of research results from the first area to the many lab studies use simplified experimental paradigms for
second or about the validity of theories from one area to the testing hypotheses about specific processes. The reason for
other. Before giving an answer, similar and related con- this procedure comes from the striving for internal validity
cepts to CPS like macrocognition and operative intelli- (see, e.g., Shadish et al. 2002), which guarantees correct
gence are presented and discussed shortly. evaluation of postulated causal relationships. But, what
about ‘‘user labs’’ or simulators (Gray 2002)? These setups
allow for much more external validity in the lab, at the
Concepts related to complex problem solving same time giving control over complex conditions and
processes (Brehmer and Dörner 1993). Additionally, pro-
The previous section showed that the term ‘‘Complex gress in methodology allows for better data analyses in
Problem Solving’’ is used in at least three different ways nonrandomized field situations (Shadish and Cook 2009).
(thanks to an anonymous reviewer for clarification): (1) as From my point of view, lab research is not necessarily
a paradigm to study cognition under real-life conditions restricted to microcognition but could be opened for mac-
(with different foci such as learning, knowledge acquisi- rocognition; also, macrocognition could be studied in field
tion, and decision-making), (2) as a descriptor of behavior situations. Due to new analytic developments from our
exhibited while dealing with a certain class of problems methodology, more accurate estimations of effect sizes can
usually presented on a computer, and (3) as an ability be used than before for analyzing such data. Also, by
construct that is related to intelligence. means of ‘‘ecological momentary assessment’’ new ways of
To clear the different understandings of CPS, it seems data collection in real environments become possible
necessary to elaborate its connection to other related con- (Hoppmann and Riediger 2009).
cepts. I will consider in more detail the two concepts of (a)
macrocognition and (b) operative intelligence.
Operative intelligence
123
136 Cogn Process (2010) 11:133–142
Instead, changes and stabilities of the system variables as integrate this information into his model of the system.
well as changes and stabilities in participants’ behavior Typically, the system does not deliver any required infor-
(asking questions, making interventions) should be identi- mation automatically. This forces the agent to ask specific
fied. Thus, the term ‘‘operative intelligence’’ comes from questions or to conduct experiments that examine the way
an interest in the details of the psychic processes under- in which the variables work. This component of informa-
lying CPS. tion retrieval and information integration is taken into
To give an example: Dörner’s (1986), p. 301ff) pro- account in the Multiple-Space Models by the experiment
posals for process indicators are divided in those related to space. Goals in complex problems are often formulated
questions asked by participants (only available if a thinking only globally and unspecifically, for example, ‘‘Manage
aloud method is used for data collection) and decisions this town successfully!’’ Therefore, the problem solver is
made by them in the course of the simulation. Concerning required to render the nonspecific goal concretely. Addi-
questions, he differentiated between questions for states tionally, goals might contradict each other, which makes it
(‘‘what is the value of … ?’’), for dependencies (‘‘what necessary to balance them by working out compromises or
does … depend on?’’), for effects (‘‘what happens abandoning goals. Dörner (1986) calls this (2) the ability of
if … ?’’), for components (‘‘what do … exist of?’’), for goal elaboration and goal balancing. To achieve this
subordination (‘‘what types of … do exist?’’—specific subgoal in turn, (3) the agent has to plan measures and
formings of a variable), and for superordination (‘‘what make decisions. These measures might conflict with the
is … ?’’—embedding of a specific object or event in a agent’s own system of values. This conflict can cause
more abstract context). All these questions help a subject to unpleasant emotions that affect the process of problem
identify the objects and their interrelations within the given solving. Likewise, the agent has to cope with frustration,
domain. Concerning decisions, he distinguished the place time pressure, and stress. In order to succeed in all this, (4)
of a decision from its dosage; for example, an intervention he or she needs to be capable of self-management.
in the ‘‘Tailorshop’’ scenario could be made in the area of The importance of Dörner’s contribution to European
advertising, and the dosage could be the specific amount of research on problem solving (e.g., Bach 2003; Dörner
money spent for that activity. Also, the sequence of deci- 1986; Dörner and Schaub 1994) cannot be overstated.
sions could contain interesting patterns, and the transitions Nevertheless, the theory of operational intelligence offers
from questions to decisions (and vice versa) are worthwhile neither a fully elaborated theory nor a measuring device,
analyzing. although Dörner repeatedly emphasizes the necessity of
The breadth of questions, the depth of exploration, the such a diagnostic device. Despite its stimulating character,
consistency of decisions, and the coordination of different the approach is not complete, resulting in a fascinating but
action types are interesting indicators for describing the loosely formulated theory, which still requires refinement.
problem-solving behavior of subjects in complex situa- Because the status of a concept is sometimes best under-
tions. These indicators go far beyond variables that eval- stood by pointing to the measurement approaches, the next
uate solution quality of a complex situation in a rather section presents two assessment procedures from the field
coarse manner. For example, analyses of transition fre- of CPS.
quencies between questions and decisions show significant
differences between successful and unsuccessful problem
solvers (Dörner and Wearing 1995, p. 74f). Assessment of complex problem solving
Both in traditional and in contemporary European
research on problem solving (e.g., Buchner 1995; Dörner For the assessment of CPS, two different approaches exist
and Wearing 1995), experiments are conducted using (Buchner 1995): On the one hand, semantically rich ad-hoc
complex dynamic scenarios such as the commonly cited simulations of complex microworlds (Brehmer and Dörner
‘‘Lohhausen’’ scenario (Dörner et al. 1983). Sternberg 1993), on the other hand, formally constructed artificial
(1995) states that this contrasts American research on systems, which allow systematic variation of difficulty
problem solving which is mainly concerned with static (Funke 2001). As an example of the first approach, the
paradigms (e.g., Chi et al. 1982) despite some exceptions system ‘‘Tailorshop’’ will be presented. As an example for
(Anzai and Simon 1979). To come back to his theory of the second serves the ‘‘MicroDYN’’ approach.
Operational Intelligence, Dörner postulates four process
components of dynamic situations, which were derived Tailorshop
from empirical observations and are presented in the fol-
lowing section. In 1981, the first papers about a computer-simulated scenario
In order to successfully manage a complex system, (1) called ‘‘Tailorshop’’ (in German: ‘‘Schneiderwerkstatt’’)
the agent has to gather information about the system and were published (Putz-Osterloh 1981; Putz-Osterloh and Lüer
123
Cogn Process (2010) 11:133–142 137
1981). The scenario was originally programmed by Dietrich the following month. - The system is build around a set of
Dörner who started at that time a new paradigm in the psy- (non)linear equations dealing with variables representing
chology of thinking which later was labeled ‘‘complex the flow of money (e.g., into investments or from sales), the
problem solving’’ (Dörner and Reither 1978). No one could production (e.g., raw material, machinery, and workforce)
imagine at that point that ‘‘Tailorshop’’ would become a and the turnover factors (e.g., prices, advertisement,
Drosophila for problem solving researchers. Numerous demand, and sales). From a system analytic point of view,
studies have been published (and are in the process of being the scenario is centered on two subsystems, one being
published) since 1981 (Endres and Putz-Osterloh 1994; responsible for production (depending on machines,
Funke 1983, 1986; Hörmann and Thomas 1989; Hussy 1991; workers, salaries, social security contributions, and main-
Kersting and Süß 1995; Klocke 2004; Leutner 1988; Meyer tenance), the other one being responsible for sales
et al. 2009; Putz-Osterloh 1981, 1983; Putz-Osterloh et al. (depending on price, demand for shirts, advertising, utility
1990; Putz-Osterloh and Lüer 1981; Strauß 1993; Süß et al. vans, shop location, and restricted by the number of pro-
1991; Wittmann and Hattrup 2004). duced shirts).
Tailorshop is a microworld, which realizes the produc- Pseudo-random processes (i.e., for all participants, the
tion conditions of a small factory. The participant takes on same sequence of random numbers) determine the price for
the role of a manager of a small shirt factory. By means of raw material, the production, and the demand in previously
changing the input variables (number of workers, number defined value regions. For all variables, interventions into
of machines, raw material, salaries, social security contri- the system become functional in the next cycle, with one
butions, maintenance, advertising, shop location, utility exception: the demand function becomes functional in the
van, and sales price), participants can increase the satis- next but one cycle instead of a direct effect.
faction of the workers, the production conditions, the
demand for shirts, and the sales figures. Figure 1 shows the MicroDYN
connection diagram of the 24 variables.
A monthly report gives the participant all the necessary A shortcoming of CPS research (as it was introduced by
information for making decisions whose effects show up Dörner in the 1970s) is its ‘‘one-item-testing’’ (Funke and
Frensch 2007). Virtually all devices consist of one large
and rather complicated scenario, the participant has to
work through. At the end, either overall performance or
various status and process indicators are calculated and
evaluated. Thus, CPS instruments are tests which contain
exactly one excessive item or at best one bundle speaking
in IRT-terms (Embretson and Reise 2000) if various
independent subsystems are considered as some authors do
(i.e., Müller 1993). Other tests allow subjects to explore a
given system over a period of time and then ask several
questions about this one system. That does not make the
answers any less dependent.
Bearing these limitations in mind, the question arises
how dynamic problem solving could possibly be measured
with psychological tests. One possible approach to indi-
vidual differences might come from the formal framework
of linear structural equation systems (LSE-systems), which
is called the MicroDYN approach (see Greiff and Funke
2009). This type of items has been used considerably in
experimental research as indicators for problem solving
performance (Funke 2001). The basic approach, however,
is now a different one as outlined below.
Items based on this approach require participants to
detect causal relations and control the presented systems. It
is assumed that the everyday examples mentioned earlier
can be modeled by MicroDYN systems, since advanced
Fig. 1 Diagram of the connections within Tailorshop. Variables in
bold boxes can be changed directly by participants (=exogenous skills in strategic planning, internal model building, and
variables), the others only indirectly (=endogenous variables) system control are crucial in the specified situations as well
123
138 Cogn Process (2010) 11:133–142
123
Cogn Process (2010) 11:133–142 139
well as external) actions with varying degrees of will and according to that position, complexity could be computed
varying degrees of affection. The driving forces behind any by simply counting the required elements. But what is the
cognition and the affective states accompanying them are basic element of a psychological process? Is it a transition
more than a by-product of cognition. The founder of the between two neuronal states? The overwhelming com-
modern experimental psychology of motivation, see Lewin plexity of neural processes prohibits such a simple
(1935), connected the dynamics of action with his concept approach.
of personality. Today, the neuropsychology of motivational A primitive complexity indicator could be reaction time
processes is better understood (see, e.g., Kalis et al. 2008), (Welford 1980): the longer the time needed for an operation
but the integration of the separate modules is still an open the more complex must be the underlying process. This
question. Interestingly, in studies with simple cognitive statement assumes the sequential processing of composed
processes emotions are normally blanked out, because they elements—a proposition which is questioned by many
do not play an important role, for example in a visual parallel processing models of cognition (see, e.g., Bechtel
discrimination task; but in studies with complex situations, and Abrahamsen 2001; Mcclelland and Rumelhart 1985).
the interactions become highly visible and inevitable: if the To make things even more complicated, issues for psy-
manager of the ‘‘Tailorshop’’ does not succeed with her chological research have a broad range of time. Newell
investment strategy, bad feelings emerge which in turn (1990) differentiated between 12 time scales of human
influence information processing. In a recent experiment actions, coming from four different ‘‘worlds’’ (see Table 1).
with ‘‘Tailorshop’’, Barth and Funke (2009) showed that The Biological Band is currently more intensively
‘‘nasty’’ environments (where participants could hardly focused than before due to the progress of neuroscience;
enhance the capital and received negative feedback most of the Cognitive Band has been an issue for microcognition
the time) increased negative and decreased positive affect. since the Cognitive Revolution; and the Rational and
The reverse was true for nice environments where it was Social Band could be the ones for macrocognition.
easy to increase capital and to receive positive feedback. But, does this differentiation on the time scale really
Furthermore, nasty environments influenced CPS by lead- help? What else besides time could be used for discrimi-
ing to a higher information retrieval and to a better CPS nating simple from complex processes? Instead of con-
performance than nice environments. centrating on the cognitive process, a totally different
At least three different approaches—the ‘‘affect as approach would be to focus on the demands posed to the
information’’ approach by Schwarz (1990), the ‘‘assimila- cognitive system by the task. Cognitive task analysis
tion–accommodation’’ approach by Fiedler (2001), and the (CTA) has a long tradition in psychology (see Crandall
‘‘affect-infusion’’ model by Forgas (2001)—compete with et al. 2006). It tries to determine the thought processes that
each other to explain the interaction between cognitive subjects follow to perform tasks at various levels of diffi-
processes and affective states. All three approaches dem- culty, from novice to expert. CTA looks at a specific sys-
onstrate the necessity to connect cognitive processes with tem from the viewpoint of the subject performing a specific
affective states. In a more elaborated phase of theory task. The number and variety of required tasks could be
development, instead of generally speaking about positive helpful in separating simple from complex cognition.
or negative affects, it might be even possible to qualify the
differential effects of different emotions (e.g., happiness or
Table 1 Newells (1990) time scales of human action in the version
proudness; fear or anger) on information processing and from Anderson (2002, p. 88)
vice versa. Research on complex cognition would miss its
goal if this interaction would not be an integral part of the Scale (sec) Time units System World
next generation’s theory. Especially, the aspect of emotion 107 Months Social band
regulation (Koole 2009) might become a promising area. 106 Weeks
105 Days
104 Hours Task Rational band
Cognition: simple versus complex 103 10 min Task
102 Minutes Task
Is there a clear border between simple and complex cog- 101 10 s Unit task Cognitive band
nition, and if yes, how can one determine the degree of 100
1s Operations
simplicity or complexity of a cognitive process? The 10-1 100 ms Deliberate act
founder of Experimental Psychology, Wilhelm Wundt
10-2 10 ms Neural circuit Biological band
(1832–1920), believed that psychological processes could
10-3 1 ms Neuron
be reduced to their basic elements (and provoked strong
10-4 100 ls Organelle
critique for this proposition by Gestalt Psychologists)—
123
140 Cogn Process (2010) 11:133–142
Another proposal, made by Halford et al. (1998), defines manuscript. Thanks! Finally, Ann Wolf helped to improve the quality
processing capacity by the relational complexity given by of my English. Part of this research was funded by a grant from the
DFG to the author (Az. Fu 173/11-1).
the number of related dimensions or sources of variation
that can be processed in parallel. This approach would
argue for a continuum between simple and complex pro-
References
cesses. At the same time, it demands a definition of com-
plexity (which is not the same as difficulty), which goes Anderson JR (2002) Spanning seven orders of magnitude: a challenge
beyond the scope of this paper. for cognitive modeling. Cogn Sci 26:85–112
Anderson JR (2005) Cognitive psychology and its implications, 6th
edn. Worth, New York
Anzai Y, Simon HA (1979) The theory of learning by doing. Psychol
Concluding remarks Rev 86:124–140
Bach J (2003) The MicroPsi agent architecture. In: Detje F, Dörner D,
After a review of different constructs, some questions still Schaub H (eds) Proceedings of the fifth European conference on
remain open, e.g., what is the relationship between mac- cognitive modelling. Universitäts-Verlag Bamberg, Bamberg, pp
15–20
rocognition, operative intelligence, naturalistic decision- Barth C, Funke J (2009) Negative affective environments improve
making, and CPS? Is complex cognition the proper term or complex solving performance. Cogn Emot (in press)
should not it be better labeled complex information pro- Bechtel W, Abrahamsen A (2001) Connectionism and the mind:
cessing? Concerning the relationship between the terms, it parallel processing, dynamics, and evolution in networks.
Blackwell, Oxford
becomes obvious that they represent different research Brehmer B, Dörner D (1993) Experiments with computer-simulated
traditions; but at the same time, they all share the idea that microworlds: escaping both the narrow straits of the laboratory
there does exist a more complex interplay of cognitive and the deep blue sea of the field study. Comput Hum Behav
processes than can be seen on the level of elementary 9:171–184
Buchner A (1995) Basic topics and approaches to the study of
processes. With respect to the question of labeling, the term complex problem solving. In: Frensch PA, Funke J (eds)
‘‘complex cognition’’ seems to be a good counterpart to the Complex problem solving: the European perspective. Lawrence
opposite term ‘‘simple cognition’’ even if it uses a broad Erlbaum, Hillsdale, pp 27–63
understanding of cognition (including emotion and moti- Cacciabue PC, Hollnagel E (1995) Simulation of cognition: applica-
tions. In: Hoc JM, Cacciabue PC, Hollnagel E (eds) Expertise
vation) in the second case, which is not meant in the first and technology: cognition and human-computer cooperation.
one. As Moors (2009) argues, a broad sense of cognition Lawrence Erlbaum, Hillsdale, pp 55–73
contrasts the mental with somatic and motor responses, Chi MTH, Glaser R, Rees E (1982) Expertise in problem solving. In:
whereas the narrow sense contrasts cognition with moti- Sternberg RJ (ed) Advances in the psychology of human
intelligence, vol 1. Lawrence Erlbaum, Hillsdale, pp 7–75
vation and emotion. Crandall B, Klein G, Hoffman RR (2006) Working minds:
The aim of this paper was to review the concept of CPS a practitioner’s guide to cognitive task analysis. MIT Press,
under the perspective of complex cognition. CPS differs Cambridge
according to not only my view markedly from simple Dörner D (1980) On the difficulty people have in dealing with
complexity. Simul Games 11:87–106
problem solving by introducing additional facets of the Dörner D (1986) Diagnostik der operativen Intelligenz. Diagnostica
problem space like intransparency, dynamics, or polytely. 32:290–308
At the same time, there is also a difference between simple Dörner D (1996) The logic of failure. Recognizing and avoiding error
and complex cognition. Even if this is not a clear-cut in complex situations. Addison-Wesley, Reading
Dörner D, Kreuzig HW (1983) Problemlösefähigkeit und Intelligenz.
concept with a sharp border, a major difference between Psychologische Rundschau 34:185–192
simple and complex cognition lies in its interaction with Dörner D, Reither F (1978) Über das Problemlösen in sehr komplexen
different psychic functions like motivation and emotion Realitätsbereichen. Zeitschrift für Experimentelle und Ange-
which are strongly present in the complex case but missing wandte Psychologie 25:527–551
Dörner D, Schaub H (1994) Errors in planning and decision-making
or at least reduced in the simple one. This interaction and the nature of human information processing. Appl Psychol
requires additional regulation processes, which cannot be Int Rev 43:433–453
found when studying psychic functions in isolation and out Dörner D, Wearing AJ (1995) Complex problem solving: toward a
of context. So in the end, from my point of view, complex (computersimulated) theory. In: Frensch PA, Funke J (eds)
Complex problem solving: the European perspective. Lawrence
problem solving turns out to be an interesting case for Erlbaum, Hillsdale, pp 65–99
complex cognition. Dörner D, Kreuzig HW, Reither F et al (1983) Lohhausen. Vom
Umgang mit Unbestimmtheit und Komplexität, Hans Huber
Acknowledgments Thanks to Carola Barth, Christine Blech, Sven Embretson SE, Reise SP (2000) Item response theory for psycholo-
Brüssow, Samuel Greiff, Daniel Holt and Sabrina Zinke for helpful gists. Lawrence Erlbaum, Mahwah
comments on a draft version. Two anonymous reviewers gave further Endres J, Putz-Osterloh W (1994) Komplexes Problemlösen in Kleing-
valuable comments and hints for improvements; the comments of one ruppen: Effekte des Vorwissens, der Gruppenstruktur und der
of them were so useful that they found their way directly into the Gruppeninteraktion. Zeitschrift für Sozialpsychologie 25:54–70
123
Cogn Process (2010) 11:133–142 141
Endsley MR (1995a) Measurement of situation awareness in dynamic Kersting M, Süß H-M (1995) Kontentvalide Wissensdiagnostik und
systems. Hum Factors 37:65–84 Problemlösen: Zur Entwicklung, testtheoretischen Begründung
Endsley MR (1995b) Towards a theory of situation awareness in und empirischen Bewährung eines problemspezifischen Diag-
dynamic systems. Hum Factors 37:32–64 noseverfahrens. Zeitschrift für Pädagogische Psychologie 9:83–
Fiedler K (2001) Affective states trigger processes of assimilation and 93
accomodation. In: Martin LL, Clore GL (eds) Theories of mood Klein G (2008) Naturalistic decision making. Hum Factors 50:456–
and cognition: a user’s guidebook. Lawrence Erlbaum, Mahwah, 460
pp 85–98 Klein G, Orasanu J, Calderwood R et al (eds) (1993) Decision making
Forgas JP (2001) The affect infusion model (AIM): an integrative in action: models and methods. Ablex, Norwood
theory of mood effects on cognition and judgments. In: Martin Klein G, Ross KG, Moon BM et al (2003) Macrocognition. IEEE
LL, Clore GL (eds) Theories of mood and cognition. Erlbaum, Intell Syst 18:81–85
Mahwah, pp 99–134 Klocke U (2004) Folgen von Machtausübung und Einflussnahme
Frensch PA, Funke J (1995a) Definitions, traditions, and a general für Wissenszuwachs und Effektivität in Kleingruppen. In:
framework for understanding complex problem solving. In: Mathematisch-Naturwissenschaftlichen Fakultät II. Humboldt-
Frensch PA, Funke J (eds) Complex problem solving: the Universität zu Berlin, Berlin
European perspective. Lawrence Erlbaum, Hillsdale, pp 3–25 Kluwe RH, Misiak C, Haider H (1991) The control of complex
Frensch PA, Funke J (eds) (1995b) Complex problem solving: the systems and performance in intelligence tests. In: Rowe H (ed)
European perspective. Lawrence Erlbaum, Hillsdale Intelligence: reconceptualization and measurement. Lawrence
Funke J (1983) Einige Bemerkungen zu Problemen der Problem- Erlbaum, Hillsdale, pp 227–244
löseforschung oder: Ist Testintelligenz doch ein Prädiktor? Knauff M, Wolf AG (2010) Editorial. Complex Cognition this
Diagnostica 29:283–302 volume
Funke J (1986) Komplexes Problemlösen - Bestandsaufnahme und Koole SL (2009) The psychology of emotion regulation: an integra-
Perspektiven. Springer, Heidelberg tive review. Cogn Emot 23:4–41
Funke J (1991) Solving complex problems: exploration and control of Kröner S, Plass JL, Leutner D (2005) Intelligence assessment with
complex systems. In: Sternberg RJ, Frensch PA (eds) Complex computer simulations. Intelligence 33:347–368
problem solving: principles and mechanisms. Lawrence Erl- Leutner D (1988) Computersimulierte dynamische Systeme: Wissen-
baum, Hillsdale, pp 185–222 serwerb unter verschiedenen Lehrmethoden und Sozialformen
Funke J (1995) Experimental research on complex problem solving. des Unterrichts. Zeitschrift für Entwicklungspsychologie und
In: Frensch PA, Funke J (eds) Complex problem solving: the Pädagogische Psychologie 20:338–355
European perspective. Lawrence Erlbaum, Hillsdale, pp 243– Lewin K (1935) A dynamic theory of personality (selected papers).
268 McGraw-Hill, New York
Funke J (2001) Dynamic systems as tools for analysing human Lipshitz R, Klein G, Orasanu J et al (2001) Taking stock of
judgement. Think Reason 7:69–89 naturalistic decision making. J Behav Decis Mak 14:331–352
Funke J, Frensch PA (2007) Complex problem solving: the European Mayer RE (1992) Thinking, problem solving, cognition, 2nd edn.
perspective—10 years after. In: Jonassen DH (ed) Learning to W. H. Freeman, New York
solve complex scientific problems. Lawrence Erlbaum, New McClelland JL, Rumelhart DE (1985) Distributed memory and the
York, pp 25–47 representation of general and specific information. J Exp Psychol
Gray WD (2002) Simulated task environments: the role of high- Gen 114:159–188
fidelity simulations, scaled worlds, synthetic environments, and Meyer B, Grütter J, Oertig M et al (2009) Women’s underperfor-
laboratory tasks in basic and applied cognitive research. Cogn mance in complex problem solving: stereotype threat in micro-
Sci Q 2:205–227 world performance. Eur J Soc Psychol (under review)
Greiff S, Funke J (2009) Measuring complex problem solving: the Moors A (2009) Theories of emotion causation: a review. Cogn Emot
MicroDYN approach. In: Scheuermann F (ed) The Transition to 23:625–662
computer-based assessment—lessons learned from large-scale Müller H (1993) Komplexes Problemlösen: Reliabilität und Wissen.
surveys and implications for testing. Office for Official Publi- Holos, Bonn
cations of the European Communities, Luxembourg Newell A (1990) Unified theories of cognition. Harvard University
Halford GS, Wilson WH, Phillips S (1998) Processing capacity Press, Cambridge
defined by relational complexity: implications for comparative, Nisbett RE, Norenzayan A (2002) Culture and cognition. In: Pashler
developmental, and cognitive psychology. Behav Brain Sci H, Medin D (eds) Steven’s handbook of experimental psychol-
21:803–865 ogy. Third edition. Vol. 2: memory and cognitive processes.
Hoppmann CA, Riediger M (2009) Ambulatory assessment in John Wiley, New York, pp 561–597
lifespan psychology: An overview of current status and new Osman M (2009) Controlling uncertainty: a review of human
trends. European Psychologist (in press) behavior in complex dynamic environments. Psychol Bull (in
Hörmann H-J, Thomas M (1989) Zum Zusammenhang zwischen press)
Intelligenz und komplexem Problemlösen. Sprache & Kognition Putz-Osterloh W (1981) Über die Beziehung zwischen Testintelligenz
8:23–31 und Problemlöseerfolg. Zeitschrift für Psychologie 189:79–100
Hussy W (1991) Komplexes Problemlösen und Vera- Putz-Osterloh W (1983) Über Determinanten komplexer Problemlö-
rbeitungskapazität. Sprache & Kognition 10:208–220 seleistungen und Möglichkeiten zu ihrer Erfassung. Sprache &
Hutchins E (1995) Cognition in the wild. MIT Press, Cambridge Kognition 2:100–116
Kahneman D, Slovic P, Tversky A (1982) Judgement under Putz-Osterloh W, Lüer G (1981) Über die Vorhersagbarkeit kom-
uncertainty. Heuristics and biases. Cambridge University Press, plexer Problemlöseleistungen durch Ergebnisse in einem Intel-
Cambridge ligenztest. Zeitschrift für Experimentelle und Angewandte
Kalis A, Mojzisch A, Schweizer TS et al (2008) Weakness of will, Psychologie 28:309–334
akrasia, and the neuropsychiatry of decision-making: an inter- Putz-Osterloh W, Bott B, Köster K (1990) Modes of learning in
disciplinary perspective. Cogn Affect Behav Neurosci 8:402– problem solving—are they transferable to tutorial systems?
417 Comput Hum Behav 6:83–96
123
142 Cogn Process (2010) 11:133–142
Rasmussen J (1983) Skills, rules, knowledge: signals, signs, and Süß H-M (1996) Intelligenz. Wissen und Problemlösen, Hogrefe,
symbols, and other distinctions in human performance models. Göttingen
IEEE Trans Syst Man Cybern SMC 13:257–266 Süß H-M (1999) Intelligenz und komplexes Problemlösen—Perspekti-
Rigas G, Brehmer B (1999) Mental processes in intelligence tests and ven für eine Kooperation zwischen differentiell-psychometrischer
dynamic decision making tasks. In: Juslin P, Montgomery H und kognitionspsychologischer Forschung. Psychologische
(eds) Judgement and decision making: Neo-Brunswikean and Rundschau 50:220–228
process-tracing approaches. Lawrence Erlbaum, Hillsdale, pp Süß H-M, Kersting M, Oberauer K (1991) Intelligenz und Wissen als
45–65 Prädiktoren für Leistungen bei computersimulierten komplexen
Schwarz N (1990) Feelings as information: informational and Problemen. Diagnostica 37:334–352
motivational functions of affective states. In: Higgins ET, von Ehrenfels C (1890) Über Gestaltqualitäten. Vierteljahrsschrift für
Sorrentino RM (eds) Handbook of motivation and cognition. Wissenschaftliche Philosophie 14:249–292
Guilford Press, New York, pp 527–561 Welford AT (ed) (1980) Reaction times. Academic Press, New York
Shadish WR, Cook TD (2009) The renaissance of field experimen- Wenke D, Frensch PA (2003) Is success or failure at solving complex
tation in evaluating interventions. Annu Rev Psychol 60:607– problems related to intellectual ability? In: Davidson JE,
629 Sternberg RJ (eds) The psychology of problem solving. Cam-
Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi- bridge University Press, Cambridge, pp 87–126
experimental designs for generalized causal inference. Houghton Wittmann WW, Hattrup K (2004) The relationship between perfor-
Mifflin, Boston mance in dynamic systems and intelligence. Syst Res Behav Sci
Sternberg RJ (1995) Expertise in complex problem solving: a 21:393–409
comparison of alternative conceptions. In: Frensch PA, Funke Zsambok CE (1997) Naturalistic decision making: where are we now?
J (eds) Complex problem solving: the European perspective. In: Zsambok CE, Klein GA (eds) Naturalistic decision making.
Lawrence Erlbaum, Hillsdale, pp 295–321 Lawrence Erlbaum, Mahwah, pp 3–16
Strauß B (1993) Konfundierungen beim Komplexen Problemlösen. Zsambok CE, Klein GA (eds) (1997) Naturalistic decision making.
Zum Einfluß des Anteils der richtigen Lösungen (ArL) auf das Lawrence Erlbaum, Mahwah
Problemlöseverhalten in komplexen Situationen. Holos, Bonn
Strohschneider S (1991) Problemlösen und Intelligenz: Über die
Effekte der Konkretisierung komplexer Probleme. Diagnostica
37:353–371
123