Active learning works best even if it sometimes feel challenging
Activate
What theory is most relevant to your interests?
People talk about theories all the time:
We are supposed to work with theories to understand human nature
This discussion is designed to help us to think clearly
Reading
We borrow the title of the lecture from Olivia Guest’s very helpful article (Guest, 2024)
We need to do this here and now because, typically, we will not have done it before and this neglect causes problems (Proulx & Morey, 2021; Scheel et al., 2021; van Rooij, 2022):
The evidence or the insights that psychologists produce when they do research often come to us, in everyday life, framed in terms of ideas about people and the things we can do:
These ideas are often (we will see: not always) constructed as theories
Graduates of social or psychological science typically (Proulx & Morey, 2021; Scheel et al., 2021; van Rooij, 2022) train to:
We talk about theories in psychological science but do not typically consider (1.) what makes the things we talk about theories or (2.) what makes them good or bad
This is why “Demonstrate critical reflection” is hard
This will be challenging because
Discussions of theory can get abstract so I will refer to examples to make the discussion concrete
Reading
My examples are based on theory development in research on reading development, dyslexia, and cognitive reading processes in skilled readers
Activate
Think about the psychological science you have read about and are interested in:
To begin our work, we look at some ways that critical thinkers have identified what a theory is and what it does
This definition is compact but does a lot of useful work for us (Guest, 2024; referencing Guest & Martin, 2021):
A theory is a scientific proposition — described by a collection of natural-language sentences, mathematics, logic, and figures — that introduces causal relations with the aim of describing, explaining, and/or predicting a set of phenomena
Guest (2024):
a collection of natural-language sentences
Seidenberg & McClelland (1989)’s targets:
Guest (2024):
a collection of natural-language sentences
Seidenberg & McClelland (1989)’s core assumptions:
… reading words involves the computation of three types of codes: orthographic, phonological, and semantic.
Each of these codes is … distributed …
Processing in the model is … interactive …
… [and] mediated by connections among the units.
Key ideas
When we are looking for the presentation of a theory, we are typically looking for statements identifying:
Guest (2024):
A theory is a scientific proposition — described by a collection of natural-language sentences, mathematics, logic, and figures — that introduces causal relations with the aim of describing, explaining, and/or predicting a set of phenomena
where
Phenomenon is a process that generates, or requires, observations, constituting scientists’ perspective on what things appear or seem to be, not how they are.
Guest (2024):
… describing, explaining, and/or predicting a set of phenomena
Seidenberg & McClelland (1989) target phenomena that are observed if we ask adults to read words aloud:
Guest (2024):
… causal relations
Seidenberg & McClelland (1989)’s causal explanation:
Figure 2: Theories and families of theories, as theoretical positions, mapped onto the phenomena they address (adapted from Guest (2024), Figure 1)
In reading and writing about psychology, we may need to map (Guest, 2024):
In some fields of Psychology, where theories are well-developed we see the relationship between theories discussed explicitly
Activate
Think about the psychological science you have read about and are interested in:
Can you identify different theories in your topic area?
Are different presentations actually presentations of different versions of the same theory or presentations of competing theories?
Why are we bothering to think or talk about this stuff? Isn’t it obvious? Is it worth the effort?
Over the past 15 years, a series of analyses have been taken to show that some published findings in Psychology cannot be replicated (e.g., Open Science Collaboration, 2015)
But some argue that the real problem all along was a lack of adequate theory (Proulx & Morey, 2021)
One way we can tell there is a problem is that it is often difficult to identify the key analysis in published papers:
You may remember that, following Meehl (1990), we discussed how to get to a prediction we can test we need:
Multiverse analyses suggest estimates of psychological effects (phenomena) vary (Silberzahn & Uhlmann, 2015)
Silberzahn & Uhlmann (2015): Variation in effects estimates by different analysis teams
But Auspurg & Brüderl (2021) argue this happens when researchers don’t knoww how to interpret the research question
Silberzahn & Uhlmann (2015): Variation in effects estimates by different analysis teams
Borsboom (2026) argues that what has been going on looks like theoretical amnesia: we teach our students or learn how to
Borsboom (2026) argues that what has been going on looks like theoretical amnesia: we do not teach or learn how to
Borsboom (2026): this is why
psychology is so hyper-ultra-mega empirical.
We so often see papers that wrap a narrative story about the things people are or do around some statistical test results
Theories and not theories
Theories:
Theories and not theories
Theories are not (Devezer, 2024; Fried, 2020; Gigerenzer, 1998; van Rooij, 2022):
It will help you to keep these things separate
Figure 4: Different theories can imply the same process, and different processes can imply the same statistical test result
Activate
Think about the psychological science you are interested in:
So: how do we do this? It will not surprise you to learn that
Tip
Eronen & Bringmann (2021) argue developing good theories is difficult because:
Borsboom et al. (2021) identify a theory construction method:
Identify relevant phenomena
Formulate a prototheory
Develop a formal model
van Rooij & Baggio (2021): actually, no, psychologists spend too much effort looking for effects
We don’t need to build collections of robust effects before starting to build theories
Relevant effects are things we need to explain but they are secondary to our real targets:
van Rooij & Baggio (2021):
The majority of possible effects will be irrelevant for the aims of theory building
We first need to build candidate theories so that we can determine which effects they imply
van Rooij & Baggio (2021) build on Marr (1982/2010) to help us to divide our work into:
Guest & Martin (2021): formal models can drive theory development
We progress step-by-step towards increasingly more specific ideas, each next step dependent on the previous step:
Activate
Think about the psychological science you are interested in:
We reflect on examples of theory to learn how to identify (after Guest, 2024):
Metaphysical commitment
Discursive survival
Empirical interface
Minimising harm
Scientists do theory evalution all the time but unconsciously:
Tip
An ontology can comprise a formal naming or definition of the categories or properties of, and the relations between, the things we want to talk about
Guest (2024):
The “triangle model theory” of reading is presented in a series of theoretical papers (Harm & Seidenberg, 1999; Harm & Seidenberg, 2004; Plaut et al., 1996; Seidenberg & McClelland, 1989) reported in cognitive psychology journals like Psychology Review
The “triangle model theory” commits to principles (Seidenberg & Plaut, 2006):
Guest (2024):
The “triangle model theory” of reading has frequently been contrasted with alternate or competing theories: compare the Dual Route theory (Coltheart et al., 2001; Pritchard et al., 2018) or CDP++ (Perry et al., 2007; Ziegler et al., 2014)
Discourse around the rival theories has sometimes been hot tempered but is often productive:
Guest (2024):
The potential to explicate the relationship between theory and observation
The various presentations of the different theories have involved:
Cognitive process diagrams (box-and-arrow figures) and formal statements (math equations) on how network unit activation or learning works
Executable code (if shared) in languages like C for running simulations of reading behaviour using model instantiations of theories
Analyses of how model-based simulations do or do not capture reading phenomena:
Guest (2024):
Reckoning with the history of the theory and the potential for future harms
Scientists sometimes have a hard time recognizing or acknowledging problematic contexts or histories for our theories, or the potential for harms, but it is productive to reflect on these questions
Reading
Castles et al. (2018) discuss the long history of the often heated and obviously consequential argument between advocates of phonics and whole language approaches to how we teach children to read (see also Rayner et al., 2001)
strong scientific consensus around the importance of phonics instruction in the initial stages of learning to read
It is productive to reflect on these questions
Reading
The history of reading research has mostly involved work in English in the UK and USA
It is productive to reflect on these questions
Kalluri et al. (2025): research on computer vision increasingly involve extraction of human body and other socially salient data, enabling surveillance, though the language of research output obscures these applications
It is productive to reflect on these questions
Reading
We can track the genealogy (family history) of contemporary theories about reading back to work like Rumelhart et al. (1986)
We must resist the temptation to adopt the perspectives or assumptions or language of Great Men
Reading research might seem a long way from potential harms but maybe this work and harmful AI work are at least cousins
Activate
Think about the psychological science you are interested in: