How Do We Perceive the World?
From sensory evidence to organized objects, expectations, and possibilities for action.
- Level
- Introductory
- Reading load
- 8 core readings in 5 units
- Prerequisites
- No prior perception course is required. How Can We Study the Mind? offers useful preparation. The guides introduce the statistical and neural vocabulary; two reviews are conceptually demanding.
- Last reviewed
- September 2026
Introduction
A faint sound becomes a warning; a familiar object keeps its identity through a change of angle; a doorway appears passable before we try it. Perception gives the information at our senses the order of a meaningful world. To understand that achievement, we must distinguish what information is available, how it is interpreted, and the response through which we study it.
Eight works across five units develop those distinctions. We begin with perceptual judgment, then consider grouping and object recognition, expectations, the combination of hearing, vision, and touch, and finally possibilities for action. Conceptual papers offer competing starting points; demonstrations, experiments, and reanalyses show what would constrain them. One reading is a clearly identified book chapter.
The recurring question is what a comparison actually establishes. Does an observer have more precise information, organize it differently, or require stronger evidence before giving a particular answer? A compelling explanation must say which, and identify evidence that could distinguish its account from another. The final task brings these questions together in an everyday situation.
Unit 1 of 5
Did sensitivity change—or the decision?
Psychophysics connects physical variation to perceptual responses. Begin by separating how well alternatives can be distinguished from the criterion used to report them. This distinction will remain useful when later papers invoke expectations or action choices.
Reading
1 of 8“Utilizing” Signal Detection Theory
Lynn, S. K., & Barrett, L. F. (2014). “Utilizing” signal detection theory. Psychological Science, 25(9), 1663–1673. https://doi.org/10.1177/0956797614541991
Methodological contribution · Foundational argument · Moderate · Full work: 11 pages
Use the tutorial to distinguish sensory evidence, response criterion, and the consequences of mistakes. The purpose is to explain why a change in reports need not mean a change in sensitivity.
A question to consider. A station announcement becomes more important to a listener, who now reports hearing it more often. Which counts would you collect to determine what changed?
Unit 2 of 5
How do elements become recognizable objects?
Organizing elements and recognizing an identity are related but different achievements. Palmer asks what belongs together; DiCarlo and Cox ask how an identity remains recoverable as its image changes. Compare descriptions of perceptual organization with proposals about useful representations.
Reading
2 of 8Common Region: A New Principle of Perceptual Grouping
Palmer, S. E. (1992). Common region: A new principle of perceptual grouping. Cognitive Psychology, 24(3), 436–447. https://doi.org/10.1016/0010-0285(92)90014-S
Foundational argument · Methodological contribution · Accessible · Full work: 12 pages
Identify the comparison behind each demonstration and the inference it supports. Connect grouping to the problem of selecting a unit before asking what that unit is.
A question to consider. Two identical groups of dots appear inside different boundaries. How would you test the boundary’s contribution while keeping proximity and similarity constant?
Reading
3 of 8Untangling Invariant Object Recognition
DiCarlo, J. J., & Cox, D. D. (2007). Untangling invariant object recognition. Trends in Cognitive Sciences, 11(8), 333–341. https://doi.org/10.1016/j.tics.2007.06.010
Foundational argument · Major synthesis · Challenging · Full work: 9 pages
Move from grouping to recognition across changed views. Translate the geometric diagrams into the ordinary question of which differences a representation must preserve and which it must tolerate.
A question to consider. How could a representation distinguish two bags while still identifying the same bag when it is turned around? What evidence would test both requirements?
Unit 3 of 5
What do expectations contribute?
An ambiguous input can be interpreted using prior regularities, but expectation effects do not identify their own mechanism. Revisit sensitivity and criterion while distinguishing a computational goal from the process proposed to achieve it.
Reading
4 of 8How Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018). How do expectations shape perception? Trends in Cognitive Sciences, 22(9), 764–779. https://doi.org/10.1016/j.tics.2018.06.002
Major synthesis · Contemporary update · Challenging · Full work: 16 pages
Compare the review’s explanations of expectation effects and its acknowledged disagreements. Use the opening signal-detection distinction to assess claims based on reports, and the recognition unit to assess claims based on neural representations.
A question to consider. Someone identifies a blurred object more accurately after a predictive cue. What would separate improved sensory evidence, a useful prior, attention, and a changed response rule?
Unit 4 of 5
When should the senses agree—or disagree?
Different senses may supply information about the same event. First examine an audiovisual conflict; then ask whether precision measured separately predicts how vision and touch combine. An interaction and an optimal-integration claim demand different evidence.
Reading
5 of 8Hearing Lips and Seeing Voices
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746–748. https://doi.org/10.1038/264746a0
Landmark empirical study · Accessible · Full work: 3 pages
Use this shared reading to ask what a sensory conflict establishes about integration. Here its role is to set up the distinction between demonstrating cross-sensory influence and predicting the relative weight of each source.
A question to consider. If mouth movements change a reported syllable, what further evidence would justify saying the senses were combined optimally?
Reading
6 of 8Humans Integrate Visual and Haptic Information in a Statistically Optimal Fashion
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429–433. https://doi.org/10.1038/415429a
Landmark empirical study · Methodological contribution · Moderate · Full work: 5 pages
Compare the audiovisual influence with a model that predicts weights and precision from separate measurements. Connect a shift in the combined estimate to the psychometric comparisons introduced earlier.
A question to consider. As visual information becomes noisier, what should happen to cue weights and combined precision under the model, and what result would challenge it?
Unit 5 of 5
How do we perceive what we can do?
Finish with an ecological alternative that starts from the relation between an organism and its environment. Gibson defines action possibilities; Franchak and Adolph ask how to measure them when performance varies. This returns us to the distinction between evidence, judgment, and choice.
Reading
7 of 8The Theory of Affordances
Gibson, J. J. (1979). The theory of affordances. In The ecological approach to visual perception (Chapter 8, pp. 127–143). Houghton Mifflin.
Foundational argument · Historical turning point · Moderate · Full work: 17 pages
Evaluate the chapter’s relational definition and its stronger claim about directly perceiving affordances. Compare the explanatory question with the earlier recognition and inference accounts before treating them as simple opposites.
A question to consider. Does knowing that a doorway affords passage explain how a person detects that fact? State what evidence the perceptual explanation still needs.
Reading
8 of 8Affordances as Probabilistic Functions: Implications for Development, Perception, and Decisions for Action
Franchak, J., & Adolph, K. (2014). Affordances as probabilistic functions: Implications for development, perception, and decisions for action. Ecological Psychology, 26(1-2), 109–124. https://doi.org/10.1080/10407413.2014.874923
Methodological contribution · Critical reappraisal · Moderate · Full work: 16 pages
Reconsider an affordance as a probability of success rather than a single cutoff. Bring the opening distinction between sensitivity, criterion, and payoffs to the interpretation of action decisions.
A question to consider. If a person refuses a passage that they could sometimes negotiate, what would distinguish a mistaken judgment from a sensible response to variable ability and costly failure?
Scope and omissions
This path introduces perceptual explanation rather than cataloguing illusions or surveying every sensory system. Vision is prominent, but audiovisual speech and visual–haptic integration make the interaction of senses explicit. Grouping and recognition are distinct problems; neither is reduced to a list of visual tricks.
Signal detection, population representations, Bayesian inference, and ecological affordances address partly different questions. Their inclusion is an invitation to compare assumptions and explanatory scope, not a claim that one framework has settled perception. The neural reviews support questions about information and interpretation; detailed sensory anatomy belongs to further biological study.
Color and brightness constancy, depth, motion, eye movements, olfaction, taste, pain, and interoception receive selective or little treatment. Attention, conscious experience, perceptual learning, and clinical differences are relevant boundaries rather than comprehensive topics here. Much of the laboratory evidence comes from small adult samples; developmental examples broaden the action unit without establishing universality across ages, cultures, or disabilities. Optional works offer historical depth and objections beyond the core sequence.
Synthesis
Perception brings sensory information into relation with organization, expectation, and the possibilities of action. The readings approach that achievement from different starting points. A change in judgment may reflect more precise information, a different representation, or a different willingness to respond. Explaining the change requires a comparison that can separate these possibilities, while respecting the distinct questions each framework was built to answer.
Imagine someone finding a bag in a dim, crowded station, checking it by touch, listening to an announcement, and deciding whether to pass through a narrow gap. Choose one part of this situation and state precisely what needs explaining.
Propose two accounts that differ in available information, grouping or representation, prior expectations, sensory integration, or action possibilities. Describe a comparison that would separate them. Identify the stimulus or environmental change, the response to measure, and what each possible result would imply. Keep actual performance, perceptual judgment, and willingness to act distinct.
Finally, state what would remain uncertain: model assumptions, the effect of the task and its payoffs, a neural mechanism, or generalization to other people and conditions. Connect at least two units without treating their frameworks as interchangeable.
For a next step, How Does Practice Build Skill? explores how practice changes performance and when learning transfers. How Do We Learn What Predicts What? examines how predictive relationships are learned.
To examine how information is selected, goals maintained, and competing responses coordinated, continue to How Do We Direct Attention and Control Thought?.
Further reading
Optional. Not part of the core sequence.
- Swets, J. A. (1961). Is there a sensory threshold? Science, 134(3473), 168–177. Paper. Historical depth for the opening unit: examines the relation between thresholds, sensory evidence, and decision criteria. Lynn and Barrett provide the core tutorial and its link to action costs.
- Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94(2), 115–147. Paper. Develops a more extensive parts-based account of object recognition to compare with the representation framework in the core. Consult the publisher’s clarification.
- Gregory, R. L. (1980). Perceptions as hypotheses. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 290(1038), 181–197. Paper. A historical argument for perception as hypothesis formation. Compare its use of errors with the evidence and computational distinctions in de Lange and colleagues.
- Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8(4), 162–169. Paper. Extends the integration unit by distinguishing strategies for combining complementary and redundant sensory information.
- Firestone, C., & Scholl, B. J. (2016). Cognition does not affect perception: Evaluating the evidence for “top-down” effects. Behavioral and Brain Sciences, 39, Article e229. Paper. A critical target article about whether proposed cognitive influences alter perception itself. Its six methodological challenges sharpen comparisons among perception, attention, memory, and judgment. The accompanying commentaries offer objections; the title is the authors’ position, not an editorial verdict.
- Warren, W. H., Jr. (1984). Perceiving affordances: Visual guidance of stair climbing. Journal of Experimental Psychology: Human Perception and Performance, 10(5), 683–703. Paper. An empirical foundation for body-scaled affordances and a useful comparison with the later probabilistic treatment. The core uses Franchak and Adolph to keep variability, perceived ability, and action decisions explicit.