Add to Favorites

Big Question

Decisions as a Window on Cognition

The Neural Building Blocks of Thought
Michael Shadlen

The evolution of sophisticated brains has freed us from the immediacy of sensation and action by giving us the capacity for flexible decision-making. The evidence we obtain through our senses (or from memory) need not precipitate an immediate, reflexive response. Instead our decisions are deliberative and provisional, contingent on other sources of information, long-term goals, and values.

I believe the principles of brain function that underlie simple forms of reasoning and decision-making are also the building blocks of human cognition. Brain circuits support integration of evidence from diverse sources (for example, different senses and memory), assign more or less weight to cues that differ in their reliability, calculate expected costs and benefits associated with anticipated outcomes, process elapsed time to meet a deadline or to assess temporal cost, and implement rules (such as deciding on what to decide upon) and policies (balancing accuracy against speed).

Almost all these neural mechanisms, which can be studied most effectively in nonhuman primates, require processing on a flexible time scale much longer than the time scales imposed by the biology of nerve cells. Cellular events, such as an ion channel opening to allow current to flow or a neuron exciting or inhibiting another neuron, take a fixed length of time, typically hundredths of a second. To make decisions, in contrast, our brains operate in a flexible time frame, dictated neither by moment-to-moment fluctuations in sensory information nor the need to control our muscles in real time. Such freedom from immediacy (see movie below) is an essential element of many functions that we call cognitive, such as working memory, planning, anticipating, inferring cause and effect, and resolving ambiguity.





Neural computations incorporate the kind of mathematics of probability that a statistician would use to accumulate evidence bearing on an hypothesis, or that an actuary would apply to assess risk (see movie below). Our studies of perceptual decision-making show that the same neurons that can hold a value in working memory can also represent a variety of different values. They do not merely switch between a low and a high rate of firing but instead compute and represent graded amounts of information. During decision-making, these amounts correspond to a degree of belief that one alternative is better than another. In other contexts, these same neurons represent plans for action, allocation of attention, or anticipation of an event or cue.







The capacity of neurons—or more likely groups of interacting neurons—to manifest such persistent activity appears to be a common feature of the primate association cortex. I believe the computations made by these neurons comprise the basic neural building blocks of cognition. The study of decision-making exposes other building blocks as well: mechanisms that sense that neurons like the ones in the Movie 2 have reached a criterion firing rate, establish this criterion, start and stop processes, and turn on or select or configure another brain circuit. We know more about some of these mechanisms than others, but we can already appreciate the generic necessity for such operations in cognition.

Indeed, the sophisticated mental capacities of humans can be explained in large part by our having a bigger brain with more of these building blocks. Instead of deciding what to do next, human brains decide about the kinds of things to decide about. A cascade of operations with features like those involved in simple perceptual decisions probably underlies our capacity to strategize, form abstract ideas, and express ourselves through recursive grammar. This is the structure of thought: cascades of decisions about decisions about decisions.

At its most abstract, decision-making invites consideration of philosophical concepts, such as personal responsibility, conscious awareness, and authorship of our ideas and actions. For example, the mechanism we use to establish the balance between the speed and accuracy of our decisions explains why different people may reach different decisions under identical circumstances—differences upon which we may hinge moral responsibility.

Moreover, I believe that the neural mechanism of decision-making will ultimately serve as a basis for understanding human consciousness. Simply put, consciousness can be understood as a decision to engage information in a certain way. When we wake from sleep, our brains make a nonconscious decision to engage the world. They decide to ignore the sound of rain or traffic but to attend to the baby’s cry. Subjective awareness, volition, and authorship rely on a decision to engage in another way—for purposes of possibly reporting an experience by pointing, recalling, or telling about it.

Consider a brain process that does not simply look to the visual cortex for evidence bearing on grasping, looking, reaching, eating, mating, or other actions, but instead engages this information with a possibility of reporting to someone else. This process imbues objects with a phenomenal presence in a reference frame that is shared by other agents with minds like mine. In other words, it makes them feel like something that has existence and purpose in a subjective/world framework. Similarly, a nonconscious decision to store information to be retrieved for possible reporting involves systems that tag information with before, after, and context—the stuff of autobiographical memory.

Thus we are beginning to appreciate the many ways that the neurobiology of decision-making has exposed mechanisms that are likely to figure prominently in human cognition. These mechanisms—integration of information (evidence), process termination, circuit selection—explain how simple decisions are formed in the brain. I believe they also comprise the rudiments of complex cognitive functions, which at first glance seem unrelated to decision making.

These core functions make a normal brain “not confused”: able to reason, prioritize, infer causes and consequences, assign authorship to one’s own thoughts, explore, avoid distractions, and engage with the environment. Brain disorders affecting cognition have many causes, including genetic mutation, ischemia, infection, degeneration, autoimmune processes, developmental errors, trauma, and environmental toxins. I believe, though, that these causes ultimately affect cognitive function by inducing failures of a small set of fundamental mechanisms like the ones listed above and others to be discovered. If so, restoring these mechanisms will prove key to future treatments of a wide variety of brain diseases.

Michael Shadlen, a Howard Hughes Medical Investigator, is Professor of Neuroscience at Columbia University.


Ken Britten
4 years ago

Nice piece, and great video. I liked the phrase "freedom from immediacy", but I wonder how far you think it can go. In your work, you can only stretch out the intervals to seconds or tens of seconds. But lots of decisions evolve over much longer periods. In the Diijksterhuis piece, he talked about a very slow, semi-conscious form of decision-making, which he called System 3. It makes me wonder how distinct the circuitry underlying such slower, strategic decisions might be.