History and future directions of human brain mapping and functional neuroimaging

https://doi.org/10.1016/S0001-6918(01)00018-XGet rights and content

Abstract

It has long been known that there is some degree of localisation of function in the human brain, as indicated by the effects of traumatic head injury. Work in the middle of the 20th century, notably the direct cortical stimulation of patients during neurosurgery, suggested that the degree and specificity of such localisation of function were far greater than had earlier been imagined. One problem with the data based on lesions and direct stimulation was that the work depended on the study of what were, by definition, damaged brains. During the second half of the 20th century, a collection of relatively non-invasive tools for assessing and localising human brain function in healthy volunteers has led to an explosion of research in what is often termed “Brain Mapping”. The present article reviews some of the history associated with these tools, but emphasises the current state of development with speculation about the future.

Introduction

Let me begin by defining three terms: psychology, neuropsychology, and brain mapping. The first definition that I learned in college was for the term psychology: “The science that attempts to understand (i.e., explain, predict, and control) behaviour.” This definition was stated by Professor Hans-Lukas Teuber (the founder and then Chair of the Psychology Department at the Massachusetts Institute of Technology) to contrast it with the enterprise that most interested him: neuropsychology: “The science that attempts to understand the interactions between the nervous system and behaviour.” The distinction between psychology and neuropsychology (i.e., the distinction between behaviour and physiology) is another way of thinking about the question which the authors of this special issue of Acta Psychologica have been asked to address: “What is the role of traditional Psychonomics in the broader enterprise that goes by the name Cognitive Neuroscience?” This is a question of current interest and excitement primarily because of the explosion of research in brain mapping: the attempt to specify in as much detail as possible the localisation of function in the human brain. The growth of this research is driven largely by new developments in a collection of non-invasive technologies, with increasing spatial and temporal resolutions. Questions and opportunities are implied by this work for us as psychologists. Can our expertise in the study of behaviour improve the enterprise of brain mapping and, more generally, cognitive neuroscience? Do the new discoveries about human brain function based on neuroimaging experiments really teach us things that are relevant for the study and understanding of behaviour?

You will judge for yourself the answers to the above two questions by reading the collection of articles – addressing specific scientific applications – that compose the bulk of this special issue of Acta Psychologica. The present article will present an overview of the tools of functional neuroimaging, with a mildly historical flavour and an emphasis on the past, current, and future spatial and temporal resolutions of the relevant technologies. There will be an emphasis on functional magnetic resonance imaging (fMRI) because it is, in many ways, the most exciting new volumetric imaging tool, and (not coincidentally) because the experiments in this special issue are mostly based on fMRI.

It is important to note that the enterprise of brain mapping did not begin with fMRI or any other non-invasive imaging tool. The understanding that localisation of function is pervasive in the human brain has been well established for more than 50 years. Consider, for example, the summary of this knowledge represented by Fig. 1, reproduced from a book published in 1957 (Polyak, 1957). There are at least two kinds of questions that should be asked about this figure. The first questions are methodological: What is the basis for this figure? Where did the data come from? What were the technologies that gave rise to this data? The answer to these first questions is that the figure is based upon two techniques: study of people with lesions (caused, for example, by stroke, disease or traumatic wounds) and the direct electrical stimulation of the cortex of patients undergoing brain surgery. More about these techniques will be written below.

The second question that should be asked about Fig. 1 is: “What is the status of the data in terms of our current knowledge of the localisation of human brain function?” In other words, is the information portrayed in the figure accurate, as far as we know today? The answer, perhaps surprisingly, is that this figure is remarkably accurate. There is nothing indicated in the figure that is obviously wrong (though some of the terminology is out-of-date). On the other hand, as will be apparent in the remainder of the articles in this special issue of Acta Psychologica, a great deal more is known about the localisation of function in some areas (perhaps most notably in the multiple visual areas of the occipital lobe), and there are a wide variety of subtle perceptual, cognitive, and emotional tasks that have been used to refine this map at the cortical level, and to add information about subcortical structures, as well.

Thus, Fig. 1 teaches us that we were far from ignorant or misguided about localisation of brain function in 1957. So, what is all the current excitement about? The primary answer1 is that today there are a host of technologies that can be used to give us information non-invasively that address the same issue. The study of patients with lesions, or those who are undergoing direct cortical stimulation during surgery, has substantial limitations. For ethical reasons, neither lesions (obviously) nor direct electrical stimulation of the brain via surgery (for reasons of general risk associated with exposing the brain) may be used in the study of healthy human subjects. Furthermore, the data in Fig. 1 are based on brains that were (by definition) not in a normal state of health.

Today, we have a plethora of techniques that allow us to measure brain function in healthy human subjects of all ages, repeatedly, and safely, over substantial periods of time. Each of these techniques has its own safety considerations, and each has characteristic limits in terms of spatial and temporal resolutions. Nonetheless, they permit us to generate data that are more refined than the information shown in Fig. 1, and which have the promise to become substantially better in the near future.

Section snippets

History: lesions

Historically, the oldest data for suggesting localisation of function in the human brain have come from people with lesions caused by disease or trauma. Three famous individuals and a collection of anonymous cases deserve particular mention because of their influence on the understanding of the importance of localisation of human brain function. The first was Phineas Gage. In 1848 he suffered severe (but remarkably localised) damage to his frontal lobes in an industrial accident. While he

History: direct stimulation of exposed cortical tissue

The work of Wilder Penfield and colleagues in the middle of the 20th century revolutionised our understanding of cortical localisation (Penfield & Jasper, 1954). Given antiseptic techniques that permitted the relatively safe exposure of the brain for substantial periods of time during surgery, and given the need to attempt to avoid particularly critical areas of the brain (having to do with language and/or motor control) even when some tissue needed to be removed for clinical reasons, it was

Modern brain mapping: intra-cranial recordings and stimulation

In addition to the use of cortical stimulation during surgery, there is another form of direct cortical recording and stimulation that is sometimes used prior to the ablative surgery. This is the technique of subdural and/or intra-cortical electrodes, in which one or more strips of recording electrodes are placed directly into the patient's brain. The usual clinical need for such recording is driven by the desire to specify the foci of epileptic seizures. The neurosurgeon and neurologist

Modern brain mapping: temporary lesions and stimulation via TMS and TES

The above method for recording and/or stimulating the brain requires surgery and is, therefore, highly invasive. There are now at least two techniques for cortical stimulation of healthy human subjects that do not involve surgery. The first is transcranial magnetic stimulation (TMS). In TMS, a coil (or a pair of coils forming a figure-8) is placed near the subject's head and a very brief, very large pulse of current is run through it. This creates a strong, transient magnetic field. The

Modern brain mapping: electromagnetic recording

There are two technologies for non-invasively recording the electrical activity of the human brain: electroencephalography (EEG), and magnetoencephalography (MEG). Both are exceptionally safe and both have millisecond temporal resolution. Both can be used to measure electrical activity continuously (so-called “brain waves”), or to obtain repeated responses to a fixed type of stimulus and average the results (so-called “event-related potentials” – ERPs from EEG; or “event-related fields” – ERFs

Modern brain mapping tools: hemodynamic responses to neural activity

All of the preceding technologies have measured some aspect of the electromagnetic activity of neurons directly. As such, they have had temporal resolutions based on either the technology itself (typically milliseconds or better) or the neural response (also on the order of milliseconds). There is another collection of tools that can be used to investigate human brain function based on a more indirect measure: the changes in blood flow and the changes in venous oxygenation level that follow

Modern brain mapping: hemodynamics via PET

Position emission tomography is based on the decay of radioactive atoms that release positrons. Each positron annihilates a nearby electron and the annihilation results in the release of a pair of oppositely directed high-energy gamma rays. The coincident detection of this pair of gamma rays on opposite sides of the head – thus defining a line along which is the likely source of the gamma rays – forms the basic data for PET. For functional neuroimaging, the radioactive atom of choice is

Modern brain mapping: hemodynamics via functional MRI

Functional3 MRI refers, in the present context, to the detection of hemodynamic changes associated with neural activity, using the technology of MRI. It represents a novel

Modern brain mapping: hemodynamics via optical imaging

The reflection spectrum of hemoglobin and oxyhemoglobin differ, and this difference can be detected in the visible or near infrared portion of the spectrum. Striking demonstrations of ocular dominance columns and the smaller orientation columns have been obtained using optical imaging of the exposed brains of cats and monkeys (e.g. Bonhoeffer and Grinvald, 1996, Frostig et al., 1990). Moreover, this technique has been used to question some aspects of human functional neuroimaging and to

Current research: excitement; concerns; integrating data

It is impossible to summarise the range of work that has been conducted using the above technologies in the service of brain mapping. An indication of the breadth of this field is apparent, however, by examine the book of abstracts from any of the recent annual International Conferences on the Functional Mapping of the Human Brain (available as supplements to the journal NeuroImage in 1996–2000). The Organisation for Human Brain Mapping (OHBM), which sponsors these annual meetings, has received

Closing

My pre-doctoral education included a broad spectrum of psychology, physics, electrical engineering and mathematics. My doctoral training was in visual psychophysics. My exposure to neuroscience and brains during those years was limited to single-cell recording studies. Why did I start looking at brains and brain function at the systemic level in 1992? Why am I still at it after 8 years? Why am I excited about the future of functional brain imaging and cognitive neuroscience?

The answer, in a

Acknowledgments

The author wishes to thank all of his colleagues at the Rowland Institute and MGH NMR Center for their continued support and for perennially stimulating discussions of various topics related to brain mapping. Particular thanks to Randy Buckner for graciously supplying the data shown in Fig. 4. Thanks are due, also, to the reviewers (especially Randy McIntosh) and editors, who made several useful suggestions. Finally, thanks to Kathleen O'Craven for help in collecting the data shown in Fig. 2,

References (104)

  • L. Stewart et al.

    The role of Transcranial Magnetic Stimulation (TMS) in studies of vision, attention and cognition

    Acta Psychologica

    (2001)
  • R.B.H. Tootell et al.

    New images from human visual cortex

    Trends in Neuroscience

    (1996)
  • Adams, R. D., & Victor, M. (1985). Principles of neurology (3rd ed., Vol. Part 1/Approach to the Patient with...
  • Bandettini, P. A., Birn, R. M., & Donahue, K. M. (2000). Functional MRI: background, methodology, limits, and...
  • P.J. Basser et al.

    In vivo fiber tractography using DT-MRI data

    Magnetic Resonance in Medicine

    (2000)
  • R.M. Birn et al.

    Event-related fMRI of tasks involving brief motion

    Human Brain Mapping

    (1999)
  • Bonhoeffer, T., & Grinvald, A. (1996). Optical imaging based on intrinsic signals: the methodology. In A. W. Toga, & J....
  • Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (in press). Conflict monitoring and...
  • G.M. Boynton et al.

    Linear systems analysis of functional magnetic resonance imaging in human V1

    Journal of Neuroscience

    (1996)
  • Brandt, S. A., Brocke, J., Niehaus, L., Röricht, A., Villringer, A., & Meyer, B.-U. (1999). Distant effects from...
  • M.A.B. Brazier

    A history of the electrical activity of the brain: The first half-century

    (1961)
  • M.A.B. Brazier

    A history of neurophysiology in the 19th century

    (1988)
  • J.B. Brewer et al.

    Making memories: brain activity that predict show well visual experience will be remembered

    Science

    (1998)
  • R.L. Buckner et al.

    Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging

    Proceedings of the National Academy of Science

    (1996)
  • S.C. Bushong

    Magnetic resonance imaging: Physical and biological principles

    (1995)
  • Buxton, R. B., Wong, E. C., & Frank, L. R. (1999). The post-stimulus undershoot of the functional MRI signal. In C. T....
  • R. Cabeza et al.

    Imaging cognition: an empirical review of PET studies with normal subjects

    Journal of Cognitive Neuroscience

    (1997)
  • R. Cabeza et al.

    Imaging cognition II: an empirical review of 275 PET and fMRI studies

    Journal of Cognitive Neuroscience

    (2000)
  • W.H. Calvin et al.

    Conversations with Neil's brain: The neural nature of thought and language

    (1995)
  • C.S. Carter et al.

    Anterior cingulate cortex, error detection, and the online monitoring of performance

    Science

    (1998)
  • K. Chen et al.

    Optical computed tomography in a turbid medium using early arriving photons

    Journal of Biomedical Optics

    (2000)
  • Cheng, K., Waggoner, R. A., & Tanaka, K. (1999). Patterns of human ocular dominance columns as revealed by high-field...
  • Cherry, S. R., & Phelps, M. E. (1996). Imaging brain function with positron emission tomography. In A. W. Toga, & J. C....
  • Clarke, J. (1994). SQUIDs. Scientific American, (August),...
  • M. Corbetta et al.

    Attentional modulation of neutral processing of shape, color, and velocity in humans

    Science

    (1990)
  • S. Corkin et al.

    H.M.'s medial temporal lobe lesion: findings from MRI

    Journal of Neuroscience

    (1997)
  • J.C. Culham et al.

    Recovery of fMRI activation in motion area MT following storage of the motion after effect

    Journal of Neurophysiology

    (1999)
  • A.M. Dale et al.

    Selective averaging of rapidly presented individual trials using fMRI

    Human Brain Mapping

    (1997)
  • A.M. Dale et al.

    Improved localization of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach

    Journal of Cognitive Neuorscience

    (1993)
  • H.A. Drury et al.

    Computerized mappings of the cerebral cortex: a multiresolution flattening method and a surface-based coordinate system

    Journal of Cognitive Neuroscience

    (1996)
  • V. Edward et al.

    Qualification of fMRI artifact reduction by a novel plaster case headholder

    Human Brain Mapping

    (2000)
  • P.C. Fletcher et al.

    Brain systems for encoding and retrieval of auditory-verbal memory

    Brain

    (1995)
  • H. Foltys et al.

    The representation of the plegic hand in the motor cortex: a combined fMRI and TMS study

    NeuroReport

    (2000)
  • P.T. Fox et al.

    Focal physiological uncoupling of cerebral blood flow and oxidative metabolism during somatosensory stimulation in human subjects

    Proceedings of the National Academy of Science, USA

    (1986)
  • R.D. Frostig et al.

    Cortical functional architecture and local coupling between neuronal activity and the microcirculation revealed by in vivo high-resolution optical imaging of intrinsic signals

    Proceedings of the National Academy of Science, USA

    (1990)
  • J.F. Fulton

    Observations upon the vascularity of the human occiptial lobe during visual activity

    Brain

    (1928)
  • M.S. George et al.

    Transcranial magnetic stimulation: applications in neuropsychiatry

    Archives of General Psychiatry

    (1999)
  • Gevins, A. (1996). Electrophysiological imaging of brain function. In A. W. Toga, & J. C. Mazziotta (Eds.), Brain...
  • R.L. Gollub et al.

    Cocaine decreases cortical cerebral blood flow but does not obscure regional activation in functional magnetic resonance imaging in human subjects

    Journal of Cerebral Blood Flow and Metabolism

    (1998)
  • G. Gratton et al.

    Dynamic brain imaging: event-related optical signal (EROS) measures of the time course and localization of cognitive-related activity

    Psychonomic Bulletin Review

    (1998)
  • Cited by (90)

    View all citing articles on Scopus
    View full text