Perception Lecture Notes: The Brain

Professor David Heeger

What you should know from this lecture

Bold, unsubstantiated claim: The mind is an interesting, and complicated, machine. All behavior is a reflection of brain function. YOU, your joys/sorrows, memories, ambitions, sense of personal identity/free will, are no more than the electrical activity of a vast assembly of nerve cells.

Many historians credit Descartes with being the first to argue that the brain is a machine, but he believed very strongly (as do most people in the world today) that the mind is separate from the brain. What do you think? Class discussion...

Descartes' description of a reflex includes some correct observations (e.g., nerves are involved, there are fluid-filled ventricles in the brain) but the details are way off.

At least, Descartes figured out that the brain was somehow involved.  Over the millenia there have been various theories about where in the body thought processes occurred, and it hasn't been but for a few centuries that people were certain the brain was relevant. For example, although the ancient Egyptians took great care to preserve their dead (for the afterlife), they had very little respect for the brain which they removed with a spoon through the nose during the preservation process. Aristotle wrote that the brain simply serves to cool the blood.

Sherrington, about a century ago, replaced Decartes' mechanical and hydraulic model of the reflex with a model based on electrical signals in neurons.

Some of the deepest mysteries facing science in the 21st century concern the higher functions of the central nervous system: perception, memory, attention, learning, language, emotion, personality, social interaction, decision-making, motor control, and consciousness. Nearly all psychiatric and many neurological disorders are characterized by dysfunction in the neural systems that mediate these neural processes. In fact, all aspects of human behavior and hence human society are controlled by the human brain: economics and decision making, moral reasoning and law, arts and aesthetics, social and global conflict, politics and political decision making, marketing and preference, etc. Neuroscientists around the world are studying all of these aspects of brain function.

The Society for Neuroscience and the Howard Hughes Medical Institute are good resources of information about current research on the neuroscience and the brain.

Neurons

One strategy for analyzing the workings of the mind and brain is to understand the basic components that the machine is constructed from.

Action potentials

Microscope pictures neuron with microelectrode

Neurons represent and transmit information electrically. If you place an electrode close to a neuron's soma then you can measure and record these electrical signals.

This graphs shows a single action potential. Action potentials are often referred to as spikes or impulses. When its not stimulated, a typical neuron rests at a voltage of about -70mV. When stimulated and it fires an action potential, the voltage jumps way up to about +40mV, then comes back down again. It all happens very fast (note the time scale), all in a matter of a few thousandths of a second. The action potential starts at a neuron's soma and travels all the way along its axon. The shape of the action potential is basically the same anywhere along the length of the axon. Hodgkin and Huxley won the Nobel prize for work they did in the 1950s to understand what makes action potentials happen and how they propogate along axons.

Neurons use firing rates to transmit information

One can quantify a neuron's response in terms of its firing rate, the number of action potentials that occur per unit of time. For example, the response of a retinal ganglion cell (like this one) depends on the contrast of the test light. For a dim test light we would get only a few action potentials. For a bright test light, we would get many more action potentials. Any given action potential looks exactly like all the others. When we increase the light intensity, the individual action potentials do not get bigger. Rather, we just get more of them. If we did a whole series of experiments with different stimulus contrasts, we could plot the firing rate (count of action potentials) as a function of stimulus contrast, like this:

An analogous result is observed when you measure the firing rates of touch-sensitive nerves and vary the strength of a stimulus that presses on the skin:

Neurons respond selectively

How is it that we know that a particular neural signal is due to a stimulus that originated as a sound, versus knowing that another neural signal arose from some other type of physical stimulus, such as a light source? Suppose that we initiate a neural response in our visual system by electrically stimulating neurons in your eye rather than by absorbing some light. When you excite the visual receptors in any way whatsoever, the response that is evoked in the nervous system is that of a visual response. This holds true no matter what the physical cause of  the excitation. The determining factor is which neuron is being excited. Likewise, no matter how it is you excite an auditory neuron, the resulting sensation will be one of hearing. This is known as the Law of Specific Nerve Energies: formulated by Johannes Müller (19th century neural anatomist/physiologist and director of a laboratory in the mid-nineteenth century that spawned the greatest physiological scientists of that era).

Neurons in different parts of the brain are selective for different things. Just keeping to neurons involved with vision, there are neurons that are selective for all kinds of properties: stimulus position, color, pattern, direction and speed of motion. There are even neurons that respond selectively to faces.

Example: recordings are from a type of neuron (called a retinal ganglion cell) that was located in the retina (at the back of the eye) of a cat.

Each panel in the bottom row indicates the position of a spot of light. Each panel in the top row contains two graphs. The bottom graph in each panel shows the time course of a flashed spot of light. The light was turned on, stayed on for a while (about 1 second), and then was turned off again. The top graph in each panel is the electrical voltage recorded by the electrode. While the light was on, the neuron was stimulated and its voltage jumped way above its resting level a number of times. The time scale shown in each of the three panels represents a couple of seconds. So the action potentials, which each last for only a few milliseconds, look like impulses or spikes in the electrical voltage recording.

The three panels correspond to lights flashed at different locations in the visual field. It turns out that many neurons are very picky. This particular neuron reponds when the light is on if it is flashed in one position. It responds after the light goes off if it is flashed at a nearby postion. And it responds to both on and off if the light is flashed in an intermediate position. It's not shown here but if the light is flashed just a little bit further away, the neuron would not respond at all. We say that the neuron is selective for the position of the light flash.

Another example: In 1959, Jerry Lettvin (an electrical engineer at MIT) and his colleagues published a very influential research article entitled "What the Frog's Eye Tells the Frog's Brain." They recorded from individual fibers (axons) in the optic nerve of frogs and discovered that many neurons were extremely selective for the kinds of things that frogs ought to care about, small dark spots moving relative to the background, i.e. they were "bug detectors". Some quotations from their paper.

Neural responses are noisy

Recordings of action potentials are variable or noisy. If we present the same stimulus over and over again, each time we will get a slightly different response. The action potentials happen at different times on each trial, and the total number of action potentials varies from one trial to the next. On one trial we might get 10 spikes, then on the next trial 12, then 8, then 9, then 15, and so on.

Raster plot of neural responses

Responses of a neuron in a visual area of the monkey brain to 210 presentations of an identical visual stimulus.  Each tick mark corresponds to an action potential.  Each row corresponds to a different trial (a separate repeat of the identical stimulus presentation). There are a different number of action potentials from one trial to the next and the individual action potentials occur at slightly different times from one trial to the next. The graph at the bottom shows the average response (in spikes/sec), averaged across all 210 stimulus presentations. I'll come back to this issue of noise in neural responses later when I lecture on psychophysical methods and signal detection theory.

Synapses

How do neurons communicate? The axon of one neuron comes very close to (about 20 nanometers; a nanometer is a billionth of a meter) but doesn't quite touch the dendrite of its target. The narrow space between the two neurons is called a synapse. The electrical signal from the (pre-synaptic neuron's) axon is not transmitted directly across the synapse. Rather, when the action potential comes along, it causes the release of certain chemicals called neurotransmitters. The neurotransmitters diffuse across the synapse and bind to receptors in the membrane of the (postsynaptic neuron's) dendrite. This, in turn, causes a change in the electrical properties of the postsynaptic neuron. Bernard Katz won a Nobel prize for figuring out how synapses work.

Why do neurons communicate by chemical synapses instead of by direct electrical connections?  Discuss...

A given neuron may have thousands of synapses distributed on its dendritic tree. If there is enough combined excitation from all of these synapses then the postsynaptic neuron will fire an action potential. If there is even more excitation, then this neuron will fire a bunch of action potentials, and its firing rate will increase with dendritic excitation.

Anatomy of the brain

The whole brain atlas web site is a great way to learn about the structure of the different parts of the brain. We will focus on only a few areas of the brain that are primarily involved in vision and hearing. The cerebral cortex (or neocortex) is the part of the brain that you seen many times. It covers the rest of the brain.

Schematic of brain, lateral (side) view

Medial (split in half) view

Of the structures visible in this slide we'll be mainly concerned in this class with the auditory brain stem nuclei (small collections of neurons in the brain stem involved in hearing), optic nerve, thalamus, and cerebral cortex.

Back of monkey brain and cross-section of visual cortex

This tissue is stained so that the cell bodies appear purple. All the cell bodies are in a layer near the surface of the brain, called the gray matter of the brain because it has grayish color when its not stained. The longer axons reach out (below) the cortex into the central part of the brain, called the white matter of the brain because the axons altogther look white. The white matter is kind of like a massive tangle of wires - axons connecting from one part of the cortex to another.

Gray matter or the cortical sheet is about 3-4 mm thick, filled with cell bodies (somas), dendrites, and axon terminals (synapsing on the dendrites). Gray matter is where all the interesting stuff happens; a neuron receives inputs (via synapses) from a whole bunch of other neurons, and then it computes a new output. The axons in the white matter just transmit that output to other parts of the brain.

Different brain areas have differences in layering. Motor cortex (involved in controlling muscle movement), for example, has an expanded layer 5 and a reduced layer 4. Layer 5 is the ouput layer where neurons send their axons down the spinal cord. Layer 4 is the input layer. This is a motor control area so it makes sense to have lots of output and not much input. Visual cortex on the other hand has an expanded layer 4 becuase it is a sensory area with strong inputs.

Neurons perform computations

Neurons perform computations. For example, a given neuron’s response might depend on the sum of the responses from two of its inputs. The function of the neurons in a particular brain area is best understood in terms of the computations that they perform. It is not unlike a computer, but neural circuits are extremely complex. About 50,000 neurons lie in each cubic mm of the gray matter. Each neuron has, on average, about 6,000 synapses, for a total of 10 billion neurons and 60 trillion synapses in the whole cortex. There are about 3 kilometers of axon in each cubic mm of cortex.

Treatment of animals

The use of animals in experiments is controversial. The US government and individual universities have strict guidelines about the treatment of animals in experiments. In some of the experiments we'll talk about in this class, the animals were fully anesthetized. In other experiments, the animals were awake while electrodes are implanted to record neural activity. It is important to realize that there are no pain receptors in the brain so even when the animals are awake they do not feel anything when the electrodes are implanted. It is also important to realize that the scientists (faculty, grad students, etc.) depend on having healthy and cooperative animals in their experiments. Everyone is motivated to make sure that the animals are well taken care of.  It is still an ethical issue as to whether or not animals should ever be used in science. What do you think? Class discussion...

I will show you some examples later in the course of how sensory neuroscience is leading to treatments for deafness, blindness, and developmental disabilities like dyslexia.

Human brain physiology

We can use microelectrodes to study the physiology of animal brains. But we also need to study the physiology of the human brain. After all, humans and monkeys are a bit different. And, ultimately we are interested in human perception.

Neuropsychology: Study patients with brain damage to specific brain areas (e.g., due to stroke, accident, or surgury). Examples: blind sight (residual ability to discriminate visual stimuli when forced to guess, even though the subject has no conscious experience of the stimuli), face agnosia (inability to recognize faces), object agnosia (inability to recognize objects), akinetopsia (inability to see motion), achromatopsia (inability to see color), etc.

Brain lesion (damage) in the occipital lobe

For example, this MRI picture shows a slice through the brain of a subject known in the research literature as GY. GY suffered a head injury during a bike accident as a child. The black region (near the left) is now filled with fluid instead of being filled with cortical brain tissue. This has left him effectively blind in part of his visual field, from which we know that this part of the brain is critical for vision. Interestingly, however, GY can to discriminate certain visual stimuli presented to the blind part of his visual field when forced to guess, even though he has no conscious experience of the stimuli. This has been called "blind sight" and we'll talk more about it later in the semester.

Electrical microstimulation: In the course of surgical treatment of patients suffering from epilepsy, neurosurgions sometimes operate with the patient awake under only a local anesthetic, so that they can electrically stimulate the brain and make sure that they do not accidentally remove critical (e.g., language) brain centers. Wilder Penfield pioneered this surgical technique during the middle part of the century. In the process, he mapped out much of what we know about the organization of the human cortex. He localized specific regions of the brain involved in vision, hearing, touch, and motor control.

By plotting the movements and sensations that are evoked by electrical stimulation along the central sulcus, Penfield revealed a homunculus, a representation of the body surface. Stimulating in front of the central sulcus (colored red) evokes twitching movements of various body parts. Stimulating at one position in front of the central sulcus evokes a twitching movement of one of the toes. Stimulating a nearby position evokes a movement of another toe, then the foot, ankle, etc. Likewise, stimulating just behind the central sulcus evokes touch sensations. Stimulating at one position evokes a sensation of the thumb being tickled, then nearby for each of the other fingers, then the hand, the arm, etc.

Penfield also localized a brain area that when stimulated evoked a kind of stream of consciousness. Some quotations from one of his patients.

Action potentials from neurons in the human brain: Nowadays, patients with severe epilepsy are often studied in the hospital for a period of several days to carefully locate the abnormal brain tissue that is causing seizures, before removing any brain tissue. These patients undergo surgery to have some electrodes implanted in their brain to record the electrical activity of the brain. In some cases, it is possible to record action potentials from individual neurons. Then they sit in a hospital bed waiting for seizures to occur. When the seizures do occur, the electrical measurements from the implanted electrodes help to locate the diseased tissue very precisely. Once the location has been determined, the patients undergo another operation to have the electrodes removed along with the diseased brain tissue that is causing the seizures. While in the hospital with the electrodes implanted, in between seizures, some of these patients have agreed to participate in perceptual and cognitive neuroscience experiments. Hence, there are a handful of reports in the neuroscience journals of the responses of individual neurons in human brains.

.

The above MRI images show the placement of a bundle of electrodes in the medial temporal lobe of a patient with severe epilepsy. The electrodes were used to record activity of individual neurons, some of which responded very selectively to pictures of famous people and places. One neuron responded to pictures of Jennifer Aniston (interestingly it did not respond to pictures of Jennifer together with Brad Pitt, only to Jennifer on her own), another neuron responded selectively to pictures of Halle Berry, and another to pictures of the Sydney Opera House.

Transcranial magnetic stimulation (TMS): Transcranial magnetic stimulation (TMS) is the use of powerful rapidly changing magnetic fields to induce electric fields in the brain by electromagnetic induction without the need for surgery or external electrodes. Repetitive transcranial magnetic stimulation is known as rTMS. TMS is a powerful tool in research for mapping out how the brain functions, and has shown promise for noninvasive treatment of a host of disorders, including depression and auditory hallucinations.

One reason TMS is important in neuroscience is that it can demonstrate causality. A noninvasive mapping technique such as fMRI allows researchers to see what regions of the brain are activated when a subject performs a certain task, but this is not proof that those regions are actually used for the task; it merely shows that a region is associated with a task. If activity in the associated region is suppressed with TMS stimulation and a subject then performs worse on a task, this is much stronger evidence that the region is used in performing the task. For example, it has been shown the TMS in a particular area of the brain (called cortical area MT) interferes with motion perception.


Copyright © 2006, Department of Psychology, New York University
David Heeger