In Biological Learning and Control, Reza Shadmehr and Sandro Mussa-Ivaldi present a theoretical framework for understanding the regularity of the brain’s perceptions, its reactions to sensory stimuli, and its control of movements. They offer an account of perception as the combination of prediction and observation: the brain builds internal models that describe what should happen and then combines this prediction with reports from the sensory system to form a belief.
Considering the brain’s control of movements, and variations despite biomechanical similarities among old and young, healthy and unhealthy, and humans and other animals, Shadmehr and Mussa-Ivaldi review evidence suggesting that motor commands reflect an economic decision made by our brain weighing reward and effort. This evidence also suggests that the brain prefers to receive a reward sooner than later, devaluing or discounting reward with the passage of time; then as the value of the expected reward changes in the brain with the passing of time (because of development, disease, or evolution), the shape of our movements will also change.
The internal models formed by the brain provide the brain with an essential survival skill: the ability to predict based on past observations. The formal concepts presented by Shadmehr and Mussa-Ivaldi offer a way to describe how representations are formed, what structure they have, and how the theoretical concepts can be tested.
About the Authors
Reza Shadmehr is Professor of Biomedical Engineering and Neuroscience at Johns Hopkins University and the author of The Computational Neurobiology of Reaching and Pointing (MIT Press, 2005).
Sandro Mussa-Ivaldi is Professor of Physiology in the Medical School at Northwestern University, with joint appointments in Physical Medicine and Rehabilitation and Biomedical Engineering. He is also Founder and Director of the Robotics Laboratory at the Rehabilitation Institute of Chicago.
Table of Contents
- Biological Learning and Control
- Computational Neuroscience
- Terence J. Sejnowski and Tomaso A. Poggio, editors
- For a complete list of books in this series, see the back of the book and
- Biological Learning and Control
- How the Brain Builds Representations, Predicts Events, and Makes Decisions
- Reza Shadmehr and Sandro Mussa-Ivaldi
- The MIT Press
- Cambridge, Massachusetts
- London, England
- Massachusetts Institute of Technology
- All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher.
- MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email firstname.lastname@example.org or write to Special Sales Department, The MIT Press, 55 Hayward Street, Cambridge, MA 02142.
- This book was set in Syntax and Times Roman by Toppan Best-set Premedia Limited. Printed and bound in the United States of America.
- Library of Congress Cataloging-in-Publication Data
- Shadmehr, Reza.
- Biological learning and control : how the brain builds representations, predicts events, and makes decisions / Reza Shadmehr and Sandro Mussa-Ivaldi.
- p. cm.—(Computational neuroscience)
- Includes bibliographical references and index.
- ISBN 978-0-262-01696-4 (hardcover : alk. paper)
- 1. Brain. 2. Neuropsychology. 3. Brain—Mathematical models. I. Mussa-Ivaldi, Sandro. II. Title.
- QP376.S4373 2012
- 10 9 8 7 6 5 4 3 2 1
- Series Foreword vii
- Introduction 1
- 1 Space in the Mammalian Brain 7
- 2 Building a Space Map 35
- 3 The Space Inside 67
- 4 Sensorimotor Integration and State Estimation 95
- 5 Bayesian Estimation and Inference 143
- 6 Learning to Make Accurate Predictions 177
- 7 Learning Faster 213
- 8 The Multiple Timescales of Memory 225
- 9 Building Generative Models: Structural Learning and Identification of the Learner 251
- 10 Costs and Rewards of Motor Commands 279
- 11 Cost of Time in Motor Control 307
- 12 Optimal Feedback Control 335
- Appendix 367
- Notes 371
- References 375
- Index 383
“This exciting book provides a coherent framework for understanding how the brain learns to control the body. By synthesizing recent advances with historical perspectives, it provides an accessible entry point for both biological and engineering students, as well as a valuable resource for professionals seeking to understand the workings of the brain.”
—Daniel Wolpert, University of Cambridge
“As neuroscience moves into the 21st century, insights from theories, neurobiological and behavioral experiments are molded into an understanding of the nature of perception, action and cognition. The authors guide the reader through data and theory, revealing deep and beautiful insights into the way uncertainty and environmental constraints shape the way we move and learn.”
—Konrad Körding, Associate Professor, Northwestern University; Lead Scientist, Rehabilitation Institute of Chicago, Center for Parkinson’s Disease
“Almost 20 years have passed since Reza Shadmehr and Sandro Mussa-Ivaldi published their seminal work on motor adaptation, leading to an explosion of research on how we learn, retain, and generalize our movement skills. This book brings these studies together into a unified and coherent theory of adaptive motor control, synthesizing recent ideas on space perception, state estimation, reward maximization, optimal control, and many other fascinating topics. The result is sure to become an influential milestone in the field, leaving one eager to see what the next 20 years will bring.”
—Paul Cisek, Department of Physiology, University of Montréal