Motor control

Motor control is the regulation of movements in organisms that possess a nervous system. Motor control includes conscious voluntary movements, subconscious muscle memory and involuntary reflexes,^[1] as well as instinctual taxes.

To control movement, the nervous system must integrate multimodal sensory information (both from the external world as well as proprioception) and elicit the necessary signals to recruit muscles to carry out a goal. This pathway spans many disciplines, including multisensory integration, signal processing, coordination, biomechanics, and cognition,^[2]^[3] and the computational challenges are often discussed under the term sensorimotor control.^[4] Successful motor control is crucial to interacting with the world to carry out goals as well as for posture, balance, and stability.

Some researchers (mostly neuroscientists studying movement, such as Daniel Wolpert and Randy Flanagan) argue that motor control is the reason brains exist at all.^[5]

Neural control of muscle force

All movements, e.g. touching your nose, require motor neurons to fire action potentials that results in contraction of muscles. In humans, ~150,000 motor neurons control the contraction of ~600 muscles. To produce movements, a subset of 600 muscles must contract in a temporally precise pattern to produce the right force at the right time.^[6]

Motor units and force production

A single motor neuron and the muscle fibers it innervates are called a motor unit. For example, the rectus femoris contains approximately 1 million muscle fibers, which are controlled by around 1000 motor neurons. Activity in the motor neuron causes contraction in all of the innervated muscle fibers so that they function as a unit. Increasing action potential frequency (spike rate) in the motor neuron increases the muscle fiber contraction force, up to the maximal force.^[6]^[7] The maximal force depends on the contractile properties of the muscle fibers. Within a motor unit, all the muscle fibers are of the same type (e.g. type I (slow twitch) or Type II fibers (fast twitch)), and motor units of multiple types make up a given muscle. Motor units of a given muscle are collectively referred to as a motor pool.

The force produced in a given muscle thus depends on: 1) How many motor neurons are active, and their spike rates; 2) the contractile properties and number of muscle fibers innervated by the active neurons. To generate more force, increase the spike rates of active motor neurons and/or recruiting more and stronger motor units. In turn, how the muscle force produces limb movement depends on the limb biomechanics, e.g. where the tendon and muscle originate (which bone, and precise location) and where the muscle inserts on the bone that it moves.

Recruitment order

Motor units within a motor pool are recruited in a stereotypical order, from motor units that produce small amounts of force per spike, to those producing the largest force per spike. The gradient of motor unit force is correlated with a gradient in motor neuron soma size and motor neuron electrical excitability. This relationship was described by Elwood Henneman and is known as Henneman's size principle, a fundamental discovery of neuroscience and an organizing principle of motor control.^[8]

For tasks requiring small forces, such as continual adjustment of posture, motor units with fewer muscle fibers that are slowly-contracting, but less fatigueable, are used. As more force is required, motor units with fast twitch, fast-fatigeable muscle fibers are recruited.

               High|
                   |                                     _________________
 Force required    |                                    /
                   |                                   |
                   |                                   |
                   |                      _____________|_________________
                   |           __________|_______________________________
                Low|__________|__________________________________________    
                              ↑          ↑             ↑                   Time
              Type I Recruit first    Type II A      Type IIB

Computational issues of motor control

The nervous system produces movement by selecting which motor neurons are activated, and when. The finding that a recruitment order exists within a motor pool is thought to reflect a simplification of the problem: if a particular muscle should produce a particular force, then activate the motor pool along its recruitment hierarchy until that force is produced.

But then how to choose what force to produce in each muscle? The nervous system faces the following issues in solving this problem.^[4]

Redundancy. Infinite trajectories of movements can accomplish a goal (e.g. touch my nose). How is a trajectory chosen? Which trajectory is best?
Noise. Noise is defined as small fluctuations that are unrelated to a signal, which can occur in neurons and synaptic connections at any point from sensation to muscle contraction.
Delays. Motor neuron activity precedes muscle contraction, which precedes the movement. Sensory signals also reflect events that have already occurred. Such delays affect the choice of motor program.
Uncertainty. Uncertainty arises because of neural noise, but also because inferences about the state of the world may not be correct (e.g. speed of on coming ball).
Nonstationarity. Even as a movement is being executed, the state of the world changes, even through such simple effects as reactive forces on the rest of the body, causing translation of a joint while it is actuated.
Nonlinearity. The effects of neural activity and muscle contraction are highly non-linear, which the nervous system must account for when predicting the consequences of a pattern of motor neuron activity.

Much ongoing research is dedicated to investigating how the nervous system deals with these issues, both at the behavioral level, as well as how neural circuits in the brain and spinal cord represent and deal with these factors to produce the fluid movements we witness in animals.

"Optimal feedback control" is an influential theoretical framing of these computation issues.^[9]

Model systems for motor control

All organisms face the computational challenges above, so neural circuits for motor control have been studied in humans, monkeys,^[10] horses, cats,^[11] mice,^[12] fish^[13] lamprey,^[14] flies,^[15] locusts,^[16] and nematodes,^[17] among many others. Mammalian model systems like mice and monkeys offer the most straightforward comparative models for human health and disease. They are widely used to study the role of higher brain regions common to vertebrates, including the cerebral cortex, thalamus, basal ganglia and deep brain medullary and reticular circuits for motor control.^[18] The genetics and neurophysiology of motor circuits in the spine have also been studied in mammalian model organisms, but protective vertebrae make it difficult to study the functional role of spinal circuits in behaving animals. Here, larval and adult fish have been useful in discovering the functional logic of the local spinal circuits that coordinate motor neuron activity. Invertebrate model organisms do not have the same brain regions as vertebrates, but their brains must solve similar computational issues and thus are thought to have brain regions homologous to those involved in motor control in the vertebrate nervous system,^[19] The organization of arthropod nervous systems into ganglia that control each leg as allowed researchers to record from neurons dedicated to moving a specific leg during behavior.

Model systems have also demonstrated the role of central pattern generators in driving rhythmic movements.^[14] A central pattern generator is a neural network that can generate rhythmic activity in the absence of an external control signal, such as a signal descending from the brain or feedback signals from sensors in the limbs (e.g. proprioceptors). Evidence suggests that real CPGs exist in several key motor control regions, such as the stomachs of arthropods or the pre-Boetzinger complex that control breathing in humans. Furthermore, as a theoretical concept, CPGs have been useful to frame the possible role of sensory feedback in motor control.

Sensorimotor feedback

Response to stimuli

The process of becoming aware of a sensory stimulus and using that information to influence an action occurs in stages. Reaction time of simple tasks can be used to reveal information about these stages. Reaction time refers to the period of time between when the stimulus is presented, and the end of the response. Movement time is the time it takes to complete the movement. Some of the first reaction time experiments were carried out by Franciscus Donders, who used the difference in response times to a choice task to determine the length of time needed to process the stimuli and choose the correct response.^[20] While this approach is ultimately flawed, it gave rise to the idea that reaction time was made up of a stimulus identification, followed by a response selection, and ultimately culminates in carrying out the correct movement. Further research has provided evidence that these stages do exist, but that the response selection period of any reaction time increases as the number of available choices grows, a relationship known as Hick's law.^[21]

Closed loop control

The classical definition of a closed loop system for human movement comes from Jack A. Adams (1971).^[22]^[23] A reference of the desired output is compared to the actual output via error detection mechanisms; using feedback, the error is corrected for. Most movements that are carried out during day-to-day activity are formed using a continual process of accessing sensory information and using it to more accurately continue the motion. This type of motor control is called feedback control, as it relies on sensory feedback to control movements. Feedback control is a situated form of motor control, relying on sensory information about performance and specific sensory input from the environment in which the movement is carried out. This sensory input, while processed, does not necessarily cause conscious awareness of the action. Closed loop control^[24]^: 186 is a feedback based mechanism of motor control, where any act on the environment creates some sort of change that affects future performance through feedback. Closed loop motor control is best suited to continuously controlled actions, but does not work quickly enough for ballistic actions. Ballistic actions are actions that continue to the end without thinking about it, even when they no longer are appropriate.^{[citation needed]} Because feedback control relies on sensory information, it is as slow as sensory processing. These movements are subject to a speed-accuracy trade-off, because sensory processing is being used to control the movement, the faster the movement is carried out, the less accurate it becomes.

Open loop control

The classical definition from Jack A. Adams is:^[22]^[23] “An open loop system has no feedback or mechanisms for error regulation. The input events for a system exert their influence, the system effects its transformation on the input and the system has an output...... A traffic light with fixed timing snarls traffic when the load is heavy and impedes the flow when the traffic is light. The system has no compensatory capability.”

Some movements, however, occur too quickly to integrate sensory information, and instead must rely on feed forward control. Open loop control is a feed forward form of motor control, and is used to control rapid, ballistic movements that end before any sensory information can be processed. To best study this type of control, most research focuses on deafferentation studies, often involving cats or monkeys whose sensory nerves have been disconnected from their spinal cords. Monkeys who lost all sensory information from their arms resumed normal behavior after recovering from the deafferentation procedure. Most skills were relearned, but fine motor control became very difficult.^[25] It has been shown that the open loop control can be adapted to different disease conditions and can therefore be used to extract signatures of different motor disorders by varying the cost functional governing the system.^[26]

Coordination

A core motor control issue is coordinating the various components of the motor system to act in unison to produce movement.

Peripheral neurons receive input from the central nervous system and innervate the muscles. In turn, muscles generate forces which actuate joints. Getting the pieces to work together is a challenging problem for the motor system and how this problem is resolved is an active area of study in motor control research.

Reflexes

In some cases the coordination of motor components is hard-wired, consisting of fixed neuromuscular pathways that are called reflexes. Reflexes are typically characterized as automatic and fixed motor responses, and they occur on a much faster time scale than what is possible for reactions that depend on perceptual processing.^[27] Reflexes play a fundamental role in stabilizing the motor system, providing almost immediate compensation for small perturbations and maintaining fixed execution patterns. Some reflex loops are routed solely through the spinal cord without receiving input from the brain, and thus do not require attention or conscious control. Others involve lower brain areas and can be influenced by prior instructions or intentions, but they remain independent of perceptual processing and online control.

The simplest reflex is the monosynaptic reflex or short-loop reflex, such as the monosynaptic stretch response. In this example, Ia afferent neurons are activated by muscle spindles when they deform due to the stretching of the muscle. In the spinal cord, these afferent neurons synapse directly onto alpha motor neurons that regulate the contraction of the same muscle.^[28] Thus, any stretching of a muscle automatically signals a reflexive contraction of that muscle, without any central control. As the name and the description implies, monosynaptic reflexes depend on a single synaptic connection between an afferent sensory neuron and efferent motor neuron. In general the actions of monosynaptic reflexes are fixed and cannot be controlled or influenced by intention or instruction. However, there is some evidence to suggest that the gain or magnitude of these reflexes can be adjusted by context and experience.^[29]

Polysynaptic reflexes or long-loop reflexes are reflex arcs which involve more than a single synaptic connection in the spinal cord. These loops may include cortical regions of the brain as well, and are thus slower than their monosynaptic counterparts due to the greater travel time. However, actions controlled by polysynaptic reflex loops are still faster than actions which require perceptual processing.^[30]^{: 171, 578} While the actions of short-loop reflexes are fixed, polysynaptic reflexes can often be regulated by instruction or prior experience.^[31] A common example of a long loop reflex is the asymmetrical tonic neck reflex observed in infants.

Synergies

A motor synergy is a neural organization of a multi-element system that (1) organizes sharing of a task among a set of elemental variables; and (2) ensures co-variation among elemental variables with the purpose to stabilize performance variables.^[32]^[33] The components of a synergy need not be physically connected, but instead are connected by their response to perceptual information about the particular motor task being executed. Synergies are learned, rather than being hardwired like reflexes, and are organized in a task-dependent manner; a synergy is structured for a particular action and not determined generally for the components themselves. Nikolai Bernstein famously demonstrated synergies at work in the hammering actions of professional blacksmiths. The muscles of the arm controlling the movement of the hammer are informationally linked in such a way that errors and variability in one muscle are automatically compensated for by the actions of the other muscles. These compensatory actions are reflex-like in that they occur faster than perceptual processing would seem to allow, yet they are only present in expert performance, not in novices. In the case of blacksmiths, the synergy in question is organized specifically for hammering actions and is not a general purpose organization of the muscles of the arm. Synergies have two defining characteristics in addition to being task dependent; sharing and flexibility/stability.^[34]

"Sharing" requires that the execution of a particular motor task depends on the combined actions of all the components that make up the synergy. Often, there are more components involved than are strictly needed for the particular task (see "Redundancy" below), but the control of that motor task is distributed across all components nonetheless. A simple demonstration comes from a two-finger force production task, where participants are required to generate a fixed amount of force by pushing down on two force plates with two different fingers.^[35] In this task, participants generated a particular force output by combining the contributions of independent fingers. While the force produced by any single finger can vary, this variation is constrained by the action of the other such that the desired force is always generated.

Co-variation also provides "flexibility and stability" to motor tasks. Considering again the force production task, if one finger did not produce enough force, it could be compensated for by the other.^[35] The components of a motor synergy are expected to change their action to compensate for the errors and variability in other components that could affect the outcome of the motor task. This provides flexibility because it allows for multiple motor solutions to particular tasks, and it provides motor stability by preventing errors in individual motor components from affecting the task itself.

Synergies simplify the computational difficulty of motor control. Coordinating the numerous degrees of freedom in the body is a challenging problem, both because of the tremendous complexity of the motor system, as well as the different levels at which this organization can occur (neural, muscular, kinematic, spatial, etc.). Because the components of a synergy are functionally coupled for a specific task, execution of motor tasks can be accomplished by activating the relevant synergy with a single neural signal.^[36] The need to control all of the relevant components independently is removed because organization emerges automatically as a consequence of the systematic covariation of components. Similar to how reflexes are physically connected and thus do not require control of individual components by the central nervous system, actions can be executed through synergies with minimal executive control because they are functionally connected. Beside motor synergies, the term of sensory synergies has recently been introduced.^[37] Sensory synergy are believed to play an important role in integrating the mixture of environmental inputs to provide low-dimensional information to the CNS thus guiding the recruitment of motor synergies.

Synergies are fundamental for controlling complex movements, such as the ones of the hand during grasping. Their importance has been demonstrated for both muscle control and in the kinematic domain in several studies, lately on studies including large cohorts of subjects.^[38]^[39]^[40] The relevance of synergies for hand grasps is also enforced by studies on hand grasp taxonomies, showing muscular and kinematic similarities among specific groups of grasps, leading to specific clusters of movements.^[41]

Motor Programs

While synergies represent coordination derived from peripheral interactions of motor components, motor programs are specific, pre-structured motor activation patterns that are generated and executed by a central controller (in the case of a biological organism, the brain).^[30]^: 227 They represent at top-down approach to motor coordination, rather than the bottom-up approach offered by synergies. Motor programs are executed in an open-loop manner, although sensory information is most likely used to sense the current state of the organism and determine the appropriate goals. However, similar to central pattern generators, once the program has been executed, it cannot be altered online by additional sensory information.

Evidence for the existence of motor programs comes from studies of rapid movement execution and the difficulty associated with changing those movements once they have been initiated. For example, people who are asked to make fast arm swings have extreme difficulty in halting that movement when provided with a "STOP" signal after the movement has been initiated.^[42] This reversal difficulty persists even if the stop signal is presented after the initial "GO" signal but before the movement actually begins. This research suggests that once selection and execution of a motor program begins, it must run to completion before another action can be taken. This effect has been found even when the movement that is being executed by a particular motor program is prevented from occurring at all. People who attempt to execute particular movements (such as pushing with the arm), but unknowingly have the action of their body arrested before any movement can actually take place, show the same muscle activation patterns (including stabilizing and support activation that does not actually generate the movement) as when they are allowed to complete their intended action.^[43]

Although the evidence for motor programs seems persuasive, there have been several important criticisms of the theory. The first is the problem of storage. If each movement an organism could generate requires its own motor program, it would seem necessary for that organism to possess an unlimited repository of such programs and where these would be kept is not clear. Aside from the enormous memory requirements such a facility would take, no motor program storage area in the brain has yet been identified. The second problem is concerned with novelty in movement. If a specific motor program is required for any particular movement, it is not clear how one would ever produce a novel movement. At best, an individual would have to practice any new movement before executing it with any success, and at worst, would be incapable of new movements because no motor program would exist for new movements. These difficulties have led to a more nuanced notion of motor programs known as generalized motor programs.^[30]^{: 240–257} A generalized motor program is a program for a particular class of action, rather than a specific movement. This program is parameterized by the context of the environment and the current state of the organism.

Redundancy

An important issue for coordinating the motor system is the problem of the redundancy of motor degrees of freedom. As detailed in the "Synergies" section, many actions and movements can be executed in multiple ways because functional synergies controlling those actions are able to co-vary without changing the outcome of the action. This is possible because there are more motor components involved in the production of actions than are generally required by the physical constraints on that action. For example, the human arm has seven joints which determine the position of the hand in the world. However, only three spatial dimensions are needed to specify any location the hand could be placed in. This excess of kinematic degrees of freedom means that there are multiple arm configurations that correspond to any particular location of the hand.

Some of the earliest and most influential work on the study of motor redundancy came from the Russian physiologist Nikolai Bernstein. Bernstein's research was primarily concerned with understanding how coordination was developed for skilled actions. He observed that the redundancy of the motor system made it possible to execute actions and movements in a multitude of different ways while achieving equivalent outcomes.^[36] This equivalency in motor action means that there is no one-to-one correspondence between the desired movements and the coordination of the motor system needed to execute those movements. Any desired movement or action does not have a particular coordination of neurons, muscles, and kinematics that make it possible. This motor equivalency problem became known as the degrees of freedom problem because it is a product of having redundant degrees of freedom available in the motor system.

Perception in motor control

Related, yet distinct from the issue of how the processing of sensory information affects the control of movements and actions is the question of how the perception of the world structures action. Perception is extremely important in motor control because it carries the relevant information about objects, environments and bodies which is used in organizing and executing actions and movements. What is perceived and how the subsequent information is used to organize the motor system is an ongoing area of research.

Model based control strategies

Most model based strategies of motor control rely on perceptual information, but assume that this information is not always useful, veridical or constant. Optical information is interrupted by eye blinks, motion is obstructed by objects in the environment, distortions can change the appearance of object shape. Model based and representational control strategies are those that rely on accurate internal models of the environment, constructed from a combination of perceptual information and prior knowledge, as the primary source information for planning and executing actions, even in the absence of perceptual information.^[44]

Inference and indirect perception

Many models of the perceptual system assume indirect perception, or the notion that the world that gets perceived is not identical to the actual environment. Environmental information must go through several stages before being perceived, and the transitions between these stages introduce ambiguity. What actually gets perceived is the mind's best guess about what is occurring in the environment based on previous experience. Support for this idea comes from the Ames room illusion, where a distorted room causes the viewer to see objects known to be a constant size as growing or shrinking as they move around the room. The room itself is seen as being square, or at least consisting of right angles, as all previous rooms the perceiver has encountered have had those properties. Another example of this ambiguity comes from the doctrine of specific nerve energies. The doctrine presents the finding that there are distinct nerve types for different types of sensory input, and these nerves respond in a characteristic way regardless of the method of stimulation. That is to say, the color red causes optical nerves to fire in a specific pattern that is processed by the brain as experiencing the color red. However, if that same nerve is electrically stimulated in an identical pattern, the brain could perceive the color red when no corresponding stimuli is present.

Forward models

Forward models are a predictive internal model of motor control that takes the available perceptual information, combined with a particular motor program, and tries to predict the outcome of the planned motor movement. Forward models structure action by determining how the forces, velocities, and positions of motor components affect changes in the environment and in the individual. It is proposed that forward models help with the Neural control of limb stiffness when individuals interact with their environment. Forward models are thought to use motor programs as input to predict the outcome of an action. An error signal is generated when the predictions made by a forward model do not match the actual outcome of the movement, prompting an update of an existing model and providing a mechanism for learning. These models explain why it is impossible to tickle yourself. A sensation is experienced as ticklish when it is unpredictable. However, forward models predict the outcome of your motor movements, meaning the motion is predictable, and therefore not ticklish.^[45]

Evidence for forward models comes from studies of motor adaptation. When a person's goal-directed reaching movements are perturbed by a force field, they gradually, but steadily, adapt the movement of their arm to allow them to again reach their goal. However, they do so in such a way that preserves some high level movement characteristics; bell-shaped velocity profiles, straight line translation of the hand, and smooth, continuous movements.^[46] These movement features are recovered, despite the fact that they require startlingly different arm dynamics (i.e. torques and forces). This recovery provides evidence that what is motivating movement is a particular motor plan, and the individual is using a forward model to predict how arm dynamics change the movement of the arm to achieve particular task level characteristics. Differences between the expected arm movement and the observed arm movement produces an error signal which is used as the basis for learning. Additional evidence for forward models comes from experiments which require subjects to determine the location of an effector following an unvisualized movement^[47]

Inverse models

Inverse models predict the necessary movements of motor components to achieve a desired perceptual outcome. They can also take the outcome of a motion and attempt to determine the sequence of motor commands that resulted in that state. These types of models are particularly useful for open loop control, and allow for specific types of movements, such as fixating on a stationary object while the head is moving. Complementary to forward models, inverse models attempt to estimate how to achieve a particular perceptual outcome in order to generate the appropriate motor plan. Because inverse models and forward model are so closely associated, studies of internal models are often used as evidence for the roles of both model types in action.

Motor adaptation studies, therefore, also make a case for inverse models. Motor movements seem to follow predefined "plans" that preserve certain invariant features of the movement. In the reaching task mentioned above, the persistence of bell-shaped velocity profiles and smooth, straight hand trajectories provides evidence for the existence of such plans.^[46] Movements that achieve these desired task-level outcomes are estimated by an inverse model. Adaptation therefore proceeds as a process of estimating the necessary movements with an inverse model, simulating with a forward model the outcome of those movement plans, observing the difference between the desired outcome and the actual outcome, and updating the models for a future attempt.

Information based control

An alternative to model based control is information based control. Informational control strategies organize movements and actions based on perceptual information about the environment, rather than on cognitive models or representations of the world. The actions of the motor system are organized by information about the environment and information about the current state of the agent.^[48] Information based control strategies often treat the environment and the organism as a single system, with action proceeding as a natural consequence of the interactions of this system. A core assumption of information based control strategies is that perceptions of the environment are rich in information and veridical for the purposes of producing actions. This runs counter to the assumptions of indirect perception made by model based control strategies.

Direct perception

Direct perception in the cognitive sense is related to the philosophical notion of naïve or direct realism in that it is predicated on the assumption that what we perceive is what is actually in the world. James J. Gibson is credited with recasting direct perception as ecological perception.^[49] While the problem of indirect perception proposes that physical information about object in our environment is not available due to the ambiguity of sensory information, proponents of direct perception (like Gibson) suggest that the relevant information specified in ambient optic array is the distal physical properties of objects. This specifying information reveals the action opportunities the environment affords. These affordances are directly perceivable without ambiguity, and thus preclude the need for internal models or representations of the world. Affordances exist only as a byproduct of the interactions between an agent and its environment, and thus perception is an "ecological" endeavor, depending on the whole agent/environment system rather than on the agent in isolation.

Because affordances are action possibilities, perception is directly connected to the production of actions and movements. The role of perception is to provide information that specifies how actions should be organized and controlled,^[50] and the motor system is "tuned" to respond to specific type of information in particular ways. Through this relationship, control of the motor system and the execution of actions is dictated by the information of the environment. As an example, a doorway "affords" passing through, but a wall does not. How one might pass through a doorway is specified by the visual information received from the environment, as well as the information perceived about one's own body. Together, this information determines the pass-ability of a doorway, but not a wall. In addition, the act of moving towards and passing through the doorway generates more information and this in turn specifies further action. The conclusion of direct perception is that actions and perceptions are critically linked and one cannot be fully understood without the other.

Behavioral dynamics

Building on the assumptions of direct perception behavioral dynamics is a behavioral control theory that treats perceptual organisms as dynamic systems that respond to informational variables with actions, in a functional manner.^[48] Under this understanding of behavior, actions unfold as the natural consequence of the interaction between the organisms and the available information about the environment, which specified in body-relevant variables. Much of the research in behavioral dynamics has focused on locomotion, where visually specified information (such as optic flow, time-to-contact, optical expansion, etc.) is used to determine how to navigate the environment^[51]^[52] Interaction forces between the human and the environment also affect behavioral dynamics as seen in by the Neural control of limb stiffness.

Planning in motor control

Individual movement optimization

There are several mathematical models that describe how the central nervous system (CNS) derives reaching movements of limbs and eyes. The minimum jerk model states that the CNS minimizes jerk of a limb endpoint trajectory over the time of reaching, which results in a smooth trajectory.^[53] However, this model is based solely on the kinematics of movement and does not consider the underlying dynamics of the musculoskeletal system. Hence, the minimum torque-change model was introduced as an alternative, where the CNS minimizes the joint torque change over the time of reaching.^[54]

Later it was argued that there is no clear explanation about how could the CNS actually estimate complex quantities such as jerk or torque change and then integrate them over the duration of a trajectory. In response, model based on signal-dependent noise was proposed instead, which states that the CNS selects a trajectory by minimizing the variance of the final position of the limb endpoint. Since there is a motor noise in the neural system that is proportional to the activation of the muscles, the faster movements induce more motor noise and are thus less precise.^[55] This is also in line with the Fitts' Law and speed-accuracy trade-off.^[56] Optimal control theory was used to further extend the model based on signal-dependent noise, where the CNS optimizes an objective function that consists of a term related to accuracy and additionally a term related to metabolic cost of movement.^[9]

Another type of models is based on cost-benefit trade-off, where the objective function includes metabolic cost of movement and a subjective reward related to reaching the target accurately. In this case the reward for a successful reach within the desired target is discounted by the duration of reaching, since the gained reward is perceived less valuable when spending more time on it.^[57]^[58] However, these models were deterministic and did not account for motor noise, which is an essential property of stochastic motor control that results in speed-accuracy trade-off. To address that, a new model was later proposed to incorporate the motor noise and to unify cost-benefit and speed-accuracy trade-offs.^[59]

Multi-component movements

Some studies observed that the CNS can split a complex movement into sub-movements. The initial sub-movement tends to be fast and imprecise in order to bring the limb endpoint into vicinity of the target as soon as possible. Then, the final sub-movement tends to be slow and precise in order to correct for accumulated error by the first initial sub-movement and to successfully reach the target.^[60]^[61] A later study further explored how the CNS selects a temporary target of the initial sub-movement in different conditions. For example, when the actual target size decreases and thus complexity increases, the temporary target of the initial sub-movement moves away from the actual target in order to give more space for the final corrective action. Longer reaching distances have a similar effect, since more error is accumulated in the initial sub-movement and thus requiring more complex final correction. In less complex conditions, when the final actual target is large and the movement is short, the CNS tends to use a single movement, without splitting it into multiple competents.^[62]

References

^ Sibson F (1850). "On The Causes Which Excite And Influence Respiration In Health And Disease". The Transactions of the Provincial Medical and Surgical Association. 5 - New Series: 181–350. In all these instances the act of inspiration is excited through the reflex function of the nervous system -- the sudden impression made on the skin stimulates the extremities of the incident nerves; the stimulus is conveyed by the incident nerves to the spinal nervous centre, and is thence transmitted back over the motor nerves of inspiration. That these respiratory movements are purely excito-motor, and performed without the intervention of sensation, in many of those instances in which the excited movements are most energetic, is proved by the case with which remarkable movements of respiration were occasioned by stimulating the surface in cases of syncope, hysteria, and epilepsy, cases in which sensation was altogether absent, and was only restored after repeatedly stimulating the surface, and so inducing deep reflex inspirations again and again by exciting the incident nerves. [Page 206]
^ Rosenbaum DA (1991). Human motor control. San Diego, CA: Academic Press. p. 411. ISBN 978-0-12-597300-7.
^ Wise SP, Shadmehr R (July 10, 2002). "Motor Control". Encyclopedia of the Human Brain. Academic Press. pp. 137–157. ISBN 978-0-12-227210-3.
^ ^a ^b Franklin DW, Wolpert DM (November 2011). "Computational mechanisms of sensorimotor control". Neuron. 72 (3): 425–442. doi:10.1016/j.neuron.2011.10.006. PMID 22078503.
^ Wolpert D (3 November 2011). "The real reason for brains". TED Conferences, LLC. Retrieved 2020-03-27.
^ ^a ^b Kernell D (2006). The motoneurone and its muscle fibres. Oxford: Oxford University Press. ISBN 978-0-19-852655-1. OCLC 68260702.
^ Monster AW, Chan H (November 1977). "Isometric force production by motor units of extensor digitorum communis muscle in man". Journal of Neurophysiology. 40 (6): 1432–1443. doi:10.1152/jn.1977.40.6.1432. PMID 925737.
^ Mendell LM (June 2005). "The size principle: a rule describing the recruitment of motoneurons". Journal of Neurophysiology. 93 (6): 3024–3026. doi:10.1152/classicessays.00025.2005. PMID 15914463. S2CID 1136763.
^ ^a ^b Todorov E, Jordan MI (November 2002). "Optimal feedback control as a theory of motor coordination". Nature Neuroscience. 5 (11): 1226–1235. doi:10.1038/nn963. PMID 12404008. S2CID 205441511.
^ Shadmehr R, Wise SP (2005). The computational neurobiology of reaching and pointing : a foundation for motor learning. Cambridge, Mass.: MIT Press. ISBN 978-0-262-19508-9. OCLC 54529569.
^ Pearson KG (2004). "Generating the walking gait: role of sensory feedback". Progress in Brain Research. Brain Mechanisms for the Integration of Posture and Movement. Vol. 143. Elsevier. pp. 123–129. doi:10.1016/s0079-6123(03)43012-4. ISBN 978-0-444-51389-2. PMID 14653157. Retrieved 2022-08-18.
^ Inagaki HK, Chen S, Ridder MC, Sah P, Li N, Yang Z, et al. (March 2022). "A midbrain-thalamus-cortex circuit reorganizes cortical dynamics to initiate movement". Cell. 185 (6): 1065–1081.e23. doi:10.1016/j.cell.2022.02.006. PMC 8990337. PMID 35245431.
^ McLean DL, Dougherty KJ (August 2015). "Peeling back the layers of locomotor control in the spinal cord". Current Opinion in Neurobiology. 33: 63–70. doi:10.1016/j.conb.2015.03.001. PMC 4523447. PMID 25820136.
^ ^a ^b Grillner S, Deliagina T, el Manira A, Hill RH, Lansner A, Orlovsky GN, Wallén P (June 1995). "Neural networks that co-ordinate locomotion and body orientation in lamprey". Trends in Neurosciences. 18 (6): 270–279. doi:10.1016/0166-2236(95)80008-P. PMID 7571002. S2CID 15960971.
^ Azevedo, Anthony W; Dickinson, Evyn S; Gurung, Pralaksha; Venkatasubramanian, Lalanti; Mann, Richard S; Tuthill, John C (2020-06-03). Calabrese, Ronald L; Doe, Chris Q (eds.). "A size principle for recruitment of Drosophila leg motor neurons". eLife. 9: e56754. doi:10.7554/eLife.56754. ISSN 2050-084X. PMC 7347388. PMID 32490810.
^ Burrows M (1996). The neurobiology of an insect brain. Oxford: Oxford University Press. ISBN 978-0-585-21080-3. OCLC 44954885.
^ Flavell SW, Gordus A (April 2022). "Dynamic functional connectivity in the static connectome of Caenorhabditis elegans". Current Opinion in Neurobiology. 73: 102515. doi:10.1016/j.conb.2021.12.002. PMC 9621599. PMID 35183877. S2CID 246873548.
^ Shadmehr R, Wise SP (2005). The computational neurobiology of reaching and pointing : a foundation for motor learning. Cambridge, Mass.: MIT Press. ISBN 978-0-262-19508-9. OCLC 54529569.
^ Strausfeld NJ, Hirth F (April 2013). "Deep homology of arthropod central complex and vertebrate basal ganglia". Science. 340 (6129): 157–161. Bibcode:2013Sci...340..157S. doi:10.1126/science.1231828. PMID 23580521. S2CID 206546163.
^ Donders FC (1969). "On the speed of mental processes". Acta Psychologica. 30: 412–431. doi:10.1016/0001-6918(69)90065-1. PMID 5811531.
^ Hick WE (1952). "On the rate of gain of information". Quarterly Journal of Experimental Psychology. 4 (1): 11–26. doi:10.1080/17470215208416600. S2CID 39060506.
^ ^a ^b Adams JA (1971). "A closed loop theory of motor learning". Journal of Motor Behavior. 3 (2): 111–150 (116). doi:10.1080/00222895.1971.10734898. PMID 15155169.
^ ^a ^b Adams JA (1976). "Issues for a Closed Loop Theory of Motor Learning.". In Stelmach GE (ed.). Motor Control, Issues and Trends. New York: Academic press. p. 89. ISBN 978-0-12-665950-4.
^ Schmidt RA (1982). Motor control and Learning. Champaign, Illinois: Human Kinetics Publishers. ISBN 978-0-931250-21-7. OCLC 856829418.
^ Taub E, Ellman SJ, Berman AJ (February 1966). "Deafferentation in monkeys: effect on conditioned grasp response". Science. 151 (3710): 593–863. Bibcode:1966Sci...151..593T. doi:10.1126/science.151.3710.593. PMID 4955315. S2CID 23105615.
^ Unni MP, Sinha A, Chakravarty K, Chatterjee D, Das A (2017). "Neuromechanical Cost Functionals Governing Motor Control for Early Screening of Motor Disorders". Frontiers in Bioengineering and Biotechnology. 5: 78. doi:10.3389/fbioe.2017.00078. PMC 5733372. PMID 29326926.
^ Dewhurst DJ (July 1967). "Neuromuscular control system". IEEE Transactions on Bio-Medical Engineering. 14 (3): 167–171. doi:10.1109/TBME.1967.4502494. PMID 6080533.
^ Pearson K, Gordon J (2000). "Spinal reflexes". In Kandel ER, Jessell TM, Schwartz JH (eds.). Principles of Neural Science. New York, NY: McGraw-Hill. pp. 713–736. ISBN 978-0-07-112000-5. OCLC 541621060.
^ Matthews PB (May 1986). "Observations on the automatic compensation of reflex gain on varying the pre-existing level of motor discharge in man". The Journal of Physiology. 374 (1): 73–90. doi:10.1113/jphysiol.1986.sp016066. PMC 1182707. PMID 3746703.
^ ^a ^b ^c Schmidt RA (1988). Motor control and learning. Champaign, IL: Human Kinetics Publishers. ISBN 978-0-87322-115-3.
^ Evarts EV (February 1973). "Motor cortex reflexes associated with learned movement". Science. 179 (4072): 501–503. Bibcode:1973Sci...179..501E. doi:10.1126/science.179.4072.501. PMID 4196171. S2CID 35097073.
^ Latash ML, Scholz JP, Schöner G (July 2007). "Toward a new theory of motor synergies". Motor Control. 11 (3): 276–308. doi:10.1123/mcj.11.3.276. PMID 17715460. S2CID 5839709.
^ Alnajjar F, Wojtara T, Kimura H, Shimoda S (2013). "Muscle synergy space: learning model to create an optimal muscle synergy". Frontiers in Computational Neuroscience. 7: 136. doi:10.3389/fncom.2013.00136. PMC 3796759. PMID 24133444.
^ Latash M (2008). Synergy. Oxford, NY: Oxford University Press. pp. 412. ISBN 978-0-19-533316-9.
^ ^a ^b Scholz JP, Danion F, Latash ML, Schöner G (January 2002). "Understanding finger coordination through analysis of the structure of force variability". Biological Cybernetics. 86 (1): 29–39. doi:10.1007/s004220100279. PMID 11918210. S2CID 21724369.
^ ^a ^b Bernstein N (1967). The Co-ordination and Regulation of Movement. Long Island City, NY: Permagon Press. p. 196. ISBN 978-0-08-011940-3.
^ Alnajjar F, Itkonen M, Berenz V, Tournier M, Nagai C, Shimoda S (2015). "Sensory synergy as environmental input integration". Frontiers in Neuroscience. 8: 436. doi:10.3389/fnins.2014.00436. PMC 4292368. PMID 25628523.
^ Santello M, Flanders M, Soechting JF (December 1998). "Postural hand synergies for tool use". The Journal of Neuroscience. 18 (23): 10105–10115. doi:10.1523/JNEUROSCI.18-23-10105.1998. PMC 6793309. PMID 9822764.
^ Scano A, Chiavenna A, Molinari Tosatti L, Müller H, Atzori M (2018). "Muscle Synergy Analysis of a Hand-Grasp Dataset: A Limited Subset of Motor Modules May Underlie a Large Variety of Grasps". Frontiers in Neurorobotics. 12: 57. doi:10.3389/fnbot.2018.00057. PMC 6167452. PMID 30319387.
^ Jarque-Bou NJ, Scano A, Atzori M, Müller H (May 2019). "Kinematic synergies of hand grasps: a comprehensive study on a large publicly available dataset". Journal of Neuroengineering and Rehabilitation. 16 (1): 63. doi:10.1186/s12984-019-0536-6. PMC 6540541. PMID 31138257.
^ Stival F, Michieletto S, Cognolato M, Pagello E, Müller H, Atzori M (February 2019). "A quantitative taxonomy of human hand grasps". Journal of Neuroengineering and Rehabilitation. 16 (1): 28. doi:10.1186/s12984-019-0488-x. PMC 6377750. PMID 30770759.
^ Henry FM, Harrison JS (1961). "Refractoriness of Fast Movement". Perceptual and Motor Skills. 13 (3): 351–354. doi:10.2466/pms.1961.13.3.351. S2CID 145550278.
^ Wadman WJ, Denier van der Gon JJ, Geuze RH, Mol CR (1979). "Control of Fast Goal-Directed Arm Movements". Journal of Human Movement Studies. 5: 3–17.
^ Kawato M (December 1999). "Internal models for motor control and trajectory planning". Current Opinion in Neurobiology. 9 (6): 718–727. doi:10.1016/S0959-4388(99)00028-8. PMID 10607637. S2CID 878792.
^ Blakemore SJ, Wolpert D, Frith C (August 2000). "Why can't you tickle yourself?". NeuroReport. 11 (11): R11–R16. doi:10.1097/00001756-200008030-00002. PMID 10943682.
^ ^a ^b Shadmehr R, Mussa-Ivaldi FA (May 1994). "Adaptive representation of dynamics during learning of a motor task". The Journal of Neuroscience. 14 (5 Pt 2): 3208–3224. doi:10.1523/JNEUROSCI.14-05-03208.1994. PMC 6577492. PMID 8182467.
^ Wolpert DM, Ghahramani Z, Jordan MI (September 1995). "An internal model for sensorimotor integration". Science. 269 (5232): 1880–1882. Bibcode:1995Sci...269.1880W. doi:10.1126/science.7569931. PMID 7569931. S2CID 2321011.
^ ^a ^b Warren WH (April 2006). "The dynamics of perception and action". Psychological Review. 113 (2): 358–389. CiteSeerX 10.1.1.536.7948. doi:10.1037/0033-295x.113.2.358. PMID 16637765.
^ Gibson JJ (1986). The Ecological Approach to Visual Perception. Psychology Press. p. 332. ISBN 978-0-89859-959-6.
^ Michaels CF, Carello C (1981). Direct Perception. Englewood Cliffs, NJ: Prentice Hall. pp. 200. ISBN 978-0-13-214791-0.
^ Fajen BR, Warren WH (April 2003). "Behavioral dynamics of steering, obstacle avoidance, and route selection". Journal of Experimental Psychology: Human Perception and Performance. 29 (2): 343–362. doi:10.1037/0096-1523.29.2.343. PMID 12760620.
^ Fajen BR, Matthis JS (October 2011). "Direct perception of action-scaled affordances: the shrinking gap problem". Journal of Experimental Psychology: Human Perception and Performance. 37 (5): 1442–1457. doi:10.1037/a0023510. PMC 3140555. PMID 21500936.
^ Flash T, Hogan N (July 1985). "The coordination of arm movements: an experimentally confirmed mathematical model". The Journal of Neuroscience. 5 (7): 1688–1703. doi:10.1523/JNEUROSCI.05-07-01688.1985. PMC 6565116. PMID 4020415.
^ Uno Y, Kawato M, Suzuki R (1989). "Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change model". Biological Cybernetics. 61 (2): 89–101. doi:10.1007/BF00204593. PMID 2742921. S2CID 8099349.
^ Harris CM, Wolpert DM (August 1998). "Signal-dependent noise determines motor planning". Nature. 394 (6695): 780–784. Bibcode:1998Natur.394..780H. doi:10.1038/29528. PMID 9723616. S2CID 4429717.
^ Fitts PM (June 1954). "The information capacity of the human motor system in controlling the amplitude of movement". Journal of Experimental Psychology. 47 (6): 381–391. doi:10.1037/h0055392. PMID 13174710. S2CID 501599.
^ Shadmehr R, Orban de Xivry JJ, Xu-Wilson M, Shih TY (August 2010). "Temporal discounting of reward and the cost of time in motor control". The Journal of Neuroscience. 30 (31): 10507–10516. doi:10.1523/JNEUROSCI.1343-10.2010. PMC 2926660. PMID 20685993.
^ Rigoux L, Guigon E (2012). "A model of reward- and effort-based optimal decision making and motor control". PLOS Computational Biology. 8 (10): e1002716. Bibcode:2012PLSCB...8E2716R. doi:10.1371/journal.pcbi.1002716. PMC 3464194. PMID 23055916.
^ Peternel L, Sigaud O, Babič J (2017). "Unifying Speed-Accuracy Trade-Off and Cost-Benefit Trade-Off in Human Reaching Movements". Frontiers in Human Neuroscience. 11 (615): 615. doi:10.3389/fnhum.2017.00615. PMC 5770750. PMID 29379424.
^ Woodworth RS (1899). "Accuracy of voluntary movement". The Psychological Review: Monograph Supplements. 3 (3): i-114. doi:10.1037/h0092992. hdl:2027/hvd.hb16pk. S2CID 61029674.
^ Elliott D, Helsen WF, Chua R (May 2001). "A century later: Woodworth's (1899) two-component model of goal-directed aiming". Psychological Bulletin. 127 (3): 342–357. doi:10.1037/0033-2909.127.3.342. PMID 11393300.
^ Peternel L, Babič J (December 2019). "Target of initial sub-movement in multi-component arm-reaching strategy". Scientific Reports. 9 (1): 20101. Bibcode:2019NatSR...920101P. doi:10.1038/s41598-019-56430-x. PMC 6934494. PMID 31882708.