Keyboard Shortcuts?

×
  • Next step
  • Previous step
  • Skip this slide
  • Previous slide
  • mShow slide thumbnails
  • nShow notes
  • hShow handout latex source
  • NShow talk notes latex source

Click here and press the right key for the next slide (or swipe left)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Action Observation by Adults

Flanagan and Johansson, 2003 figure 1 (part)

\citet{Flanagan:2003lm} showed that ‘patterns of eye–hand coordination are similar when performing and observing a block stacking task’.

Costantini et al, 2012

‘We recorded proactive eye movements while participants observed an actor grasping small or large objects. The participants' right hand either freely rested on the table or held with a suitable grip a large or a small object, respectively. Proactivity of gaze behaviour significantly decreased when participants observed the actor reaching her target with a grip that was incompatible with respect to that used by them to hold the object in their own hand.’
Follow ups: tie hands = \citet{ambrosini:2012_tie}; TMS (impair) = \citet{costantini:2013_how}.
Planning-like processes in action observation have also been demonstrated by measuring observers' predictive gaze. If you were to observe just the early phases of a grasping movement, your eyes might jump to its likely target, ignoring nearby objects \citep{ambrosini:2011_grasping}. These proactive eye movements resemble those you would typically make if you were acting yourself \citep{Flanagan:2003lm}. Importantly, the occurrence of such proactive eye movements in action observation depends on your representing the outcome of an action motorically; even temporary interference in the observer's motor abilities will interfere with the eye movements \citep{Costantini:2012fk}.
In human adults, motor representations and processes enable anticipatory looking that is driven by goal ascription \citep[e.g.][]{Costantini:2012fk,ambrosini:2012_tie}.

How?

Motor representations ocurring in action observation sometimes facilitate the identification of goals.

What are those motor representations doing here?

The Motor Theory of Goal Ascription:

goal ascription is acting in reverse

The idea is that we could solve the problem--the problem of matching optimisation in planning actions with optimisation in predicting them--by supposing that a single set of mechanisms is used twice, once in planning action and once again in observing them.
What does this require?

-- in action observation, possible outcomes of observed actions are represented

-- these representations trigger planning as if performing actions directed to the outcomes

-- such planning generates predictions

predictions about joint displacements and their sensory conseuqences

-- a triggering representation is weakened if its predictions fail

The proposal is not specific to the idea of motor representations and processes, although there is good evidence for it (which I won't cover here because we're in Milan!)

Sinigalia & Butterfill 2015, figure 1

There is evidence that a motor representation of an outcome can cause a determination of which movements are likely to be performed to achieve that outcome \citep[see, for instance,][]{kilner:2004_motor, urgesi:2010_simulating}. Further, the processes involved in determining how observed actions are likely to unfold given their outcomes are closely related, or identical, to processes involved in performing actions. This is known in part thanks to studies of how observing actions can facilitate performing actions congruent with those observed, and can interfere with performing incongruent actions \citep{ brass:2000_compatibility, craighero:2002_hand, kilner:2003_interference, costantini:2012_does}. Planning-like processes in action observation have also been demonstrated by measuring observers' predictive gaze. If you were to observe just the early phases of a grasping movement, your eyes might jump to its likely target, ignoring nearby objects \citep{ambrosini:2011_grasping}. These proactive eye movements resemble those you would typically make if you were acting yourself \citep{Flanagan:2003lm}. Importantly, the occurrence of such proactive eye movements in action observation depends on your representing the outcome of an action motorically; even temporary interference in the observer's motor abilities will interfere with the eye movements \citep{Costantini:2012fk}. These proactive eye movements also depend on planning-like processes; requiring the observer to perform actions incongruent with those she is observing can eliminate proactive eye movements \citep{Costantini:2012uq}. This, then, is further evidence for planning-like motor processes in action observation.
So observers represent outcomes motorically and these representations trigger planning-like processes which generate expectations about how the observed actions will unfold and their sensory consequences. Now the mere occurrence of these processes is not sufficient to explain why, in action observation, an outcome represented motorically is likely to be an outcome to which the observed action is directed.
To take a tiny step further, we conjecture that, in action observation, \textbf{motor representations of outcomes are weakened to the extent that the expectations they generate are unmet} \citep[compare][]{Fogassi:2005nf}. A motor representation of an outcome to which an observed action is not directed is likely to generate incorrect expectations about how this action will unfold, and failures of these expectations to be met will weaken the representation. This is what ensures that there is a correspondence between outcomes represented motorically in observing actions and the goals of those actions.

How?

Motor representations ocurring in action observation sometimes facilitate the identification of goals.

Now we’ve solved this: the Motor Theory of Goal Ascription is the solution.
See \citet{sinigaglia:2015_goal_ascription} for an outline of the Motor Theory of Goal Ascription.
Recall David Marr’s famous three-fold distinction between levels of description of a system: the computational theory, the representations and algorithm, and the hardware implementation.

1. computational description

-- What is the thing for and how does it achieve this?

2. representations and algorithms

-- How are the inputs and outputs represented, and how is the transformation accomplished?

3. hardware implementation

-- How are the representations and algorithms physically realised?

Marr (1992, 22ff)

The teleological stance provides a computational description of goal ascription.
The Teleological Stance:

‘an action can be explained by a goal state if, and only if, it is seen as the most justifiable action towards that goal state that is available within the constraints of reality’

\citep[p.~255]{Csibra:1998cx}

Csibra & Gergely, 1998 p. 255

1. Consider goals to which the action might be directed.

2. For each goal, determine how justifiable the observed actions are as a means to achieving that goal.

3. Ascribe the goal with the highest rationality score.

The Teleological Stance provides a computational description of the process of goal ascription that underpin proactive gaze in adults; the Motor Theory of Goal Ascription (partially) specifies the representations and algorithms needed for this.
Recall David Marr’s famous three-fold distinction between levels of description of a system: the computational theory, the representations and algorithm, and the hardware implementation.

1. computational description

-- What is the thing for and how does it achieve this?

2. representations and algorithms

-- How are the inputs and outputs represented, and how is the transformation accomplished?

3. hardware implementation

-- How are the representations and algorithms physically realised?

Marr (1992, 22ff)

The motor theory of goal ascription provides an account of the representations and algorithms, one that competes with Csibra and Gergely’s account based on general reasoning.

Adults

  1. Proactive gaze indicates fast goal ascription.
  2. The Teleological Stance provides a computational description of the goal ascription underpinning adults’ proactive gaze
  3. Proactive gaze depends on motor processes and representations: the Motor Theory provides an account of the representations and algorithms.

Infants

  1. Proactive gaze (from ~12 months) and violation-of-expectations (from ~3 months) indicate goal ascription.
  2. The Teleological Stance ...
  3. Two conjectures about algorithms and representations ...
Is there any evidence? ...