Chapter 11 Progress and recommendations

The study of multiple object tracking has traditionally been done in the laboratory exercise with only a few dozen participants in an experiment. Only recently, then, has one of the greatest virtues of the MOT task become clear: it’s high test-retest reliability, of approximately .8 or .9, among the highest among attentional tasks and far higher than many common laboratory tasks (see chapter 9). The outlook for future work, then, is very positive both from the prospect of new results being credible (because with a non-noisy task, less data is needed to have high statistical power) and for the use of MOT as a tool to study other things, such as individual differences.

To further highlight how much we have learned, next I will describe how much findings have allowed us to disconfirm multiple aspects of the first and most influential theory of tracking.

11.1 The decline of Pylyshyn’s FINST theory

At the time of writing, Pylyshyn’s FINST theory described in the very first paper on MOT is the featured theory on the “multiple object tracking” Wikipedia page (Editors 2021), and it is frequently invoked in the scholarly literature as well. However, some of the main features of the theory have been rebutted (Brian J. Scholl 2008).

Core to the theory is the idea that tracking is mediated by a fixed set of discrete, preattentive indices. As we have seen, however, as speed increases, the number of targets that can be tracked rapidly decreases, to one target, which is hard to explain with a fixed set of discrete indices (G. A. Alvarez and Franconeri 2007; Alex O. Holcombe and Chen 2012).

Adding to the evidence that tracking draws on attentional resources are dual-task studies. I did not have space to review them in this book, but they indicate that tracking draws on attentional resources shared with some other tasks, and pupil data (Oksama and Hyönä 2016; Alnaes et al. 2014). One should add, however, that such studies do not seem to have ruled out the possibility that these findings were caused entirely by a C=1 resource rather than the hemifield-specific tracking processes; unfortunately, none of these studies appear to have tested for the hemifield specificity of their findings.

An important prediction of Pylyshyn’s theory was also that participants should be aware which target is which among the targets they are tracking. Pylyshyn himself found strong evidence against this. Again, I have focused on the evidence against Pylyshyn’s theory to showcase that the literature has come a long way in thirty-four years. This is also worth emphasizing because we share a problem of many other literatures, that large numbers of researchers know something about tracking but can be way out of date on theory and recent findings.

A salient case of more mixed progress is that while early work had concluded that MOT could not reflect serial position sampling (Z. W. Pylyshyn and Storm 1988; Yantis 1992), this recently has been questioned, and now is a favored account of tracking in some circumstances, as reviewed in Chapter ??.

11.2 Topics not covered by this book

Many topics were not covered in this book (I was given a word limit by the publisher). Some of the most important are whether tracking operates in a retinotopic, spatiotopic, or configural representation (see (Yantis 1992; Bill et al. 2020; Piers D. L. Howe, Pinto, and Horowitz 2010; Meyerhoff et al. 2015; G. Liu et al. 2005; Maechler, Cavanagh, and Tse 2021)), the role of distractors and possible distractor suppression, the role of surface features (Papenmeier et al. 2014), and the literature on dual-task paradigms, although a few such papers were mentioned along the way (e.g., G. A. Alvarez et al. 2005).

11.3 Recommendations

Here are a few recommendations for multiple object tracking researchers that have emerged from this journey through the literature:

  • To dilute the influence of C=1 processes, use several targets, not just two or three. But remember that even with several targets, a small effect could be explained by a C=1 process, so consider that. Test for hemifield specificity as that can also rule out C=1 processes.

  • Always test for hemifield specificity. In addition to it helping to rule out a factor having its effect only on C=1 processes, we know very little about what limited-resource processes are hemisphere-specific, so any results here are likely to be interesting.

  • For computational modelling, I don’t recommend modelling only data from standard, fairly unconstrained trajectories, as such data may not constrain models enough. Show your model successfully mimics both spatial crowding and temporal interference effects, including that temporal interference is more resource-intensive than spatial interference. Another strategy is to model large sets of data at an individual trial level; previous efforts seem to have modelled data from only one or a few different MOT experiments.

References

Alnaes, Dag, Markus Handal Sneve, Thomas Espeseth, Steven Harry Pieter, and Bruno Laeng. 2014. “Pupil Size Signals Mental Effort Deployed During Multiple Object Tracking and Predicts Brain Activity in the Dorsal Attention Network and the Locus Coeruleus.” Journal of Vision 14: 1–20. https://doi.org/10.1167/14.4.1.doi.
Alvarez, G. A., T. S. Horowitz, H. C. Arsenio, J. S. DiMase, and J. M. Wolfe. 2005. “Do Multielement Visual Tracking and Visual Search Draw Continuously on the Same Visual Attention Resources?” Journal of Experimental Psychology 31 (4): 643–67.
Alvarez, G A, and S L Franconeri. 2007. “How Many Objects Can You Track? Evidence for a Resource-Limited Attentive Tracking Mechanism.” Journal of Vision 7 (13): 14.1–10. https://doi.org/10.1167/7.13.14.
Bill, Johannes, Hrag Pailian, Samuel J. Gershman, and Jan Drugowitsch. 2020. “Hierarchical Structure Is Employed by Humans During Visual Motion Perception.” Proceedings of the National Academy of Sciences, September. https://doi.org/10.1073/pnas.2008961117.
Editors, Wikipedia. 2021. “Multiple Object Tracking.” Wikipedia, September.
Holcombe, Alex O., and Wei-Ying Chen. 2012. “Exhausting Attentional Tracking Resources with a Single Fast-Moving Object.” Cognition 123 (2). https://doi.org/10.1016/j.cognition.2011.10.003.
Howe, Piers D L, Yair Pinto, and Todd S Horowitz. 2010. “The Coordinate Systems Used in Visual Tracking.” Vision Research 50 (23): 2375–80. https://doi.org/10.1016/j.visres.2010.09.026.
Liu, Geniva, Erin L Austen, Kellogg S Booth, Brian D Fisher, Ritchie Argue, Mark I Rempel, and James T Enns. 2005. “Multiple-Object Tracking Is Based on Scene, Not Retinal, Coordinates.” Journal of Experimental Psychology. Human Perception and Performance 31 (2): 235–47. https://doi.org/10.1037/0096-1523.31.2.235.
Maechler, Marvin R., Patrick Cavanagh, and Peter U. Tse. 2021. “Attentional Tracking Takes Place over Perceived Rather Than Veridical Positions.” Attention, Perception, & Psychophysics, January. https://doi.org/10.3758/s13414-020-02214-9.
Meyerhoff, Hauke S., Frank Papenmeier, Georg Jahn, and Markus Huff. 2015. “Distractor Locations Influence Multiple Object Tracking Beyond Interobject Spacing: Evidence From Equidistant Distractor Displacements.” Experimental Psychology 62 (3): 170–80. https://doi.org/10.1027/1618-3169/a000283.
———. 2016. “Position Tracking and Identity Tracking Are Separate Systems: Evidence from Eye Movements.” Cognition 146: 393–409.
Papenmeier, Frank, Hauke S. Meyerhoff, Georg Jahn, and Markus Huff. 2014. “Tracking by Location and Features: Object Correspondence Across Spatiotemporal Discontinuities During Multiple Object Tracking.” Journal of Experimental Psychology: Human Perception and Performance 40 (1): 159.
Pylyshyn, Z W, and R W Storm. 1988. “Tracking Multiple Independent Targets: Evidence for a Parallel Tracking Mechanism.” Spatial Vision 3 (3): 179–97.
Scholl, Brian J. 2008. “What Have We Learned about Attention from Multiple-Object Tracking ( and Vice Versa )?” In Computation, Cognition, and Pylyshyn, 49–78. MIT Press.
Yantis, S. 1992. “Multielement Visual Tracking: Attention and Perceptual Organization.” Cognitive Psychology 24 (3): 295–340.