"There must be a reason why an experience feels the way it does. A good place to begin addressing this question is spatial experience, because it may be more penetrable by introspection than other qualities of consciousness such as color or pain. Moreover, much of experience is spatial, from that of our body to the visual world, which appears as if painted on an extended canvas in front of our eyes. Because it is ‘right there’, we usually take space for granted and overlook its qualitative properties. However, we should realize that a great number of phenomenal distinctions and relations are required for the canvas of space to feel ‘extended’. Here we argue that, to be experienced as extended, the canvas of space must be composed of countless spots, here and there, small and large, and these spots must be related to each other in a characteristic manner through connection, fusion, and inclusion. Other aspects of the structure of spatial experience follow from extendedness: every spot can be experienced as enclosing a particular region, with its particular location, size, boundary, and distance from other spots. We then propose an account of the phenomenal properties of spatial experiences based on integrated information theory (IIT). The theory provides a principled approach for characterizing both the quantity and quality of experience by unfolding the cause–effect structure of a physical substrate. Specifically, we show that a simple simulated substrate of units connected in a grid-like manner yields a cause–effect structure whose properties can account for the main properties of spatial experience. These results uphold the hypothesis that our experience of space is supported by brain areas whose units are linked by a grid-like connectivity. They also predict that changes in connectivity, even in the absence of changes in activity, should lead to a warping of experienced space. To the extent that this approach provides an initial account of phenomenal space, it may also serve as a starting point for investigating other aspects of the quality of experience and their physical correspondents."
To reference the content of this presentation, please cite Haun, A., & Tononi, G. (2019). Why does space feel the way it does? Towards a principled account of spatial experience. Entropy, 21(12), 1160.
Abstract from Song, C., Haun, A. M., & Tononi, G. (2017). Plasticity in the structure of visual space. Eneuro, 4(3):
"Visual space embodies all visual experiences, yet what determines the topographical structure of visual space remains unclear. Here we test a novel theoretical framework that proposes intrinsic lateral connections in the visual cortex as the mechanism underlying the structure of visual space. The framework suggests that the strength of lateral connections between neurons in the visual cortex shapes the experience of spatial relatedness between locations in the visual field. As such, an increase in lateral connection strength shall lead to an increase in perceived relatedness and a contraction in perceived distance. To test this framework through human psychophysics experiments, we used a Hebbian training protocol in which two-point stimuli were flashed in synchrony at separate locations in the visual field, to strengthen the lateral connections between two separate groups of neurons in the visual cortex. After training, participants experienced a contraction in perceived distance. Intriguingly, the perceptual contraction occurred not only between the two training locations that were linked directly by the changed connections, but also between the outward untrained locations that were linked indirectly through the changed connections. Moreover, the effect of training greatly decreased if the two training locations were too close together or too far apart and went beyond the extent of lateral connections. These findings suggest that a local change in the strength of lateral connections is sufficient to alter the topographical structure of visual space."
Abstract from Grasso, M., Haun, A. M., & Tononi, G. (2021). Of maps and grids. Neuroscience of Consciousness, 2021(2), niab022:
"Neuroscience has made remarkable advances in accounting for how the brain performs its various functions. Consciousness, too, is usually approached in functional terms: the goal is to understand how the brain represents information, accesses that information, and acts on it. While useful for prediction, this functional, information-processing approach leaves out the subjective structure of experience: it does not account for how experience feels. Here, we consider a simple model of how a “grid-like” network meant to resemble posterior cortical areas can represent spatial information and act on it to perform a simple “fixation” function. Using standard neuroscience tools, we show how the model represents topographically the retinal position of a stimulus and triggers eye muscles to fixate or follow it. Encoding, decoding, and tuning functions of model units illustrate the working of the model in a way that fully explains what the model does. However, these functional properties have nothing to say about the fact that a human fixating a stimulus would also “see” it—experience it at a location in space. Using the tools of Integrated Information Theory, we then show how the subjective properties of experienced space—its extendedness—can be accounted for in objective, neuroscientific terms by the “cause-effect structure” specified by the grid-like cortical area. By contrast, a “map-like” network without lateral connections, meant to resemble a pretectal circuit, is functionally equivalent to the grid-like system with respect to representation, action, and fixation but cannot account for the phenomenal properties of space."
Abstract from Haun, A. M., & Tononi, G. (2025). The unfathomable richness of seeing. Trends in Cognitive Science, 29(10), 892–902:
Many hold that visual experience is sparse and its richness illusory, relying on high-level summaries rather than detailed content. However, we argue here that seeing is more than this—it is unfathomably rich. We distinguish three levels of visual phenomenology: high level object and scene categorizations; mid-level feature groupings; and a fundamental spatial field composed of spots and their spatial relations. Crucially, we argue that seeing objects requires seeing the groupings that compose them, and that seeing groupings requires seeing the spatial field that grounds them. Even the most basic feeling of spatial extendedness implies rich phenomenal structure. It follows that much of what we see cannot be used, reported, or remembered. And yet we see it.