9

Symbiotic Consciousness and Distributed Selves in XR

Symbiotic consciousness across bodies.

20 min read

Something that could not happen alone

At fourteen I started jamming at the Staten Island Bluegrass Festival. I was learning what a roomful of musicians could know together.

I worked up my playing alone, with jam-along CDs: the same fiddle tunes at different tempos, a backing band that would wait while I found my way through the form. I did not have friends to play with. When I was finally ready for the picking parties at the Baggot Inn, my mother had to bring me because I was underage. Old-time in the front room, bluegrass in the back, sometimes a splinter jam of hotshots in the middle. I had spent hours preparing to join something that could not happen alone. The recorded band had taught me the tune. In the circle, another player's phrasing could change what the tune asked of me. Someone took a fill and another player covered the rhythmic duty they had left. The music kept going through adjustments no one had to announce.

The circle gives each instrument work to do. The bass has the 1 and the 3. The mandolin's chop answers on the upbeats. The guitar braids strong and weak beats together, and the banjo keeps subdivisions moving through harmony and melody. Those roles enter your hands and breathing. You begin to anticipate where another player will go, and they anticipate you; the anticipations interlock until the ensemble is operating as a single distributed nervous system.

A fill makes the relation audible. One player steps away from keeping the rhythm to answer the singer, and someone else has to hold the place. The sound stays whole because the duties can move. What looks like freedom from the outside depends on this attention to what another player has stopped doing, and on the willingness to take it up.

You affect others' experience. Just by existing.

At ITP, I took a course called "Performing Reality" with Andrew Schneider. The course description began with a sentence that has shaped my thinking ever since: "You affect others' experience. Just by existing."

Schneider is a performance artist and theater maker whose work uses technologylighting, sound, precisely timed cuesto manipulate the audience's perceptual apparatus directly. Not to tell them a story about disorientation but to disorient them. Not to describe the uncanny but to produce uncanniness in their bodies through timing, rhythm, and sensory surprise. His central question: "What behind-the-scenes work can we employ to manipulate experience?"

The course's methodology was radical in its simplicity. We read neuroscienceOliver Sacks's Hallucinations, David Eagleman's Incognito, research on mirror neurons and attentional synchronyas design blueprints. A neurological phenomenon was not something to understand. It was something to stage. The final project brief was explicit: take a neurological, psychological, or physiological phenomenon and use it as the architecture for an experience you put others through.

This reframingscience as blueprint for experience designwas the hinge in my education. Before Schneider's class, I had the classical training (Ovid, the metamorphosed body, the gaze that transforms) and the phenomenological framework (Merleau-Ponty, embodied cognition, the lived body). What I did not have was the operational linkthe understanding that you could take a scientific finding about how the body processes sensory information and reverse-engineer it into a designed experience that produces a specific perceptual or emotional state in the participant.

Musicians have a word for the state the circle reaches when this works. They call it the pocket.

The listener leads

The pocket has a signature you can feel from inside it: the listener leads. When the circle is working, I know where the fiddler's phrase is going before she gets there, and she knows the same about mine. The anticipation is not a guess laid over the sound. It is the sound, heard slightly early.

The same thing happens to a room hearing a story told well. The listeners' attention runs ahead of the teller. Their bodies settle into the story's timing and begin predicting it, and when the prediction lands, the story feels less like something received than something the room is doing together. The brain-imaging work that measured this found the listener's activity leading the speaker's in the best-coupled pairs, and found the coupling reaching past hearing into the regions that predict and comprehend. When a story transports you, the simulation running in your head borrows much of the machinery of actual experience. Transported listeners change their minds. They keep memories with the texture of things that happened to them.

A film does it to a thousand people at once. Well-cut sequences pull an audience's eyes to the same point of the screen at the same moment. The editor is conducting. Cinema through editing, the circle through rhythm, a story through transport: these are one thing, distributed consciousness produced by designed temporal structure. Multiple nervous systems, locked into a shared time, begin to operate as parts of one larger system.

Components of the work

Schneider's course also taught me something about the relationship between the performer and the audience that deepened my experience of playing and singing. In performance, the distributed consciousness is not just between performers. It includes the audience. The performer feels the audience's attention as a physical force—the quality of their silence, the rhythm of their breathing, the collective intake of breath before a reveal. Schneider was explicit about this: the audience's neural states are part of the performance. Their synchronized attention, their motor empathy, their transported simulation are not responses to the work. They are components of the work. The performance exists in the space between the performer's body and the audience's bodies, in the coupling between them.

The Theater of Dionysus did this with fifteen thousand citizens. The theater was designed so the audience could see each other watchingso the distributed consciousness was among the spectators themselves. The collective gasp, the shared silence, the awareness of fifteen thousand bodies attending to the same crisisthese were part of the political technology of the theater. The audience's distributed consciousness was the mechanism through which Athens processed its moral questions.

A ladder I have borrowed and kept

There is a ladder I have borrowed and kept. Albert Michotte, watching film audiences in the middle of the last century, distinguished three levels of a viewer's relationship to a character, and Adriano D'Aloia turned the ladder into a design tool. I use it for the circle.

The three levels are the spectrum of distributed consciousness:

At the base level, there is mere synchronizationfoot-tapping to a musical rhythm, a slight lean when a character leans. The viewer's body responds to the perceived movement, but the response is automatic and shallow. The two systems are coupled at the motor level, but there is no experiential merging. This is what happens when you walk past a street musician and your stride adjusts to the beat without your noticing.

At the middle level, there is motor empathythe viewer's body reproduces the character's posture, facial expression, and movement pattern at the musculoskeletal level. This imitation is less pronounced than the original movement but structurally homologous. Crucially, Michotte insists that motor empathy preserves the separation of subjectivities. There is, as he puts it, "a single action presented in two different forms (visual and proprioceptive), belonging to two distinct subjectivities." This is what he calls "contact at a distance." You feel the other's movement in your own body, but you do not lose yourself. You remain two, joined by a shared motor state.

The circle helps me understand this middle state. The banjo and bass can share a pulse without becoming the same voice. A player can feel where another's phrase is going and answer it without surrendering a phrasing of their own. The coordination depends on distinct people continuing to act. Each must remain able to do something the others have not already done. The ensemble was a system of motor empathies—distinct bodies, each feeling the others' movements, each preserving its own agency within the collective.

At the extreme level, there is full fusionwhat Michotte, invoking Theodor Lipps, calls Einfühlung. The viewer loses self-awareness entirely and merges with the character. There is a single "moving I." The boundary between self and other dissolves. This is the state an immersive experience reaches when it is built for absorption: the participant so far inside the designed world that the frame between their life and the experience goes invisible.

The laddersynchronization, motor empathy, fusionis not only a description. It is a design parameter. The filmmaker moves the viewer up and down this ladder deliberately, through camera movement, editing rhythm, sound design, and the strategic management of proximity to the character's body. In his analysis of Gravity, Cuarón achieves this through cycles of "disembodiment" (the camera spins, the viewer loses orientation, identification breaks) and "re-embodiment" (the camera locks onto the character's movement, stabilizes, approaches the face, penetrates the helmet visor to merge with the character's point of view). Each cycle takes the viewer further into empathetic fusion, then pulls them back, then pushes deeper.

This oscillation—destabilize, restabilize, destabilize at greater depth—is the temporal signature of designed empathetic experience. I recognized something musical in these cycles of deepening attention and release. An ensemble need not hold one intensity throughout a tune. It can build, pull back, build higher, allowing the return to carry what happened before it. D'Aloia gave me another way to think about that movement: how a shared temporal structure can draw bodies closer, let them separate, and give their next meeting more weight.

Design for motor empathy, not for fusion

There is a risk in all of this that must be stated clearly.

The same mechanisms that produce the session circle's distributed consciousness—motor empathy, temporal synchronization, the progressive dissolution of the boundary between self and other—can produce manipulation, coercion, and the erasure of individual agency. A designed experience that deliberately pushes the viewer toward Michotte's third level—full fusion, the loss of self-awareness, the merger of egos—is performing an operation on the participant's body that they may not have consented to and may not be able to reverse.

There is a paradox at the top of the ladder: at the moment of maximum empathetic alignment, the other person's face disappears. When the camera penetrates the visor and merges with Stone's point of view, we stop seeing her. We become her. But becoming-her means she ceases to exist as an otheras a separate subjectivity we are in relationship with. The moment of deepest empathy is also the moment of deepest erasure. We do not feel for her anymore. We feel as her. And the ethical difference between those two states is the difference between empathy and absorption, between relationship and consumption.

Call this the ethics of the thick frame. A thick framea powerful structuring of attention and experiencecan produce Einfühlung: the participant's complete absorption in the designed world. But absorption eliminates the participant's capacity for critical reflection. They are inside the experience, feeling it as their own, unable to perceive the frame that structures their perception. The designer who produces this state without the participant's informed consentor who designs for absorption as the default rather than as an earned, consensual, reversible stateis performing an act of violence on the participant's autonomy.

The ethical principle that emerges from this analysis: design for motor empathy, not for fusion. Design for the session circle's state—distinct bodies coupled, synchronized, operating as a distributed system, but each maintaining its own agency, its own voice, its own capacity to diverge from the collective. The middle of Michotte's ladder, not the top. Contact at a distance. The shared motor state that preserves the separation of subjectivities. The session circle is a thaumatrope: individual musicians on one side, a single distributed consciousness on the other, and the music—the thing the audience actually hears—exists only in the spinning between them.

What it is like to play with the guitarist

Thomas Nagel asked: what is it like to be a bat? His answerthat we cannot know, because the bat's subjective experience is organized around sonar rather than vision, and no amount of third-person description can bridge the gap between our phenomenology and the bat'shas haunted philosophy of mind for fifty years. It is the canonical statement of the problem of other minds: that subjective experience is private, irreducible, and inaccessible to anyone who does not inhabit the specific body that produces it.

Nagel is right. But the question, stated in the abstract, conceals something that playing together reveals. I cannot know what it is like to be the guitarist. But I can know, with extraordinary precision, what it is like to play with the guitarist. I can feel his temporal intention in my body. I can predict his phrasing before he produces it. I can adjust my motor output to complement his in real time. I have access to his sensorimotor style—the distinctive pattern of timing, emphasis, and micro-dynamics that constitutes his way of being a musician.

Intersubjectivity is coupling with another body through shared action. I do not infer the guitarist's intentions through a theory of mind. I feel them through motor empathythrough the alignment of my body's temporal structure with his. And this felt coupling gives me something that no amount of cognitive inference could provide: a participatory knowledge of another person's way of being in the world.

The crew that navigates a ship is the same kind of system. No single sailor knows how to navigate. The knowing is spread across the crew, the instruments, the procedures, and the deck, and it emerges from the coupling between them. The same is true of the session circle. No single musician "knows" the performance. The performance is a property of the distributed system—the players, their instruments, the acoustic space, the players' gestures, the temporal structure they co-produce.

XR can build these systems deliberately. Not by simulating what it is like to be another personthat remains Nagel's unanswerable questionbut by constructing the conditions under which coupling with another person becomes possible. The medium can track two bodies' temporal signatures, visualize their synchrony, reward alignment, and scaffold the progressive deepening of motor empathy that transforms two individuals into a distributed cognitive system.

The exchange went both ways

There is a critical difference between cinema's distributed consciousness and XR's.

In cinema, the viewer is coupled to the character's body through the mediation of the camera. Gravity shows how precisely this coupling can be managedthe four types of camera movement, the cycles of attachment and detachment, the penetration of the helmet visor. But the viewer never acts. Their motor empathy is internaltheir muscles tense, their posture shifts, their breathing synchronizes with the character's, but they do not do anything. The coupling is one-directional. The character's body drives the viewer's body, but the viewer's body does not drive anything back.

Call it the viewer's share. The viewer fills in gaps, generates predictions, simulates the character's mental states. But the share is entirely internal. The viewer's cognitive and motor contribution is invisible to the system. The film does not know the audience is there.

XR breaks this asymmetry. In a shared virtual environment, the participant's motor output is visible to the system and to other participants. Their gestures, gaze direction, posture, temporal patternsall of these are tracked, transmitted, and available as input to the experience. The coupling becomes bidirectional. Two participants in a shared VR space can achieve the kind of motor empathy cinema producesthe reproduction of each other's movement patterns, the synchronization of temporal signatures, the progressive deepening of coordinationbut now both directions of the coupling are active. Each participant drives the other's experience. The distributed consciousness is reciprocal (participantparticipant).

At the Baggot Inn, someone taking a fill changed what another player needed to do. The exchange went both ways. The player giving up a rhythmic duty depended on someone receiving it; the person who stepped in changed what the first could risk. That reciprocity gave the circle its shape while the music was happening.

XR can produce this in contexts far beyond music. Schneider's course taught me to think of every designed experience as a system of couplings between bodies. The question is not "what does the participant see?" It is "what does the participant's body do, and how does that doing couple with the bodies of other participants and with the designed environment?" The answer to that question determines the quality and depth of the distributed consciousness the experience produces.

Hold the divergence where both can meet it

A shared narrative space where two participants inhabit the same story from different perspectivesthe same temporal structure experienced from different positionsproduces the distributed consciousness a told story produces. The participants are running coupled simulations of the same narrative, but their motor contributions to the story (different choices, different paths, different actions) produce divergent yet interlinked experiences. When they compare notes afterward, they discover both what they shared and what they did nota conversation that makes the texture of another person's experience available in a way that no amount of abstract discussion could. Notice where the meeting happens. Not in a shared point of viewthere is none. It happens in the comparing, at the seam between two divergent passes through one structure. The divergence is not noise in the coupling. The divergence is what they meet through.

And notice when it happens: afterward. The coupling did not end when the participants separated. It completed when they compared notes—which means coupling does not require simultaneity at all. A trace left in a shared place—a phrase carved into a bench, an arrowhead turned up in a field, a note in the margin of a library book—carries its maker's sensorimotor style forward in time: the pressure of the hand, the decisiveness or hesitation of the stroke, the choice of this stone, this height, this word. The finder's body reads the trace as a musician reads another's phrase—through a felt response to its movement, arriving late. This is contact at a distance in Michotte's exact sense, with the distance measured in years instead of meters. The two subjectivities never share a moment. They share a place, and the place holds the temporal scaffold the way a shared pulse holds an ensemble—at a longer wavelength. One body inscribes. Another body finds. The coupling exists in the interval between them. The session circle joins its players within a single night; the trace joins two bodies across decades. The mechanism is the same. Only the wavelength changes.

A rhythm-based experience where two participants must synchronize their movements to advance—in complementary patterns, the way the banjo's subdivisions move against the bass's pulse in the circle—trains motor empathy directly. The system can make the coupling perceptible to the participants—the XR equivalent of what the theater's architecture does for the Athenian audience: making the collective state perceptible to the collective itself. But the design must know what drift is. Drift and mismatch are not degradation. They are the moments when one sensorimotor style becomes distinguishable from another—when the participants discover that they are two. A system that punishes divergence by constricting the world has confused the pocket with unison, and the pocket is not unison. Divergence is what the coupling is made of: without it there is nothing to feel in the other, nothing to compare afterward, nothing to find. The environment's job is not to dim when the participants diverge. It is to hold the divergence where both can meet it.

The ordinary condition

Schneider's course ended with a line from George Orwell: "All happenings are in the mind. Whatever happens in all minds, truly happens." And a line from Elmyr de Hory: "If my forgeries are hung long enough in the museum, they become real."

These two statements, placed together, capture the ambiguity of designed experience. If you produce a perceptual state in someone's bodythrough theater, cinema, VR, or the architecture of ancient Romethe state is real. The neural coupling is real. The motor empathy is real. The beliefs formed through transportation are real. The question is not whether designed experiences are "genuine" or "artificial." The question is who has the right to produce them, under what conditions, and with what accountability for the transformations they produce.

Playing together taught me that distributed consciousness is not exotic. It is the ordinary condition of human beings who act together in time. Every conversation, every ensemble, every shared meal, every classroom, every protest march, every religious service is an instance of bodies coupling through temporal structure to produce a shared cognitive state. What XR offers is the deliberate design of distributed consciousness—the construction of environments that produce specific qualities of coupling, specific depths of motor empathy, specific rhythms of synchronization and divergence.

This is a power. As with every power this book examines, the question is how to wield it without destroying what makes it valuable. The session circle's pocket is beautiful because the musicians choose to enter it, because they can leave it, because each voice remains audible within the blend. The design challenge is to build virtual environments that produce pockets—spaces of distributed consciousness that are entered voluntarily, maintained through mutual regulation, and structured to preserve the distinctness of every participating body.

This is what musicians call "the pocket"the state where the ensemble's timing is so precisely aligned that individual contributions become indistinguishable from the collective sound. The pocket is not unison. Each player maintains distinct phrasing, dynamics, emphasis. But the temporal scaffolding is shared, and the body's sense of agency expands to include the other players' actions as extensions of your own motor intention. You are yourself, and you are simultaneously a component in something larger, and these two states do not conflict. They coexist. That is symbiotic consciousness.