I was certain they were characters
I remember sitting at breakfast at the Black River Café, eavesdropping on a table of unfamiliar Gen X-ers who were discussing a construction project and the businesses that would open there. I was certain they were characters. I parsed their conversation for coded references, structural patterns, anything that might be a clue. They were not part of the game. They were people eating breakfast and talking about real estate. But my body could not tell the difference, because the game had trained my body to read all of reality as potentially authored — every conversation a possible script, every stranger a possible character, every ordinary event a possible clue. I was performing Talmudic reading on the world itself, placing the overheard conversation beside the game's narrative and searching for structural rhymes. Except the rhymes were not there. I was producing them. The frame was so total that it generated meaning from noise.
Walk one street and hear another
What the game did to my body by accident at that breakfast can be built on purpose, with one street and one voice. The word for it is haunt.
Janet Cardiff's audio walks demonstrate that audio alone is sufficient to haunt a space. You don't need visual overlays, don't need haptics, don't need full sensory replacement. Just sound—if it's site-specific, if it's spatialized, if it's synchronized with the architecture—can make a location mean differently.
"The Missing Voice (Case Study B)" (1999): The Walk That Doubles the Street
It begins in the crime section of the Whitechapel Library in East London. You put on headphones. Cardiff's voice arrives—recorded binaurally, so close that she seems to stand just behind your shoulder. She describes the room you are in. Then she starts walking, and you follow: out of the library, through Spitalfields and Brick Lane, toward Liverpool Street Station. Her footsteps sound under your footsteps. For fifty minutes you walk one street and hear another—the same street, recorded earlier, laid directly over the one you are standing in.
The story is a detective fiction that refuses to resolve—a woman gone missing, a narrator who may be tracking her or may be her. But the plot is a pretext. The real work happens between the two streets. She describes what she passed; you check it against what you are passing. Some of it is still there. Some of it is gone. The recording and the city drift apart, and the drift is not a flaw in the experience—it is the experience. Her street is perished and objectively immortal on the tape; your street is happening now; you prehend both at once, and they refuse to align. That refusal is the haunting. The palimpsest, built deliberately, as an instrument.
"Her Long Black Hair" (2004): The Photograph Held Against the View
Five years later, Central Park. For the Public Art Fund, Cardiff made a walk that hands you headphones and a packet of photographs. She leads you along the park's nineteenth-century paths, retracing the steps of an unknown woman with long black hair, and at certain points she tells you to take out one of the photographs and hold it up against the view in front of you—the same spot, another time.
The gesture is the whole grammar of mixed reality in one motion. The park does not disappear behind the photograph; the photograph does not dissolve into the park. Two times of one place, held in one hand, refusing to resolve—and you stand in the contrast and feel the place thicken. No headset, no render pipeline. A piece of paper and a voice, and the park is haunted.
The Video Walks: The Screen Held Up to the Station
Then the photograph became a screen. In the video walks Cardiff makes with George Bures Miller—her partner and longtime collaborator—the kit is a small screen and headphones. In "Alter Bahnhof Video Walk" (2012), made for dOCUMENTA (13), you borrow a device at the old train station in Kassel and watch footage shot in that same station, along the same route you are now walking. You hold the screen up and try to keep the recorded station aligned with the standing one. Sometimes they match, and the effect is vertiginous. Sometimes a figure crosses the frame who is not in the hall, or the hall holds someone the frame does not. Twenty-six minutes of past and present sliding over each other in your raised hand.
This is the direct ancestor of every phone raised in a street to see the same street otherwise. The device is a lens onto here—the same place, another time, aligned by your body and undone by your body's drift. And what the walks demonstrate is that the alignment does not need to be perfect. The seams are load-bearing. The haunting lives in the mismatch.
"The Forty Part Motet" (2001): Distributed Choral Architecture
Not all of the hauntings move. Cardiff takes Thomas Tallis's 16th-century choral piece Spem in Alium (written for 40 voices) and spatializes it. Each of the 40 voices is played through a separate speaker, arranged in a wide oval. You walk between them. You stand close to one speaker and hear the soprano line clearly; the other 39 voices become accompaniment, background, context. You move to another speaker and a different voice comes forward—now the bass line is primary, and everything else recedes. You stand in the center and all 40 voices converge, creating the piece as Tallis might have intended it, as a unified whole.
But here's what's crucial: the piece doesn't exist as a single text. It exists as a spatial field of possibilities. Your movement through the space composes your experience. You're not passively receiving the music—you're navigating it, editing it through your body's position. You are authoring your experience of the work through locomotion.
This is distributed narrative in its most elegant form: the full work exists only in the aggregate of all possible paths through the space, but each individual experiences a unique traversal. No two listeners hear the same piece, yet everyone is hearing Spem in Alium. The eternal object (the choral piece) remains identical, but its actualization varies with each listener's spatial trajectory.
The eternal object (the choral piece) ingresses into 40 simultaneous actual occasions (the 40 speakers, each producing sound at each moment). But the prehension, the way an occasion grasps and integrates other occasions, depends on the listener's spatial relation to those occasions. The listener is not outside the work—the listener constitutes the work through their movement. Each step the listener takes creates a new actual occasion in which the 40 sound-occasions are prehended differently. The listener's body becomes a moving locus of integration, constantly creating new unities from the distributed sonic field.
"The Murder of Crows" (2008): The Theater That Becomes a Forest
You enter a darkened space—a gallery, a theater, an installation room. Ninety-eight speakers surround you, arranged in a precise spatial configuration. You sit. Cardiff and Miller's audio begins: footsteps on gravel, wind through leaves, birdsong, the rustle of wings. A gunshot. The sound of a body falling. Crows gathering, their calls building in intensity. Then Billie Holiday's voice singing "Strange Fruit"—Southern trees bear a strange fruit / Blood on the leaves and blood at the root. More gunshots. The sound of war, of genocide, of ecological collapse. The crows return, louder now, accusatory.
The audio is immersive but not replacing. You're still in the theater. You can see the speakers, see the other audience members, see the exit signs. But the theater has become something else. It's a forest. It's a battlefield. It's a lynching site. It's a meditation on violence, on complicity, on the way beauty and horror coexist.
When you leave, the theater is changed. You can't sit in that room again without remembering the fiction. The space is haunted. Not by ghosts, but by narrative. The actual occasions of the theater (the particular moments of sitting, listening, experiencing) have been enriched by the ingression of Cardiff and Miller's narrative eternal object. The theater is now a contrast—it is both a neutral institutional space and the site of Cardiff and Miller's meditation on violence.
This is the power and the danger of site-specific fiction: it persists. The overlay doesn't vanish when the audio stops. The memory of the overlay remains, stuck to the location. The space has been narrativized, and you can't de-narrativize it. The space has become objectively immortal—it perishes as the immediate occasion of the installation, but it becomes a datum for all your future occasions of experiencing that space. Every time you return, you prehend the memory of the installation as part of the space's meaning.
Audio as Minimal Viable Haunting
Cardiff's walks and installations suggest a design principle for mixed reality: start with audio. Don't begin with visual overlays, with 3D models, with full environmental replacement. Begin with spatial audio that's pinned to locations, that responds to movement, that transforms how users experience real space through sound alone.
Audio is cognitively cheaper than visual processing. It doesn't require constant visual attention. It doesn't demand that you look at a screen. It can coexist with other activities. You can listen to a spatial audio narrative while walking, while working, while sitting in a theater, while navigating a city.
But audio is also powerful enough to recontextualize an entire environment. The right sound at the right location can make a park feel like a battlefield, a museum feel like a cathedral, a subway station feel like a cave. Audio has ontological weight—it changes what the space is, not just how it appears.
For distributed narrative systems, this means: layer audio first. Establish the sonic haunting before adding visual elements. Let users navigate space through sound before asking them to look at screens or wear headsets. Audio is the minimal viable haunting—the simplest intervention that can make a space mean differently.
Alice onto institutional bones
Third Rail Projects creates immersive experiences that transform entire buildings into narrative spaces. But unlike theme parks or escape rooms, these spaces are ambiguous. You can't always tell what's part of the fiction and what's part of the real building. The boundary between set and site is deliberately blurred. And unlike Punchdrunk's approach (which tends toward total aesthetic control), Third Rail often works with the existing character of spaces, letting the building's history and architecture co-author the experience.
"Then She Fell" (2012-2020): The Hospital That Became Wonderland
Third Rail's adaptation of Lewis Carroll's Alice books opened in 2012 in the outpatient wing of the former Greenpoint Hospital in Brooklyn. This was a real hospital—people actually suffered there, underwent surgery there, recovered there, died there. The building had its own ghosts, historical ones. Then the show moved. Its long run—seven and a half years, 4,444 performances—played out in a former parochial school in Williamsburg, a building that had never been a hospital at all. The company renamed the venue into the fiction: The Kingsland Ward at St. Johns. They did not find a ward. They declared one.
Third Rail layered Alice onto institutional bones. Fifteen audience members at a time were received into the ward by doctors and nurses. Actors performed scenes—Alice falling, the Hatter's tea party, the Red Queen holding court—and you did not choose your route; the company chose it for you, performers leading you room by room, often one-on-one. You drank "potions"—real liquids, in medicine cups and vials. You were given keys to locked drawers and cabinets, letters to read.
The ethical complexity here is profound, and the move makes it double. In the first building, the fiction was layered onto real suffering—the hospital had its own meanings, its own weight, and Wonderland moved in on top of them. In the second, the company manufactured the haunting the first building had given them for free: a ward constructed inside a former school, the name doing the work the walls no longer could. The space became a palimpsest either way—hospital and Wonderland occupying the same location, each inflecting the other. But in one building the hospital layer was history, and in the other it was scenography.
The giveaway is instructive: the haunting was never in the building. It was in the layering. A real hospital lends its ghosts; a named ward conjures them. What the fiction needs either way is a substrate that resists it—institutional architecture, corridors that mean confinement, rooms that mean care. What it cannot use is neutrality.
But the question remains: is it ethical to narrativize a space of suffering as a site of whimsy and wonder? Does the overlay honor the space or exploit it? Does Alice's fall down the rabbit hole resonate with the experience of illness and hospitalization, or does it trivialize it?
There's no easy answer. But the question itself is crucial for mixed reality design: every space already has meanings. Some are personal, some are cultural, some are historical. When you overlay fiction onto a space, you're not adding to a blank canvas—you're intervening in an existing semantic field. You have to do that carefully, with awareness, with respect for what's already there.
The hospital is itself a nexus of actual occasions—thousands of moments of suffering, healing, dying, caring—that have created a society with its own defining characteristics. When Third Rail overlays Alice onto this society, they're creating a contrast between two incompatible eternal objects (hospital-pattern and Wonderland-pattern) ingressing into the same nexus of occasions. The power of the work comes from this tension—the way the whimsy of Carroll and the gravity of medical suffering refuse to synthesize, creating instead a sustained dissonance that makes both more vivid.
"The Grand Paradise" (2016): The Resort as Temporal Labyrinth
"The Grand Paradise" took place in a Bushwick warehouse transformed into a tropical resort at the end of the 1970s—a fountain-of-youth paradise at the moment the seventies were curdling into the eighties. You arrived as a guest. Sixty audience members a night were met with tropical drinks and flower garlands and released into the resort: the beach, the disco, the motel rooms, the floorshow, performers who drew you away for one-on-one encounters.
The fiction was about time refusing to pass. The resort's centerpiece was a fountain of youth; its characters were consumed by aging, desire, the moment already slipping. And its deepest instrument was you—a present-tense body walking through a meticulously reconstructed 1979. The audience was the anachronism. Every room held two times at once: the resort's endless summer and the present you carried in through the door. The show's ache—all that longing about youth and lost time—ran exactly along the seam between them.
The innovation here: the threshold did the time travel. Outside the warehouse it was 2016; inside it was 1979 and holding—the way a resort holds, out of season, out of history, promising that time can be made not to pass. Walking through the door was temporal traversal. The building became a four-dimensional architecture—three spatial dimensions plus the temporal one, all navigable at once.
This is a crucial model for mixed reality: space as temporal index. Different locations can trigger different temporal overlays. Walking from one room to another isn't just spatial traversal—it's temporal traversal. The fiction doesn't just haunt the space; it makes the space into a time machine.
The resort is a society of occasions with a defining characteristic—the 1979-pattern—maintained against constant pressure from the present, which arrives nightly in the bodies of sixty guests. The boundary is permeable by design. Every occasion inside is a contrast: the resort-pattern and the present-pattern ingressing at once, and the intensity of the show is the intensity of that contrast.
The 1970s party hasn't disappeared; it persists as an objective datum that can be prehended by present occasions. The resort exists in a state of temporal superposition, where multiple pasts are simultaneously available for prehension.
"Ghost Light" (2017): The Theater That Remembers Itself
"Ghost Light" took place in the Claire Tow Theater at Lincoln Center, made with LCT3. The premise: the theater itself is the haunted site. The audience was led out of the house and into the theater's hidden body—the wings, the dressing rooms, the crossover, the world on the far side of the proscenium. The title names the lamp left burning on an empty stage overnight, and the superstition underneath it: that a dark stage draws its ghosts, or that the ghosts need the light to find the stage.
Performers surfaced as the theater's own populations—stagehands, stars, chorus lines—playing out fragments of the backstage life every production leaves behind. Scenes overlapped, interfered, ran at once in different rooms. A performance about performance: the superstitions, the rituals, the smoke and mirrors that conjure the theater's mystique. The theater became a palimpsest of every show it had held and every show it might hold, all present at once.
The innovation: performative archaeology. The fiction didn't import a narrative into the space—it excavated the life the space already leads. And here is the joke with teeth: the Claire Tow was five years old. The ghosts were not residues of that building; they were residues of the form—every theater's accumulated rituals, terrors, and superstitions, condensing into whatever theater will hold them. A stage inherits its haunting the day the ghost light is first switched on.
This is a crucial ethical model for site-specific fiction: instead of imposing your narrative onto a space, you amplify the narratives that are already there. You make the space's own history audible, visible, palpable. You're not colonizing the space with your fiction—you're helping the space tell its own story.
Every actual occasion perishes, but it becomes objectively immortal—it persists as a datum for future occasions. "Ghost Light" makes this objective immortality experientially available. You don't just know that the theater's past is present; you feel it, hear it, encounter it as a living presence. The space becomes a thick nexus where past occasions remain actively prehensible rather than merely historically recorded.
Punchdrunk's "Viola's Room" (2024): The Intimate Haunting
While Punchdrunk is known for large-scale works like "Sleep No More," "Viola's Room" (2024, at the company's home in Woolwich) was an intimate haunting—and a radical subtraction. The company synonymous with masked crowds and a performer around every corner removed the performers entirely.
You entered barefoot, in a group of no more than six, wearing headphones. Helena Bonham Carter's recorded voice told the story—Barry Pain's 1901 gothic tale "The Moon-Slave," adapted by the novelist Daisy Johnson—while a trail of light led you through a sequence of exquisitely built rooms, darkness pooling between them. No actor ever appeared. The voice in your ears and the light at your feet were the only guides.
The subtraction is the point. Everything a Punchdrunk show usually distributes across a building and a cast was compressed into sound, touch, and dark: bare feet reading the floor, a voice binaurally close, rooms that had to be trusted blind. It is a Cardiff walk staged inside a built world—the audio walk brought indoors and given scenery. A quarter century after "The Missing Voice," the most spectacle-rich company in immersive theater arrived at Cardiff's conclusion: the voice is enough.
The innovation: haunting at the scale of the body. Six people, no crowd, no cast to watch—nothing to spectate at all. The fiction was private, personal, nearly solitary. The haunting was scaled to individual consciousness rather than collective experience: whatever the story became, it became inside you, at the pace of your own bare feet.
This is crucial for mixed reality: not all hauntings need to be public or distributed. Sometimes the most powerful fiction is intimate, private, singular. A space that's haunted for you alone, that responds to your presence, your movement, your choices.
With no performer to prehend and no crowd prehending you, the walk strips the occasion to its minimum ingredients—a body, a place, and a voice carrying the story's eternal object. Nothing mediates the ingression. The intensity comes from that absence: you are alone with the pattern, and the pattern has nowhere to land but you.
A stain that spread across the entire campus
Alternate Reality Games (ARGs) take the opposite approach from immersive theater. Instead of concentrating fiction in a single building, they distribute it across multiple media, multiple locations, multiple platforms. The fiction becomes pervasive—it's online, offline, in phone calls, in physical spaces, in emails, in newspapers, in your daily life.
The frame between fiction and reality breaks—and it stays broken for weeks or months. But this broken frame, this epistemic uncertainty, can be used for play or for manipulation. The same techniques that make ARGs engaging can make propaganda dangerously effective.
Personal Case Study: The Obie Game at Oberlin
I encountered the Obie Game during my first years at Oberlin College — an annual ARG designed and run by students, distributed across campus through cryptic messages, hidden objects, fake websites, phone numbers on flyers, and midnight meetings in academic buildings. The 2008 game, "It's All Relative," centered on a time disturbance beneath the Mudd Library ramp — gravitons sent backward through time, reality altering around the players, historical anachronisms walking the streets of Oberlin in period costume. The 2009 game, "Slippery When Wet," threaded a fifty-year-old mystery through a team of fictional thieves whose private message board you could access through a backdoor, a package that arrived at your actual mailbox from fictional characters, and a dead woman who sent your team a photograph. The game's own cancellation by the administration was part of the fiction. The frame kept eating the frame that contained it.
These games changed my life. They restructured my perceptual apparatus, and the restructuring was irreversible.
Teams had to conceal from one another that they were playing, lest they sabotage each other's progress. This meant the game had no visible boundary. There was no theater to enter and exit, no headset to put on and take off. The magic circle — Huizinga's boundary between play and ordinary life — was not a circle at all. It was a stain that spread across the entire campus. My team and I were so deep inside it that we could not tell where reality ended and the game began.
The proof of how complete the immersion was came from my teammate Marck. One day I received a text message with an ISBN number from the Mudd Library service. I was certain it was a clue. I raced to the library. I retrieved the book clandestinely — checking over my shoulder, concealing it in my bag, moving with the urgency of someone on a mission. I returned to our team's headquarters in the dorm and could hardly contain my excitement. I pulled the book from my bag and presented it feverishly.
Marck thanked me for the book. He needed it for a research paper he was writing. He had sent the ISBN through the library's text service — a perfectly ordinary function of the campus infrastructure — knowing that the game had so thoroughly colonized my perception that I would interpret any message through any channel as a potential game instruction. He took full advantage of my immersion. It was a practical joke, and it was also a perfect demonstration of the point: once the frame between fiction and reality breaks, the body does not know how to re-establish it. Every verb in that story is a body verb — raced, retrieved, concealed, presented feverishly. My body was playing the game. My body could not distinguish between a game instruction and a friend's prank because the game had trained my body not to distinguish. The peplos was on. I could not take it off.
And after the reveal — after the laughter, after the embarrassment — the training persisted. I did not stop reading reality as a designed environment after Marck's joke. I did not stop reading it after the Obie Game ended for the semester. I have not stopped reading it since. The game rewrote my perceptual apparatus at Oberlin, and I went on to spend the rest of my life building the things it taught my body to see. The body accumulates, the body persists, there is no restore point. The Obie Game was my Actaeon moment — the gaze that transforms the gazer irreversibly.
"The Institute" (2013): When ARG Becomes Life
Spencer McCall's documentary "The Institute" chronicles the Jejune Institute, an ARG that ran in San Francisco from 2008 to 2011. Created by artist Jeff Hull, it started with a simple premise: you'd see a flyer around the city inviting you to "join the Jejune Institute." If you followed the instructions, you'd arrive at an office building, take an elevator to a specific floor, and find an actual office—reception desk, waiting room, corporate branding.
You'd watch an "orientation video" featuring a charismatic leader explaining the Institute's mission (something vague about human potential and consciousness expansion). Then you'd be given a "mission"—find specific locations around San Francisco, complete tasks, look for clues.
But as you played, the game got stranger. You'd encounter other players. You'd find evidence of a resistance movement opposing the Institute. You'd receive cryptic messages. You'd attend events where the line between performance and reality was completely blurred. Street performers might be game characters, or just street performers. Homeless people might be actors, or just homeless people.
The game ran for three years. Some players became obsessed. They spent hours every day searching for clues, attending events, creating elaborate theories. The game became more real than their actual lives. Work, relationships, responsibilities—all became secondary to the game.
McCall's documentary interviews several players who describe the experience as transformative—but not always in healthy ways. One player says: "I couldn't tell what was real anymore. I'd be at work and think my boss was part of the game. I'd be with my girlfriend and wonder if she was an actor." Another: "It took me months after the game ended to feel normal again. I'd still see clues everywhere. I couldn't turn it off."
This is ARG at its most powerful and most dangerous: it becomes a total environment, a pervasive reality that replaces or subsumes ordinary life. The fiction doesn't just haunt reality—it becomes reality.
The game created a rival society—a nexus of occasions with its own defining characteristics that competed with the society of ordinary life for ontological primacy. Players were experiencing two societies simultaneously, and the game-society was often more vivid, more intense, more meaningful than the ordinary-society. The game-society's defining characteristic (the pattern of clues, mysteries, and missions) was ingressing so strongly into players' actual occasions that it was overwhelming other patterns (work-pattern, relationship-pattern, self-care-pattern).
The Elsewhere Public Works Agency: When the Meta-Game Becomes the Game
The resistance had a name: the Elsewhere Public Works Agency—an underground network dedicated to exposing the Institute and dismantling it, complete with its own induction, its own mythology, its own missions. Players were recruited by Jejune and then recruited against it; the game handed you a villain, then handed you the fight. And players who followed the arc to its end discovered that the resistance, too, was Jeff Hull's creation. Both sides—the sinister Institute and the rebels working to bring it down—came out of the same studio, the San Francisco arts group Nonchalance. The entire conflict was scripted. There was no outside of the game—only another layer of fiction.
The vertigo outlived the game. McCall's documentary keeps the blur going: former players describe their induction, their missions, their awakening, and you cannot always tell which of them are documentary subjects and which are performances—whether the film is a record of the game or its final level. Even the exit was inside.
This is infinite regress: once the frame between fiction and reality breaks, it's impossible to re-establish it with certainty. Every apparent "reality" could be another layer of fiction. Every "sincere" statement could be performance. Trust becomes impossible.
This is not just a problem for games—it's a problem for epistemology in the digital age. When any image can be faked, any video deepfaked, any news story fabricated, any person online potentially a bot—how do we know what's real? ARGs train us in this epistemic uncertainty, but they don't necessarily equip us to handle it responsibly.
QAnon demonstrates how ARG techniques can be weaponized for political manipulation and radicalization. It's not a game—there's no "game master" coordinating it (or if there is, they're using it for propaganda, not entertainment). But it uses exactly the same mechanics as ARGs: distributed clues, epistemic uncertainty, collective sense-making, the breaking of the frame between fiction and reality.
Set beside that a Seder at which every hand at the table holds a different Haggadah, and the story exists only in the performance the table makes together.
The fiction is bleeding into public space
This is not an ARG (it's not hidden, not game-like, not based on epistemic uncertainty). It's not immersive theater (it's not performed by actors in a constructed environment). It's participatory ritual where narrative authority migrates from reader to reader, and coherence emerges through coordinated difference.
Scenario: The Seder doesn't happen in a single room. It happens distributed across a city. Each participant is in a different location—one in a park, one in a museum, one in a subway station, one at home, one on a bridge, one in a hospital. But they're all synchronized—connected by spatial audio, by AR overlays, by the shared ritual spine.
When it's your turn to read, your location becomes the center of the narrative. The Exodus is happening here, in your specific place, in your specific environment. The site-specific fiction overlays onto your real location.
You're in the park. It's your turn to read about the parting of the Red Sea. You put on your AR glasses. The overlay activates. The pond in the park becomes the Red Sea. You see the water parting, revealing a path through. You see the Israelites crossing—translucent figures moving through the park, walking on the dry ground where water should be. You hear the sound of waves held back, of footsteps on wet sand, of people singing in relief and terror.
You read: "And Moses stretched out his hand over the sea, and the Lord drove the sea back by a strong east wind all night and made the sea dry land, and the waters were divided."
And everyone else—in their different locations across the city—sees your version. They see the park through your AR overlay. They hear your reading. They see the pond parting. For this moment, the park is the site of the Exodus. The Red Sea is here, in this city, in this park, now.
Then authority passes to the next person, in the museum. It's their turn to read about the plague of darkness. Their AR overlay activates. The museum galleries become Egypt under the ninth plague. The lights dim (virtually—the actual lights stay on, but the AR overlay makes everything appear dark). They see Egyptian families huddled together, unable to see each other, terrified. They hear whispers, crying, prayers.
They read: "And there was thick darkness in all the land of Egypt for three days. They did not see one another, nor did anyone rise from his place for three days."
And everyone else—including you, still in the park—sees their version. You see the museum through their AR overlay. You see the darkness descending. For this moment, the museum is Egypt under the plague. The darkness is here, in this city, in this museum, now.
The fiction migrates through physical space, haunting each location temporarily. Each site becomes, for a moment, the center of the narrative. And then the center shifts to the next location.
The Danger: Haunting Multiple Sites Simultaneously
You're haunting multiple real locations simultaneously. Each location has its own history, its own meaning, its own other people (who aren't part of the Seder).
The fiction is bleeding into public space. The park is being used by families, by joggers, by people reading on benches. The museum has other visitors. The subway has commuters. None of these people consented to have the Exodus overlaid onto their environment.
How do you ensure the fiction doesn't violate the space or the people in it? How do you prevent the Seder from becoming an imposition on public space?
This is the central ethical problem of distributed mixed reality: you're not just affecting your own experience—you're potentially affecting everyone's experience of shared space. Even if the AR overlay is only visible to Seder participants, the behavior of participants (gathering in specific locations, performing ritual actions, speaking aloud) affects non-participants. The space is being claimed for the Seder, at least temporarily.
Site-specific fiction can overwhelm reality. If too many fictions are overlaid, if too many ghosts haunt the same space, if too many narratives compete for the same location—the real world becomes unnavigable.
You can't see the space for all the fictions. You can't experience the present for all the overlaid pasts. The space becomes semantically saturated—carrying so many meanings that it becomes meaningless, or carrying such conflicting meanings that coherence breaks down.
This is the tragedy of the semantic commons: if everyone has the right to overlay fiction onto public space, and if there are no coordination mechanisms, the result is chaos. The space becomes a battlefield of competing narratives, each trying to claim the space for its own purposes.
We see this already in the digital realm: websites cluttered with ads, pop-ups, notifications, all competing for attention. The result is noise. Mixed reality threatens to do the same to physical space—turning every location into a cacophony of competing overlays.
Who has the right to haunt a space?
Who has the right to haunt a space?
When you overlay fiction onto a real location, you're changing that location, for yourself and potentially for others. You're imposing a narrative onto a space that has its own meanings, its own uses, its own stakeholders.
Case Study: Pokémon GO and the Holocaust Museum
When Pokémon GO launched in 2016, players discovered there were Pokémon in the United States Holocaust Memorial Museum. The game had automatically placed virtual creatures—cute, collectible, game-ified—in a space of mourning, of memory, of atrocity.
Players were walking through the museum, looking at their phones, trying to catch Pokémon. The fiction (the game) had inappropriately overlaid onto a space where that fiction was disrespectful. The museum—a site dedicated to remembering genocide, to honoring victims, to educating about the horrors of the Holocaust—was being gamified.
The museum asked Niantic to remove the Pokémon. Niantic complied. But the damage was done. The space had been violated by the game's fiction. People who were trying to mourn, to remember, to learn were distracted by other people playing a game. The sacred space had been profaned.
The lesson: Site-specific fiction requires consent—from the space, from the community, from the people who hold that space sacred or meaningful. You can't just impose narrative onto any location. You need permission, care, respect for what's already there.
But the Pokémon GO case also reveals a deeper problem: algorithmic haunting. Niantic didn't deliberately place Pokémon in the Holocaust Museum. Their algorithm automatically designated locations as "PokéStops" based on criteria like "interesting landmarks" and "public gathering spaces." The algorithm had no semantic understanding of what those spaces meant. It couldn't distinguish between a park (appropriate for a game) and a Holocaust museum (inappropriate for a game).
This is a crucial warning for mixed reality: as AR becomes more widespread, as more fictions overlay onto more spaces, we need semantic awareness built into the systems. Algorithms need to understand—or at least check—what spaces mean before overlaying fictions onto them.
Design Principles for Ethical Haunting
1. Consent from the space
If you're haunting a public space, consider who has authority over that space and what that space means to different communities.
* A park might be appropriate for a game or a ritual, if the activity doesn't exclude other users.
* A memorial or sacred site requires explicit permission and careful consideration of whether any fiction is appropriate.
* A privately owned space (museum, theater, store) requires permission from the owner.
* A space with contested meanings (e.g., a site of historical trauma that different communities remember differently) requires negotiation among stakeholders.
Every actual occasion has a subjective aim—an internal purpose, a direction of becoming. Spaces (as societies of occasions) have collective aims. Ethical haunting respects those aims rather than overriding them. If a space's collective aim is mourning, your fiction should support mourning or refrain from haunting that space. If a space's collective aim is play, your fiction can be playful. The fiction should ingress in ways that are compatible with the space's existing character.
2. Respect for existing meanings
Every location already has meanings—historical, cultural, personal. Your fiction should acknowledge those meanings, should layer onto them rather than replacing them.
The haunting should add to the space, not erase what's already there. Ideally, the fiction should amplify or illuminate the space's existing meanings rather than competing with them.
Example: Third Rail's "Ghost Light" didn't impose an arbitrary narrative onto the Claire Tow Theater. It excavated the history of theater as a form, making that history audible and visible. The fiction honored the space by revealing what was already there.
Counter-example: Overlaying a cheerful, playful game onto a site of historical trauma competes with the space's existing meanings. It asks people to ignore or override the site's history in order to engage with the fiction.
3. Visibility of the fiction
People who aren't participating should be able to see that something is happening. The fiction shouldn't be invisible to non-participants.
If you're performing a ritual in a park, other people in the park should be able to understand that a ritual is happening, even if they're not part of it. If you're playing an AR game in a museum, other visitors should be able to see that you're playing a game (through your behavior, your equipment, your interaction with the space).
Transparency prevents the fiction from feeling like invasion or surveillance. If the fiction is invisible, non-participants might feel like they're being watched or manipulated without their knowledge. They might feel like the space has been taken over by something they can't see or understand.
Transparency also allows non-participants to opt out. If they can see that a ritual or game is happening in a specific area, they can avoid that area if they don't want to encounter it.
4. Reversibility
The haunting should be temporary. The fiction should fade. The space should be able to return to its pre-haunted state.
Permanent haunting without consent is colonization—you're claiming the space, imposing your meaning, preventing others from experiencing it differently.
This doesn't mean the fiction can't have lasting effects. People who participated will remember the haunting. The space will be different for them. But the space itself—for non-participants, for future users—should be able to return to its prior state.
This is respecting the perishing of occasions. Each occasion comes into being and then perishes, becoming objective immortality (a datum for future occasions). Ethical haunting allows spaces to perish and become available for new becomings. The haunting should be an occasion (or a series of occasions), not a permanent alteration of the space's defining characteristics.
5. Opt-in participation
People in the space should be able to choose whether to engage with the fiction. If someone is in the park and doesn't want to see your AR overlays, doesn't want to hear your audio, doesn't want to be part of your ritual—they should be able to opt out.
The haunting shouldn't be forced on anyone. This is especially important for pervasive AR that might be visible to everyone with AR glasses, not just participants in a specific experience.
Design implication: AR systems need filtering mechanisms. Users should be able to control what overlays they see, what audio they hear, what fictions they encounter. The default should be minimal haunting, with users opting in to specific experiences rather than having to opt out of pervasive fictions.
6. Semantic awareness and algorithmic responsibility
If you're using algorithms to place fictions in locations (like Pokémon GO), those algorithms need semantic awareness. They need to understand—or at least check—what spaces mean before overlaying fictions onto them.
This might involve:
* Databases of sacred sites, memorials, trauma sites that should be excluded from certain types of fiction
* Community input mechanisms where local residents can flag inappropriate overlays
* Human review of algorithmically generated placements before they go live
* Machine learning systems trained to recognize semantic categories (memorial, playground, hospital, etc.) and apply appropriate constraints
The goal is to ensure that hauntings are appropriate to the spaces they inhabit.
It transforms the body
Site-specific fiction doesn't just haunt the space—it transforms the body.
You arrive at the park for your turn in the distributed Interdimensional Seder. You put on your AR glasses. The overlay activates. You see the Red Sea—the pond is now the sea, parting, revealing the path through. The water is held back by invisible walls, and you can see the sea floor, wet and glistening, stretching across the pond.
But you also see yourself differently. You look down at your hands and they're different—darker, calloused, marked with symbols you don't recognize. You see your reflection in the parted water and it's someone else—an ancient face, weather-worn, eyes full of fear and hope. You're wearing different clothes—rough linen, sandals, a cloak.
You've become an Israelite slave, fleeing Egypt, standing at the edge of the impossible.
The site-specific fiction has changed your body. You're not just seeing the Exodus—you're embodying it. The location has triggered a metamorphosis.
And the metamorphosis is site-specific—it only happens here, in this park, at this moment. When you leave the park, when you take off the AR glasses, your body returns to normal. Your hands are your hands again. Your reflection is your reflection again.
But the memory of the transformation persists. You can't walk through that park again without remembering what it felt like to be someone else, to inhabit a different body, to stand at the edge of the Red Sea in the body of a slave.
The Power: Site-Specific Metamorphosis
Site-specific metamorphosis makes locations transformative. The place doesn't just remind you of something—it changes you. It gives you a different body, a different perspective, a different subjectivity.
This is pilgrimage in its deepest sense: being transformed by the journey. The site has agency—it acts on you, reshapes you, makes you into something you weren't before.
This is transmutation—the way a nexus of occasions can be felt as a single characteristic that then becomes a datum for new occasions. The park-as-Red-Sea is a transmuted feeling that becomes part of your future self-understanding. But more radically, the body-as-slave is a transmutation of your own bodily society. Your body (normally experienced as a society with a specific defining characteristic—your identity, your habitual sense of self) is temporarily re-characterized. A different defining characteristic (slave-identity, ancient-body) ingresses into your bodily society, creating a profound contrast with your usual self-sense.
This is the Proteus Effect: the phenomenon where avatar embodiment changes users' psychology, behavior, and sense of self. If you embody a taller avatar, you become more confident in negotiations. If you embody an older avatar, you become more future-oriented in financial decisions. If you embody a different race or gender, your implicit biases shift.
The Proteus Effect shows that embodiment is not just representation—it's ontologically constitutive. The body you inhabit shapes who you are, how you think, how you act. And in mixed reality, this embodiment can be site-specific: different locations trigger different bodies, different identities, different subjectivities.
The Danger: When Transformation Sticks
What if the transformation persists? What if you leave the park but the changed body remains—psychologically, phenomenologically? What if you can't fully return to your prior sense of self?
This is not hypothetical. After embodying an avatar with different characteristics, users sometimes report feeling different for hours or days afterward. The avatar's characteristics bleed into their sense of self.
For site-specific metamorphosis, this raises serious ethical questions:
* Consent: Did users consent to the possibility of feeling like a different person afterward?
* Reversibility: Can users reliably return to their prior sense of self, or does the metamorphosis leave lasting traces?
* Psychological safety: What if the embodied identity triggers trauma, dysphoria, or identity confusion?
* Cultural appropriation: Is it ethical to let users embody identities (racial, cultural, historical) that aren't theirs? Does embodying a slave trivialize slavery? Does embodying an ancient Israelite appropriate Jewish identity?
Site-specific fiction in mixed reality isn't just about seeing differently—it's about being differently. And that power requires profound ethical care.
And the street is the palace
You leave the honky-tonk. George Jones's "The Grand Tour" is still playing in your head—the three-minute palace you just walked through. You are on the street now, past the corner store, the bus stop, the apartment building. And the street is the palace. That corner is the living room where she left him. That building is the bedroom he can't enter. That bus stop is the kitchen table where they used to eat breakfast.
The song has overlaid onto reality. The compressed architecture you carried out in your head has re-expanded into space. But it has not replaced the street. It is haunting it.
The Phenomenology of Re-Expansion
The song was the compression: spatial into temporal, the mansion folded down into a melody small enough to carry on a barstool. What happens on the street is the inverse—temporal back into spatial—and the inverse is not a reversal. You do not return to the original room. The song does not reconstruct the honky-tonk; it infects the block you are walking down. You take the portable form and lay it over new ground. The fiction does not pull you out of the world. It makes the world mean differently.
Whitehead's Ingression
Whitehead has the vocabulary for this, and it is worth borrowing. In Process and Reality he separates actual occasions—the concrete, perishing events that are the real units of the world—from eternal objects, the patterns that can enter those events without being spent. "The Grand Tour" is an eternal object. When you hear it in the honky-tonk it ingresses into that occasion: you, that bar, that hour, that particular weather of light and bourbon and whoever is sitting two stools down. The song becomes concrete by happening there.
But an eternal object can ingress more than once. The same song enters the new occasion of you on the street, and the pattern recurs without repeating—the song-in-the-bar and the song-on-the-block are the same song and not the same event, because no two occasions are. This is what makes a fiction portable: it can enter many spaces, taking the specific grain of each while holding its shape. The palace travels because it can re-ingress anywhere there is a body to receive it.
The Street as Palimpsest
The street was never blank. It is already thick with occasions—every walk anyone has ever taken down it, each with its own grain, its own errand, its own arrival. Mixed reality does not scrape that surface clean. It writes over it. The street becomes a palimpsest: more than one text on the same ground, each one half-covering and half-revealing the others.
This is the line between mixed reality and virtual reality, and it is not a line of degree. VR replaces the street—you are not on it anymore, you are in the bar or the palace or the spaceship, and the street's occasions are suspended while another world runs in their place. Mixed reality keeps the street and adds to it. The street is still the street. It is also the palace. Both are present, and they refuse to resolve—both patterns ingress into the same occasion at once, and the occasion thickens with the work of holding them. Whitehead's word for that held tension is contrast: incompatible things coexisting in one event without canceling out.
That contrast is what makes this haunting and not immersion. A ghost does not replace the house; it moves in. It makes the house uncanny, and once you have seen it you cannot unsee it—the house is changed even after the ghost is gone. The street you are walking now is both itself and the room where she left him, and the two will not synthesize. They spin. The disc does not stop when the song ends; you carry the spinning out the door. The jukebox follows you home—and so does everything the jukebox was a palace for.
The fiction bleeds into reality
The fiction doesn't stay contained. The portable palace expands back into reality. The song follows you home. The memory overlays onto real locations. The narrative distributes across physical space.
You can't unsee the fiction once it's overlaid. You can't walk past the park without remembering the Red Sea. You can't enter the museum without remembering the plague of darkness. You can't ride the subway without remembering the journey through the wilderness.
The spaces are permanently changed—experientially. They're haunted. They mean differently. They carry the weight of the fiction you overlaid onto them.
The Gift
Site-specific fiction makes the world richer, more meaningful, more navigable. The real world becomes a distributed palace—every location is a room, every street is a hallway, every city is an architecture of memory and meaning.
This is the promise of mixed reality: to make the world resonate with more meanings, more stories, more possibilities. The world becomes thicker, more textured, more alive with narrative.
This is intensity of experience—the way occasions can be more or less unified, more or less rich in contrast. Site-specific fiction increases the intensity of spatial experience by layering multiple meanings onto the same location. A park is just a park (low intensity) or a park is also the Red Sea, a site of liberation, a place of transformation (high intensity). The fiction makes the world more, not less.
The Ethical Framework
Site-specific fiction requires care, consent, coordination. You can haunt a space, but you have to do it responsibly. You have to respect the space, respect the people in it, respect the other meanings that are already there.
And you have to build exits. The fiction should be temporary. The haunting should fade. The space should be able to return to itself.
But—and this is crucial—you'll be changed. You can remove the AR glasses, you can leave the park, you can end the ritual. But you can't undo the experience. The fiction has changed how you see that space. The memory has overlaid onto that location. The distributed narrative has made you part of the collective story.
The palace follows you home. The song is pinned to the street corner. The fiction bleeds into reality.
And that fiction will change your body.
Coda: Ingression and the Ontology of Mixed Reality
Mixed reality works by controlling the ingression of eternal objects into actual occasions. The narrative pattern (the eternal object) ingresses into specific locations and times (actual occasions) through technological mediation (AR glasses, spatial audio, haptic feedback, etc.).
But crucially, the same eternal object can ingress into multiple actual occasions. The song "Grand Tour" ingresses into the honky-tonk, into your walk home, into the park you pass, into your memory weeks later. Each ingression is unique (because each actual occasion is unique, with its own specific characteristics and context), but they're coordinated (because they share the same eternal object, the same pattern).
This is what makes distributed narrative possible: the same narrative pattern can ingress into multiple locations, multiple bodies, multiple moments, creating a society (a coordinated nexus of occasions) that extends across space and time.
The Interdimensional Seder is a society: each reading is an actual occasion, each reader is a nexus of bodily occasions, but they're all coordinated by the shared pattern (the Exodus narrative spine). The society has a defining characteristic (the ritual structure, the synchronized readings) that makes it one thing despite being many occasions.
The ethical question becomes: who controls which eternal objects ingress into which actual occasions? Who decides what narratives haunt what spaces? Who has the authority to coordinate the ingression of fiction into reality?
This is not a question of representation (does the fiction accurately represent reality?) but of ontology (how does fiction become part of reality?).
Mixed reality doesn't just show you things. It changes what is. It makes fictions actual. It causes eternal objects (narrative patterns, fictional identities, imagined architectures) to ingress into actual occasions (real locations, real bodies, real experiences). And that power requires responsibility.
The gift of mixed reality: it can make the world richer by enabling the ingression of more eternal objects, creating more contrast (the coexistence of incompatible elements), increasing the intensity of experience.
The danger of mixed reality: it can make the world chaotic by enabling the uncoordinated ingression of conflicting eternal objects, creating incoherence and overwhelm.
The ethical framework: we need coordination mechanisms for site-specific fiction—ways to ensure that the ingression of fictional eternal objects into real spatial occasions is appropriate, consensual, reversible, and respectful of existing meanings.
We need, in other words, to become responsible for the hauntings we create.
The Seder is a dependency graph. Fifteen nodes — Kadesh, Urchatz, Karpas, through to Nirtzah — each self-contained, each carrying its own ritual weight, each connected to the others through a sequence that has been traversed for three thousand years. But the sequence is not the meaning. The meaning is produced by the specific body at the specific table in the specific year performing the traversal. Six billion possible emotional paths through fifteen fixed nodes — the architecture of Day of the Tentacle applied to the oldest ritual technology I know. This is the thaumotrope at its most dangerous and its most beautiful: fiction on one side of the disc, reality on the other, and the haunting — the thing that follows you home, the thing that changes your body, the thing that will not let you return to the world you left — produced by the spinning between them. The disc does not stop when you leave the honky-tonk, the theater, the Seder table, the haunted street. The body carries the spinning with it. The fiction follows you home because the thaumotrope is your body now.