The piece “Reflections” explores power relationships through the manipulation of angle and time. A rotatable double-sided reflective surface (commonly known as a whiteboard) inherently forces spectators into two disparate experiences.
It is impossible for one person to see both sides at once. While someone tilts the whiteboard, they can only see the effect on their own experience. They are thus naturally inclined to disregard the experience of “the other” (side).
The piece uses two projectors, two cameras, a whiteboard, an accelerometer, and signal processing to create this interaction opportunity.
Projectors are directed at each side of the whiteboard, positioned so that a person may stand in front of the board without blocking the light. Two cameras are mounted on top of the whiteboard, pointing in opposite directions.
An iPhone is affixed to the top of the whiteboard so that the y-axis of its accelerometer corresponds to the tilt of the board. Camera feeds and accelerometer data are processed using Max/MSP/Jitter, with images mapped through Millumin.
Within Max, an operator can switch between different “recipes” that dictate how inputs are mixed into outputs.
One recipe uses the tilt of the board to control playback of recorded video. This mode begins with a recording period in which people move in front of the cameras.
During playback, the tilt controls the temporal position of the playhead, allowing the interactor to move forward and backward through recorded frames, either one frame at a time or rapidly.
A second recipe layers live video with delayed video, creating a double image. The tilt of the whiteboard determines how delayed the second image appears.
Before the first workday, we discussed various ideas — including projecting on a mirror ball — but nothing fully resonated. Once we began working together, we quickly landed on the idea of projecting on two sides of a whiteboard.
The fact that only one side of the whiteboard could be seen at a time led to discussions around privilege and the physical relationship between interactors and the angle of the board. While we initially considered using found footage, we settled on live camera feeds for their generative and performative qualities.
After experimenting with the basic setup, we realized the potential of capturing data about the tilt of the whiteboard. Since smartphones contain numerous sensors, we chose to use an iPhone’s accelerometer to interpret the board’s angle.
With this data, we brainstormed different methods of mixing inputs, eventually landing on the idea of navigating recorded video using tilt.
We then began building a Max patch and enhanced the setup with directional lighting and the iPhone integration. Over two working sessions, we observed how projected light bounced off the whiteboard, casting murky figures onto the surrounding architecture.
Recognizing this as a powerful visual effect, we incorporated it into the core of the piece. A false wall was added so both sides of the installation could experience this reflection.
We refined our recipes, including one that composites a current frame with a past frame to form a double image. With all components — laptop, projectors, cameras, Millumin, Syphon, and Max — fully integrated, we shared the completed work with our class.