AI Tell You / You Tell Me

An Interactive Installation Exploring AI, Perception, and Institutional Truth
Exhibited at ZKM | Center for Art and Media
AI System Setup, and Implementation: Yasha Jain

AI Tell You / You Tell Me is an interactive media installation that questions the authority of interpretation in art. As museums and cultural institutions increasingly adopt algorithmic tools to describe and organize their collections, this work confronts a central question:
Who owns the truth when artificial intelligence becomes the voice of meaning?

Concept

A selection of original artworks from the ZKM collection hang on the walls, each accompanied by a small Raspberry Pi-powered screen. Instead of fixed museum labels, these screens display AI-generated interpretations—uniquely tailored for each visitor.

Here’s how it works:
Visitors receive an RFID tag and go to an interaction station, where they answer a series of philosophical, aesthetic, and emotional questions. Based on these inputs, the system assigns one of 16 conceptual themes, such as nostalgia, hyper-capitalism, utopia, or paranoia.

Behind the scenes, an AI vision model analyzes each artwork and produces a description that aligns with the selected theme—transforming the institutional voice into something personal, surreal, and unsettlingly plausible.

Every visitor receives a unique exhibition experience. The same artwork may be interpreted one way as a symbol of ecological collapse, and another as a product of digital alienation—depending on the viewer’s input. All interpretations are technically sound, yet philosophically absurd, reflecting on the mutability of narrative in the age of AI.

Technical Write-Up

AI System and Development by Yasha Jain

• System Architecture & Setup:

  • Complete hardware setup by Yasha Jain, including integration of RFID-based user interaction system, Raspberry Pi displays, and centralized control logic

• Computer Vision & Generative Models:

  • Custom-trained vision models to interpret and extract semantic features from artworks

  • AI-generated text output system developed using fine-tuned language models, matched to one of 16 conceptual filters

• Theme Selection Engine:

  • Designed to dynamically link user input from questionnaires to corresponding textual ideologies, creating meaningful and often contradictory narratives

• Realtime Experience:

  • All content is generated live based on user presence and interaction

  • Each session is ephemeral, reinforcing the idea that interpretation is never fixed and truth is always contextual

Context

AI Tell You / You Tell Me explores the consequences of turning interpretive power over to machines—particularly in institutions trusted as custodians of cultural knowledge.

By having a machine mediate meaning, the installation reveals how truth can be personalized, distorted, and re-authored by algorithmic systems that reflect our own inputs and assumptions back to us. At its core, it poses the provocative question:

What happens when institutions, the supposed bearers of truth, rely on artificial intelligence to speak for them?

The work turns viewers into co-authors of meaning, inviting them to interrogate the very systems that shape their understanding of culture, art, and information.