Overview
Visual direction and interactive projection visuals created for the music video “Memoria” by MARINE (BMSG).
The project combined projection-based light, performer-reactive visuals, and real-time visual systems to integrate spatial imagery directly into the filmed environment.
Concept & Visual Direction
Because the music video was filmed inside BMSG’s newly relocated office space, preserving the atmosphere and physical presence of the location became an important consideration within the visual direction.
Rather than relying heavily on post-production VFX, the visuals were designed to exist physically within the filmed environment through projection.
Projection was treated not simply as background imagery, but as environmental light integrated directly into the performance space.
Projection mapping, performer interaction, and audio-reactive visual behavior were combined to create an immersive spatial environment throughout the filming process.
Role
Visual Direction / Interactive Visual System Design / Projection Visual Development / TouchDesigner Development / Spatial Previsualization
Tools
TouchDesigner / LiDAR Sensor / Blender / MIDI Controller / Projectors
Process & Spatial Workflow
3D Environment Planning
A 3D model of the filming location was created in Blender to plan projection placement, visual scale, and spatial composition prior to production.
Spatial Previsualization Workflow
Virtual projection tests were developed in TouchDesigner to simulate the filming environment and refine visual alignment before the shoot.
Choreography & Interaction Planning
Choreography reference footage was used to explore how projected visuals should respond to performer movement during filming.
Using TouchDesigner-based previsualization workflows, interaction timing, visual motion, and spatial behavior were tested in advance to refine the relationship between choreography and projection.
Projection-Based Environmental Visuals
Projection-based visuals were designed to transform the filmed environment into an immersive spatial installation.
Inspired by underwater light, drifting particles, and fluid motion, the visuals extended across walls and floors to integrate directly into the physical space during filming.
00:04 — Deep-sea-inspired visuals projected across the walls and floor of the filming environment.
02:20 — Star-like particle trails flowing across the projection-mapped environment.
Performer-Reactive Visual Direction
Real-time performer interaction systems were developed using LiDAR-based tracking, motion-driven visual control, and MIDI-triggered visual transitions.
Visual behavior was designed to respond dynamically to performer movement, allowing projected imagery to evolve in sync with choreography and performer motion during filming.
00:09 — LiDAR-based foot tracking generating ripple-like visual reactions across the projected environment.
02:35 — LiDAR-based performer interaction controlling flowing particle trajectories in real time.
02:38 — LiDAR-based foot tracking used to attract flowing particle motion toward the performer’s feet.
02:38 — LiDAR-based performer tracking and MIDI-controlled visual motion synchronized with choreography in real time.
The projection visuals were designed to exist physically within the filmed environment during production.