All of it Now (AOIN) at Coachella 2023 involved crafting augmented reality (AR) experiences, AOIN used Stage Precision’s SP software.
As the sun rose on Coachella 2023, AOIN faced several challenges. The project brief included enhancing the main stage livestream broadcast to create a new augmented reality platform for artists including Gorillaz, Bad Bunny and Blackpink. As a central component of Coachella’s 2023 marketing campaign, Coachella introduced the “mirage effect,” an interstitial element that combined real-world objects with digital elements, a task undertaken within Unreal Engine’s real-time compositing pipeline. To achieve this, AOIN collaborated closely with Nexus, and stYpe’s team to develop a custom compositing solution.
“The Coachella project was challenging because we had to manage a large amount of content as well as send out a large amount of data to trigger specific events and effects,” recalled Berto Mora, CTO at AOIN. “This difficulty was compounded by the fact that we were working with multiple teams, which created logistical programming challenges.”
Amidst the challenges, SP by Stage Precision emerged as the operator controller, bringing together the entire workflow. “We used SP board views to create a user interface to monitor all engines and cue lists at a glance,” remarked Vishal Sharma, UE Operator at AOIN. “This removed our need to visit each individual machine; a game-changer as we were able to control all six engines from one desk, with timecode, tracking data and genlock united into a single source of truth.”
SP offered the AOIN team other advantages to traditional workflows: “The 3D visualiser allowed us to visualise in 3D space, as opposed to 2D, which helped us to think differently about the environment and space that we were augmenting,” commented Mora, highlighting the versatility of SP’s software features. “Additionally, we used SP to control our video router to switch between mains and backup engines, whilst the robust cue list system provided us with a method of triggering all engines simultaneously via OSC, with scalable control via unicast commands.”
Looking to the future, the team considers Stage Precision a key tool in their mission to usher in a new era of AR experiences. “At this year’s festival, we supported three artists as well as Coachella’s marketing team. SP allowed us to maintain the cues and commands for each specific artist, segmenting them so there was no chance of mistakenly cueing the wrong content during a performance,” explains Mora. “With this workflow, we are prepared to scale to support more artists in 2024 and beyond, as well as open the possibilities to support more tracked cameras and engines in the future.”
