spatial audio
Search documents
Hands-on experience with Spatial Audio for Apple Immersive Video | Meet with Apple
Apple Developer· 2025-12-10 00:01
Spatial Audio Design Principles - Immersive audio design should account for the entire visual frame, as viewers can explore different areas and focus on mini-stories within the scene [1][2][5][6] - Spatial audio should consider the sonic world behind the viewer, utilizing equirectangular representations to place sounds accurately in 360-degree space [7][8][9][10] - Headlocked stereo is suitable for elements like voiceover and narration, where the sound should remain constant relative to the viewer's ears, rather than being spatialized within the scene [12][13][14][15][42][43][44] DaVinci Resolve Fairlight Integration - DaVinci Resolve integrates editing, color correction, and Fairlight audio post-production, enabling a collaborative workflow without data exchange between pages [17][18] - Fairlight offers standard DAW tools, including faders, spatial panners (azimuth, elevation, Cartesian view), built-in EQ, dynamics processors (compressor, gate, limiter), and bus routing [18][19][20][21][22] - Fairlight supports ASAF (Apple Spatial Audio Format) master bus output, allowing for mixing in binaural, stereo, or speaker system configurations, optimized for the listening environment [23][24][25][26] - Buses can be set up in Fairlight to route audio signals to different destinations, including ambisonic formats for Apple Immersive Video [27][28] ASAF Workflow and Features - ASAF and ambisonics enable realistic positioning of sounds in the sound field, such as placing stereo sounds in the upper canopy of trees [37][38] - Headlocking in Fairlight can be achieved by routing a track to the main ASAF output, selecting the track, and enabling the headlocked option in the inspector [43] - DaVinci Resolve Fairlight's IntelliTrack, an AI-based tracker, automates complex pan moves by tracking objects in the video, saving time for audio engineers [52][53][54][55][56] Project Setup and Delivery - Apple Immersive Audio requires DaVinci Resolve Studio (the paid version) and enabling Apple Spatial Audio in the Video and Audio I/O preferences [57][58] - Final output for Vision Pro or master files can be delivered through the Deliver page, with options for Vision Pro Review or creating a master file bundle [58][59]
Meet the Apple Immersive Video format | Meet with Apple
Apple Developer· 2025-12-03 20:52
Apple Immersive Video (AIV) Key Features - AIV aims for perfect fidelity, targeting 20/20 vision (60 pixels per degree) and a field of view between 180 and 230 degrees [3][4][20] - AIV uses dynamic bespoke projection, eliminating the need for lat long conversion, saving production time and storage space [5][6] - AIV emphasizes world scale, using accurate lens calibration data (ELPD file, approximately 50kB) to avoid warping and stitching artifacts [7][8][9] AIV Technical Specifications and Workflow - AIV capture and playback occur at a minimum of 90 frames per second and 7200x7200 resolution per eye, resulting in a 44x increase in pixels compared to 4K [11][12] - AIV production format uses ProRes, uncompressed, or Raw, while delivery format uses a lightweight video track (MV-HEVC) and Apple Positional Audio Codec (APAC) [27][28][29] - AIV ecosystem is designed for simplicity, with all-in-one cameras, 2D-like editing workflows, and a streamlined encode and delivery pipeline [21][22] AIV Acuity and Delivery - AIV uses acuity (pixels per degree) as a key metric, targeting 60 pixels per degree to achieve a sense of presence [16][20] - AIV employs foveation, a special imaging process, and MV-HEVC tuned encoders to preserve acuity while reducing image sizes for efficient delivery (target delivery size of 4320x4320 per eye) [34][35][36][37][38] - AIV incorporates motion data into every shot, allowing creators to visualize camera motion in the timeline and use it as a story tool [39][40][41]