Hands-on experience with visual effects for Apple Immersive Video | Meet with Apple

Immersive VFX Challenges & Solutions - Immersive VFX is more complex than traditional VFX due to stereo lenses, high frame rates (90 fps), and 8K resolution per eye [2] - Even simple VFX elements can have a significant impact in immersive environments if executed well [3] - Previsualization in 180 degrees is crucial for planning various aspects of production, potentially justifying budget through cost savings [4][5] - Data capture on set (HDRIs, photogrammetry, LiDAR scans, etc) is essential for adding elements, cleanup, and ensuring spatial awareness in stereo [6][7] - Camera tracking accuracy is critical due to the realistic stereoscopic depth in immersive experiences [9] - Reviewing VFX work in Apple Vision Pro is necessary at all stages to avoid discrepancies between 2D monitors and the final immersive output [10] DaVinci Resolve/Fusion Workflow for Immersive Video - DaVinci Resolve's Fusion tab offers tools for immersive VFX, including Immersive Patcher, LatLong Patcher, and Panomap [15][18] - The Immersive Patcher converts lens space images to rectilinear images for easier paint and compositing work, with adjustable angle of view [20][21] - The Panomap tool converts between different formats, such as immersive to lat-long, useful for stabilization and CG render mapping [23][24] - Fusion allows previewing work in the Apple Vision Pro headset by combining left and right eyes into layers using a combiner node [26][27] - DaVinci Resolve can pass through the ILPD metadata into EXRs, maintaining camera information throughout the VFX pipeline [74] - Spherical Stabilizer in Fusion can stabilize shaky camera footage by converting immersive space to lat-long space [86][87]