SpatialGen Platform Overview - SpatialGen is designed for spatial computing, handling multi-terabyte files and streaming unique video formats [3] - The platform supports visually lossless formats like ProRes and Resolve release exports [3] - SpatialGen offers a free macOS app for uploading ProRes files, AIM bundles, and Final Cut zip files, supporting 2D and 3D spatial videos including Apple Immersive Video [5] - Users can upload videos via browser, tagging video characteristics, adding audio tracks and subtitles [5] - SpatialGen allows real-time updates to audio and subtitles without downtime, with options for setting resolutions and bitrates or using auto-configured options [6] Apple Immersive Video Streaming - Apple Immersive Video streams are fully automated, with Spatial Audio building dynamic metadata [7] - Digital rights management (DRM) is supported to prevent piracy, including Apple's Fairplay DRM [7][8] - SpatialGen provides HLS links for Apple Immersive Video, enabling distribution on Vision Pro, multiple Apple platforms, and custom apps [8][9] - SpatialGen's API allows integration into any app or website, with a published Streams endpoint for testing before launch [9] Performance and Quality - SpatialGen uses quality metrics like VMAF, aiming for scores over 90, and has achieved significant improvements in VMAF scores even at low bitrates like 30mbps [14][15] - SpatialGen monitors and embeds developments around Foveation into the platform [15][16] Use Cases and Applications - SpatialGen is trusted by brands and creatives, powering experiences on Vision Pro [10] - The platform is leveraged for enterprise use cases, including pilot training and defense workflows [11] - SpatialGen has contracts with the United States Air Force and is used by Immersive India to reduce costs [12]

Colorfront's Solutions for Apple Immersive Video - Colorfront aims to empower storytellers by providing tools that push the boundaries of immersive video creation [1] - Colorfront's software runs natively on macOS and is optimized for Apple Silicon, ensuring top performance [3] - Colorfront Onset Dailies delivers a streamlined, color-accurate workflow, ensuring what is seen on set matches the final experience on Apple Vision Pro [4] - Colorfront Transcoder ensures every frame is delivered with precision, meeting the highest industry standards for quality and performance [5] Technology and Industry Recognition - Colorfront's color science and media processing are built on the Colorfront Engine, trusted by major productions [6] - Colorfront's innovations have been recognized with scientific and technical awards from the Academy of Motion Picture Arts and Sciences and the Television Academy [7] - Colorfront's tools are used by Apple TV Studios, Disney, Sony Pictures, Company 3, and Picture Shop [8] - Colorfront supports Apple's content creation, powering immersive experiences with high-quality workflows, as seen in titles like Metallica [9] Workflow and Performance Enhancements - Colorfront captures, displays, and carries forward rich metadata, preserving critical information throughout the workflow [13] - Colorfront supports AIV for instant playback in Apple Vision Pro and ProRes AIM for offline editorial workflows [16] - Colorfront's distributed rendering allows workflows to scale across multiple systems, improving performance by up to 300% [17][19] - Colorfront integrates the MainConcept Immersive Encoding Library to enhance video quality and performance for Apple Immersive Video [20]

Spatial Audio Acquisition - Industry emphasizes recording Ambisonics spatial audio from the camera's perspective, especially in documentary filmmaking, to capture the entire sonic environment [7] - Industry suggests using mono recordings in addition to spatial recordings for dialog, prioritizing individual mics due to the wide field of view in immersive experiences [13][14] - Industry highlights the availability of various ambisonic microphones with similar form factors to regular shotgun microphones, offering options for different needs and budgets [10] Sound Editorial - Sound editorial involves assembling and layering dialog, sound effects, and music, similar to standard post-production [15] - Industry recommends using Foley and Ambiances to build immersion by focusing on small, everyday sounds [19][20] - Industry suggests compiling and assembling all sound sources, including multiple spatial mics and individual mono ISOs, during sound editorial [18] Spatial Mix - Industry advises anchoring sounds to visual elements using Apple Spatial Audio instead of relying on a center channel, as the audience is inside the scene [26] - Industry recommends mixing on headphones to ensure the mix translates well with regards to perspective and dynamic range [30] - Industry stresses the importance of reviewing work on Apple Vision Pro to accurately judge distance, perspective, and sound positioning [31]

Camera & Equipment Preparation - For expedition shoots, under 100W travel-safe, stackable V-mount batteries are essential for power [4] - 16 terabyte media modules are recommended for prioritizing the moment, but long download times should be planned for [7] - Overpacking media and power is recommended to avoid limitations in the field [8] Monitoring Solutions - Internal LCD wing is an excellent mobile monitoring option for quick deployments [10] - Single eye monitoring is fantastic for heli work, gimbal techs, crane techs, and underwater operations [12] - Dual I monitoring is important for checking lens consistency and avoiding issues like bugs on the lens [12] Aerial Equipment & Considerations - Heavy lift drones like Alta X have limited battery time (approximately 5 minutes) in cold weather [16] - Planning for VFX costs is necessary to remove blades and booms from final footage when using Alta X [17] - Cablecam allows for intimate shots without disturbing wildlife [18] Dailies & Post-Production - Dailies are essential for confirming the frame, especially since the composition can only be accurately assessed in a Vision Pro [20] - A small slimline Mac Pro with multiple raids is ideal for confirming shots in the field, while a cart with multiple Mac studios is suitable for faster backup and processing power on land [21]

Good morning. I'm Deep and I'm the lead immersive audio architect at Apple. This year, our team publicly released new end to end immersive audio technology involving a new audio format, the Apple Spatial Audio Format or ASAF, and a new codec called APAC. Today, I'm excited to give you an overview of this new format and the new codec. I'll also dive into the workflow a little bit and tooling to create content in this new format.Let's explore the format a little bit. The format allows content with both HOA ob ...

Apple Immersive Video (AIV) Key Features - AIV aims for perfect fidelity, targeting 20/20 vision (60 pixels per degree) and a field of view between 180 and 230 degrees [3][4][20] - AIV uses dynamic bespoke projection, eliminating the need for lat long conversion, saving production time and storage space [5][6] - AIV emphasizes world scale, using accurate lens calibration data (ELPD file, approximately 50kB) to avoid warping and stitching artifacts [7][8][9] AIV Technical Specifications and Workflow - AIV capture and playback occur at a minimum of 90 frames per second and 7200x7200 resolution per eye, resulting in a 44x increase in pixels compared to 4K [11][12] - AIV production format uses ProRes, uncompressed, or Raw, while delivery format uses a lightweight video track (MV-HEVC) and Apple Positional Audio Codec (APAC) [27][28][29] - AIV ecosystem is designed for simplicity, with all-in-one cameras, 2D-like editing workflows, and a streamlined encode and delivery pipeline [21][22] AIV Acuity and Delivery - AIV uses acuity (pixels per degree) as a key metric, targeting 60 pixels per degree to achieve a sense of presence [16][20] - AIV employs foveation, a special imaging process, and MV-HEVC tuned encoders to preserve acuity while reducing image sizes for efficient delivery (target delivery size of 4320x4320 per eye) [34][35][36][37][38] - AIV incorporates motion data into every shot, allowing creators to visualize camera motion in the timeline and use it as a story tool [39][40][41]

Learn directly from developers about how they implemented the new design and Liquid Glass across Apple platforms. In this series of online presentations by third-party teams like Slack, LTK, and Tide Guide, you’ll find out how developers of all sizes are embracing native design, expressing their brand identities, and quickly and successfully adopting the latest features. This activity also includes a panel discussion with Apple designers. To explore additional sessions, appointments, and workshops, view the ...

Technology & Development - The session focuses on teaching the basics of app development using Swift and SwiftUI [1] - Participants will build a simple view from an iOS demo app in Xcode [1] - The session covers adding text fields and photos to capture input and saving information using SwiftData [1] - A complete, interactive interface will be created by the end of the session [1] - The session requires a Mac running macOS Sonoma 140 or later and Xcode 15 or later [1] Resources & Events - Additional sessions, appointments, and workshops are available via the Meet with Apple activities worldwide [1] - Apple Developer resources include video sessions, documentation, and forums [1]

Want your game to reach one of the largest global gaming audiences. Tune in for a full day of practical insights. Learn how to create compelling player experiences that scale beautifully across every Apple device and bring your game to hundreds of millions of players around the world. ...

Event Focus - Apple is hosting an all-day online activity streaming from Cupertino focused on game development for iOS, iPadOS, macOS, and visionOS [1] - The event aims to help developers succeed in the Apple ecosystem by leveraging Metal, optimizing for Apple silicon, designing handheld experiences, and navigating the App Store [1] Session Highlights - Morning session (10:00 a.m - 12:30 p.m PT) covers topics like charting a course to Apple platforms, leveling up with Apple game technologies, bringing PC and console games to Mac, power/performance/scale on iPhone and iPad, and designing great interfaces for handheld games [1] - Afternoon session (1:30 p.m - 3:30 p.m PT) focuses on transforming games with Apple Vision Pro, unlocking success with premium games on the App Store, boosting discoverability and engagement with the Apple Games app, and exploring curation and featuring on the App Store [1] Resources and Engagement - Additional sessions, appointments, and workshops are available via the full schedule of Meet with Apple activities worldwide [1] - Apple provides developer resources including video sessions, documentation, forums, and a developer app [1]