spatialcomputing.info

Apple appears to be getting ready to unveil its first mixed reality headset at its Worldwide Developers Conference (WWDC) in June. Now a report from Bloomberg maintains the Cupertino tech giant is also prepping a dizzying number of first-party apps, including gaming, fitness, video and collaboration tools.

Bloomberg’s Mark Gurman is a lightning rod for all things Apple, and in his new info dump it appears we now have a pretty sizable list of first-party content coming to the still very much under-wraps mixed reality headset.

Here’s all of the major apps and features mentioned in the report:

• iPad apps adapted for mixed reality: Calendars, Contacts, Files, Home control, Mail, Maps, Messaging, Notes, Photos, Reminders, Music, News, Stocks, and Weather apps.
• FaceTime: conferencing service will generate 3D versions of users in virtual meeting rooms.
• Freeform collaboration app: will let users work on virtual whiteboards together while in mixed reality.
• Work apps: Pages word processing, Numbers spreadsheet and Keynote slide deck apps, as well as iMovie and GarageBand for video and music production.
• Apple TV: both immersive sports content and traditional video content – the latter presented in virtual environments, such as a desert or the sky.
• Apple Books: will allow users to read in virtual reality.
• Fitness+: will let users exercise while watching an instructor in VR.
• Multitasking & Siri: will be able to run multiple apps at the same time, floating within the mixed reality space. Siri voice control is also present.
• Camera app: can take pictures from the headset.

Provided all of the above is accurate, Apple may be releasing the industry’s most feature-rich headset out of the gate, as it appears to be hauling in a ton of its mature and battle-tested ecosystem of apps.

It’s also said that gaming will be a major focus—a reversal from previous reports. This could mean we’ll see a wider push for Apple to court third-party developers soon after release, which is said to release a few months after is June unveiling, priced at somewhere around $3,000.

As for hardware, as many suggested in the past, Gurman reconfirms the existence of a dial crown similar to the one seen on Apple Watch, which will let the wearer seamlessly switch between virtual and augmented reality views.

Here’s a compilation list of alleged Apple MR headset features scavenged from previous reports—all of which you should take with a heaping handful of salt. We’ve broken them down into specs and design rumors:

Rumored Apple MR Specs

• Resolution: Dual Micro OLED displays at 4K resolution (per eye)
• FOV: 120-degrees, similar to Valve Index
• Chipset: Two 5nm chips. Includes a main SoC (CPU, GPU, and memory) and a dedicated image signal processor (ISP). Chips communicate via a custom streaming codec to combat latency.
• Battery: Waist-mounted battery, connected via MagSafe-like power cable to the headset’s headband. Two-hour max battery life, although hotswappable for longer sessions.
• Passthrough: ISP chip contains custom high-bandwidth memory made by SK Hynix, providing low latency color passthrough
• Audio: H2 chip, providing ultra-low latency connection with the second-generation AirPods Pro and future AirPods models. No 3.5mm and possible no support for non-AirPod BT headphones.
• Controller: Apple is said to favor hand-tracking and voice recognition to control the headset, but it has tested a “wand” and a “finger thimble” as alternative control input methods.
• Prescription Lenses: Magnetically attachable custom prescription lenses for glasses-wearers.
• IPD Adjustment: Automatic, motorized adjustment to match the wearer’s interpupillary distance.
• Eye Tracking: At least one camera per-eye for things like avatar presence and foveated rendering
• Face & Body Tracking: More than a dozen cameras and sensors capture both facial expressions and body movements, including the user’s legs.
• Room Tracking: Both short- and long-range LiDAR scanners to map surfaces and distances in three dimensions.
• App Compatibility: Said to have the ability to run existing iOS apps in 2D.
• Price: $3,000 – $4,000

Design Rumors

• Outer Shell: Aluminum, glass, and carbon fiber to reduce its size and weight. Cameras are largely concealed for aesthetic reasons.
• Presence Displays: Outward-facing display can show user’s facial expressions and also presumably eye movements. Said to be an always-on display similar in latency and power draw of Apple Watch or iPhone 14 Pro.
• Dedicated Passthrough Switch: Digital Crown-like dial on its right side to switch between VR and AR.
• Headstrap: Various available, including consumer-focused headstrap similar in material to Apple Watch sport bands with built-in speakers. Unspecified, but different headstrap targeted at developers.

– – — – –

As you’d imagine, Apple has confirmed absolutely nothing, so we’ll be tuning in for the June 5th keynote to see whether we’ll finally get a big “one more thing” moment we’ve been waiting for.