Another wild week in XR. As the holiday period kicks off and the final quarter starts to draw to an end, the XR world as always, never sleeps.
A long list of major firms are showing investments in AR/VR/MR solutions this week, with the technology even becoming intertwined with major world events.
Soon, a drive towards consumer adoption of XR will be underway as XR firms will look to boost at-home adoption, showcasing how AR/VR/MR hardware can become part of everyday life and, therefore, part of work life.
OpenAI Looks Towards AR Smart Glasses
Caitlin Kalinowski, Meta’s former Head of AR Glasses Hardware, recently shifted gears to join OpenAI’s technical staff, focusing on robotics and consumer hardware development.
In a X post, Kalinowski said:
I’m delighted to share that I’m joining OpenAI to lead robotics and consumer hardware! In my new role, I will initially focus on OpenAI’s robotics work and partnerships to help bring AI into the physical world and unlock its benefits for humanity.
As noted by Kalinowski, their professional shift aims to encompass robotics while also integrating “AI into the physical world,” which may suggest the development of an AR device. This news follows OpenAI’s hiring of former Apple iPhone leader Jony Ive last year, who was tasked with designing a new hardware product to enhance the company’s AI platform.
This ex-Apple hiring, in conjunction with Kalinowski’s move, may indicate that OpenAI is engaged in research and development for an AI-enhanced AR device or something similar.
AR smart glasses are being viewed as a potential consumer solution that could enhance the use of AI in everyday life. The successful semi-augmented Meta Ray-Ban smart glasses have become a prominent testing ground for such technologies, with Meta showcasing new AI applications during Connect 2024 a few months ago.
While there is clear interest in AR smart glasses, the news remains somewhat speculative, if OpenAI decides to pursue the technology, a product announcement may not occur for several years.
Apple Vision Pro Teases OS Update Amidst Hardware Rumours
Rumours about Apple’s next move in smart glasses are frequently circulating. Recently, Bloomberg reported that Apple is researching AR smart glasses, aligning with the 2024 trend.
According to various sources, Apple is currently involved in a project named “Atlas,” which aims to gather feedback from both Apple employees and competitors regarding AR smart glasses.
Apple also recently released the visionOS 2.2 Beta, the operating system for the Vision Pro spatial computing device. While this beta release may not reflect the final version of the upcoming OS update, the information it provides can offer insights into the future direction of the headset.
Apple’s news regarding the Vision Pro has not been as extensive as earlier this year. Last month, Apple introduced several new hardware updates for its broader product lineup but did not provide any updates on its spatial computing portfolio, leaving only rumours circulating in the media.
With the release of visionOS 2.2 Beta, engineers now have access to first-party updates pertaining to the hardware. The beta update appears to improve support for MR application development on the device. It includes integration with Xcode 16.2, a framework for testing features across Apple’s entire product line.
VisionOS 2.2 and Xcode 16.2 are available to early adopters through the Mac App Store. Furthermore, visionOS 2.2 enhances SwiftUI, a critical framework for updates related to Vision Pro. The beta update also addresses issues with SwiftUI, particularly errors in compiling Swift 6 language modes.
CBS to Use AR/VR During Donald Trump, Kamala Harris US Election Coverage
As the crucial and divisive U.S. election period approached, featuring returning Republican candidate Donald Trump against Democratic candidate Kamala Harris, CBS Stations utilized virtual production technology to visualize important voter information during their newscasts.
CBS’s use of augmented reality and virtual technology does not require headsets. Instead, it offers real-time 3D information that responds dynamically to camera movements and is displayed live on air. In the electoral coverage, CBS implemented this technology across five owned stations in New York, Chicago, Philadelphia, San Francisco, and Denver.
Jennifer Mitchell, President of Stations and Digital for CBS News and Stations, said, “using this technology for the presidential election coverage also paves a way for us to set a new standard in journalism.”
CBS leveraged XR broadcast services from Zero Density’s Reality solution, which integrates Unreal Engine rendering, Chyron Prime graphics platforms, and Myreze virtual sets to enable the visualisations.
Mitchell also added:
As we embark on this historic election, we are committed to bringing our audience closer to the story than ever before. Using our groundbreaking AR/VR technology, we’re not just reporting on the election—we’re immersing viewers in the experience, giving them unprecedented access to the events, data, and insights that shape our democracy.
The RT3D visualizations presented real-time election results within virtual broadcasting environments that emphasized vital information, including national and local race data, interactive maps, and displays of results for municipal and presidential elections.
Disney CTO Steps Down to Lead Internal XR/AI Group
Walt Disney is reaffirming its commitment to emerging XR technologies by establishing a dedicated group to develop AR and AI solutions. The media giant has taken various steps toward adopting and researching AR, VR, and MR, with this new initiative representing a significant advancement in that direction.
Disney announced the creation of a new division called the Office of Technology Enablement. This division will enhance the company’s use of emerging technologies, including XR and the expanding AI sector.
The Office of Technology Enablement is led by the company’s former CTO, Jamie Voris. Voris will focus on leveraging these technologies to strengthen Disney’s position in the media industry, which includes film, television, and theme parks. Eddie Drake has been appointed as Walt Disney’s new CTO, indicating a serious investment in emerging XR and AI technologies. This leadership transition highlights the importance of the new group and its mission within the company.
Alan Bergman, Disney Entertainment Co-Chairman, said:
The pace and scope of the advances in AI and XR (extended reality) are profound and will continue to impact consumer experiences, creative endeavors and our businesses for years to come – making it critical that Disney explore the exciting opportunities and navigate the potential risks. The creation of this group underscores our dedication to doing that.
Walt Disney’s Office of Technology Enablement is focused on blending the real and digital worlds through AR and XR across various projects. A dedicated leadership team currently guides this initiative, which is set to expand significantly with plans to add approximately 100 new employees soon.