Apple is rolling out the initial beta of visionOS 2.4 today, and it could be the most significant update for Apple Vision Pro users to date. This update introduces support for Apple Intelligence, significant enhancements to Guest Mode, a new Spatial Gallery application, an Apple Vision Pro application for iPhone, and more. Here’s what you need to know…
“Apple Vision Pro is revolutionizing the way users communicate, collaborate, and enjoy entertainment — and we’re committed to expanding the possibilities of spatial computing with visionOS 2.4,” said Mike Rockwell, Apple’s vice president of the Vision Products Group. “With Apple Intelligence, Vision Pro users will elevate their productivity and creativity through features like Writing Tools, Image Playground, and Genmoji. We can’t wait for users to experience and share exciting new experiences with the Spatial Gallery.”
Support for Apple Intelligence
With the launch of visionOS 2.4, Apple Vision Pro now includes support for Apple Intelligence, Apple’s range of AI features. Previously, Apple unveiled these capabilities for iPhone, iPad, and Mac at WWDC last year, but Apple Vision Pro users were left out — until now.
Genmoji allows Apple Vision Pro users to create personalized emoji based on text descriptions and photos from their library. This feature is integrated directly into the keyboard across various Apple applications, including Messages.
Image Playground enables users to generate images based on ideas, text descriptions, and photos from their library. This application is designed specifically to utilize Vision Pro’s spatial computing capabilities and is also incorporated into the Messages app.
The writing tools feature is also being integrated into visionOS 2.4. This feature aids in proofreading and rewriting text, offering built-in options for adjusting the tone of your writing to be friendlier, more professional, or concise. Users can also create summaries, key points, lists, and tables from their text. Additionally, on Apple Vision Pro, the Writing Tools can utilize ChatGPT to generate text based on user prompts.
Smart Reply features are now integrated to analyze email and Messages threads to suggest appropriate responses. This version also introduces a memory movie functionality within the Photos app, enabling users to craft custom memory movies styled according to personal descriptions, with Apple Intelligence selecting the best images and videos to tell the story. Natural language search within the Photos app is also a new addition.
Here are a few additional details regarding Apple Intelligence in visionOS 2.4:
visionOS 2.4 also integrates Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries. Apple Intelligence uses on-device processing to safeguard user privacy whenever possible. For tasks requiring more substantial models, Private Cloud Compute extends Apple’s privacy and security protocols into the cloud, unlocking additional intelligence capabilities. When utilizing Private Cloud Compute, user data is never stored or shared with Apple; it is solely used for executing the request. Independent experts have the ability to audit the code running on Apple silicon servers, ensuring verification of this privacy commitment.
Currently, Vision Pro maintains its existing Siri functionalities without upgrades. For instance, users cannot access ChatGPT through Siri on visionOS 2.4, as is possible with other Apple Intelligence platforms. Apple has indicated that more features and languages for Siri will unfold for Apple Vision Pro during the upcoming year.
Introducing the New Spatial Gallery App
In addition to Apple Intelligence support, visionOS 2.4 brings a variety of new features to Vision Pro, including a novel Spatial Gallery app. This application aggregates spatial photos, videos, and panoramas into a single location. Content curated by Apple for Vision Pro users will be offered at no cost and will receive regular updates.
The Spatial Gallery app encompasses various categories such as sports, travel, entertainment, and much more.
Apple describes it as follows:
visionOS 2.4 unveils Spatial Gallery, a new application showcasing a selection of spatial photos, spatial videos, and panoramas curated for Apple Vision Pro. Users will be able to savor stunning and intimate moments across art, culture, entertainment, lifestyle, nature, sports, and travel, with new content rolled out regularly. At launch, notable photographers like Jonpaul Douglass and Samba Diop will present remarkable perspectives, along with new narratives and experiences from iconic brands like Cirque du Soleil, Red Bull, and Porsche; behind-the-scenes glimpses from Apple Originals such as Disclaimer, Severance, and Shrinking; along with special moments from prominent artists.
Apple Vision Pro Application for iPhone
Alongside iOS 18.4, visionOS 2.4 introduces a new “Apple Vision Pro” application for iPhone. Through this app, Vision Pro users have access to exclusive content, spatial experiences, and helpful tips regarding their devices.
The app features a robust Discover page, which showcases immersive videos from the TV app, content from the Spatial Gallery app, and new applications and updates. This page is also where Apple will spotlight upcoming features for Vision Pro. Additionally, the “My Vision Pro” section presents details about serial numbers, optical inserts, AppleCare coverage, and more.
The app will automatically appear on your iPhone following updates to iOS 18.4 and your Apple Vision Pro to visionOS 2.4. Users without an Apple Vision Pro can still download this app from the App Store to explore the Discover page and gain insight into the spatial computing platform.
Enhancements to Guest User Feature
The Guest User feature allows Apple Vision Pro owners to share their headset easily with friends, family, and colleagues. The initial iteration required the device owner to wear the headset and select apps to share. Afterward, the guest could put the headset on and complete hand and eye tracking calibration.
With the release of visionOS 2 last fall, Apple enhanced the feature so guest users could save their calibration data for 30 days, simplifying the process for future access.
visionOS 2.4 introduces another notable improvement. Owners no longer need to wear Vision Pro before sharing it. Guests can now don the headset and request access from the owner, who will see a prompt on their iPhone to approve the request and select which apps to share.
During this process, owners can activate AirPlay to monitor the guest’s activity and provide guidance as needed.
Conclusion
visionOS 2.4 also includes several other minor enhancements for Apple Vision Pro. The Dictation feature now supports voice editing, and users can resolve inline math equations in the Notes app, similar to the functionality introduced in iOS 18 last year.
The first developer beta of visionOS 2.4 is available starting today, with a public release scheduled for April.
Follow Chance: Threads, Bluesky, Instagram, and Mastodon.
