Last Week in AVP #20: Every Detail From, WWDC 24, visionOS 2, New Native Apps, Keyboard Breakthrough, Improved Hand Tracking, Hand Tracking and more!
Official visionOS 2 Feature List
The official feature page here. Below are some additional details not on the official page.
Keyboard Breakthrough works with Macbook
By default Apple announced support for the Magic Keyboard
Interesting to see that breakthrough works with the macbook! (source)
And it does work with non apple keyboard (source)!
visionOS 2 indicate that the Sky Environment will be returning
New code strings and an icon added in visionOS 2 indicate that the Sky Environment will be returning!
Code strings: SKY_NOTIFICATION_MOVE_AROUND_MESSAGE: "To help detect the ceiling for Sky."
SKY_NOTIFICATION_MOVE_AROUND_TITLE: "Move Around the Room" SKY_NOTIFICATION_UNAVAILABLE_TITLE: "Sky is Unavailable" SKY_NOTIFICATION_UNAVAILABLE_BUTTON_TITLE: "Dismiss" SKY_NOTIFICATION_UNAVAILABLE_MESSAGE: "Try again in a different space."
Hand tracking vastly improved in visionOS 2
Hand tracking has advanced prediction algorithm and runs at 90Hz. Technical details confirmed in a WWDC session.
Force quit multiple apps (source)
visionOS 2.0 environments depth map
visionOS 2.0 now takes your environments depth map into account so you can easily snap your personal spatial objects onto countertops, chairs, floors, etc
Full camera feed access now available for Enterprise Distribution
I know a lot of users wanted real time visual overlays etc which is only possible with camera feed access.
visionOS 2 contains an image of the Lake Vrangla Environment at night (source)
It is very likely that Lake Vrangle will be included as part of visionOS 2
Safari videos in Environment (source)
Here’s a demonstration how to activate the safari video in environment feature (also shown at top of post).
Windows persists through reboot
I was able to confirm that windows now persist in their positions after a reboot.
visionOS 2 only masks out the floor where you're walking (source)
visionOS 2's .mixed mode safety passthrough has an interesting change, instead of making the entire view go transparent while moving, it only masks out the floor where you're walking (and probably walls if you're about to run into them)
Blackmagic URSA Cine camera in development, designed to capture content for Apple Vision Pro
Introducing Blackmagic URSA Cine Immersive! New camera in development, designed to capture content for Apple Vision Pro with 8160 x 7200 resolution per eye, 16 stops of dynamic range for 90fps stereoscopic 3D immersive cinema content and more! Available later in 2024. Learn more!
Object tracking! You can now use real world objects as anchors in visionOS
Major visionOS volumes improvements! (including this sick hover animation)
Real-time audio! Virtual objects can generate procedural sound effects and react to real world materials (hitting a soft chair vs. a hard table)
Multiview videos! Now you can show up to 5 videos playing simultaneously on visionOS. Great for sports and livestreaming baby animals 24/7
Metal rendering! …is now available in mixed immersion!
With visionOS 2, Apple Vision Pro Can Print What You See (source)
RealityKit’s new LowLevelMesh API (1, 2)
Convert any photo into a 3D spatial photo
If you haven’t tried turning any photo into a 3D spatial photo yet, it will truly blow your mind (source)
Persona in visionOS now has both visual and sound feedback when people doing high five, fist bumping or finger touching. (source)
Translucency effects can be achieved with the new blurred background shader graph node in Reality Composer Pro (source)
visionOS 2.0 secretly added some new eye comfort settings for users to tweak/adjust (source)
Just in case they run into eye strain issues with the default alignment.
New home screen gesture requires eye gaze (source)
To stop a user from accidentally summoning or clicking it during usage, it only appears when the user’s eye gaze is directly on the hand that they want to UI to appear from
You can use physical controllers to interact with Vision Pro (source)
Passwords App as a native app on visionOS 2
VisionOS 2 Enables Custom Hover Effects
VisionOS 2 Enables WebXR by Default, Unlocking a Cross-platform Path to Vision Pro (source)
Updated Human Interface Guidelines for Vision Pro
https://developer.apple.com/design/human-interface-guidelines/designing-for-visionos
Updated Figma Vision Pro design kits
https://developer.apple.com/design/resources/#visionos-apps
Building immersive spaces for Apple Vision Pro
With VisionOS 2.0 you'll be able to include reflections of media into your own custom environments.
Mockup of what the iOS home designs will look on visionOS
Imagine an app that handles clothing materials on visionOS2 (source)
Apple‘s new spaceship demo from WWDC is fun and free (source)
Asking Siri to open an already opened app will now move that app into your view (source)
That’s all for now, feel free to leave me any feedback and discussions! 🙏
Until next week 👋