Last Week in AVP #33: visionOS 2 Releases Sept 16, WW2 Documentary on Apple Vision Pro, Cops Testing AVP For Surveillance Use, AirPods 4 Supports Lossless Audio, and more!
visionOS 2 For Apple Vision Pro Releases This Week! (source)
Here are some highlights from the features incase you aren’t already on the beta!
Create spatial photos from your 2D images
Now you can take existing photos from your photo library and instantly transform them into spatial photos. With just a tap, your memories are brought to life with natural-looking depth and dimension.
New gestures for easy navigation
Use your hand to access Home View. See the date and time, control the volume and even check the battery level. You can also open Control Center to get quick access to frequently used features such as notifications, Mac Virtual Display and more.
Panoramic productivity with Mac Virtual Display (Later This Year)
Using Mac Virtual Display is like having an expandable, ultrawide screen that wraps around you. It’s the equivalent of having two 4K displays sitting side by side — everything looks astoundingly sharp and incredibly detailed.
AVP spotted at the iPhone 16 event (source)
Inside of the Steve Jobs Theatre #appleevent
See iPhone 16 3D models in AVP (source)
Stepping Into a WW2 Documentary on Apple Vision Pro (source)
Why 16 Pro / 16 Pro Max can potentially take Spatial Video to the next level with two 48MP camera (source)
Apple fixes dangerous 'GAZEploit' Vision Pro security flaw (source)
The GAZEploit attack, as it was dubbed by the researchers, works by tracking the eye movements of a user's Persona to identify when they're typing something on the Vision Pro's virtual keyboard. The researchers discovered that users tend to direct their gaze onto specific keys that they're about to click, and were able to construct an algorithm that identified what the users were typing. The results were quite accurate; for example, the researchers were able to identify the correct letters of users' passwords 77 percent of the time. When it came to detecting what people were typing in a message, the results were accurate 92 percent of the time.
The researchers disclosed the vulnerability to Apple back in April, and Apple fixed it in visionOS 1.3, which came out in July. In the release notes, Apple says that the flaw enabled inputs to the virtual keyboard to be inferred from Persona.
Simulating baseball in AVP (source)
We also implemented a mode where you can experience speeds of up to 160km/h (commonly known as Otani mode).
Motion capture and AVP used for baseball training (source)
We had them try out Apple Vision Pro's Baseball Skill Improvement XR and also had the opportunity to try out the motion capture equipment
United Airlines is adding free Starlink Wi-Fi to all its aircraft for AVP use (source)
The arrival of reliable high-speed internet on airline flights will be transformative for standalone headsets.
If you didn't catch the news, United Airlines announced today that it will install SpaceX's Starlink internet service on all of its aircraft to deliver free high-speed low-latency Wi-Fi for all its passengers, starting in late 2025.
Riding the VR Wave: Why I'm Still Bullish on Apple Vision Pro (source)
The Vision Pro has been out in the US since February and is finally available in France this week. Let's start with the obvious: It didn't change the industry like we expected. We've been waiting for years for Apple to enter the space, but they got the marketing wrong and failed on big things like price and comfort. It's a very expensive dev kit when we expected an amazing consumer device.
…
Despite all the ups and downs, I still believe VR has the potential to change how we work and connect with each other. It might take longer than we thought, but I think it'll be worth the wait. And who knows? Maybe the next big VR breakthrough will come from those of us crazy enough to keep believing in the tech.
Rumours of lower resolution 1500 PPI displays for lower Apple Vision models (source)
NEWS: Japan JDI sends 1500 PPI display sample to Apple for lower end "Apple Vision" headset - hinting at Apple's display quality target for the device
List of common headset PPI's:
- Apple Vision Pro: 3386 PPI
- Meta Quest 3: 1218 PPI
- Valve Index: ~615 PPI
- PlayStation VR2: ~850 PPI
Future of field service with Apple Vision Pro (source)
Spatial computing unlocks vast potential for field operations, ensuring precision, safety, and sustainability. Through our collaboration with @Deloitte and @Apple, we are pioneering an immersive future for field service, where AI agents enhance and scale operations
Cops Are Testing Apple Vision Pro For Use In Surveillance (source)
Orange County isn't the first police agency to experiment with Apple’s virtual reality headset. The Los Angeles Police Foundation confirmed $20,000 would be spent on five Apple Vision Pros for the LAPD, which it hoped would be useful for “enhanced surveillance and monitoring,” as tweeted by investigative journalist Joey Scott. Augmented reality overlays could present officers with critical information over live video feeds or maps, such as license plate reader data, the LAPD said, while 3D visualizations of surveillance feeds could help analysts “quickly identify patterns, correlations and anomalies that might indicate criminal activity.” (The LAPD did not respond to requests for comment.)
“This enhanced situational awareness can improve decision-making, response times and overall officer safety,” wrote deputy chief John McMahon in a proposal for the Vision pro deployment. “We plan to investigate the potential associated with future hands-free operations… This hands-free operation could provide means for officers to remain focused on their surroundings and potential threats while still accessing critical data and resources.”
AirPods 4 supports Lossless Audio when connected to Apple Vision Pro (source)
Apple had even more up its sleeves, as they’ve confirmed support for Lossless Audio on the AirPods 4 when connected to the $3499 Apple Vision Pro. This is possible due to the close proximity of the AirPods 4 to the Apple Vision Pro when wearing both of them as it enables H2 to H2 connection with ultra-low latency. This feature is also available on the AirPods Pro 2 with USB-C, but not the one with Lightning.
Originally from: AirPods 4 supports Lossless Audio when connected to Apple Vision Pro – Appleosophy https://appleosophy.com/2024/09/11/airpods-4-supports-lossless-audio-when-connected-to-apple-vision-pro
TechInsights Teardown: Apple Vision Pro (source)
Major components
$432.20 — 100 Hz left micro-OLED display subsystem — Sony (Qty: 1)
$432.20 — 100 Hz right micro-OLED display subsystem — Sony (Qty: 1)
$111.69 — 64-bit octa-core applications processor — Apple (Qty: 1)
$98.12 — Sensor processing unit with memory — Apple (Qty: 1)
$86.35 — Battery subsystem — Apple (Qty: 1)
$44.59 — Left audio strap subsystem (Qty: 1)
$39.53 — Right audio strap subsystem (Qty: 1)
$39.45 — Multichip memory — 8 GB mobile LPDDR5 SDRAM — Hynix (Qty: 2)
$26.75 — Light seal (Qty: 1)
$16.79 — Multichip memory — 256 GB 3D TLC NAND flash — Kioxia (Qty: 1)
Spotify app for AVP concept (source)
Day 14 of my #dailyui @Apple Vision Pro #Challenge: I reimagined @Spotify in a spatial app, inspired by the gorgeous @Algoriddim "djay" for Vision Pro. Picture grabbing records and placing them on a virtual turntable for a fun, interactive way to control your music!
Introductory visionOS samples for visionOS 2 & Xcode 16 (source)
Apple has just released new introductory visionOS samples for visionOS 2 & Xcode 16. These beginner-friendly projects are perfect to learn the fundamentals of building apps for visionOS.
Creating immersive spaces in visionOS
That’s all for now, know someone who might enjoy this newsletter? Please share with them! 🙏
Until next week 👋