This Week's Sponsor:

Hello Weather

Half Off for WWDC Week, Just in Time for Summer.

Posts tagged with "visionOS"

visionOS 27: The MacStories Overview

Source: Apple.

Source: Apple.

Siri AI is coming to spatial computing, but that’s not all Apple announced for visionOS 27 during yesterday’s WWDC keynote. Vision Pro users have new capabilities and platform improvements to look forward to this fall, too, and we’re going to dive into all of it.

Let’s start with Siri AI, which exists as a floating, semi-translucent orb that you can place anywhere within your environment. It’s the strongest taste of the Liquid Glass style we’ve gotten so far in visionOS, and it makes for some fascinating interaction methods. Rather than using a trigger phrase or a gesture, you can activate Siri simply by looking at it and talking. As on Apple’s other platforms, you can have back-and-forth conversations with Siri and make use of its personal context awareness, world knowledge, and app actions.

Read more

Apple Intelligence-Infused Accessibility Features Promise Greater Flexibility and Power

Source: Apple.

Source: Apple.

In what I expect will be an overarching theme at WWDC 2026, Apple’s Accessibility group took the wraps off an impressive collection of features coming later this year. The announcement, which is timed to lead into Global Accessibility Awareness Day on Thursday, emphasizes existing features and technologies that the company says will gain deeper capabilities thanks to Apple Intelligence.

For starters, VoiceOver will become more descriptive, allowing a device’s camera to be used to describe the user’s surroundings or a scanned document in greater detail. The feature will also make use of the Action button to trigger the camera and allow users to ask questions and make follow-up inquiries about what’s in the viewfinder. The Magnifier will gain voice controls, too, so users can simply ask it to zoom in, for example.

Source: Apple.

Source: Apple.

Voice Control will get similar enhancements. Rather than requiring a defined set of commands that need to be memorized to control a device, the feature will allow users to invoke actions with natural language, such as, “Tap the orange folder.”

Accessibility Reader will be able to handle more complex written layouts that include tables, columns, and other traditionally challenging formatting. If there’s one thing that LLMs have become extremely good at, it’s scraping the web and learning how to parse the meaningful parts of a webpage. While I’d have preferred that the web not have been pillaged as fuel for models in the first place, I’m glad at least part of that is going towards making the web and other text more readable for people who need it.

One of my favorite demos that Apple showed off during my briefing was a short video shot on an iPhone that had subtitles added to it on the fly using an on-device model. We’ve grown so accustomed to subtitles being available with the TV shows, movies, and YouTube videos we watch that they feel like they’re missing from the home movies we shoot and share with friends and family. Later this year, though, subtitles will be available for all types of video, generated privately on device.

Vision Pro wheelchair control. Source: Apple.

Vision Pro wheelchair control. Source: Apple.

The Vision Pro uses state-of-the-art eye tracking for interacting with your environment. Apple announced that it is extending that technology to motorized wheelchairs by working with partners TOLT Technologies and LUCI. The system allows a motorized wheelchair to be maneuvered by the user simply looking at controls inside the Vision Pro. The video showing off the feature was impressive and makes perfect sense if you’ve ever used the Vision Pro.

Apple also announced a new accessory with an accessibility angle. You may have seen the Hikawa Grip and Stand collection, a series of colorful accessories designed to make it easier for people to hold an iPhone more securely. Designed late last year by artist Bailey Hikawa, the Hikawa Grip and Stand is being mass-produced by PopSockets and sold in Apple retail stores in 20 markets starting today.

Finally, a bunch of other accessibility features are coming to Apple platforms later this year, including:

  • Vehicle Motion Cues, face gestures for taps, and eye-select in Dwell Control for visionOS,
  • Touch Accommodations setup customization,
  • Improvements to MFi hearing aid pairing and handoff across devices,
  • Larger Text support in tvOS,
  • Name Recognition in over 50 languages,
  • An API for adding human sign language interpreters to FaceTime, and
  • Support for Sony’s Access game controllers on iOS, iPadOS, and macOS.

With all the overblown hype surrounding artificial intelligence, it’s refreshing to see Apple putting it to practical use in ways that are meaningful to its users. One thing I’ve learned from following the work of Apple’s Accessibility team over the years is that there’s no one-size-fits-all approach to accessibility. The solutions are as unique as the people they serve. Apple has always offered a wide range of APIs and user features to make their hardware and apps available to as many people as possible, but Apple Intelligence promises to take the company’s longstanding commitment and make it more flexible and powerful for more people than ever before.

Steam Announces Steam Link for Apple Vision Pro and Releases Beta Version

The gaming ecosystem on visionOS continues to grow, this time with the announcement that Steam Link is coming to the platform. The official app will allow users to wirelessly stream games in 2D from Steam on their local Macs and PCs to their Vision Pros. According to the company, the app can stream games at up to 4K resolution and includes an adjustable, curved panoramic view. A TestFlight beta is now available for those who want to test the app before its public release.

Steam’s stature in the PC gaming market cannot be understated, so opening the platform up to the Vision Pro is a huge boon for gaming on the device. Of course, one would hope to see VR streaming support come with time, but official support even for 2D gaming is a big step.

Between an official Steam client, 4K cloud game streaming from NVIDIA GeForce NOW, console remote play via Portal, local OpenVR game streaming with ALVR, HDMI input over UVC via the Developer Strap, and native titles from Apple Arcade and the App Store, the variety of games available for Vision Pro users to play is getting larger by the day. There’s lots to be excited about in the world of visionOS gaming these days.

NVIDIA GeForce NOW Adds 4K 90 FPS Game Streaming on Apple Vision Pro

Source: NVIDIA.

Source: NVIDIA.

NVIDIA has released version 2.0.83 of its GeForce NOW game streaming service with a couple of upgrades for Vision Pro users. First, games can now be streamed at up to 4K resolution at 90 FPS. Gaming at this quality requires a subscription to the service’s Ultimate tier and a Wi-Fi connection with a speed of at least 55 Mbps, and users have to enable 4K resolution manually in their settings. Still, it’s great that game streaming of this quality is available to those who want to play cloud-streamed games on a huge virtual screen, and the 4K option is a Vision Pro exclusive not available on other headsets. It’ll really put the device’s powerful screens to good use.

This version of GeForce NOW also coincides with the gradual rollout of H.265 video encoding in supported browsers. Because the service is still accessed via Safari on Vision Pro rather than a native app, H.265 browser encoding will be beneficial for the efficiency and quality of game streaming on the device.

This news comes on the heels of foveated streaming support coming to Vision Pro with last week’s release of visionOS 26.4. Apple and NVIDIA worked together to include support for NVIDIA’s CloudXR technology in the framework, giving developers a way to take advantage of foveated streaming in their own VR games and apps. Flight simulator X-Plane, motorsport simulator iRacing, and 3D visualization tool Autodesk VRED have already committed to adopting the feature on visionOS, and I imagine we’ll hear more similar announcements soon.

The full gaming story on Vision Pro is yet to be told, but these developments – along with the integration of spatial controllers into visionOS last fall – point towards a bright future for gamers on Apple’s newest platform, and I’m happy to see Apple working with partners like NVIDIA to make the experience as enjoyable and immersive as possible.

Google Releases YouTube App for Apple Vision Pro

Today, Google released the official YouTube app for visionOS. The app allows users to sign in to view their subscriptions, watch later queues, and playlists, and it supports native playback of regular videos, shorts, and spatial formats including 3D, 180-degree, and 360-degree. On the M5 Vision Pro, the app supports playback of 8K videos as well.

The Vision Pro launched two years ago without an official way to watch YouTube. Third-party options like Tubular Pro and the now-defunct Juno filled the gap well, and users have always been able to watch YouTube in a browser on visionOS. (Apple even made improvements to web video playback in visionOS 2 to make using sites like YouTube and Netflix more seamless.) But the lack of a native app from Google has been seen as a mark against visionOS up to this point.

Whether you’re a Vision Pro user who spends a lot of time watching YouTube or just someone who wants to see the platform thrive, having an official solution is a win. One of the device’s most compelling use cases is watching video, and now, there’s a great way to do so directly from Google. It’s always seemed inevitable to me that YouTube would come to the platform at some point, and as visionOS continues its slow burn toward maturity while awaiting hardware that can run it with more mass market appeal, it’s good to have YouTube onboard.

Now, it’s Netflix’s turn.

WWDC 2025: All the Small Things (Bento Box Version)

Source: Apple.

Source: Apple.

Every keynote, Apple is well-known for summarizing sections of the presentation with immaculately laid-out bento boxes containing key features. They often serve as good, easily digestible overviews of all the new features for each OS.

With that in mind, let’s take a look at all the bento boxes from today’s WWDC 2025 keynote.

Read more

visionOS 26: The MacStories Overview

Source: Apple.

Source: Apple.

As part of this year’s WWDC keynote, Apple today announced visionOS 26, the next major version of visionOS coming this fall. The update features new ways for users to experience spatial content, display information in their environment, and interact with apps and games. It represents the next step forward for Apple’s vision of spatial computing, including what the company refers to as “the spatial web.”

Since Apple’s new Liquid Glass design language borrows heavily from visionOS, design changes won’t be as striking on the platform. The most prominent user-facing feature of the update is likely to be spatial widgets.

Up to this point, native widgets have been completely absent on visionOS, and the company has introduced them in a way that is consistent with its other devices while adding a spatial flair. Widgets can be customized to include a border and a depth effect to blend in with the user’s environment, and they remain fixed persistently in place even after the Vision Pro restarts. Built-in options like the Clock, Calendar, Music, and Photos widgets were featured, though third-party developers will be able to provide their own widget options via the new Widgets app.

Various ways of experiencing spatial content have been enhanced in visionOS 26 as well. Building on last year’s introduction of spatial photo conversion, Apple this year added a feature called spatial scenes to all of its platforms. Spatial scenes add depth to photos, enabling users to experience their pictures from different perspectives by moving their heads. These scenes can be viewed in Photos, the Spatial Gallery, and Safari, and developers can add them to their own apps. visionOS 26 also adds native support for playing back 180-degree, 360-degree, and wide field-of-view content.

Read more

Shareshot 1.3: Greater Image Flexibility, New Backgrounds, and Extended Shortcuts Support

If you have a screenshot you need to frame, Shareshot is one of your best bets. That’s because it makes it so hard to create an image that looks bad. The app, which is available for the iPhone, iPad, Mac, and Vision Pro, has a lot of options for tweaking the appearance of your framed screenshot, so your final image won’t have a cookie-cutter look. However, there are also just enough constraints to prevent you from creating something truly awful.

You can check out my original review and coverage on Club MacStories for the details on version 1.0 and subsequent releases, but today’s focus is on version 1.3, which covers three areas:

  • Increased image size flexibility
  • New backgrounds
  • Updated and extended Shortcuts actions
Adjusting sizes.

Adjusting sizes.

With version 1.3, Shareshot now lets you pick any output size you’d like. The app then frames your screenshot and fits it in the image size you specify. If you’re doing design work, getting the exact-size image you want out of the app is a big win because it means you won’t need to make adjustments later that could impair its fidelity.

A related change is the ability to specify a fixed width for the image that Shareshot outputs. That means you can pick the aspect ratio you want, such as square or 16:9, then specify a fixed width, and Shareshot will take care of automatically adjusting the height of the image to preserve the aspect ratio you chose. This feature is perfect if you publish to the web and the tools you use are optimized for a certain image width. Using anything wider just means you’re hosting a file that’s bigger than necessary, potentially slowing down your website and resulting in unnecessary bandwidth costs.

Shareshot is stripey now.

Shareshot is stripey now.

Shareshot has two new categories of backgrounds too: Solidarity and Stripes. Solidarity has two options styled after the Ukrainian and Palestinian flags, and Stripes includes designs based on LGBTQ+ colors and other color combinations in a variety of styles. All of the new categories allow you to adjust several parameters including the angle, color, saturation, brightness, and blur of the stripes.

Examples of angles.

Examples of angles.

Finally, Shareshot has revamped its Shortcuts actions to take advantage of App Intents, giving users control over more parameters of images generated using Shortcuts and preparing the app for Apple’s promised Smart Siri in the future. The changes add:

  • Support for outputting custom-sized images,
  • A scale option for fixed-width and custom-sized images, and
  • New parameters for angling and blurring backgrounds.

The progress Shareshot has made since version 1.0 is impressive. The app has grown substantially to offer a much wider set of backgrounds, options, and flexibility without compromising its excellent design, which garnered it a MacStories Selects Award last year. I’m still eager to see multiple screenshot support added, a feature I know is on the roadmap, but that’s more a wish than a complaint; Shareshot is a fantastic app that just keeps getting better.

Shareshot 1.3 is free to download on the App Store. Some of its features require a $1.99/month or $14.99/year subscription.

Apple Previews a Wide Range of Upcoming Accessibility Features to Mark Global Accessibility Awareness Day

Source: Apple.

Source: Apple.

With Global Accessibility Awareness Day coming up this Thursday, May 15, Apple is back with its annual preview of accessibility features coming to its platforms later in the year. This year marks the 40th anniversary of the creation of the first office within Apple to address accessibility, and there’s no sign of any slowdown in the company’s development on this front. While no official release date has been announced for these features, they usually arrive with the new OS updates in the fall.

In addition to a new accessibility-focused feature in the App Store, Apple announced a whole raft of system-level features. Let’s take a look.

Read more