This Week's Sponsor:

Collections Database

A Powerful Database with iCloud Sync


Posts tagged with "Vision Pro"

Job Simulator Devs Say They Feel ‘Vindicated’ By Apple Vision Pro’s Approach To VR

Henry Stockdale, of UploadVR is at the annual Game Developers Conference (GDC) in San Francisco this week and interviewed Andrew Eiche, the CEO of Owlchemy Labs, creators of Job Simulator and other VR games:

Asked about the studio’s hand tracking focus and how Apple Vision Pro uses hand tracking as its primary control method, Eiche believes Apple’s system feels like “huge vindication” for Owlchemy’s strategy.

Eiche told Stockdale:

We had this similar pinch gesture in our previous hand tracking demo without knowing what Apple was going to do at all, so it’s great to see that we’ve all coalesced around this one interaction.

When we first tried the Apple Vision Pro, we were like, ‘yes!’ This is like what we have been hoping for in many cases. Making an app on a headset is difficult right now on every headset because you have to start from scratch. With Apple, you can use Swift UI. You can use all of these different tools to build an app to get the base layer. And then you add everything on top of it and it’s interesting. So yeah, it felt like a huge vindication.

Job Simulator first launched on Sony’s PlayStation VR in 2016, so it’s interesting to hear that its veteran VR development team independently arrived at a similar interaction scheme as Apple’s Vision Pro designers and engineers.

In addition to Job Simulator, Owlchemy Labs announced last month that it is also working on bringing Vacation Simulator to the Vision Pro.

Permalink

NVIDIA Introduces Remote Scene Rendering for Vision Pro Development

NVIDIA is in the midst of its 2024 GTC AI conference, and among the many posts published by the company yesterday, was a bit of news about the Apple Vision Pro:

Announced today at NVIDIA GTC, a new software framework built on Omniverse Cloud APIs, or application programming interfaces, lets developers easily send their Universal Scene Description (OpenUSD) industrial scenes from their content creation applications to the NVIDIA Graphics Delivery Network (GDN), a global network of graphics-ready data centers that can stream advanced 3D experiences to Apple Vision Pro.

That’s a bit of an NVIDIA word salad, but what they’re saying is that developers will be able to take immersive scenes built using OpenUSD, an open standard for creating 3D scenes, render them remotely, and deliver them to the Apple Vision Pro over Wi-Fi.

What caught my eye about this announcement is the remote rendering and Wi-Fi delivery part. NVIDIA has been using its data centers to deliver high-resolution gaming via its GeForce NOW streaming service. I’ve tried it with the Vision Pro, and it works really well.

NVIDIA says:

The workflow also introduces hybrid rendering, a groundbreaking technique that combines local and remote rendering on the device. Users can render fully interactive experiences in a single application from Apple’s native SwiftUI and Reality Kit with the Omniverse RTX Renderer streaming from GDN.

That means visionOS developers will be able to offload the rendering of an immersive environment to NVIDIA’s servers but add to the scene using SwiftUI and RealityKit frameworks, which Apple and NVIDIA expect will create new opportunities for customers:

“The breakthrough ultra-high-resolution displays of Apple Vision Pro, combined with photorealistic rendering of OpenUSD content streamed from NVIDIA accelerated computing, unlocks an incredible opportunity for the advancement of immersive experiences,” said Mike Rockwell, vice president of the Vision Products Group at Apple. “Spatial computing will redefine how designers and developers build captivating digital content, driving a new era of creativity and engagement.”

“Apple Vision Pro is the first untethered device which allows for enterprise customers to realize their work without compromise,” said Rev Lebaredian, vice president of simulation at NVIDIA. “We look forward to our customers having access to these amazing tools.”

The press release is framed as a technology focused on enterprise users, but given NVIDIA’s importance to the gaming industry, I wouldn’t be surprised to see the new frameworks employed there too. Also notable is the quote from Apple’s Mike Rockwell given the two companies’ historically chilly relationship.

Permalink

Club MacStories Sample: BetterTouchTool Tips, Vision Pro Shortcuts, a Task Manager Review, and the Effect of AI on the Internet

We often describe Club MacStories as more of the MacStories you know and love reading on this website. That’s an apt shorthand for the Club, but when you’re being asked to sign up and pay for something, it still helps to see what you’re buying. That’s why every now and then, we like to share samples of some of what the Club has to offer every week.

So today, we’ve made Issue 408 of MacStories Weekly from a couple of Saturdays ago available to everyone. Just use this link, and you’ll get the whole issue. You can also use the links in the excerpts below to read particular articles.

Everybody in the Club gets MacStories Weekly and our monthly newsletter called the Monthly Log, but there’s a lot more to the Club than just email newsletters. All members also get MacStories Unwind+, an ad-free version of the podcast that we publish a day early for Club members. All Club members also have access to a growing collection of downloadable perks like wallpapers and eBooks.

Club MacStories+ members get all of those perks along with exclusive columns that are published outside our newsletters, access to our Discord community, discounts on dozens of iOS, iPadOS, and Mac apps, and advanced search, filtering, and custom RSS feed creation of Club content. Club Premier builds on the first two tiers by adding AppStories+, the extended, ad-free version of our flagship podcast that’s delivered a day early, as well as full-text search of AppStories show notes, making it the all-access pass for everything we do at MacStories.

To learn more and sign up, you can use the buttons below:

Join Club MacStories:

Join Club MacStories+:

Join Club Premier:

Issue 408 of MacStories Weekly, which you can access here, starts with two excellent tips from Niléane on how to use BetterTouchTool to remap the Mac’s yellow and green ‘stoplight’ buttons. Like a lot of tips and workflows we share, Niléane’s was inspired by a similar technique Federico employed a couple of weeks before:

Two weeks ago, in Issue 406 of MacStories Weekly, Federico shared a tip for BetterTouchTool that resonated with me. Just like him, I am used to minimizing my windows instead of hiding them, which can be annoying since minimized windows no longer come up when you Command (⌘) + Tab to their app’s icon…

…after poking around in BetterTouchTool for a few minutes, I realized that the app allows you to change what the red, yellow, and green window buttons do. As a result, I was able to make it so that the yellow button will actually hide a window instead of minimizing it to the Dock.

Read more


The Best Small Feature of visionOS 1.1

Apple released visionOS 1.1 earlier today. The update focuses on a variety of performance enhancements (I’m intrigued to test improved cursor control and Mac Virtual Display), but, arguably, updated Personas are the most important feature of this release.

I haven’t recreated my Persona for visionOS 1.1 yet, but judging by comparisons I’ve seen online, Apple’s 3D avatars should now look more realistic and, well, less creepy than before. David Heaney at UploadVR has a good rundown of the changes in this update.

I’m here to talk about what is, for me, the best small feature of visionOS 1.1, which isn’t even mentioned in Apple’s changelog. In the launch version of visionOS last month, there was an annoying bug in the Shortcuts app (which is still running in compatibility mode) that caused every ‘Open App’ action to open the selected app but, at the same time, also remove every other window from your field of view.

I ran into this issue when I thought I could use shortcuts to instantly recreate groups of windows in my workspace; I was unpleasantly surprised when I realized that those shortcuts were always hiding my existing windows instead. And even worse, every other Shortcuts action that involved launching an app (like Things’ ‘Show Items’ action) also caused other windows to disappear. It was, frankly, terrible.

All of this has been fixed in visionOS 1.1. Using ‘Open App’ actions in Shortcuts doesn’t hide other currently open windows anymore: it just spawns new ones for the apps you selected. This means that a shortcut like this…

…when run on the Vision Pro with visionOS 1.1 will open a Safari window and an Obsidian one in front of other windows I have already open, without hiding them. This unlocks some interesting possibilities for “preset shortcuts” that open specific combinations of windows for different work contexts (such as my writing workspace above) with one tap, which could even be paired with a utility like Shortcut Buttons for maximum efficiency in visionOS. Imagine having quick launchers for your ‘Work’ windows, your ‘Music’ workspace, or your ‘Research’ mode, and you get the idea.

I guess what I’m saying is that my favorite feature of visionOS 1.1 is a bug fix that hasn’t even been mentioned by Apple in their release notes. Maybe I’ll change my mind if my updated Persona won’t make me look like an exhausted 50-year-old Italian blogger anymore, but, for now, this Shortcuts update made visionOS 1.1 worth installing immediately.


Vision Pro App Spotlight: GameTrack Updated with Built-In Cloud Streaming

Late last week, Joe Kimberlin released GameTrack 5.4, an update to the iOS, iPadOS, and visionOS versions of the app that enables new ways to access your favorite games and navigate the app’s UI. Of course, the Vision Pro version of GameTrack is completely new since the last time I wrote about the app, too. So, let’s take a closer look at the latest iOS and iPadOS updates, as well as the visionOS version, which has become one of my favorite media management apps for Apple’s headset.

Read more


Vision Pro App Spotlight: Status Bar Builder’s Key Is Customization Combined with Simplicity

There’s an elegance in simplicity that I value. I use plenty of complex apps, but there’s a certain satisfaction in finding one that fits your needs perfectly. One such app that seems destined to claim a long-term spot on my Vision Pro is Status Bar Builder, a customizable utility that displays useful information without taking up much space.

Status Bar Builder's UI for organizing and creating status bars.

Status Bar Builder’s UI for organizing and creating status bars.

The app allows you to build status bars, which are narrow, horizontal windows reminiscent of the Mac’s menu bar that you can place around your environment. Status bars come in three text sizes and can have no background, be translucent, or use a colored background.

Regardless of the styling you pick, status bars can include:

  • Shortcuts
  • Links
  • Today’s date
  • Weekday
  • Numerical date
  • Month
  • Time
  • Your calendar events
  • A battery charge indicator
  • A spacer
Adding items to a status bar.

Adding items to a status bar.

Designing status bars is easy. They’re created and stored in the app’s main window, which includes a preview of each along with buttons to open any existing status bars, make revisions, or delete them. At the bottom of the main window, there’s also a ‘New’ button to add to your collection.

You can make as many status bars as you’d like, sprinkling them around your room. There doesn’t seem to be a limit to how many items you can include in a status bar, either, but as a practical matter, if a status bar gets too long, it doesn’t look great, and some text will be truncated.

Adding shortcuts to a status bar.

Adding shortcuts to a status bar.

What’s more, you can add as many of each type of item as you’d like to a status bar. For Shortcuts, that means you can create a long list of shortcuts if you want. However, you better be able to identify them by their icons because the buttons in the status bar don’t include shortcut names or the colors you assigned to them.

Links work like a mini bookmark bar, allowing you to save frequently visited websites with a custom icon as a button in your status bar. However, like shortcuts, you’ll need a memorable icon because there are no link labels or other text to go by. Links support URL schemes too, offering additional automation options.

Links and shortcuts can be represented by an icon.

Links and shortcuts can be represented by an icon.

There are also a few other other item-specific settings available. For example, there are three sizes of spacers that can be added to a status bar, and calendar events can include the color of their associated calendars if you’d like. Plus, dates and times have formatting, color, size, and other style options. It’s worth noting that your next calendar event doesn’t include the scheduled time and events cannot be opened, both of which are things I’d love to see added to the app in the future.

Although you can overstuff your status bars with links, shortcuts, and other information, I’ve found that the best approach is to be picky, limiting yourself to a handful of items that make your status bars more glanceable. Then, if you find yourself adding more and more to a status bar, consider breaking it up into multiple status bars organized thematically. I find that works well and gives me more flexibility about where I put each.


I have to imagine that Apple will eventually release something like Status Bar Builder. It’s too easy to lose track of time in the Vision Pro. It needs a clock, battery indicator, date, and other basic data we’ve had on our iPhones since day one. Status Bar Builder fills that gap but goes one step further by adding links, calendar items, and shortcuts. I wouldn’t add a lot more to the app, but a weather item with the current conditions and temperature would be great. However, even though parts of Status Bar Builder may eventually wind up as parts of visionOS, I expect the app has a long and useful life ahead of it, thanks to the other components that go a step further than I expect Apple ever will.

Status Bar Builder is available on the App Store for $4.99.


AppStories, Episode 372 – Apple Vision Pro Entertainment Apps

This week on AppStories, we share some of our favorite visionOS entertainment apps.

Sponsored by:

  • Memberful – Help Your Clients Monetize Their Passion
  • Porkbun: Get $1 off your next domain name with the code APPDEVFOO1.

AppStories+ Pre-Show

Vision Pro Entertainment Apps


On AppStories+, I explain all the little gotchas involved with taking screenshots even if you have the Vision Pro Developer Strap.

We deliver AppStories+ to subscribers with bonus content, ad-free, and at a high bitrate early every week.

To learn more about the benefits included with an AppStories+ subscription, visit our Plans page, or read the AppStories+ FAQ.

Read more


Vision Pro App Spotlight: Longplay Adds Immersive Album Listening

The music experience on the Apple Vision Pro is excellent. It starts with the device’s built-in headphones and spatial audio, which work hand-in-hand with the visual components of spatial computing. Apple has already shown off the potential for immersive experiences like Alicia Keys: Rehearsal Room, but the music experience goes deeper than that, thanks to third-party developers.

I’ve already covered Juno, Christian Selig’s YouTube player app, which is great for watching music videos and other content, and NowPlaying, which supplements Apple Music with editorial content, lyrics, and more. Today, though, I want to focus on Longplay, Adrian Schönig’s album-oriented playback app for Apple Music.

Longplay 2.0 was released last August. It was a big update that I reviewed at the time and have been enjoying ever since. The app is available on the Vision Pro now too, complete with an immersive mode that I love.

Read more


Apple Vision Pro Accessory Roundup: Our Favorites So Far

Slowly but surely, a growing number of accessories are popping up around the Apple Vision Pro. Today, we thought we’d share our favorites so far.

Battery Accessories

Battery Packs

The [Anker Prime 27,650mAh](https://amzn.to/3SpPCSm) power bank.

The Anker Prime 27,650mAh power bank.

John: Apple sells the battery pack that powers the Apple Vision Pro as a separate accessory for $199. However, because the Vision Pro’s battery includes a USB-C port for charging it, there are plenty of cheaper solutions.

One option is simply plugging Apple’s battery into its power adapter as you use it. However, if you want something more portable, I’d suggest a battery pack to charge your Apple battery pack. Any battery pack will do, but we have several listed on our Setups page that Federico and I use and recommend and will do the trick too.

Belkin Battery Holder

Federico: I never thought I’d become the sort of person who casually holsters a tech accessory in his daily routine, and yet here we are thanks to the Vision Pro. I decided to get the Belkin battery holder upon ordering the Vision Pro, and I’m glad I did. Not only does the clip on the case make it easier to walk around the house while wearing the Vision Pro (putting the battery in my pocket causes too much tension on the cable and I don’t like it), but it also provides a nice degree of protection for the battery itself. I genuinely recommend getting this if you plan on moving around a lot while using the Vision Pro.

Keyboard and Trackpad Accessories

John: The Apple Vision Pro’s built-in keyboard and dictation are fine for entering short bits of text when you’re using the device, but for anything more than a few words, you’ll want a keyboard. The Apple Magic Keyboard works best with the Vision Pro because it integrates tightly with visionOS, displaying a preview of what you’re typing that floats just above the keyboard. Plus, Magic Trackpad is the only trackpad that I am aware of that works with the Vision Pro.

The MagicBridge or a Lap Desk

The trouble is finding a way to use the Magic Keyboard and Trackpad when you’re away from your desk or a tabletop because both are small and can be hard to balance in your lap. There are a few options here, depending on your preferences. Twelve South’s MagicBridge joins the Magic Keyboard and Magic Trackpad using a plastic frame that holds the two together side-by-side. It works much better in the lap that way, but it’s also wide and can feel unbalanced when the keyboard is directly in front of you, and the trackpad is hanging off to the side.

Since my initial experiments with the MagicBridge, I’ve gravitated to a lap desk for those times that I’m sitting on the couch. There are a million of these on Amazon and elsewhere. However, I like the simplicity of the 30.5” Wood Curved Lap Desk Table Tray, which is a simple curved piece of wood without any notches for iPhones or ridges to hold a laptop in place to get in my way.

Hazevaiy Acrylic Magic Keyboard and Trackpad Support Stand

Federico: After some research and asking on Mastodon, I discovered that accessory manufacturers have been making for quite some time what is, effectively, the opposite of a MagicBridge: a tray where the Magic Trackpad and Keyboard are held in a laptop-like configuration, with the keyboard above the trackpad. I got a couple from Amazon, and I like the transparent one better than others I’ve seen thanks to its slimmer profile. (Plus, let’s face it – anything looks better when it’s made of transparent plastic.) These accessories all lack the sort of palm rejection features that are typically found on Mac laptops, so if you can get used to avoiding the trackpad with your palm or wrist when typing, I think you should consider this as a lap-friendly alternative to the MagicBridge.

A Smaller Case – Syntech Hard Carrying Case

John: By all accounts Apple’s Vision Pro case is very nice, but I wasn’t interested because it’s so bulky and expensive. Instead, I went with one Federico discovered on Reddit by Syntech that was originally made for the Meta Quest. It’s not small, but it fits in a backpack better than Apple’s case ever will. Inside, there’s a velcro strap for securing your Vision Pro in place and enough spare room to stow your battery and polishing cloth. Best of all, the Syntech case is less than $30.

Protecting the Vision Pro’s Lenses - KIWI design Lens Protector Cover

John: My most recent accessory find for the Vision Pro is the KIWI Lens Protector Cover. It’s another accessory originally designed for the Meta Quest, but it works perfectly with the Vision Pro too. There’s not much to say about the KIWI other than it’s a soft microfiber pillow that you stuff into the inside of your Vision Pro headset against the lenses to protect them. With a USB-C cable and other items in the same case as the Vision Pro, I feel better knowing that there’s a soft barrier between its lenses and everything else in my bag.


That’s it for now, but keep an eye on our MacStories Setups page for updates on the accessories we use with our Apple Vision Pros and other gear.