Apple Intelligence: The MacStories Overview

After months of anticipation and speculation about what Apple could be doing in the world of artificial intelligence, we now have our first glimpse at the company’s approach: Apple Intelligence. Based on generative models, Apple Intelligence uses a combination of on-device and cloud processing to offer intelligence features that are personalized, useful, and secure. In today’s WWDC keynote, Tim Cook went so far as to call it “the next big step for Apple.”

From the company’s press release on Apple Intelligence:

“We’re thrilled to introduce a new chapter in Apple innovation. Apple Intelligence will transform what users can do with our products — and what our products can do for our users,” said Tim Cook, Apple’s CEO. “Our unique approach combines generative AI with a user’s personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can’t wait for users to experience what it can do.”

It’s clear from today’s presentation that Apple is positioning itself as taking a different approach to AI than the rest of the industry. The company is putting generative models at the core of its devices while seeking to stay true to its principles. And that starts with privacy.

Read more

A Look at Code Completion and Swift Assist Coming in Xcode 16

Source: Apple.

Source: Apple.

Earlier today, I got the very first live demo of Swift Assist, one of the many developer tools introduced today by Apple. I also saw code completion in action. It was an impressive demo, and although the tools seem like magic and will undoubtedly be valuable to developers, they do have their limitations, which are worth exploring.

Code Completion in Action. Source: Apple.Replay

First, from what I could tell, code completion works extremely well. The demo I saw was of a simple restaurant app that displayed a menu. As an Apple representative typed variables and other items into Xcode, code completion named things in ways that made sense for a restaurant menu, such as Name, Price, and Calories. The feature also filled in types like strings, integers, and bools, along with the appropriate surrounding syntax.

In most cases, after typing just a handful of characters, the correct suggestion appeared and with a quick tap of the Tab key, the rest of the line of code was filled in. When the suggestion wasn’t what was wanted, a little additional typing steered the AI that backs code completion to the correct solution.

The model that drives code completion is trained specifically for the Swift programming language and Apple’s APIs. It runs locally on a developer’s Mac, enhancing privacy and ensuring that it’s available regardless of Internet connectivity. Although Apple was vague about the code on which the model was trained, it was clear from my briefing that it wasn’t on Apple’s own internal code, but Apple said it is code that it is authorized to use. I was also told that the model isn’t trained on the code of the developers that use the feature. Also worth noting is that Apple’s code completion model is continually updated independent of the update release cycle of Xcode itself.

Read more

iOS and iPadOS 18: The MacStories Overview

Image: Apple.

Image: Apple.

At its WWDC 2024 keynote held earlier today online and with an in-person event at Apple Park in Cupertino, California, Apple officially announced the next versions of the operating systems for iPhone and iPad – iOS and iPadOS 18.

As widely speculated in the lead up to the event, Apple’s focus for both OSes largely revolves around artificial intelligence, or as the company likes to refer to the AI acronym now, “Apple Intelligence”. The new AI features in iOS and iPadOS promise to make both operating systems, well, more intelligent than before thanks to a completely revamped Siri and proactive functionalities that learn from users’ habits and apps. Presented as a fast, private, and personal set of features that draws from the user’s context and combines it with generative models, Apple Intelligence – which will debut in U.S. English only later this year, with a beta expected later this summer – will power a variety of new system features and experiences, starting from a revamped Siri and text analysis features to image creation, performing actions inside apps, and more.

But AI-related improvements aren’t the only new features Apple announced today. From a renewed focus on Home Screen customization and redesigned Control Center to a new design for tab bars on iPad and expanded Tapbacks in Messages, Apple has showed that, while they can follow the rest of the tech industry in rethinking how AI can enhance how we use our devices, they can continue shipping other functionalities for iPhone and iPad, too. Or, at the very least, they certainly can for the iPhone and iOS.

We’ll have in-depth overviews for both iOS and iPadOS 18 when the public betas for each OS come out next month, and, of course, we’ll continue diving into the announcements later this week on MacStories via our WWDC 2024 hub as well as AppStories. We’ll also have a dedicated story about Apple Intelligence coming later on MacStories with the highlights of all the AI-infused features announced by Apple today.

In the meantime, here’s a recap of everything else that Apple showed today for iOS and iPadOS 18.

Read more

watchOS 11: The MacStories Overview

During today’s WWDC keynote, Apple announced a number of updates to its watchOS software as well as some improvements to the Fitness and Workout apps. While there weren’t any groundbreaking features revealed, there were several interesting additions and a couple of long-requested changes. watchOS 11 is available now as a developer beta and will be available for regular users in the fall.

Let’s take a look.

Read more

macOS Sequoia: The MacStories Overview

At its WWDC 2024 keynote held earlier today, Apple officially announced the next version of macOS, macOS Sequoia. As per its naming tradition over the past decade, this new release is once again named after a location in California; the version number for macOS Sequoia will be macOS 15.

Apart from the substantial Apple Intelligence features that were announced today for all of its main platforms, Apple introduced some welcome improvements to its desktop operating system. The new features include enhancements across multiple native apps, an impressive new iPhone mirroring integration, and even some overdue window management features for the Mac.

Here’s a recap of everything that Apple showed off today for macOS Sequoia.

Read more

visionOS 2: The MacStories Overview

Today, Apple revealed visionOS 2, the first major upgrade to the software powering Apple Vision Pro. The update, coming this fall, will include quality-of-life improvements, new ways to create and share spatial content, additional tools for developers, and more.

Interacting with the Home View and Control Center will be easier than before thanks to new system-wide gestures. Holding your hand up and tapping your fingers together will bring up the Home View, while flipping your hand over will bring up a time and battery status popover that also acts as a Control Center launcher. These gestures are simpler than the previous methods of accessing these views, which required pushing the Digital Crown for the Home View and looking upwards to reveal the Control Center launcher. Apps in the Home View can now be rearranged, and compatible iPad and iPhone apps are no longer constrained to a single folder.

The new gestures for accessing the Home View and Control Center in visionOS 2.Replay

Mac Virtual Display is expanding later this year to support a higher resolution and larger size, resulting in a display roughly equivalent to two 4K monitors side by side. The experience of using peripherals with Apple Vision Pro will be improved with Magic Keyboard passthrough in immersive environments and support for mice. Guest User information will be saved for 30 days so users’ friends and family can use Apple Vision Pro without going through the setup process repeatedly, and Travel Mode will be supported on trains in addition to airplanes.

Read more

Audio and Home: The MacStories Overview

During the WWDC keynote earlier today, Apple devoted an entire section to home and audio updates coming this fall. These updates include features for tvOS, AirPods, and the Home app. We’ll have a full tvOS overview later, but first, let’s dive into what’s coming for AirPods and Home.

AirPods

Siri Interactions offer a new, hands-free way of responding to Siri announcements for AirPods Pro users. With a simple nod or shake of the head, users can answer phone calls, dismiss messages, and more. This new interaction method is helpful in scenarios where speaking aloud or pulling out your phone isn’t an option.

Voice Isolation, a feature previously available on iPhone, iPad, and Mac, is coming to AirPods Pro themselves. When you’re on a call, the H2 chip will use machine learning to automatically filter out background noise and wind to make it easy for the person on the other end to hear what you’re saying.

Apple is also improving the experience of gaming with AirPods. Personalized Spatial Audio is expanding to games, using head tracking and the device’s understanding of your ear shape to deliver an immersive audio experience. AirPods Pro will offer lower audio latency when gaming on iPhone in Game Mode and higher voice quality for audio chats with 16-bit, 48kHz audio. Finally, an API for immersive gaming audio will be available to developers.

Home

Guest access is coming to the Home app, enabling residents to grant guests the ability to control locks, garage doors, and security systems for a limited amount of time instead of giving them full home access. Users can also view guests’ Activity History to see what home devices were accessed and when.

Smart locks that support home keys can be unlocked hands-free when a resident is within six feet of the door. The Home app is adding support for robot vacuum cleaners. And Apple is partnering with utility providers, starting with Pacific Gas & Electric Company in California, to allow users to connect their utility accounts to the Home app, track electricity usage, and make more informed decisions about their energy use.

SharePlay is coming to Apple Music on the HomePod and HomePod mini. Users can control playback and add songs to the music queue by bringing their iPhone close to the iPhone connected to the HomePod or by scanning a QR code on the other iPhone’s screen, and even users who aren’t subscribed to Apple Music can take part in SharePlay sessions. Spatial Audio is also coming to AirPlay, allowing immersive audio to be beamed from an iPhone to a HomePod or other compatible AirPlay speaker.

You can follow all of our WWDC coverage through our WWDC 2024 hub or subscribe to the dedicated WWDC 2024 RSS feed.

Apple Announces Vision Pro Launching in More Countries Later This Month

During its WWDC 2024 keynote earlier today, Apple announced that the Vision Pro will be launching in more countries and regions later this month.

Specifically, the Vision Pro will become available for pre-order in China mainland, Hong Kong, Japan, and Singapore on June 13, with availability starting on Friday, June 28. On the same day, pre-orders will go live for customers in Australia, Canada, France, Germany, and the United Kingdom, with availability starting on Friday, July 12.

From Apple’s announcement:

“The enthusiasm for Apple Vision Pro has been extraordinary, and we are thrilled to introduce the magic of spatial computing to more customers around the world,” said Tim Cook, Apple’s CEO. “We can’t wait for more people to see the impossible become possible, whether working and collaborating with an infinite canvas for apps, reliving treasured memories in three dimensions, watching TV shows and movies in a one-of-a-kind personal cinema, or enjoying brand-new spatial experiences that defy imagination.”

In addition to announcing availability in more countries and regions, Apple also showcased visionOS 2, the next major update to the Vision Pro’s operating system. Highlights from visionOS 2 include new gestures to invoke the Home Screen and Control Center, train Travel Mode, mouse support, and more. We’ll cover all the changes in visionOS 2 in a more detailed overview later today.

You can follow all of our WWDC coverage through our WWDC 2024 hub or subscribe to the dedicated WWDC 2024 RSS feed.

Raycast: An Extensible Spotlight Replacement Built to Boost Productivity [Sponsor]

Raycast makes your Mac better because it’s fast, ergonomic, and reliable. Best of all, though, Raycast comes with powerful tools your Mac should have but didn’t. Plus, it’s extensible, with a rich catalog of extensions built by developers around the world that solve every productivity need you can imagine.

With Raycast, everything is at your fingertips. The app’s searchable clipboard means always having what you need a few keystrokes away. With emoji and gif search tools, Raycast makes it easy to express yourself. Plus, there are tools to perform quick calculations, currency and unit conversions, and a lot more.

And with broad developer support, there are extensions available to:

  • Track your flights
  • Take notes
  • Save tasks
  • Search for your files
  • Run scripts
  • Kick off shortcuts
  • Translate text
  • and even manage your windows

With Raycast, all of this and more can be accomplished quickly and easily without switching contexts, reducing distractions and speeding up every interaction with your Mac.

Raycast is also the best way to interact with AI. It’s an always-on window into ChatGPT that helps you code, write email messages, automate repetitive tasks, and more.

Raycast is free to download and use, but with annual plans that start at what works out to just $8/month, you can go pro with its AI features, theming, and setup sync across multiple Macs.

Visit Raycast’s website today to learn more, download Raycast for free, and see how its Pro accounts can take your Raycast experience to the next level.

Our thanks to Raycast for sponsoring MacStories this week.