Federico Viticci

10974 posts on MacStories since April 2009

Federico is the founder and Editor-in-Chief of MacStories, where he writes about Apple with a focus on apps, developers, iPad, and iOS productivity. He founded MacStories in April 2009 and has been writing about Apple since. Federico is also the co-host of AppStories, a weekly podcast exploring the world of apps, Unwind, a fun exploration of media and more, and NPC: Next Portable Console, a show about portable gaming and the handheld revolution.

Screens 5.10 Brings Apple’s High Performance Screen Sharing to iPhone and iPad

Last year, I was talking to an Apple engineer at WWDC and they asked me which features I was still missing from iPadOS following the massive update that was iPadOS 26 and its complete rethinking of multitasking, among other updates. Without hesitation, I replied that for iPadOS to be effective in my new kind of AI workflow, I still needed two niche features that would help me – and others like me – work better with agents: a Terminal, for running agents locally on iPad, and the Screen Sharing app they’d updated on macOS a few years prior in macOS Sonoma, for connecting to agents remotely.

I knew that the second part of the answer would catch them by surprise. “What do you mean the Screen Sharing app?” As I reminded them, a few years before, Apple’s macOS team added a High Performance mode to the Screen Sharing app that is built into every Mac. That feature is awesome: it requires a high-speed network with low latency, plus a modern Mac with Apple silicon; if these requirements are met, it kicks off a remote desktop session that is basically “fancy VNC” that has vastly superior image quality, low-latency interactions, and “supports stereo audio, HDR video reference mode, 4:4:4 chroma subsampling, and high frame rates (30 or 60 fps)”. You can read more about it here; John reviewed it at the time here.

Read more


iPhone Duo Apps, Volume One

This week on AppStories, Federico and John kick off a miniseries highlighting their favorite iPhone Duo apps.

Then on AppStories+ for subscribers, John explains the technical details of Apple’s announcement of tools and skills for Siri AI.

Also available on YouTube here.


Subscribe here.

Subscribe here.

We deliver AppStories+ to subscribers with bonus content, ad-free, and at a high bitrate early every week.

To learn more about an AppStories+ subscription, visit our Plans page, or read the AppStories+ FAQ.


AppStories+ Deeper into the world of apps

AppStories Episode 509 - iPhone Duo Apps, Volume One

0:00
44:54

↓

AppStories+ Deeper into the world of apps

This episode is sponsored by:

  • Astropad Workbench – Remote desktop and terminal for AI agents. Free to use for 20 minutes/day.
  • Base44 – Build the real thing with Base44. Describe the software you need in your own words and get a working build. Get 30% off the Builder plan for your first year.

Read more


Touch, OLED, and a Classic Revisited

This week on MacStories Unwind, Federico received a MacBook Pro with PROLED to test and has thoughts, after which he and John recommend the remake of The Legend of Zelda: Ocarina of Time.

Also available on YouTube here.

Ep. 317 - Touch, OLED, and a Classic Revisited

0:00
19:01

↓

Read more


Adding Search to the iPhone Duo Home Screen

I came across a tip by friend of MacStories Parker Ortolani this week that is too good to pass up and not mention here. Did you know that you can fill the bottom-right corner of the iPhone Duo Home Screen – which I bet is an empty space for most people – with a button...


My Favorite iPhone Duo Productivity Apps, Vol. 1

As I hinted in my story about multi-window on the iPhone Duo, I find myself increasingly relying on Apple’s diminutive foldable as a pocket computer for getting work done with an external keyboard. It reminds me of the early days of iPad productivity: there’s something to be said about turning the multitasking limitations of the machine into a way to focus more and be less incentivized to switch between apps. Also, you know me: it’s fun to prove a point and show how you can get work done on an iPhone Duo if you want to.

As part of this, we’re dealing with the fact that we’ve received almost 600 submissions from developers about their iPhone Duo apps and app updates. I haven’t seen this kind of influx of new apps since the early days of the iPad (again, another parallel between these devices). John and I are working hard to make sense of all these app pitches, picking the ones that are worth our readers’ attention, time, and money. In the era of software abundance caused by AI, I think it’s more important than ever to test and curate software that wasn’t simply put together with two Claude Code prompts. This is why, rather than assembling an overflowing directory of iPhone Duo apps with no editorial curation, we’re going to write these old-fashioned roundups instead.

In the past two weeks since I’ve been testing the iPhone Duo, I’ve been impressed by the variety of productivity apps that have landed on the App Store. Most of these strike a fascinating balance of something in between an iPadOS and iOS experience – which, I guess, is the whole point of this new breed of pocket computer.

Below are some of my early favorites, which I’m using every day on my iPhone Duo. Expect more to follow over the next few weeks.

Read more


Apple Frames and Frames CLI Updated with iPad mini (A20 Pro), Apple Watch Ultra 4 Support→

Following this week’s update to my Apple Frames shortcut and Frames CLI with support for the iPhone Duo and 18 Pro, I’ve prepared another small update for more device bezels Apple released a couple of days ago: the Apple Watch Ultra 4 and the new iPad mini (which John reviewed earlier this week on MacStories).

If you’re using the Frames CLI, you can update to version 1.7.0 from the GitHub repo or ask your agent to do it for you. If you’re a Shortcuts user, you can get the latest version of Apple Frames (4.2.0) below or from the MacStories Shortcuts Archive. In either case, you’ll have to download an updated asset pack with the new bezels, which will automatically replace the older one.

As a general recommendation for Shortcuts users, before trying to run the shortcut from the Home Screen or Siri, you’ll want to run it manually at least once so you can grant the initial set of permissions.

Apple Frames

Add device frames to screenshots for iPhones (8/SE, 12-13, 15, 16, and 17 generations in mini/standard/Plus/Pro/Pro Max sizes, plus iPhone 18 Pro and iPhone 18 Pro Max), iPhone Air, iPhone Duo (inner and outer displays), iPad Pro (11” and 12.9”/13”, 2018-2025 models), iPad Air, iPad mini (including A20 Pro), iPad, Apple Watch Series 7/10/11 (Series 12 screenshots use the Series 11 frames), Apple Watch Ultra 2, Ultra 3, and Ultra 4, iMac M4, Studio Display, Studio Display XDR, MacBook Air (2020/M5 13”/M5 15”), MacBook Pro (13”/M5 14”/M5 16”), MacBook Pro with PROLED XDR Display (14” and 16”), and MacBook Neo. Apple Frames 4 supports colored device frames for iPhones 16 and 17, iPhone 18 Pro, iPhone Air, iPhone Duo, iPad mini (A20 Pro), MacBook Pro M5, MacBook Pro with PROLED XDR Display, MacBook Air M5, MacBook Neo, iMac M4, Studio Display, Studio Display XDR, Apple Watch Ultra, and Apple Watch Series 11.

Get the shortcut here.

Permalink

Testing Audio Intelligence with Siri Recap in watchOS 27.3→

Victoria Song, writing at The Verge, tested the new Audio Intelligence features for Apple Watch that also rolled out yesterday as part of the iOS and watchOS 27.3 developer betas.

My first Siri Recap was for an editorial planning meeting for a story I’m working on. It was decent at identifying different topics discussed, and I was impressed that it stripped out some sensitive information. Any outsider looking at these notes would be terribly confused. Ironically, it meant that this summary wasn’t the most useful for my job.

What I will say is that I’ve been testing the Amazon Bee Frontier for the past few weeks. In the little time I’ve spent with the watchOS 27.3 beta, the differences between Audio Intelligence and the Bee are very clear. The latter has more of what I’d call an AI-forward presence. Bee, for example, offers insights about the emotional tone of a conversation. I’ve also found that the AI can be a bit judgy about insights and takeaways. Live Rewind is just a straight transcript. Apple’s said publicly that Siri Recap is meant to be highly factual notes to jog a person’s memory. That rings true based on my first one. And, as far as I can tell, there is no commerce angle for Siri Recaps, whereas Bee has an Amazon integration that surfaces buying suggestions based on conversations.

I forgot to link this, but a few weeks ago, Apple published a technical report (PDF link) that goes into more detail on how audio is recorded, transferred, and processed for Siri Recap:

The Secure Exclave on Apple Watch encrypts the audio and transmits it to the Secure Exclave on the paired iPhone. Once the transfer completes, audio is immediately deleted from the Secure Exclave on Apple Watch, and only the Secure Exclave of the paired iPhone can decrypt it.

And:

The encrypted audio is decrypted inside the Secure Exclave of the paired iPhone. On-device speech recognition transcribes the audio to text, and then an on-device language model generates a condensed version that is less than half the length of the original transcript. This is designed to distill the conversation to its core meaning, removing content suggestive of conversation tone, non-essential language, filler words, and redundancies, while preserving the topics discussed. Once processed, the raw audio is immediately and permanently deleted and no longer exists on either Secure Exclave. Only the condensed text remains. Finally, a safety model screens the text to omit potentially harmful terms.

The implementation of Siri Recap based on dedicated hardware and on-device processing sounds like quintessential Apple, and it seems like the feature does work as advertised. Alas, while I have access to Siri AI thanks to my American Apple Account and U.S. region setting, I live in Italy, and Siri AI does not speak Italian yet.

I do not recommend testing Siri Recap if your language isn’t officially supported by Siri AI – unless you’re looking for some laughs:

…sure.

…sure.

Permalink

“Introducing Adaptive Dark Mode”→

As part of the 27.3 betas released yesterday, Apple also introduced a new Safari feature:

We’re excited to announce Adaptive Dark Mode in Safari 27.3 beta. When enabled by a user, Safari adapts light websites and presents them as dark.

In the spring of 2019, Safari 12.1 became the first browser to support dark mode on the web. A lot of people love using dark mode, but not every website has a dark version. Almost 40% of web page loads are from users in dark mode, and yet only 10% of page loads support it. If you love dark mode, you’ve probably hit a site that felt particularly bright. Adaptive Dark Mode is designed to close that gap, providing a consistent dark experience across the web.

If this sounds familiar, it’s because so many third-party Safari extensions for this very task already exist, including the very popular (and a MacStories favorite) Noir. The difference, of course, is that Adaptive Dark Mode is built deep into the WebKit engine itself now, ships for free in Safari, and offers greater speed and performance since it’s not limited by an extension. It sounds like Apple thought of a lot of details here:

At the core of Adaptive Dark Mode is the transformation of color. Sometimes colors are simply decorative, while other times they have semantic meaning. Adaptive Dark Mode determines when to invert colors so elements remain visible or when to leave colors unchanged.

While creating Adaptive Dark Mode, we developed a color matrix to invert the luminosity of colors while preserving hue. It’s used to make light backgrounds dark, and dark text light. When transforming text color, Adaptive Dark Mode aims for sufficient contrast as defined by the WCAG 4.5:1 contrast ratio. Light CSS gradients are also transformed to dark.

And:

It takes the same care with images. Most are left unchanged, preserving their integrity. But many icons and logos can lose contrast when the background color behind them is inverted. So Adaptive Dark Mode inspects SVG images and transforms colors when needed. For bitmap images, it analyzes the pixel histograms and inverts simple black-and-white logos.

Noir and similar extensions had a great run. Between this, the MCP server added earlier this year, and vertical tabs in 27.3, it’s time for me to go back to Safari everywhere.

Permalink

Siri AI’s Evolution Is Both Surprising and Obvious

Siri AI in iOS 27.3 beta.

Siri AI in iOS 27.3 beta.

As part of the release of the 27.3 developer betas yesterday, Apple announced a substantial expansion of the capabilities of Siri AI. As you recall from my iOS 27 review two months ago, Siri AI launched with support for a limited subset of app domains based on schemas that Apple specifically optimized for the first version of Siri AI. In a major reversal for a mid-cycle update to Siri AI, that limitation is entirely going away: the updated Siri AI will instead work with any kind of app that supports any custom App Intent – as long as the developers do the work of modernizing their App Intents and integrating with Siri. Effectively, though, any app can work with Siri AI now, and Apple calls this the Siri AI Developer Preview.

Read more