Posts tagged with "developers"

“Introducing Adaptive Dark Mode”→

As part of the 27.3 betas released yesterday, Apple also introduced a new Safari feature:

We’re excited to announce Adaptive Dark Mode in Safari 27.3 beta. When enabled by a user, Safari adapts light websites and presents them as dark.

In the spring of 2019, Safari 12.1 became the first browser to support dark mode on the web. A lot of people love using dark mode, but not every website has a dark version. Almost 40% of web page loads are from users in dark mode, and yet only 10% of page loads support it. If you love dark mode, you’ve probably hit a site that felt particularly bright. Adaptive Dark Mode is designed to close that gap, providing a consistent dark experience across the web.

If this sounds familiar, it’s because so many third-party Safari extensions for this very task already exist, including the very popular (and a MacStories favorite) Noir. The difference, of course, is that Adaptive Dark Mode is built deep into the WebKit engine itself now, ships for free in Safari, and offers greater speed and performance since it’s not limited by an extension. It sounds like Apple thought of a lot of details here:

At the core of Adaptive Dark Mode is the transformation of color. Sometimes colors are simply decorative, while other times they have semantic meaning. Adaptive Dark Mode determines when to invert colors so elements remain visible or when to leave colors unchanged.

While creating Adaptive Dark Mode, we developed a color matrix to invert the luminosity of colors while preserving hue. It’s used to make light backgrounds dark, and dark text light. When transforming text color, Adaptive Dark Mode aims for sufficient contrast as defined by the WCAG 4.5:1 contrast ratio. Light CSS gradients are also transformed to dark.

And:

It takes the same care with images. Most are left unchanged, preserving their integrity. But many icons and logos can lose contrast when the background color behind them is inverted. So Adaptive Dark Mode inspects SVG images and transforms colors when needed. For bitmap images, it analyzes the pixel histograms and inverts simple black-and-white logos.

Noir and similar extensions had a great run. Between this, the MCP server added earlier this year, and vertical tabs in 27.3, it’s time for me to go back to Safari everywhere.

Permalink

Siri AI’s Evolution Is Both Surprising and Obvious

Siri AI in iOS 27.3 beta.

Siri AI in iOS 27.3 beta.

As part of the release of the 27.3 developer betas yesterday, Apple announced a substantial expansion of the capabilities of Siri AI. As you recall from my iOS 27 review two months ago, Siri AI launched with support for a limited subset of app domains based on schemas that Apple specifically optimized for the first version of Siri AI. In a major reversal for a mid-cycle update to Siri AI, that limitation is entirely going away: the updated Siri AI will instead work with any kind of app that supports any custom App Intent – as long as the developers do the work of modernizing their App Intents and integrating with Siri. Effectively, though, any app can work with Siri AI now, and Apple calls this the Siri AI Developer Preview.

Read more


Apple Kicks Off Touch on Mac Developer Resources with Videos and Labs

Source: Apple

Source: Apple

As part of the introduction of Touch on the OLED MacBook Pros today, Apple has begun rolling out resources for developers. Apple’s press release explains that many third-party apps will just work with Touch, but the company is also releasing updated system gesture APIs for developers who want to provide custom Touch experiences.

The videos offer a preview of what developers can do besides turning taps into clicks. Apps can let users manipulate multiple controls at once, while sliders and dials can expand into larger controls when touched. It’s an approach that preserves the familiar Mac interface while making it easier to use with your fingers.

Currently, there are three videos available to developers:

Apple has also scheduled two one-hour online developer group labs for November 18 and 19, which registered developers can sign up for. The same webpage lists Xcode 27.3 beta and documentation and design resources as coming soon.

Developers won’t need one of the new MacBook Pros to begin testing, either. Apple says in the Bring Touch to your Mac app video that its latest macOS beta and developer tools will let them test the new Touch features with an iPad connected to a Mac with Sidecar.

Based on the timing of the developer sessions, the footnotes from today’s MacBook Pro press release, and swinging a rubber chicken around my head, my prognostication is that macOS Golden Gate 27.3 will be released on November 24, two days before the Thanksgiving holiday in the U.S. That’s just a guess, but I think it’s a pretty good one. As for those of you who pick up a MacBook Pro before then, you’ll still be able to poke at your Apple apps and existing third-party apps.

Apple says these custom Touch implementations are coming later this year. The company describes the lineup in its press release:

a wide range of third-party apps that pros rely on every day will also take advantage of Touch on the new MacBook Pro, bringing new ways to interact with their favorite tools and workflows. These include everyday productivity and collaboration apps like Notion, Canva, Zoom, Microsoft Word, Excel, PowerPoint, and Outlook; powerful creative tools for photo and video editing like Adobe Lightroom and DaVinci Resolve; 3D modeling and animation apps like Blender, Maxon Cinema 4D, Maxon ZBrush, and Shapr3D; along with music apps like Algoriddim djay Pro.

That’s an impressive lineup, and from the press release and demos at today’s event, it looks as though Apple has managed to get some of the biggest players behind its efforts. As someone who spends a lot of time swiping around audio and video timelines, I can’t wait to see what this sort of editing workflow is like.

Also worth noting, macOS is adding an Accessibility setting that allows users who can’t or don’t want to touch their MacBook Pro’s screen to disable touch input.


Apple Investigating Options for Extending Web Content Under iPhone Duo’s Safari Controls→

Jen Simmons, writing at the official WebKit blog:

Safari 27.1 does bring one change to users. Now, when someone holds iPhone Duo partially folded like a book while looking at a PDF on the web, Safari 27.1 automatically shows PDFs as two pages side by side. When they open the screen flat or close it fully, Safari switches back to one page.

I didn’t know about that, likely because I prefer saving and reading PDFs offline. The most interesting tidbit from this otherwise (very) technical blog post, however, is the fact that Apple is actively looking into ways to let web developers extend their websites’ content underneath the Safari controls shown on the right side of the iPhone Duo’s screen:

You might have noticed the outer display of iPhone Duo is wider and shorter than other iPhone displays. To give content more vertical space, iOS moves controls to the side.

In Safari 27.1, web content does not currently extend to fill the space behind these controls. Just like on other platforms, Safari looks at the web page and extends its background color to fill the space.

We would like to give web designers and developers the ability to design and use that space in more creative ways. Perhaps you want to extend your header background across the full width of the display, for example. It might seem like there’s just one obvious way to make this possible, but really there are many possibilities.

Since getting my iPhone Duo review unit yesterday, this is what has annoyed me the most. I dislike how all kinds of websites are simply cut off on the right side of Safari on the outer display. You can see this in action on MacStories itself: while we have fully updated our website to take advantage of the iPhone Duo’s new viewport sizes, there’s nothing we can do to extend the toolbar and other elements under Safari’s controls on the right side of the display. The result looks like a poor implementation on our end, but it isn’t.

MacStories on the iPhone Duo's outer display.

MacStories on the iPhone Duo’s outer display.

I hope Apple’s Safari and WebKit teams can figure this out; once they do, we’ll update MacStories for the iPhone Duo again.

Permalink

Building for iPhone Duo, in App Developers’ Own Words

I spent yesterday in New York City interviewing developers about their iPhone Duo apps and the experience of building for such a new and different device. The depth and breadth of developers Apple assembled was excellent. I spoke to indie developers like Vidit Bhargava about Deck-Man and the team behind Notewise. I also interviewed developers from big companies about their impressive Duo updates, including The New York Times for its NYT Cooking app, Netflix, and Meta’s Edits video editing app. Plus, I met Mark Otero from Azra Games, whose team poured their hearts into UnGodly, one of the best-looking games I’ve seen on iOS in a while.

A few things struck me about my conversations with developers. First, every one of them was excited about the design challenges posed by the iPhone Duo and the many orientations and ways it can be used. Second, every one of them came away impressed by how smooth Apple has made the development process. That’s not to say the design challenges weren’t real, but getting from a design idea to an app that worked on the Duo went better than anyone expected. Third, after months of building and testing, everyone was looking forward to seeing which design choices land with users.

But that’s enough of my impressions. I’ll let the developers speak for themselves in this special bonus AppStories video. I came away from New York with some great interviews, which I’ve shared on the MacStories YouTube channel. Apologies for the sometimes rough audio. There’s only so much I can do with recordings made in a room packed with press and developers, but if you’re into apps, design, and how things are built, these interviews are for you.

Also, I left New York with a Night Sky 512GB iPhone Duo that I’ve only just set up and begun testing. I’ll be writing about the Duo soon, and we’ll start covering the best of the more than 300 Duo-optimized apps that developers have sent Federico and me. Stay tuned, because the busy fall season at MacStories is just going to keep rolling.


Why Aren’t AI Labs’ Apps Better?→

Ben Davis (co-host of one of my favorite new podcasts this year, Nerd Snipe) has a fascinating take on a question I’ve seen many in the Apple community ponder as well: if these frontier models are so good, why do most AI apps from the big labs still kind of suck?

Davis wrote about this in relation to the ChatGPT/Codex desktop app, which has turned into a bit of a kitchen-sink design phenomenon with all kinds of features crammed into a UI that has two left sidebars, multiple modalities, and all sorts of disjointed menus.

To me the most interesting thing here is the implied question of “if the Codex team has unlimited tokens on really powerful unreleased models, why is the product getting worse?”

The lazy answer is “it’s just vibe coded slop, real artisanal code wouldn’t be like this”. Anyone who still says this is a moron and you can ignore them.

“Vibe coding” is not the problem. Frankly, these models are better at writing code than pretty much anyone at this point. You tell the model to make something and it’ll make that thing quite well. And also to be clear, Jira was horrid before LLMs existed. Good and bad products have always existed, and I actually think you can make infinitely better products now when using the agents properly (see T3 Code and Grok Bot).

I’ve been reviewing apps for over 17 years. Without a doubt, the most basic “vibe-coded” app created with Opus 5.5 today is infinitely more stable and nicer than any first app from an amateur developer in 2009. So if we agree that these models can write good code now, why is it that so many apps are still bad?

As we argued in our interview with OpenAI’s own Andrew Ambrosino (the irony is not lost on me), it comes down to human discernment, taste, and other qualities that can’t be turned into “metrics” for a model…at least not yet.

Davis continues:

To put a more precise definition on it, I think this “taste” is the ability to make good decisions in places where there isn’t a programmatic verification function.

For example: “make this function really fast” isn’t a “taste” task it’s a hill climbing task (make changes => test changes => repeat until goal met) which the models excel at right now (I think that any problem which can be expressed in this shape can be solved now by Opus 5.5)

“Which of these color palettes do you prefer?” is a “taste” question. You can’t really put a verifier on it other than your own opinion AKA your own taste. It’s a simple little example, but everything from codebase structure to dashboard layout to how features in chatgpt fit together all fit under here. Their implementations are “correct”, the tests pass, I just hate the choices they made.

“The tests pass, I just hate the choices” sums up my experience with coding agents perfectly. We’re working on our first two apps for MacStories (more in the near future), and while I’m not writing the code, I have to spend so much time thinking about usability decisions, onboarding flows, iOS best practices, and “it just doesn’t feel right” issues that models haven’t been able to abstract yet. I have to wonder if, in a rush to maximize infinite token usage and build everything “because why not?”, perhaps the big labs may have ignored these other aspects of good software design. I strongly believe that there’s more to a great app experience than elegant code that passes tests.

Knowing how these things can change so quickly in this scene, I’m sure this post will be obsolete in a few months. Maybe even weeks. But at this moment in time, Davis’ article is spot-on and human decisions still make a dent in software coded by agents.

Permalink

iPhone Duo App Submissions Are Open→

Source: Apple.

Source: Apple.

Yesterday, Apple announced on its developer blog that it has begun taking App Store submissions for iPhone Duo apps. The new foldable phone will be in customers’ hands in just over two weeks on October 23 and with Xcode 27.1, developers can recompile existing apps and build new ones.

To prepare for the launch, Apple has provided links to design and App Store asset guidance, as well as submitting apps to App Store Connect.

Federico's Frames CLI.

Federico’s Frames CLI.

Also, if you’re a developer, don’t forget to check out Federico’s Frames CLI 1.5.0, which includes experimental support for the iPhone Duo. The feedback from developers has been that it saves a lot of time when preparing screenshots for the App Store. The Frames CLI is available on GitHub and there’s more information on MacStories here.

Permalink

Apple Announces Plan to Impose New Full Disk Access Controls on Mac Developers→

Today, on its developer blog, Apple announced plans to “…introduce additional controls to ensure that users who genuinely wish to grant an app this extraordinary level of access can only do so with very explicit user action.” The company says it’s doing so because of the dangers posed by AI agents.

According to Apple’s post:

Full Disk Access largely sidesteps these controls in order to allow backup apps to function properly on the Mac.

That’s nonsense. Looking at this MacBook Pro, only a handful of apps to which I’ve granted Full Disk Access are backup apps. Others include the Finder replacement Bloom, launchers like Alfred, the wonderful selection utility PopClip, Apple’s own Pixelmator Pro, Setapp, TestFlight, Supercharge, Madden NFL 27 Arcade Edition, Hazel, and many others. It’s a diverse selection of apps covering everything from Apple’s own apps to Mac utilities that are longtime favorites of MacStories readers, and even one Apple Arcade game.

What is valid is that AI agents pose risks if common-sense steps aren’t taken to limit their access to your data. So while the suggestion that Full Disk Access is just for backups doesn’t pass the smell test, Apple’s concerns about agents are well-founded.

The thing that bothers me about this post, though, is that it’s vague. On the one hand, it seems to suggest that users will simply have to jump through additional explicit hoops to grant Full Disk Access to their agents and other apps. On the other hand, claiming that Full Disk Access was designed solely for backup apps raises red flags that could signal that the company intends to restrict the kinds of apps that can use Full Disk Access. I sure hope not.

Even if you want nothing to do with AI agents, the changes that Apple is contemplating could impact a wide variety of the Mac apps you rely on every day. Apple needs to find a way enable reasonable customer protections without hamstringing the Mac’s utility.

Permalink

Our Favorite Indie Apps for iOS 27, Vol. 1

With our annual OS reviews out of the way, Federico and I will be covering our favorite indie apps that take advantage of Apple’s latest OS features. We have hundreds to draw from and instead of one big sweeping roundup, we’re going to do a bunch of smaller ones as we work our way through our lists.

To start with, we have six excellent apps that make use of Siri AI, Apple Intelligence, extra-large widgets, and more. There’s a lot of innovation packed into this group, so let’s dive into the details, and check back soon for more roundups.

Things

Cultured Code’s beautiful task manager is no stranger to supporting major Apple OS releases: while the company is keeping quiet on their plans for a possible Things 4 (Things 3 was released in May 2017), for the past nine years Things has regularly received support for new versions of iOS, iPadOS, and macOS on day one. The app’s iOS 27 update is no exception, and it makes for a great demo of some of the new features of Siri AI as well as XL widgets for iPhone. It also serves as an example of the limitations of Siri AI – and not because of Cultured Code.

The updated Things app integrates with Siri AI and Spotlight, allowing you to retrieve and open tasks from anywhere on iOS and iPadOS, as well as manage tasks with the assistant using its several input methods. In my tests, Cultured Code’s integration worked well, but Apple’s slow on-device indexing was the problem. Soon after installing the app, I was able to ask Siri to create a reminder, and it prompted me to pick a destination app again because I’d installed a few more task managers since I last confirmed my previous choice. After picking Things, I was able to create a task, which landed in the inbox, and then follow-up with Siri AI by saying “make it due at 3 PM”, and it worked.

The issues I ran into, which are outside of Cultured Code’s control, are due to how long it takes iOS 27 and Siri AI to build an index of the app’s capabilities and data structure. For instance, I created an ‘iOS 27 Review’ list in Things, but, after three hours, Siri AI still can’t find it. As I noted in my review, I believe this is going to be a major challenge for most third-party apps in the short term as users download them, expect them to work with Siri, but the indexing isn’t going quickly enough.

Regardless of Apple’s technical problems, Things’ integration with Siri AI shows the path forward for third-party task managers on iOS. I also recommend reading the developers’ guide on how to prompt Siri AI for the app.

Locally AI

I covered the differences between Apple’s two flavors of local Foundation models (AFM 3 Core and 3 Core Advanced) in yesterday’s review, but there’s no better way to actually take the model for a spin than Locally AI.

The app, which is now part of the LM Studio family of products and can connect to a remote Mac using LM Link, now offers an ‘Apple Foundation Advanced’ model that, assuming you have a compatible device, lets you prompt Apple’s new on-device model.

A good way to prompt this model is to give it an image: for the first time, a local Foundation model comes with vision capabilities, and I’ve found Core Advanced to be surprisingly strong at describing things like iPhone screenshots, selfies with different facial expressions, and more. Obviously, it comes with limits: Locally AI’s harness doesn’t expose tools to the model, which means it can’t fetch web content and, say, summarize articles for you in the app. Its knowledge and creativity are also quite limited, as you can see from the non-joke it created in the screenshot above.

Still, despite the limitations of the model itself, Locally AI is an excellent utility for running local models on iPhone and iPad, and if you’re curious to see what Apple’s bigger models feels like outside of Siri AI with your own prompts, I recommend checking it out.

Dark Noise

Charlie Chapman’s Dark Noise has long been my favorite utility to play white noise and other sound effects to relax or focus, and the app has received a substantial update for iOS 27 worth checking out.

First, there’s a good-looking new Liquid Glass player that fluidly morphs on-screen from a mini-player docked at the bottom of the app into a full-screen view that lets you control playback, volume, and set a sleep timer. On the Home Screen, there’s a (customizable) XL portrait widget for iPhone that lets you configure any combination of up to 24 distinct sounds and mixes that you can play with a single tap without opening the app.

As you can imagine, the app also integrates with Siri AI now. Using Apple’s assistant, you can ask to play specific sounds from the app (make sure to add “…from Dark Noise” to your request) and you can also leverage on-screen awareness inside the app itself. While looking at your list of favorites and mixes, for instance, you can say something like “play the second mix”, and since Chapman has properly annotated the app’s views, Siri AI and Dark Noise will know what you mean.

If you, like me, struggle to get work done with music in the background but also do not appreciate complete silence, I recommend installing Dark Noise and creating a few mixes of your own.

AskPlay

I first covered Francisco Cantu’s AskPlay when it debuted on the Mac earlier this year in the App Radar for Club members, where I wrote:

Created by indie developer Francisco Cantu (a name that should be familiar to longtime MacStories readers!), AskPlay is one of the best new Mac apps I’ve tried in a long time, and we will properly review it on MacStories in the near future. The idea is simple: AskPlay gives you natural language control over Apple Music to play or queue songs. The app, which lives in the menu bar but can also be invoked with a system-wide hotkey, brings up a Spotlight-like floating search box where you can type or say things like, “Queue some ‘90s hip-hop,” or, “Play something like Oasis,” and have an AI carry out the request.

The app can build mixes for a mood or era, start stations, manage the queue (you can ask to move songs up or down), control playback, and add songs to your library or playlists, and it also answers questions such as, “Who sings this?” You can either type your requests or set a voice hotkey that summons the app already listening, pausing your music while you speak. AskPlay is a bring-your-own-key app, so you’ll need an API key from OpenAI, Anthropic, or OpenRouter in addition to an Apple Music subscription (and a subscription to the app itself).

AskPlay is now on iPhone too, and thanks to iOS 27, it’s become one of my favorite showcases of Apple’s Cloud Pro Foundation model running in Private Cloud Compute. Unlike the original version, AskPlay now lets you hand off prompt processing to a reasoning model in the cloud at no cost thanks to Apple’s PCC framework for third-party developers. And not only that, but AskPlay is also the first app I’ve seen that lets you choose between the three reasoning modes supported on PCC: light, moderate, and deep.

In my experience, I’ve had the best results with the PCC model set to “moderate” reasoning. What this means in practice is that with AskPlay for iOS 27, we now have a way to generate Apple Music-based mixes using natural language with a quality that I find superior to Apple Music’s own playlist generation feature.

AskPlay remains one of the best app debuts of the year, and if you want to demo the capabilities of Private Cloud Compute for third-party apps, you should start here.

LookUp 13

LookUp 13 from Vidit Bhargava has been released with a wide variety of features that make use of iOS and iPadOS 27. The app, which is available on the iPhone, iPad, Mac, Apple Watch, and Vision Pro, makes great use of Siri AI, allowing you to quickly ask Siri things like “Search the word plethora in LookUp,” which opens the app right to that word. Siri can also be used to find LookUp’s word of the day or a random word.

LookUp 13.

LookUp 13.

Beyond Siri, Vidit has added support for Apple Intelligence in the notes that can be tied to a word and combined Apple’s Foundation Models with the Vision framework and hand-pose tracking to let you scan a printed page for a word. Point at a word and the app’s scan mode uses your device’s camera to see which word you’re pointing at. It took a little practice to figure out the right distance from the camera to the page, but once I got that down, it felt like magic. The same feature can pick out other nearby words that might be difficult for the reader, too.

LookUp 13 also offers a Reading Mode that looks up words you speak as you read. The feature uses a Live Activity that listens to you speak, and returns a definition. Initially I ran into some trouble with Reading Mode, but when I tried again later, it worked every time. Also included in the latest release are interactive flash cards that ask for word definitions that are graded by Private Cloud Compute and new extra-large widgets for the word of the day and a shuffled word of the day.

LookUp is an excellent app. I love how Vidit continues to push the boundaries of Apple’s technologies every year, and while I hit a few rough spots in testing, which struck me as issues with Siri AI, not LookUp, I’m impressed by how much depth LookUp’s new Apple Intelligence features add to the app.

Play

The latest update to Play, the watch-it-later app from Marcos Tanaka that works on the iPhone, iPad, Mac, Vision Pro, and Apple TV, includes a bunch of great touches. There’s a new Channels Inbox for navigating saved videos by source. Play has also added Siri AI support allowing you to search for and open videos. Onscreen content is made available to Siri, so you can do things like ask it to remind you to finish a video later, and it knows what you mean. In my testing, all three features work well.

Also, on an individual video’s detail view, you can use Apple Intelligence to create a summary of a video. There are options ranging from a concise summary to a simple explanation. I ran into a roadblock when I tried to create a summary of a fifteen-year-old YouTube video, but more recent videos all worked well. Apple Intelligence can also suggest tags and icons for videos and lets you ask questions, with the answers drawn from the video’s transcript.

Beyond Siri AI and Apple Intelligence, Play adds an extra large widget, a refreshed Liquid Glass design that I love, and Spotlight search. It’s a fantastic update to my favorite way to save videos for later.