This Week's Sponsor:

GoodLinks

Save articles for later and enjoy them when you have time


Posts tagged with "AI"

Apple Announces Plan to Impose New Full Disk Access Controls on Mac Developers→

Today, on its developer blog, Apple announced plans to “…introduce additional controls to ensure that users who genuinely wish to grant an app this extraordinary level of access can only do so with very explicit user action.” The company says it’s doing so because of the dangers posed by AI agents.

According to Apple’s post:

Full Disk Access largely sidesteps these controls in order to allow backup apps to function properly on the Mac.

That’s nonsense. Looking at this MacBook Pro, only a handful of apps to which I’ve granted Full Disk Access are backup apps. Others include the Finder replacement Bloom, launchers like Alfred, the wonderful selection utility PopClip, Apple’s own Pixelmator Pro, Setapp, TestFlight, Supercharge, Madden NFL 27 Arcade Edition, Hazel, and many others. It’s a diverse selection of apps covering everything from Apple’s own apps to Mac utilities that are longtime favorites of MacStories readers, and even one Apple Arcade game.

What is valid is that AI agents pose risks if common-sense steps aren’t taken to limit their access to your data. So while the suggestion that Full Disk Access is just for backups doesn’t pass the smell test, Apple’s concerns about agents are well-founded.

The thing that bothers me about this post, though, is that it’s vague. On the one hand, it seems to suggest that users will simply have to jump through additional explicit hoops to grant Full Disk Access to their agents and other apps. On the other hand, claiming that Full Disk Access was designed solely for backup apps raises red flags that could signal that the company intends to restrict the kinds of apps that can use Full Disk Access. I sure hope not.

Even if you want nothing to do with AI agents, the changes that Apple is contemplating could impact a wide variety of the Mac apps you rely on every day. Apple needs to find a way enable reasonable customer protections without hamstringing the Mac’s utility.

Permalink

OpenAI’s Dots: A First Look

Source: OpenAI.

Source: OpenAI.

Earlier this week, I was at OpenAI’s annual DevDay conference where it launched Dots, a personal agent that lives inside the ChatGPT app. I set up my Dot and named it Puck after the mischievous sprite in Shakespeare’s A Midsummer Night’s Dream. In the days since then, I’ve found myself using Puck more and more. There are still rough edges, but I thought I’d share what’s working and what’s not, and how Dots are different from what’s already available in ChatGPT and Codex.

Dots are persistent, cloud-based agents that use the plugins and other tools you’ve connected to ChatGPT, after you allow them to do so. Your Dot has its own virtual Linux computer to assist you with your work. And at first, your Dot, which is depicted by a colorful character you can customize, doesn’t have access to anything else. However, as you give your Dot tasks that need access to other tools, it will ask for your permission to access other tools. The pacing of this initial interaction with your Dot is really well done. The requests felt natural and allowed me to get comfortable with expanding what I let Puck do without feeling like annoying interruptions.

Customizing my Dot.

Customizing my Dot.

Dots are available on mobile and desktop devices, and because they are cloud-based, your Dot’s chat is always synced between devices. But being a cloud-based agent has its downsides, too. Out of the box, your Dot can’t access your computer’s files and apps. That’s easily fixed by clicking or tapping on your Dot and granting it access to your Mac, so it can use the Mac alongside its own VM. As with Codex’s Remote feature, using a remote Mac with your Dot requires the ChatGPT app to be open on that Mac, too.

Read more


Frames CLI 1.5.0, Now with iPhone 18 Pro and (Experimental) iPhone Duo Support

The updated Frames CLI also supports proportional scaling for iPhone Duo.

The updated Frames CLI also supports proportional scaling for iPhone Duo.

The Frames CLI – the companion command line interface to my Apple Frames shortcut I released earlier this year – received a 1.5.0 update earlier today with two notable additions: iPhone 18 Pro frames, and experimental support for iPhone Duo screenshots in all poses.

As always, my shortcut and CLI are based on Apple’s official product bezels, which is why, as of today, there is no support for Apple Watch Series 12 and Ultra 4 yet (those frames haven’t been published by Apple). iPhone 18 Pro is the new default frame family for the two Pro and Pro Max screen sizes, and the CLI supports all the new device colors this year (Burgundy, Glacier, Silver, and Black).

iPhone 18 Pro in Burgundy.

iPhone 18 Pro in Burgundy.

iPhone Duo support is experimental. I obviously don’t have an iPhone Duo yet, but thanks to Opus 5.5, I was able to grab screenshots from the Xcode 27.1 Device Hub, verify them against Apple’s official assets, and test everything in the Frames CLI. It should work! The CLI – and, thanks to its skill, your agent of choice – supports framing screenshots taken on the inner and outer display, different poses, different rotation settings, as well as screen recordings.

If you’re a developer working on iPhone Duo apps, I think the updated Frames CLI should come in handy to automate the process of framing multiple screenshots and screen recordings. As before, you can take advantage of CLI features such as proportional scaling, merge mode, and batch mode, which should help you with your upcoming App Store submissions for the iPhone Duo.

The Frames CLI is free and open source, works with any agent, and is highly customizable. I’ll release an updated version of the Apple Frames shortcut once I can get my hands on an actual iPhone Duo next month (hopefully). Fingers crossed.


ChatGPT Is Surprisingly Thorough at Planning Running Routes→

Every now and then, I go looking for new running routes to mix things up, which was why I was intrigued by this post by Simon Willison, who gave ChatGPT Work his address and asked it to find 5K and 10K routes, using OpenStreetMap data:

It worked for 27 minutes and produced exactly what I’d asked for, as both an embedded visualization and downloadable GPX file and GeoJSON files. Here’s that 5K route:

I decided to give the same thing a try and was impressed by the results. ChatGPT spent a similar amount of time, poring over OpenStreetMap data, but it didn’t stop there. The model consulted my town’s website to account for road construction and the availability of sidewalks. Then, it visited the county’s website to review maps of greenways that aren’t part of the local road system. The final results were within 100m of exact 5K and 10K routes with notes on where to be careful to verify safe pathways and road crossings.

What I love about this sort of experiment is that it’s not something I’d ever have thought to ask ChatGPT myself. In hindsight, it’s obvious that all the data is there, ready to assemble. However, it just goes to show the many ways that I, and I’m sure many others, are still just scratching the surface of what LLMs make possible.

Permalink

watchOS 27: The MacStories Review

I haven’t been this excited about an Apple Watch in a long time. Last week, Apple introduced the Apple Watch Series 12 and Apple Watch Ultra 4, which will be available at the end of the week. The new Watches feature the S11 chip, which enables a bunch of new features, some of which won’t debut until later this year. At the same time, Apple is dropping support for more Watches than usual.

What we’re witnessing is a reboot of the Apple Watch and watchOS forced by advances in AI. The Apple Watch and its OS found their niche years ago, freeing us from pulling out our iPhones for notifications, tracking our health and fitness, and enabling the occasional Siri request. It was a good and comfortable spot for what by all accounts has been one of the most successful wearables to date, but watchOS also felt stuck in a rut.

Every year we got a few new workout types, a new watch face, and a few other features, but the OS didn’t advance much. What’s different this year is that watchOS 27 is breaking with slower hardware and looking forward to the substantially more powerful S11 chip, which will allow the Apple Watch to expand into all-new areas.

What this transition also means is that there is not just one set of features to track in watchOS 27 this year but three:

  • those that arrive today for anyone with a compatible Apple Watch,
  • those that arrive at the end of the week that are exclusive to the new Apple Watch Series 12 and Ultra 4, and
  • those that are coming later this year.

That makes this more than just a review. It’s also a preview of things to come and a roadmap for where the Apple Watch is heading.

There’s more than usual to cover this year, so let’s dive in and check it out.

Read more


macOS 27: The MacStories Review

Every OS update has a story to tell. With macOS 27 Golden Gate, that story captures a moment when Apple is faced with multiple challenges, many of which are tied to the rise of large language models.

One of those challenges is obvious. Apple was caught off guard by chatbots, overpromised a response at WWDC in 2024, and has been playing catch-up ever since.

But this isn’t simply a story of missteps or wasted opportunities. There’s more to it than that.

Read more


Logitech Releases the Developer-Focused MX Keypad for AI Automation

Source: Logitech.

Source: Logitech.

Today, Logitech introduced the MX Keypad. If it looks familiar, that’s because it’s one-half of Logitech’s existing MX Creative Console. However, instead of bundling a 3 x 3 keypad with a dialpad, the MX Keypad is just the keypad for $99.

I reviewed the MX Creative Console in 2024, and I still use it and write about ways to automate tasks with it. It’s an excellent pair of devices, so it’s not surprising that Logitech has adapted the keypad to a new use case.

Keypad, cable, and kickstand. Source: Logitech.

Keypad, cable, and kickstand. Source: Logitech.

The MX Keypad’s hardware is identical to the keypad from the Creative Console. In addition to the keypad itself, it comes with a kickstand you can use to prop it up at an angle and connects via USB-C to your Mac. My MX Creative Console review has more detail about the hardware, along with images and a short video.

I like the MX Creative Console a lot, and according to Logitech, so did software developers looking for ways to automate their AI workflows. While Logitech didn’t expressly say why it dropped the dialpad for the MX Keypad, it makes sense to me having used the MX Creative Console for months. Dialpads are great for timeline-based creative work, but less so for development work. Yes, developers might want to use the dialpad to control screen brightness or volume, but by limiting the MX Keypad to just the keypad, Logitech was able to hit a lower price point, making the device more appealing to a bigger audience.

I’ve been impressed by the number of ways Logitech has opened its devices up to automators who like to tinker, too. Similar to devices like the Stream Deck, Logi Options+ lets you build Smart Actions based on keyboard shortcuts and macros. But there’s more than that. If you’d prefer to let someone else do the automation, Logitech runs a Smart Actions marketplace with plugins tailored to certain apps. For developers there’s also a Logi Actions API for building plugins with access to each Logitech device’s full capabilities.

Source: Logitech.

Source: Logitech.

From a developer standpoint, the combination of automation options means the MX Keypad opens up a variety of possibilities like:

  • launching agents,
  • monitoring agent activity via the device’s dynamically updated keys,
  • triggering saved prompts,
  • activating voice input, and
  • automating many other repetitive tasks.

Logitech is also teaming up with GitHub Copilot as part of the MX Keypad launch, similar to the partnership that was announced with Adobe as part of the MX Creative Console. There’s a Copilot plugin available that adds Copilot controls to the keypad’s keys. Logitech customers can also take advantage of GitHub’s offer for three months of GitHub Copilot Pro+ for free.

Logitech’s MX Keypad is primarily a repackaging of an existing device with a GitHub Copilot deal thrown in to make it a better value. But it’s good to see the company addressing the developer market more directly. Having used the MX Creative Console primarily for automation and development-type work myself, dropping the dialpad from the package to lower the price is a good tradeoff. I use the dial and its other buttons occasionally, but for automation, the keypad is where it’s at, and between Smart Actions and a full plugin SDK you can point your agent at, the MX Keypad is a great choice for automators.

The Logitech MX Keypad is available directly from Logitech and from Amazon.


Perplexity Introduces ‘Hybrid Compute’ for Computer Agent on Apple Silicon Macs

Source: Perplexity.

Source: Perplexity.

Perplexity has announced hybrid compute for Personal Computer on Apple silicon Macs. Personal Computer already combined cloud-based Computer tasks with access to local files and apps, but its AI processing was primarily cloud-based. Recently, Perplexity also introduced Portable Computer, a local-first version of Computer that can escalate work to the cloud with a user’s permission.

Hybrid compute approaches the problem from a different direction. Tasks start in the cloud but if a new local classifier detects potentially sensitive information, the user is alerted and asked whether they want to route it to a local model, although users also have the option to let the flagged data be used by a frontier cloud-based model. Gemma E4B, Qwen3.6 35B-A3B, and a Perplexity post-trained version of Qwen3.6 35B are available at launch for that local work, with more models to come in the future.

Tasks that don’t require sensitive information are handled in the cloud by frontier models that also orchestrate the cloud and local tasks. Users select the cloud orchestrator and Perplexity chooses the helper frontier models used.

Another key feature is that hybrid compute works with tasks begun from an iPhone or iPad, too. Those devices could already kick off a session, but now they can also run tasks that use sensitive information locally if your Mac is turned on and running Perplexity.

Yesterday, I got a demo of the feature that walked through three scenarios:

  • an attorney researching a legal brief, with sensitive client data on their Mac, allowing them to update it locally,
  • an analyst using web-based data to update a confidential slide deck for a presentation about a company’s financials, and
  • a small business owner kicking off pricing research from her iPhone that was combined with private pricing data for her business that never left her Mac.

I haven’t tried hybrid compute myself yet, but if it works as advertised, it’s a big step forward for Perplexity, and one that a lot of its competitors are also chasing. AI agents are only as good as the tools and data to which they have access. Tool calling has been a big focus over the last year and more, but data privacy is an equally important issue that needs to be solved before more companies, especially those in regulated industries, adopt agentic tools like Personal Computer. It’s good to see Perplexity tackling this head-on.


Inside OpenAI’s Codex with Andrew Ambrosino→

On today’s episode of AppStories, Federico and I interview Andrew Ambrosino, the project lead for Codex. It’s a great conversation that covers a lot of ground, including:

  • the long history and many iterations of Codex,
  • the merging of Codex into a new version of ChatGPT based on web technologies,
  • Computer Use and Computer History, which came along with OpenAI’s acquisition of Sky last year, and
  • what goes into designing for user trust.

Then for AppStories+ subscribers, we dug into Andrew’s Mac origin story and some of his favorite Mac apps.

AppStories is available on Apple Podcasts and all your favorite podcast players, as well as YouTube. AppStories+ is a special ad-free, extended version of AppStories that’s delivered a day early in high-bitrate audio for $5/month or $50/year by itself or as part of a Club MacStories Premier membership that adds our weekly and monthly newsletters, app discounts, and other perks for $12/month or $120/year.

Permalink