If you're at all like me, then now is the time of year you receive the most packages. In the midst of the holiday season, the usual assortment of deliveries my wife and I have coming for ourselves are joined by all the gifts we've purchased for others. It couldn't be better timing, then, that my package tracker of choice, Deliveries, has added Siri shortcut support today.
Posts tagged with "shortcuts"
Google released an exciting update for its Assistant iOS app today, bringing support for Siri shortcuts and, for the first time, opening lines of communication between the two competing assistants.
Siri and the Google Assistant have historically been unable to work together in any way, but thanks to the opening up of Siri via shortcuts in iOS 12, that changes now. With the latest update, you can set up a shortcut in iOS to immediately, via Siri, trigger any command you'd like to give Google's Assistant.
Update: Thanks to MacStories reader Thomas, I was able to remove the need to upload image assets to Dropbox. The shortcut is now much faster to run (takes about 5 seconds instead of 20) and doesn't need to save any file in your Dropbox account. You can get the updated shortcut at the end of this post.
I've always been intrigued by Workflow's implementation of 'Add to Home Screen' – a feature that Apple kept in the transition to the Shortcuts app, and which allows users to create home screen icons to launch their favorite shortcuts. So earlier this month, I decided I wanted to learn how Shortcuts was handling the creation of home screen icons.
After a few weeks of experiments and refinements, I ended up reverse-engineering Shortcuts' 'Add to Home Screen' implementation, which turns out to be an evolution of Workflow's existing hack based on Safari and web clips. The result is Home Screen Icon Creator, an advanced shortcut that lets you create custom home screen icons to launch apps, custom shortcuts from the Shortcuts app, or specific actions for any of your contacts; the shortcut can also generate icons with solid colors, which you can combine with matching wallpapers to create custom home screen layouts.
This shortcut is, by far, the most complex piece of iOS automation I've ever put together for MacStories, and I'm happy with the final product. It fully replicates a native Shortcuts feature while giving you the freedom to create icons and launchers for anything you want. There is no configuration necessary on the user's end: it'll take you 20 seconds to create your first custom icon, complete with onscreen instructions. Allow me, however, to offer more context on how this shortcut came to be, how it works behind the scenes, and what you can build with it.
In a release that largely focuses on performance improvements and digital well-being tools to curb notification overload and smartphone addiction, Apple's Siri shortcuts initiative in iOS 12 stands out as one of the most exciting developments in modern iOS history. Perhaps even more impressive than developers' adoption of Siri shortcuts though has been the response to Apple's Shortcuts app, which enables the creation of custom shortcuts that can integrate with apps, system features, and even Siri.
In addition to a thriving community that continues to prove how combining users' imagination with automation can elevate iOS productivity, Apple itself has so far shown a remarkable commitment to the Shortcuts app by listening to the community and ensuring a smooth transition from Workflow. Traditionally, Apple's App Store apps receive major updates then linger for months before the next big set of changes; with Shortcuts, Apple has kept the TestFlight beta channel active, pushing for the same development pace that characterized Workflow before its acquisition.
The result is Shortcuts 2.1, released today on the App Store with a variety of bug fixes, iCloud improvements, and, more importantly, new actions that integrate the app even more deeply with iOS 12. If you're not familiar with the Shortcuts app, I recommending reading the dedicated section from my iOS 12 review first; if you're an existing Shortcuts user and rely on the app for key aspects of your iOS workflow, let's dig in and take a look at what's new.
Since it was announced at WWDC over the summer, the lion’s share of conversation around shortcuts has been about getting things done quickly and efficiently. Apple’s marketing message focuses on how shortcuts in iOS 12 help “streamline the things you do often” using Siri and/or the Shortcuts app. The company also recently put out a press release highlighting top App Store apps that have integrated shortcuts to extend their functionality, touting them for “making [users'] favorite apps even easier to use with a simple tap or by asking Siri.”
While the convenience factor of shortcuts is appreciated, an important aspect to their utility is accessibility. It’s a crucial aspect of the story around shortcuts, because while everyone loves a time-saver or two, these workflows also have the potential to make iPhone and iPad more accessible. In an accessibility context, shortcuts can be lifesavers in terms of reducing cognitive load, excessive swiping and tapping, and other common points of friction often met by disabled users.
Shortcuts, Past and Present
Before considering shortcuts as an accessibility tool, it’s important to understand their roots in order to properly frame them into perspective. The idea that shortcuts, or workflows, can prove valuable as an assistive technology isn’t a novel one.
Workflow, on which the Shortcuts app is based, was acquired by Apple in early 2017. Two years earlier, however, Apple selected Workflow as an Apple Design Award winner primarily for its integration of iOS accessibility features. Ari Weinstein, who joined Apple to work on Shortcuts post-acquisition, told me in an interview at WWDC 2015 that he and his team received feedback from several blind and visually impaired users who were curious about Workflow and wanted to try it. As a result, the team felt adding VoiceOver support was “the right thing to do,” Weinstein said.
To paraphrase Kendrick Lamar, Shortcuts got accessibility in its DNA.
Given the history lesson, it’s not at all far-fetched to think the Shortcuts app would have appeal to disabled users. Like Overcast and Twitterrific, Shortcuts is an app built for the mainstream, yet it has the care and design sensibility to carry relevance for a variety of use cases, like being fully accessible to a blind user via VoiceOver. This isn’t small potatoes; given Apple’s commitment to the disabled community, it’s certainly plausible Workflow’s ode to accessibility made the app all the more desirable.
More Than Just Productivity
As I reported during WWDC, Apple’s focus this year, software-wise, marked a departure from how they’ve traditionally approached accessibility enhancements. Unlike past years, there were no new discrete accessibility features for any platform. (AirPods with Live Listen is close). Instead, Apple chose to hammer on the idea that the tentpole features (e.g. Group FaceTime in iOS 12, Walkie-Talkie in watchOS 5) can be enabling technologies. The overarching theme of the conference was that the new features were so well designed that they brought inherent accessibility gains.
Siri shortcuts is another of those features. In my briefings with Apple at WWDC and since, shortcuts has been one of the first items they wanted to discuss. Like Group FaceTime and others, the company firmly believes in shortcuts' potential as an accessibility aid. Their enthusiasm is warranted: for many users with certain cognitive and/or physical motor delays, the consolidation of tasks can reduce friction associated with remembering how to perform a task and then doing it. In this way, shortcuts are the inverse of task analyses; rather than extrapolating tasks into their individual parts (e.g. tapping a series of buttons in an app), the Shortcuts app's automation turns them into a single step. (You break down steps when creating your own workflows, but that’s beside the point being made here.) Lest we forget about Siri; being able to use your voice to activate shortcuts is a boon for people with motor delays, as the “hands free” experience can be empowering.
For disabled people, shortcuts’ focus on speed and accessibility can open up new possibilities in terms of what they can do with their iOS devices and how they do things. Throw in system accessibility features like VoiceOver and Dynamic Type, and the Shortcuts app becomes far more compelling than simply being a sheer productivity tool.
”We see huge accessibility potential with Siri Shortcuts and the Shortcuts app. It’s already making a difference — helping people across a wide range of assistive needs simplify every-day tasks like getting to work, coming home, or staying in touch with friends and family,” Sarah Herrlinger, Apple’s Senior Director of Global Accessibility Policy & Initiatives, said in a statement. “We’re getting great feedback about how powerful the technology is in streamlining frequent tasks and integrating multiple app functions with just a single voice command or tap.”
How I Use Shortcuts
I am far less prolific in my adoption of shortcuts than some people. Others, like Federico and Matthew Cassinelli, are far more well-versed in the intricacies of what is possible and, more importantly, how you chain certain commands together.
My needs for shortcuts are pretty spartan. The shortcuts I use most often are practical, everyday ones I found in the Gallery section of the app. I currently have thirteen shortcuts; of those, the ones that are the most heavily-used are the laundry timer, tip calculator, and one for texting my girlfriend. While I have enjoyed spelunking through Federico’s work for esoteric, power user shortcuts, the reality is my work doesn’t require much automation. I typically don’t need to do fancy things with images, text, and the like. That isn’t to say these tools aren’t cool or valuable; they’re just not necessarily for me. For my needs, quick access to, say, the laundry timer is worth its weight in gold because I always forget to move my clothes.
Consider another shortcut of mine, Play an Album. I’ve been listening to Eminem’s new album, Kamikaze, virtually non-stop since it came out at the end of August. Rather than manually launch the Music app, find the album in my recently played queue, and hit play, I can utilize the Shortcuts widget to play it with a single tap. The manual method is three steps which, while not tedious for me in any way, is more work. Going back to the task analysis analogy I used earlier, not only is Play an Album faster, it particularly helps me conserve precious visual energy I otherwise would have expended finding the album. For fine-motor skills, the shortcut also saves on potential cramping in my fingers caused by my cerebral palsy. Again, what can take multiple taps can be condensed into a single motion. For many, that’s a huge win.
The same concept applies to sending iMessages to my girlfriend. Using the shortcut, what would normally be a multi-step process is reduced to a single step. The advantage for me is a matter of kinetics, but for others, the advantage very well could reduce cognitive load and increase executive function. Not insignificant.
The Bottom Line
As is the case with stuff like Markdown and Apple Pay, technologies not built expressly for accessibility’s sake, the Shortcuts app is so well considered and approachable that anyone can use it, regardless of ability. There are no complicated settings or special modes; as Apple designed it, it just works as they intended it.
That’s what makes Shortcuts’ star shine brighter. Yes, Apple is pitching it for speed and convenience. Yes, shortcuts can be as pedestrian or as nerdy as you want them to be. Above all, however, the Shortcuts app is accessible. It's an app that's reachable to the widest possible audience, turning its utilitarianism into something far greater.
Evgeny Cherpak’s iOS app, Remote Control for Mac, has been updated with Siri shortcut support, which opens up some interesting ways to control a Mac with shortcuts. I’ve been using the app’s new Siri shortcuts for about a week and, as I covered on AppStories today, the shortcuts I’ve created that incorporate Remote’s functionality are already ones that I use every day.
I've spent the past two weeks updating my iPhone's home screen setup for the XS Max and, as I shared in the latest episode of AppStories, part of the process involved gaining easier access to some of the shortcuts I use on a regular basis. While I'm not a fan of the shortcuts-only home screen approach described by CGP Grey in episode 75 of the Cortex podcast (at some point, I believe you just end up swapping app folders for shortcuts), I do like the idea of adding a couple of frequently used custom shortcuts to the home screen. And as I detailed on AppStories, I also like to use "shortcut launchers" – effectively, shortcuts to launch other shortcuts.
When I published my iPhone XS Frames shortcut two weeks ago, I noted that my goal was to eventually support screenshots and device templates from other Apple devices, starting with the Apple Watch and MacBook Pro. After two weeks spent rebuilding the shortcut and asking Silvia to prepare several more templates, I'm happy to re-introduce my shortcut as the new and improved Apple Frames – a comprehensive custom shortcut to frame screenshots taken on every Apple device. Well, at least most of the current ones that the company is still selling.
Fantastical was updated last week to version 2.10, which brought support for some of the key features of iOS 12 and watchOS 5 – namely Siri shortcuts and complications for the Infograph watch faces. I want to highlight some of the changes in this release and how they fit my usage of Reminders as my main task management system.