This Week's Sponsor:

Albums

Algorithm-Free Listening for Music Lovers


Posts tagged with "accessibility"

Why Shortcuts Matter for Accessibility

Since it was announced at WWDC over the summer, the lion’s share of conversation around shortcuts has been about getting things done quickly and efficiently. Apple’s marketing message focuses on how shortcuts in iOS 12 help “streamline the things you do often” using Siri and/or the Shortcuts app. The company also recently put out a press release highlighting top App Store apps that have integrated shortcuts to extend their functionality, touting them for “making [users’] favorite apps even easier to use with a simple tap or by asking Siri.”

While the convenience factor of shortcuts is appreciated, an important aspect to their utility is accessibility. It’s a crucial aspect of the story around shortcuts, because while everyone loves a time-saver or two, these workflows also have the potential to make iPhone and iPad more accessible. In an accessibility context, shortcuts can be lifesavers in terms of reducing cognitive load, excessive swiping and tapping, and other common points of friction often met by disabled users.

Shortcuts, Past and Present

Before considering shortcuts as an accessibility tool, it’s important to understand their roots in order to properly frame them into perspective. The idea that shortcuts, or workflows, can prove valuable as an assistive technology isn’t a novel one.

Workflow, on which the Shortcuts app is based, was acquired by Apple in early 2017. Two years earlier, however, Apple selected Workflow as an Apple Design Award winner primarily for its integration of iOS accessibility features. Ari Weinstein, who joined Apple to work on Shortcuts post-acquisition, told me in an interview at WWDC 2015 that he and his team received feedback from several blind and visually impaired users who were curious about Workflow and wanted to try it. As a result, the team felt adding VoiceOver support was “the right thing to do,” Weinstein said.

To paraphrase Kendrick Lamar, Shortcuts got accessibility in its DNA.

Given the history lesson, it’s not at all far-fetched to think the Shortcuts app would have appeal to disabled users. Like Overcast and Twitterrific, Shortcuts is an app built for the mainstream, yet it has the care and design sensibility to carry relevance for a variety of use cases, like being fully accessible to a blind user via VoiceOver. This isn’t small potatoes; given Apple’s commitment to the disabled community, it’s certainly plausible Workflow’s ode to accessibility made the app all the more desirable.

More Than Just Productivity

As I reported during WWDC, Apple’s focus this year, software-wise, marked a departure from how they’ve traditionally approached accessibility enhancements. Unlike past years, there were no new discrete accessibility features for any platform. (AirPods with Live Listen is close). Instead, Apple chose to hammer on the idea that the tentpole features (e.g. Group FaceTime in iOS 12, Walkie-Talkie in watchOS 5) can be enabling technologies. The overarching theme of the conference was that the new features were so well designed that they brought inherent accessibility gains.

Siri shortcuts is another of those features. In my briefings with Apple at WWDC and since, shortcuts has been one of the first items they wanted to discuss. Like Group FaceTime and others, the company firmly believes in shortcuts’ potential as an accessibility aid. Their enthusiasm is warranted: for many users with certain cognitive and/or physical motor delays, the consolidation of tasks can reduce friction associated with remembering how to perform a task and then doing it. In this way, shortcuts are the inverse of task analyses; rather than extrapolating tasks into their individual parts (e.g. tapping a series of buttons in an app), the Shortcuts app’s automation turns them into a single step. (You break down steps when creating your own workflows, but that’s beside the point being made here.) Lest we forget about Siri; being able to use your voice to activate shortcuts is a boon for people with motor delays, as the “hands free” experience can be empowering.

For disabled people, shortcuts’ focus on speed and accessibility can open up new possibilities in terms of what they can do with their iOS devices and how they do things. Throw in system accessibility features like VoiceOver and Dynamic Type, and the Shortcuts app becomes far more compelling than simply being a sheer productivity tool.

”We see huge accessibility potential with Siri Shortcuts and the Shortcuts app. It’s already making a difference — helping people across a wide range of assistive needs simplify every-day tasks like getting to work, coming home, or staying in touch with friends and family,” Sarah Herrlinger, Apple’s Senior Director of Global Accessibility Policy & Initiatives, said in a statement. “We’re getting great feedback about how powerful the technology is in streamlining frequent tasks and integrating multiple app functions with just a single voice command or tap.”

How I Use Shortcuts

I am far less prolific in my adoption of shortcuts than some people. Others, like Federico and Matthew Cassinelli, are far more well-versed in the intricacies of what is possible and, more importantly, how you chain certain commands together.

My needs for shortcuts are pretty spartan. The shortcuts I use most often are practical, everyday ones I found in the Gallery section of the app. I currently have thirteen shortcuts; of those, the ones that are the most heavily-used are the laundry timer, tip calculator, and one for texting my girlfriend. While I have enjoyed spelunking through Federico’s work for esoteric, power user shortcuts, the reality is my work doesn’t require much automation. I typically don’t need to do fancy things with images, text, and the like. That isn’t to say these tools aren’t cool or valuable; they’re just not necessarily for me. For my needs, quick access to, say, the laundry timer is worth its weight in gold because I always forget to move my clothes.

Consider another shortcut of mine, Play an Album. I’ve been listening to Eminem’s new album, Kamikaze, virtually non-stop since it came out at the end of August. Rather than manually launch the Music app, find the album in my recently played queue, and hit play, I can utilize the Shortcuts widget to play it with a single tap. The manual method is three steps which, while not tedious for me in any way, is more work. Going back to the task analysis analogy I used earlier, not only is Play an Album faster, it particularly helps me conserve precious visual energy I otherwise would have expended finding the album. For fine-motor skills, the shortcut also saves on potential cramping in my fingers caused by my cerebral palsy. Again, what can take multiple taps can be condensed into a single motion. For many, that’s a huge win.

The same concept applies to sending iMessages to my girlfriend. Using the shortcut, what would normally be a multi-step process is reduced to a single step. The advantage for me is a matter of kinetics, but for others, the advantage very well could reduce cognitive load and increase executive function. Not insignificant.

The Bottom Line

As is the case with stuff like Markdown and Apple Pay, technologies not built expressly for accessibility’s sake, the Shortcuts app is so well considered and approachable that anyone can use it, regardless of ability. There are no complicated settings or special modes; as Apple designed it, it just works as they intended it.

That’s what makes Shortcuts’ star shine brighter. Yes, Apple is pitching it for speed and convenience. Yes, shortcuts can be as pedestrian or as nerdy as you want them to be. Above all, however, the Shortcuts app is accessible. It’s an app that’s reachable to the widest possible audience, turning its utilitarianism into something far greater.


Consistent Accessibility: How Apple Can Make iOS and the Mac More Accessible

Like all Apple products, macOS is an accessible platform. Blind and low vision users can navigate their Mac using VoiceOver, while someone who has physical motor delays can use Switch Control to edit videos in Final Cut. And under the Accessibility pane in System Preferences, there is a multitude of other features one can use, ranging from Zoom to Invert Colors to closed-captioning and more. Whatever your need, the breadth and depth of Apple’s accessibility software spans many domains. This is why Apple is lauded as the industry leader in accessibility: the tools run deep and they’re well-designed.

Still, accessibility on macOS doesn’t quite reach feature parity with iOS. Amidst rumors that Apple is working on a cross-platform set of APIs to bridge the company’s two primary operating systems, now is an opportune time to consider what each platform does and what they offer one another.

In the context of accessibility, the way Apple brings consistency between iOS and macOS is by sharing features and technologies among the two. As such, there are some iOS-first features macOS sorely needs, while the Mac offers things iOS would benefit from as well. Such enhancements would not only improve the user experience across devices, but also would make iOS and Mac software richer, fuller products overall. And most importantly, more accessible.

Read more


Apple Updates Its Website for Global Accessibility Awareness Day

Apple has updated its homepage and accessibility webpage to celebrate Global Accessibility Awareness Day. The event, which Apple has marked in a variety of ways over the years, was created to promote access to technology and foster inclusion for people with disabilities.

Apple’s homepage includes a banner image highlighting the accessibility features of its products with the statement ‘Technology is most powerful when it empowers everyone.’ The Accessibility section elaborates on that idea with a video first published in 2016 and the following:

Taking a family portrait. Catching up over FaceTime. Raising the blinds to let in the morning light. We want everyone to enjoy the everyday moments that technology helps make possible, so we work to make every Apple product accessible from the very start. Because the true value of a device isn’t measured by how powerful it is, but by how much it empowers you.

The remainder of the Accessibility page is organized into sections dedicated to vision, hearing, physical and motor skills, and learning and literacy that outline accessibility features of Apple’s products and demonstrates them with animations and videos.

The updates to Apple’s website and its announcement that it is working with schools for blind and deaf students to help teach them to code is a reminder of the importance of accessibility to the company that hopefully encourages third-party developers to make accessibility a priority too.


Apple Announces ‘Everyone Can Code’ Partnership with Schools for Blind and Deaf Students

In March, Apple lead a Swift Playgrounds course at the Texas School for the Blind and Visually Impaired. Today, which is Global Accessibility Awareness Day, Apple announced that is partnering with schools in California, Texas, New York, Florida, Illinois, and Massachusetts:

Beginning this fall, schools supporting students with vision, hearing or other assistive needs will start teaching the Everyone Can Code curricula for Swift, Apple’s powerful and intuitive programming language.

Tim Cook, Apple’s CEO, said:

“Apple’s mission is to make products as accessible as possible,” said Tim Cook, Apple’s CEO. “We created Everyone Can Code because we believe all students deserve an opportunity to learn the language of technology. We hope to bring Everyone Can Code to even more schools around the world serving students with disabilities.”

In addition to existing iOS accessibility features, Apple is augmenting the Everyone Can Code curricula with tools and resources targeted at students with visual and hearing impairments.

Permalink

Apple Proposes Accessibility Emoji

Apple has proposed a set of accessibility emoji to the Unicode Consortium. According to Emojipedia:

In the opening line of the proposal, Apple writes:

“Apple is requesting the addition of emoji to better represent individuals with disabilities. Currently, emoji provide a wide range of options, but may not represent the experiences of those with disabilities”

Noting that this is “not meant to be a comprehensive list of all possible depictions of disabilities”, Apple goes on to explain that this is intended as “an initial starting point”.

Apple has worked with the American Council of the Blind, the Cerebral Palsy Foundation, and the National Association of the Deaf to develop the emoji.

Among the emoji included in the set are Guide Dog With Harness, Person With White Cane, Ear With Hearing Aid, Deaf Sign, Person in Mechanized Wheelchair, Person in Manual Wheelchair, Mechanical or Prosthetic Arm and Leg, and Service Dog With Vest and Leash.

The proposed emoji, if adopted, wouldn’t appear until Unicode 12.0 is released sometime in the first half of 2019.

Permalink

Apple Leads First-Ever Swift Playgrounds Course for Blind and Low-Vision Students in Austin

Earlier this week, Apple engineers visited the Texas School for the Blind and Visually Impaired where they led a programming course from the company’s Everyone Can Code curriculum. According to the Austin Statesman’s technology blog, Open Source, the class was the first such session led by Apple for blind and low-vision students.

With the assistance of VoiceOver, the students completed assignments in Apple’s Swift Playgrounds iPad app. The students also got a chance to go outside and fly Parrot drones using Swift Playgrounds. Viki Davidson, a technology teacher at the school, told Open Source:

“We see this as a way to get them interested in coding and realize this could open job opportunities,” said Vicki Davidson, a technology teacher at the Texas School for the Blind and Visually Impaired. “Apple has opened up a whole new world for kids by giving them instant access to information and research, and now coding.” 

Apple’s director of accessibility, Sarah Herrlinger, who will participate in a session on Innovations in Accessibility at South By Southwest on March 15th, said:

“When we said everyone should be able to code, we really meant everyone,” said Sarah Herrlinger, Apple’s director of accessibility. “Hopefully these kids will leave this session and continue coding for a long time. Maybe it can inspire where their careers can go.”

Swift Playgrounds and Apple’s Everyone Can Code curriculum have grown at a remarkable rate and are fantastic resources for students, teachers, and parents. However, it’s Apple’s long-standing commitment to accessibility across all of its products that helps ensure that those resources are available to as many students as possible.

Permalink

Smart Speakers and Speech Impairment

Steven Aquino covers an important accessibility angle of smart speakers that I’ve never truly considered:

Since the HomePod started shipping last week, I’ve taken to Twitter on multiple occasions to (rightfully) rant about the inability of Siri—and its competitors—to parse non-fluent speech. By “non-fluent speech,” I’m mostly referring to stutterers because I am one, but it equally applies to others, such as deaf speakers.

This is a topic I’ve covered before. There has been much talk about Apple’s prospects in the smart speaker market; the consensus seems to be the company lags behind Amazon and Google because Alexa and Google Home are smarter than Siri. What is missing from these discussions and from reviews of these products is the accessibility of a HomePod or Echo or Sonos.

As I see it, this lack of consideration, whether intentional or not, overlooks a crucial part of a speaker product’s story. Smart speakers are a unique product, accessibility-wise, insofar as the voice-first interaction model presents an interesting set of conditions. You can accommodate for blindness and low vision with adjustable font sizes and screen readers. You can accommodate physical motor delays with switches. You can accommodate deafness and hard-of-hearing with closed captioning and using the camera’s flash for alerts.

But how do you accommodate for a speech impairment?

A human assistant would know how to deal with stuttering, dialects, or even just the need to repeat a part of a sentence you got wrong. None of the modern digital assistants currently goes beyond being a slightly humanized command line activated by voice, and I wonder who will get there first.

Permalink

What Face ID Means for Accessibility

Steven Aquino on the accessibility implications of Face ID on the iPhone X:

The way Apple has built Face ID, hardware- and software-wise, into iOS quite literally makes using iPhone a “hands-free” experience in many regards. And that’s without discrete accessibility features like Switch Control or AssistiveTouch. That makes a significant difference to users, myself included, whose physical limitations make even the most mundane tasks (e.g., unlocking one’s device) tricky. As with so many accessibility-related topics, the little things that are taken for granted are always the thin

The combination of Face ID with Raise to Wake (or, arguably, the simplicity of Tap to Wake) truly sounds like a remarkable improvement accessibility-wise, perhaps in a way that we didn’t foresee when we started speculating on Apple abandoning Touch ID. Hands-free unlocking is one of my favorite aspects of the iPhone X experience so far.

Permalink

Steven Levy on Apple Putting Voices in Users’ Heads

Last week we reported on a new cochlear implant that was designed to integrate in special ways with an iPhone. This week, Steven Levy has more details for WIRED on the work that went into bringing this product to fruition.

To solve the huge problem of streaming high-quality audio without quickly draining the tiny zinc batteries in hearing aids, Apple had previously developed a new technology called Bluetooth LEA, or Low Energy Audio. The company released that (but didn’t talk about it) when the first Made for iPhone hearing aids appeared in 2014…“We chose Bluetooth LE technology because that was the lowest power radio we had in our phones,” says Sriram Hariharan, an engineering manager on Apple’s CoreBluetooth team. To make LEA work with cochlear implants he says, “We spent a lot of time tuning our solution it to meet the requirements of the battery technology used in the hearing aids and cochlear implants.” Apple understood that, as with all wireless links, some data packets would be lost in transmission—so the team figured out how to compensate for that, and re-transmit them as needed. “All those things came together to figure out how to actually do this,” says Hariharan.

This story perfectly demonstrates how solving accessibility issues may require a lot of hard work and investment, but in the end it can produce results that are truly life-changing.

Permalink