Siri Struggles with Commands Handled by the Original 2010 App→

Nick Heer at Pixel Envy tested how well 2018 Siri performs commands given to the voice assistant in a 2010 demo video. The video takes Siri, which started as a stand-alone, third-party app, through a series of requests like ‘I’d like a romantic place for Italian food near my office.’ Just a couple of months after the video was published, Siri was acquired by Apple and the team behind it, including the video’s narrator, Tom Gruber, began integrating Siri into iOS.

That was eight years ago. Inspired by a tweet, Heer tested how well Siri performs when given the same commands today. As Heer acknowledges, the results will vary depending on your location, and the test is by no means comprehensive, but Siri’s performance is an eye-opener nonetheless.

What’s clear to me is that the Siri of eight years ago was, in some circumstances, more capable than the Siri of today. That could simply be because the demo video was created in Silicon Valley, and things tend to perform better there than almost anywhere else. But it’s been eight years since that was created, and over seven since Siri was integrated into the iPhone. One would think that it should be at least as capable as it was when Apple bought it.

Eight years is an eternity in the tech world. Siri has been fairly criticized recently for gaps in the domains it supports and their balkanization across different platforms, but Heer’s tests are a reminder that Siri still has plenty of room for improvement in how it handles existing domains too. Of course, Siri can do things in 2018 that it couldn’t in 2010, but it still struggles with requests that require an understanding of contexts like location or the user’s last command.

Voice controlled assistants have become a highly competitive space. Apple was one of the first to recognize their potential with its purchase of Siri, but the company has allowed competitors like Amazon and Google catch up and pass it in many respects. The issues with Siri aren’t new, but that’s the heart of the problem. Given the current competitive landscape, 2018 feels like a crucial year for Apple to sort out Siri’s long-standing limitations.

Permalink

A More Friendly and Motivational Health App→

I love this concept by 9to5Mac’s Michael Steeber, who imagined how Apple’s Health app could become a friendly, useful motivational tool instead of being just a pretty collection of charts and data points:

The majority of people using iPhones and Apple Watches to track their health have the simple wish to reach their goals and monitor their wellness. While today’s Health app is rich with data points and charts, it takes valuable time to dive in and parse the information. Even more challenging is drawing accurate and informed conclusions from the data without a medical background.

The Health app of the future could be a dashboard for your body, filled with daily insights into your wellness. Helpful tips for living a better life could be drawn from the treasure trove of data synced from your Apple Watch and connected apps, tailored to your specific health history and needs. Rather than just a data aggregator, Health could become a proactive and motivational tool.

Not only is Michael exactly right about the features missing from the Health app – his mockups are beautiful, and I could see the card-style UI fitting nicely within Health.

As I was reading Michael’s article, I was reminded of something I wrote three years ago in my iPhone health story, after I spent months tracking everything about myself:

What I’m missing, however, is advanced and intelligent connections between the pieces of data I’m tracking about myself. I’ve spent months logging all I could about my body and daily activity using my iPhone. I’d love to see a smart AI capable of understanding actual patterns about my lifestyle and that could give me more detailed insights about my habits. What happened in the week I ate more vegetables than meat – did I lose weight and sleep better? What are the locations where I tend to walk more and when during the week? I can see how steps taken correlate with sleep quality, but how about something more practical such as, for instance, caffeine and food plotted against sleep?

This was published in March 2015, before I got an Apple Watch. Three years later, the Health app is still largely the same. I think it’s time for Apple to consider how data tracked in the Health app could be used in meaningful, practical ways going forward. I hope something similar to Micheal’s ideas is in the works.

Permalink

Connected, Episode 183: PodStorm→

Stephen’s family staged a HomePod intervention, Myke names his favorite Apple Watch apps, Apple kills off iTunes LP and Federico has some news.

We discussed a variety of fun and interesting topics on Connected this week, but MacStories readers shouldn’t miss the final part of the show. You can listen here.

Sponsored by:

  • Hover: Show the world what you’re passionate about with 10% off your first purchase
  • Away: Travel smarter with the suitcase that charges your phone. Get $20 off with the code ‘connected’.
  • Casper: The Internet’s favourite mattress. Get $50 off select mattresses with the code ‘CONNECTED’.
Permalink

HomePass Can Store All Your HomeKit Setup Codes

Developed by Aaron Pearce (the creator of Homecam, one of my favorite iOS apps this year), HomePass is a handy utility for iPhone and iPad to store HomeKit setup codes.

If you’ve been playing around with home automation on iOS, you know that managing accessory pairing codes isn’t exactly fun or convenient. While iOS 11 added support for QR codes and special NFC pairing tags, most accessory makers still stick basic alphanumeric codes on the back or at the bottom of accessories and essentially require you not to lose them. That’s not ideal. HomePass aims to be a single repository where you can easily keep track of all your setup codes, sync them across devices with iCloud, and even protect them with Face ID. Instead of taking pictures of your codes and storing them in Apple Notes (which is what I’ve been doing), you can collect every HomeKit code in HomePass, where they’ll be presented alongside device names, HomeKit rooms they belong to, and custom icons.

I’ve been testing HomePass for the past couple of weeks, and there are some nice touches I want to point out. First, if you grant the app access to your HomeKit data, it’ll be able to see existing accessories and allow you to simply enter the code without choosing a device name or icon (you can also create new accessories from scratch). In addition, the code displayed in the Code field of a device’s detail view is formatted with the same shape and font used on physical setup codes; this means you can open HomePass on your iPad and scan a code directly with the Home app on your iPhone. Lastly, you can add notes to your accessories and export everything as CSV if you prefer to have an additional backup of your accessory database.

One of the many shortcomings of Apple’s native Home app is the lack of deeper organizational tools for users who own dozens of HomeKit accessories and need a better way to store their codes. Ideally, such a feature shouldn’t be needed, but in my experience things sometimes go wrong and you may need to reset an accessory and add it to HomeKit again. When that happens, you don’t want to go hunting for the setup code on the back of a thermostat. I highly recommend using HomePass instead, which is available at $2.99 on the App Store.

Apple Leads First-Ever Swift Playgrounds Course for Blind and Low-Vision Students in Austin→

Earlier this week, Apple engineers visited the Texas School for the Blind and Visually Impaired where they led a programming course from the company’s Everyone Can Code curriculum. According to the Austin Statesman’s technology blog, Open Source, the class was the first such session led by Apple for blind and low-vision students.

With the assistance of VoiceOver, the students completed assignments in Apple’s Swift Playgrounds iPad app. The students also got a chance to go outside and fly Parrot drones using Swift Playgrounds. Viki Davidson, a technology teacher at the school, told Open Source:

“We see this as a way to get them interested in coding and realize this could open job opportunities,” said Vicki Davidson, a technology teacher at the Texas School for the Blind and Visually Impaired. “Apple has opened up a whole new world for kids by giving them instant access to information and research, and now coding.” 

Apple’s director of accessibility, Sarah Herrlinger, who will participate in a session on Innovations in Accessibility at South By Southwest on March 15th, said:

“When we said everyone should be able to code, we really meant everyone,” said Sarah Herrlinger, Apple’s director of accessibility. “Hopefully these kids will leave this session and continue coding for a long time. Maybe it can inspire where their careers can go.”

Swift Playgrounds and Apple’s Everyone Can Code curriculum have grown at a remarkable rate and are fantastic resources for students, teachers, and parents. However, it’s Apple’s long-standing commitment to accessibility across all of its products that helps ensure that those resources are available to as many students as possible.

Permalink

Workflow 1.7.8 Adds ‘Mask Image’ Action, Things Automation Support, PDF Text Extraction, and More

In the first update since November 2017, Apple today released version 1.7.8 of Workflow, the powerful iOS automation app they acquired last year. The latest version, which is now available on the App Store, introduces a brand new Mask Image action, adds support for Things’ automation features, and improves the ability to extract text from PDFs using the company’s PDFKit framework, launched in iOS 11. While the unassuming version number may suggest a relatively minor update, Workflow 1.7.8 actually comes with a variety of noteworthy changes for heavy users of the app.

Read more

Apple Confirms It Will No Longer Accept New iTunes LP Content After March 2018

In 2009, Apple introduced iTunes LP content as an enticement for music fans to purchase full albums. The format bundled an album with additional material like bonus tracks, liner notes, videos, and other extras. Earlier today, the UK-based website Metro reported that it had seen an email message from Apple to music industry professionals announcing that it will not accept iTunes LP content after March 2018, which Apple subsequently confirmed to The Verge.

The format, built from a bundle of JavaScript controller files, CSS, HTML, XML, an iTunesMetadata.plist file, images, and videos, never took off.1 Contrary to Metro’s initial report that Apple is deprecating iTunes LPs entirely though, Apple told The Verge that:

While iTunes LP submissions will end this month, existing iTunes LPs will not be depreciated. Not only will these iTunes LPs continue to be available, but users will still be able to download any previous or new purchases of iTunes LPs at any time via iTunes.

The decision to no longer offer new iTunes LP content is not surprising in light of the decline of music sales industry-wide and the rise of streaming services like Apple Music.

  1. If you’re curious which albums are available as iTunes LPs, there’s a list on Wikipedia. ↩︎

AppStories, Episode 45 – An Interview with Harry Nesbitt and Ryan Cash About Alto’s Odyssey→

On this week’s episode of AppStories, we interview two members of Team Alto, Harry Nesbitt and Ryan Cash, about Alto’s Adventure, the challenges they faced in following it up with Alto’s Odyssey, the creative process of making games, and the mobile game industry.

Sponsored by:

  • Ulysses – The ultimate writing app for Mac, iPad, and iPhone.
Permalink