This Week's Sponsor:

Listen Later

Listen to Articles as Podcasts

New Apple Patents: Multitouch Display On Mouse, Heart Monitor for Music

A new day, new Apple patents surface on the Internet. Unlike most days when we get to know the latest inventions the teams at Cupertino have been awarded, today’s design embodiments and ideas are fairly interesting and not so much projected in the future like a touch-based iMac could be. As reported by Patently Apple, a new patent shows two new possible touch input systems that might soon replace our usual mice and physical keyboards.

The patent applications reveal a mouse equipped with a multitouch display capable of visualizing information and virtual keys such as a numeric pad on the device’s surface. The mouse would still come with standard features like soft left / right buttons, but in the middle there would be place for a display carrying an additional interface for users.

Although a wide variety of applications are possible, as just a few examples, the displayed image data might include one or more of text, input locations such as virtual buttons, still or video images, and colored light that is either static or changing. As an example, soft-key information, such as text labels, could be displayed, for example, adjacent to left and right touch sensitive regions 116 and 118 to provide labels indicating functionality available by selection through such regions.

The report goes really in depth illustrating how a display-enabled mouse would be capable of providing a second layer of touch interaction between a user’s hand and the computer. Another touch-related patent application, also uncovered by Patently Apple, details a virtual keyboard for the iMac with haptic feedback for each key:

Haptic feedback methods and apparatus are disclosed that use a plurality of individually actuable actuators coupled to an input surface to induce vibrations into the surface, both to provide feedback vibratory response to a user, and also to assist in localizing that feedback vibratory response to the user input location. In response to a user selection at an input location, the system will generate a first feedback signal configured to provide a desired vibratory response to a user. The system will also induce vibrations at one or more other locations to suppress vibratory crosstalk resulting from at least the initial feedback signal.

Put simply, Apple is playing around with the idea of a virtual keyboard users could install on any machine, with the possibility of re-arranging any key on the virtual keyboard and configure any kind of language profile. Each virtual key would also come with a dedicated haptic motor to give feedback on pressing and releasing.

The third report details an evolution for the iTunes DJ and visualizer functionalities that will allow iPods and iPhones to change their behavior according to different environments and user’s physical conditions. Such a feature requires a heart rate, breath or blood sensor to be installed on a mobile device. Ok, this one sounds a bit like the future to us, too.

This is directed to systems and methods for controlling an audio and visual experience based on an environment. A system could monitor an environment while playing back music. The system could then identify a characteristic property of the environment and modify an audio-related or visual-related operation based on the characteristic property. The characteristic property could be any suitable property of the environment or any combination thereof. For example, the characteristic property could be related to an ambient property of the environment (e.g., light or sounds) or the environment’s occupants (e.g., number of people nearby or characteristics of people nearby).

After identifying the characteristic property, the system could modify an audio-related or visual-related operation in any suitable manner based on the characteristic property. For example, the system could modify a visual-related operation by providing a visualization of the music based on at least the characteristic property.

iPhones with cardiac sensors built-in appeared in Apple patents before.

Unlock More with Club MacStories

Founded in 2015, Club MacStories has delivered exclusive content every week for over six years.

In that time, members have enjoyed nearly 400 weekly and monthly newsletters packed with more of your favorite MacStories writing as well as Club-only podcasts, eBooks, discounts on apps, icons, and services. Join today, and you’ll get everything new that we publish every week, plus access to our entire archive of back issues and downloadable perks.

The Club expanded in 2021 with Club MacStories+ and Club Premier. Club MacStories+ members enjoy even more exclusive stories, a vibrant Discord community, a rotating roster of app discounts, and more. And, with Club Premier, you get everything we offer at every Club level plus an extended, ad-free version of our podcast AppStories that is delivered early each week in high-bitrate audio.

Choose the Club plan that’s right for you:

  • Club MacStories: Weekly and monthly newsletters via email and the web that are brimming with app collections, tips, automation workflows, longform writing, a Club-only podcast, periodic giveaways, and more;
  • Club MacStories+: Everything that Club MacStories offers, plus exclusive content like Federico’s Automation Academy and John’s Macintosh Desktop Experience, a powerful web app for searching and exploring over 6 years of content and creating custom RSS feeds of Club content, an active Discord community, and a rotating collection of discounts, and more;
  • Club Premier: Everything in from our other plans and AppStories+, an extended version of our flagship podcast that’s delivered early, ad-free, and in high-bitrate audio.