This week's sponsor

Remote for Mac

Turn iPhone or iPad into remote control for your Mac

New Apple Patents: Multitouch Display On Mouse, Heart Monitor for Music

A new day, new Apple patents surface on the Internet. Unlike most days when we get to know the latest inventions the teams at Cupertino have been awarded, today's design embodiments and ideas are fairly interesting and not so much projected in the future like a touch-based iMac could be. As reported by Patently Apple, a new patent shows two new possible touch input systems that might soon replace our usual mice and physical keyboards.

The patent applications reveal a mouse equipped with a multitouch display capable of visualizing information and virtual keys such as a numeric pad on the device's surface. The mouse would still come with standard features like soft left / right buttons, but in the middle there would be place for a display carrying an additional interface for users.

Although a wide variety of applications are possible, as just a few examples, the displayed image data might include one or more of text, input locations such as virtual buttons, still or video images, and colored light that is either static or changing. As an example, soft-key information, such as text labels, could be displayed, for example, adjacent to left and right touch sensitive regions 116 and 118 to provide labels indicating functionality available by selection through such regions.

The report goes really in depth illustrating how a display-enabled mouse would be capable of providing a second layer of touch interaction between a user's hand and the computer. Another touch-related patent application, also uncovered by Patently Apple, details a virtual keyboard for the iMac with haptic feedback for each key:

Haptic feedback methods and apparatus are disclosed that use a plurality of individually actuable actuators coupled to an input surface to induce vibrations into the surface, both to provide feedback vibratory response to a user, and also to assist in localizing that feedback vibratory response to the user input location. In response to a user selection at an input location, the system will generate a first feedback signal configured to provide a desired vibratory response to a user. The system will also induce vibrations at one or more other locations to suppress vibratory crosstalk resulting from at least the initial feedback signal.

Put simply, Apple is playing around with the idea of a virtual keyboard users could install on any machine, with the possibility of re-arranging any key on the virtual keyboard and configure any kind of language profile. Each virtual key would also come with a dedicated haptic motor to give feedback on pressing and releasing.

The third report details an evolution for the iTunes DJ and visualizer functionalities that will allow iPods and iPhones to change their behavior according to different environments and user's physical conditions. Such a feature requires a heart rate, breath or blood sensor to be installed on a mobile device. Ok, this one sounds a bit like the future to us, too.

This is directed to systems and methods for controlling an audio and visual experience based on an environment. A system could monitor an environment while playing back music. The system could then identify a characteristic property of the environment and modify an audio-related or visual-related operation based on the characteristic property. The characteristic property could be any suitable property of the environment or any combination thereof. For example, the characteristic property could be related to an ambient property of the environment (e.g., light or sounds) or the environment's occupants (e.g., number of people nearby or characteristics of people nearby).

After identifying the characteristic property, the system could modify an audio-related or visual-related operation in any suitable manner based on the characteristic property. For example, the system could modify a visual-related operation by providing a visualization of the music based on at least the characteristic property.

iPhones with cardiac sensors built-in appeared in Apple patents before.

Unlock MacStories Extras

Club MacStories offers exclusive access to extra MacStories content, delivered every week; it's also a way to support us directly.

Club MacStories will help you discover the best apps for your devices and get the most out of your iPhone, iPad, and Mac. Plus, it's made in Italy.

Starting at $5/month, with an annual option available. Join the Club.

A Club MacStories membership includes:

  • MacStories Weekly newsletter, delivered every week on Friday with app collections, tips, iOS workflows, and more;
  • Monthly Log newsletter, delivered once every month with behind-the-scenes stories, app notes, personal journals, and more;
  • Access to occasional giveaways, discounts, and free downloads.