This Week's Sponsor:

Listen Later

Listen to Articles as Podcasts

iPad 2 Head Tracking + Glasses-free 3D App Now Available

Back in April, you might remember we posted a video showing a software experiment by Jeremie Francone and Laurence Nigay from the Laboratory of Informatics of Grenoble at the EHCI Research Group aimed at bringing glasses-free 3D to the iPad’s screen. The demo, largely based on Johnny Lee’ 2007 work with the Nintendo Wii, used the iPad 2’s front-facing camera to track the movements of a user’s head and simulate various 3D animations on screen without the need of glasses, by simply modifying a 2D environment in order to give the illusion of “looking at a small window.” Francone wrote in April:

I use the front facing camera to detect and track the 3D position of the face of the user in real time. Then I use this data for dynamically adapting the perspective of the 3D scene. This Head-Coupled Perspective system gives the user the illusion that he looks at a small window. Objects can be displayed in front of the screen surface, or behind the screen surface. Such technique has a number of great properties, especially on mobile devices.

The experiment, viewed 1.5 million times on YouTube, has become an app and it’s now available for free in the App Store. It packs all the demoes seen on the video, it also runs on the iPhone 4 and, after a few tests, I can say it works pretty well although maybe it’s not just as fluid as the original video (might have been because of my room’s light conditions though). However, the Head-Coupled Perspective technology for iOS definitely does its job in displaying monocular 3D that does not use the devices’ accelerometers or gyroscopes.

The face tracking system does not detect and track the face in every lighting condition. Read the instructions in the app to get a good tracking.

Head-Coupled Perspective does not create a stereoscopic display! It provides a kind of monocular 3D display: the same picture is seen by both eyes. In the future, it might be combined with a stereoscopic display for a better 3D effect.

i3D for iPhone and iPad is available here for free. In case you missed it, check out the original video below.

Join

Unlock More with Club MacStories

Founded in 2015, Club MacStories has delivered exclusive content every week for over six years.

In that time, members have enjoyed nearly 400 weekly and monthly newsletters packed with more of your favorite MacStories writing as well as Club-only podcasts, eBooks, discounts on apps, icons, and services. Join today, and you’ll get everything new that we publish every week, plus access to our entire archive of back issues and downloadable perks.

The Club expanded in 2021 with Club MacStories+ and Club Premier. Club MacStories+ members enjoy even more exclusive stories, a vibrant Discord community, a rotating roster of app discounts, and more. And, with Club Premier, you get everything we offer at every Club level plus an extended, ad-free version of our podcast AppStories that is delivered early each week in high-bitrate audio.

Choose the Club plan that’s right for you:

  • Club MacStories: Weekly and monthly newsletters via email and the web that are brimming with app collections, tips, automation workflows, longform writing, a Club-only podcast, periodic giveaways, and more;
  • Club MacStories+: Everything that Club MacStories offers, plus exclusive content like Federico’s Automation Academy and John’s Macintosh Desktop Experience, a powerful web app for searching and exploring over 6 years of content and creating custom RSS feeds of Club content, an active Discord community, and a rotating collection of discounts, and more;
  • Club Premier: Everything in from our other plans and AppStories+, an extended version of our flagship podcast that’s delivered early, ad-free, and in high-bitrate audio.

Federico is the founder and Editor-in-Chief of MacStories, where he writes about Apple with a focus on apps, developers, iPad, and iOS productivity. He founded MacStories in April 2009 and has been writing about Apple since. Federico is also the co-host of AppStories, a weekly podcast exploring the world of apps, and Unwind, a fun exploration of media and more.

He can also be found on his other podcasts on Relay FM: Connected and Remaster, two shows about Apple and videogames, respectively.

@viticci
@viticci
@viticci@macstories.net
viticci@macstories.net