This Week's Sponsor:

Kolide

Ensures that if a device isn’t secure it can’t access your apps.  It’s Device Trust for Okta.

Posts tagged with "ARKit"

Apple’s October 2020 Event: All The Little Things

Apple events are always full of little details that don’t make it into the main presentation. Some tidbits are buried in footnotes and others in release notes. Yesterday’s event was no exception, so after having a chance to dig in a little deeper, here is an assortment of details about what Apple announced.

HomePod

iPhone 12

Accessories

  • Apple has reduced the price of EarPods $10 to $19, and the 20W charger that replaces the 18W charger is $19, down from the $29 charged for the 18W version.
  • Belkin has announced a 3-in-1 MagSafe charging stand and a MagSafe car mount.

You can follow all of our October event coverage through our October 2020 event hub, or subscribe to the dedicated RSS feed.

Epic Games Releases iPhone App That Captures Facial Expressions to Unreal Engine→

Source: Epic Games.

Source: Epic Games.

Epic Games has released a new iPhone app for videogame developers that captures facial expressions, piping them into the company’s Unreal Engine in real-time. As explained on the Unreal Engine blog:

Live Link Face streams high-quality facial animation in real-time from your iPhone directly onto characters in Unreal Engine. The app’s tracking leverages Apple’s ARKit and the iPhone’s TrueDepth front-facing camera to interactively track a performer’s face, transmitting this data directly to Unreal Engine via Live Link over a network.

What I find most interesting about Live Link Face is that Epic says it scales from solo developers working at home to sophisticated stage productions involving actors in motion capture suits and multiple iPhones. If so, that will make the app a terrific example of the sort of democratization of complex tools that technologies like ARKit and hardware like the iPhone’s TrueDepth camera make possible when integrated into existing workflows.

Permalink

Harry Potter: Wizards Unite AR Game Launches on iOS

It was the summer of 2016 when Pokémon GO took the world by storm, and now, almost exactly three years to the day later, there’s a new AR game trying to capture the same magic. Harry Potter: Wizards Unite launched today in the US, UK, and select other countries from the same studio behind Pokémon GO, Niantic.

At the core of Wizards Unite is the same AR-based system employed in Pokémon GO, whereby you can explore a digital world that’s mapped to the real world around you, where different real-life locations are mapped to in-game hot spots for engaging with certain game elements. Special locations in the game, such as fortresses, are designed for teams of players to conquer together; combined with the AR world exploration mechanic, this encourages strong community engagement in the game. If Wizards Unite takes off in any way like Pokémon GO, expect to see bands of players roaming the streets with their phones at the ready.

Chronologically, Wizards Unite takes place following the original seven book Harry Potter series but still includes many of those original characters. In the game’s tutorial, for example, a slightly aged Harry Potter, now working as an auror, instructs you regarding a crisis the Ministry of Magic is currently facing that needs your assistance. This sort of tight integration with the world and characters Harry Potter fans know and love, combined with the community-centric element found in games like Pokémon GO, could make Wizards Unite a really special experience for anyone who loves J.K. Rowling’s wizarding world. As one of those people myself, even though I never got into Pokémon GO, I’m excited to spend some quality time trying out Wizards Unite.

You can download Harry Potter: Wizards Unite on the App Store now.

Nike Introducing AR Shoe Sizing Feature This Summer→

Edgar Alvarez reports for Engadget on an upcoming AR feature I can’t wait to try:

Nike has been experimenting heavily with augmented reality for a few years now, and the company is continuing to work on new experiences powered by the technology. The sportswear giant is now introducing Nike Fit, a feature that uses a combination of computer vision, scientific data, artificial intelligence and recommendation algorithms to scan your feet and find the right shoe fit for you. And you can do it all in augmented reality, using the Nike app on your smartphone. Nike says that, according to industry research, over 60 percent of people wear the wrong size shoes. With Nike Fit, the company is hoping to solve that problem.

The AR experience itself is fairly simple: You open up the Nike app, go to a product page and, next to where there’s usually a menu that lets you pick the size of your shoes, you’ll see a new option to measure your feet. From there, the camera will pop up and you’ll be asked to stand next to a wall and point your smartphone at your feet, which will prompt a view that uses two AR circles to level your phone. Once the feature recognizes your feet and your physical environment, it starts scanning your feet and then tells you your ideal shoe size for Nike footwear. The entire process takes less than a minute.

It’s been two years since Apple introduced ARKit, yet there are still very few AR apps I’ve found add meaningful value to my life. Outside of measuring apps, the only ARKit experiences I’ve enjoyed related to shopping for furniture and other home accessories. It looks like shoe shopping will be the next major area where AR becomes more than a fun demo. According to Alvarez, the Nike Fit feature will be added to the Nike app this July.

Permalink

Niantic Previews Harry Potter: Wizards Unite, the Studio’s Follow-Up to Pokémon GO→

Later this year the team at Niantic will launch a new game based on a very popular IP: Harry Potter. The game’s full title is Harry Potter: Wizards Unite, and it will come to both iOS and Android as an AR-centered gaming experience in the vein of Pokémon GO, Niantic’s biggest hit.

Today Nick Statt of The Verge published his impressions of Wizards Unite following a preview Niantic hosted recently. Statt writes:

The core activity in Wizards Unite involves collecting a mix of artifacts and sometimes saving notable characters from the series who are stuck in a bad situation, like the titular Harry being pinned down by a spooky dementor. From there, you play a little tracing mini-game, to evoke the casting of a spell and then collect the item or free your friend. Afterward, you’re able to add that item or character to your collections book, earn experience points, and level up.
[…]
Beyond traversing the map, collecting those artifacts, and visiting inns to eat food, players of Wizards Unite will have a few more advanced activities to keep them busy. Those include leveling up your character, picking a subclass (called a “profession”) to learn new abilities, and then teaming up with up to five other players to compete in a fortress (what Niantic has designed to be this game’s version of gym battles from Pokémon Go). These team challenges feel like a cross between a traditional strategy game and something similar to Nintendo’s Fire Emblem, where one-on-one battles take place simultaneously after players select an enemy from a top-down map.

Based on Statt’s article, Harry Potter: Wizards Unite is going to have a lot more depth and complexity to it than Pokémon GO, which I’m excited about. Pokémon GO has scaled over time to become more of a gamer’s game than it used to be, but with Wizards Unite it sounds like that added depth will be there from the start for those who want it.

There’s still no firm release date available for Wizards Unite, but a 2019 launch is confirmed.

Permalink

iOS 12 AR Quick Look Demos→

I recently came across a demo of AR Quick Look, an iOS 12 feature that allows apps to present 3D and AR previews for objects built using the new USDZ file format. Shopify, the popular e-commerce platform, is going to take advantage of AR Quick Look to let customers preview items in their surroundings directly from Safari, contextually to the shopping experience.

Here’s Daniel Beauchamp, writing on the Shopify AR/VR blog:

For the past three years, Shopify has been exploring how AR / VR will change the way consumers shop. Last year, we showed how Apple’s ARKit could be used to provide compelling AR commerce experiences. The main complexity was that ARKit needed to be run in an app. This meant that Shopify merchants looking to offer these experiences had to have their own unique mobile apps that customers would need to download.

With iOS 12’s AR Quick Look, 3D models of products in the usdz file format can be uploaded directly to online Shopify stores and viewed in AR right within Safari, without needing to download a separate app.

His video gives you an even better idea of the integration possible between Safari, ARKit, and Apple Pay in iOS 12:

Beauchamp argues that “the web is how AR becomes mainstream” – looking at these demos, it’s hard to disagree. Not having to install a dedicated ARKit app for every single online store we use and actually having the ability to share and preview models from Safari or Messages is going to remove a ton of friction from the current ARKit experience (as far as shopping is concerned). I can imagine that producing 3D objects at scale will be merchants’ biggest hurdle in the short term, though.

I wasn’t aware of this until I did some research, but Apple also launched an interactive AR Quick Look Gallery as part of their ARKit 2 mini-site. You can also test Shopify’s improved shopping flow featuring ARKit and Apple Pay here.

Permalink

Snapchat Debuts Exclusive iPhone X Lens Filters→

At last September’s iPhone event at Apple Park, Craig Federighi, Senior Vice President of software engineering, used Snapchat to show how the iPhone X’s True Depth camera and ARKit could create realistic camera filters. Today, those filters finally launched with an update to Snapchat’s iOS app, which is featured in the Today section of the App Store.

Craig Federighi demonstrating Snapchat Lens filters in September 2017

Craig Federighi demonstrating Snapchat Lens filters in September 2017

The update includes the two filters demoed by Federighi during the keynote, as well as a masquerade ball Lens. The advantage of using the True Depth camera and ARKit is that the filters can track your face better than other Snapchat Lenses and account for the lighting in the room, providing realistic highlights and shadows.

The new filters are available now without updating Snapchat’s app. If you long press the screen with the selfie camera enabled, the new lenses are currently the first three listed.

Permalink

New Google Maps APIs Empowering Game Developers to Create Premium AR Experiences→

Andrew Webster, writing for The Verge:

There’s been a wave of location-based mobile games announced recently, based on everything from The Walking Dead to Jurassic World. It turns out these games have more in common than just timing: they’re all powered by Google Maps. Today Google is announcing that it’s opening up its ubiquitous mapping platform to allow game developers to more easily create real-world games. The next Pokémon Go might finally be on the way.

Gaining access to a real-time mapping source like Google Maps is huge for developers, but the additional tools that go along with Google’s newly announced game platform take that a step further. Google is also launching a Unity SDK to tie into its mapping data, and enabling gameplay experiences to be built around specific locations or location types.

Developers can do things like choose particular kinds of buildings or locations — say, all stores or restaurants — and transform each one. A fantasy realm could turn all hotels into restorative inns, for instance, or anything else.

This sounds like it could be a huge boon to the mobile game market, particularly when combined with tools like Apple’s ARKit. Yes, it means we’ll probably get tired of all the games trying to replicate Pokémon GO’s success, but these new developer tools will also likely enable some truly immersive, exciting gaming experiences.

Google created a video that shows off just a glimpse of what’s possible with its new Maps APIs.

Permalink