All Articles
Technology5 min read8 June 2017

ARKit and the Augmented Reality Platform in Your Pocket

Apple announced ARKit at WWDC 2017. No headset required. No special hardware. Just the iPhone already in hundreds of millions of pockets.

AppleARKitAugmented RealityiOSWWDC

Apple's developer conference in June 2017 had the usual collection of software updates and platform improvements. But the announcement that generated the most sustained attention was ARKit, a framework for building augmented reality applications for iPhone and iPad.

What made ARKit notable was not the technology in isolation. Motion tracking, plane detection, and light estimation had existed in various forms. What made it notable was the delivery mechanism. No headset. No depth sensor. No special hardware beyond the iPhone that was already in hundreds of millions of pockets. ARKit was going to be the largest installed base of augmented reality devices in the world on the day it launched, simply because iOS devices already existed.

The technical approach relied on the cameras already in iPhone, combined with the motion coprocessors that Apple had been building for several years. The result was tracking that was stable enough to place virtual objects in a physical scene and have them stay put as you moved around them. Not perfect, but convincingly good.

The developer response was immediate. Within weeks of the beta release, applications started appearing that demonstrated what the framework could do at its best. Measuring apps that used the camera to calculate distances. Furniture placement applications that let you see a sofa in your living room before buying it. Games that turned tables and floors into playing surfaces. The range of applications was broader than most AR demonstrations had suggested.

The furniture placement use case attracted particular attention, partly because IKEA was among the early partners and partly because it was immediately obvious why someone would want it. The gap between seeing a sofa online and knowing whether it would fit and look right in your actual room had always been a friction point in online furniture shopping. AR closed that gap in a way that was genuinely useful rather than gimmicky.

The broader implication was about what distribution means for a new technology. Microsoft's HoloLens and Magic Leap had been building impressive AR experiences for years. But the hardware required was expensive, bulky, and had a very small installed base. ARKit put a capable AR platform in the hands of everyone who already had an iPhone. That scale advantage changes what developers will build and how quickly applications improve.

Found this useful?

Share it with someone who'd enjoy it.