Gamasutra: The Art & Business of Making Gamesspacer
View All     RSS
October 25, 2014
arrowPress Releases
October 25, 2014
PR Newswire
View All

If you enjoy reading this site, you might also want to check out these UBM Tech sites:

Peering into the future of augmented reality games
Peering into the future of augmented reality games Exclusive
November 1, 2013 | By Christian Nutt

Wearable tech is in its infancy, but for those living on the cutting edge of mobile technology, it's absolutely irresistible. Some believe it will be integral to the future of how we play games -- and as part of our virtual reality and advanced I/O week, Gamasutra spoke to several of those behind the first wave of wearable tech and augmented reality games.

"It's the future of games," says Google's John Hanke, head of Niantic Labs, an internal startup the company has launched. It's the studio responsible for Google's location-aware mobile game Ingress. His team is already experimenting with Google Glass.

"Take the shift in browsing from desktop to mobile. There won't be such a thing as a desktop computer in a few years. Now it's 'obvious' that consumer tech is all about phones and tablets. In some number of years it will be equally 'obvious' that games are about wearables. How can pushing buttons and pixels around on a screen compare to moving in the real world with games that involve real people?"

Matt Kitchales, product manager for Meta -- augmented reality glasses that allow the user to see virtual objects clearly in the real world thanks to see-through screens on both lenses -- makes this point rather concretely. Meta is developed out of a house in Silicon Valley by a staff of about 30. "I like to occasionally just pull out my lightsaber and fight against another member of the house," Kitchales says.

Meta (developer hardware)

Point made. But while tech is nice, what matters is software. What kinds of new play experiences can wearable tech bring to games?

What Can Wearable Tech Do for Games?

Unni Narayanan, founder and VP, game production and operations for Mind Pirate -- a developer of games and middleware for wearable tech -- offers an interesting insight about player behavior:

"Wearable tech supports a new class of game play around the idea of 'micro-engagements.' The idea behind 'micro-engagements' is that wearable devices are 'worn' and 'always on.' This implies that a game can also be 'always on,' but the game is not always played."

He expects players to drop in and out of games as they receive notifications throughout their day -- an extension of mobile play patterns, but with an added layer of persistence or immersion.

Jeri Ellsworth and Rick Johnson, the former Valve employees currently funding their CastAR glasses via Kickstarter, see the potential to bring remote players closer together in a shared, augmented world: "People who are in different locations playing a game can both use the physical world, and be represented in the virtual world to the other player."

CastAR (prototype)

Meanwhile, Google's Hanke sees the integration and enhancement of real-life play by a video game layer. "Think about all of the kinds of play that happens on playgrounds, hiking trails, campuses, sports fields, and sidewalks. And think about all of the play that could happen in corporate break rooms, corporate campuses, downtown city streets, public parks, etc. Games that involve movement in the real world, objects in the real world, and interactions with other people all come to mind."

Meta's Kitchales sees a chance to bring new life to a different kind of collaborative real-world play. "Growing up as a kid, I used to do a lot of Dungeons & Dragons," he says. "The opportunity today is to let kids experience the whole game, but completely different. There will be dragons coming out of the table; emotionally, things will be completely different."

"The opportunity for two people to interact with the same hologram just wearing the glasses is a much more advanced technology than people think exists," he says. "We can expect great things."

Wearables and Tech: Expanding Horizons

Wearable tech will interface both with other devices and services (PCs, smartphones, tablets) and with traditional video game tech and designs, as well as the cloud. What effect will these have on the direction developers take?

Narayanan sees three basic ways in which wearable tech will interface with other technologies: "First, the interfaces between wearable devices themselves. Second, interfaces between wearables and the tethered smartphone, and lastly, a shared game space in the cloud where games as complex as MMOs could be realized with players using different devices to play in the same virtual world."

"It makes sense for wearable devices to work together to share data, gamestate, and network connections and for play experience to incorporate many different types of interactions that may take places on different devices at different times," says Hanke. "In the end we'll see smart, small, stylish devices, a super-reliable personal cloud, maybe a single device providing and sharing high-speed network connectivity, something for voice input and some kind of high-fidelity but discreet audio output, and maybe video."

Ellsworth and Johnson, meanwhile, suggest some practical software-based considerations, anticipating how the devices will interface with game development tech: "Physics plays an important new role in this space. Having the user interact in 3D into the virtual world with physics makes the player feel much more connected to the environment. Audio becomes more alive as it is now based upon your position in the physical world: Move your head closer to a virtual music box to hear it. Finally, projected AR allows multiplayer games which utilize fog of war or other hidden data mechanisms to retain those concepts even when players are sitting right next to each other."

The Long Game: The Ultimate Potential of Wearables

Already, Meta has built a Minecraft mod called Metacraft that allows you to "build with boxes in your room, really neat stuff," says Kitchales. The Niantic team is clearly experimenting with Ingress-like shared experiences, even if they're under wraps for now. But what's the long-term potential for games that use this kind of technology?

Johnson and Ellsworth offer a subtle but important insight: "We see AR bringing the social back into social gaming. People can now sit across from each other rather than side by side, watching their opponents react to the gameplay."

But they have other ideas, too: "We’ve demonstrated that you can use your head as an input device as control for a flight simulator, so exploring more ways your physical presence will have on gameplay will be interesting."

"If you move [an existing] game to Google Glass, there’s a different control scheme," says Narayanan. "Perhaps one’s head might be used to navigate the object on the screen, or hand gestures might be the inputs to the controller. In either case, we certainly believe there will be compelling new experiences by re-imagining them on wearable computing devices."

Google Glass

"Bridging the gap between the physical world and the virtual world, by using miniatures, cards, board game pieces, etc. will continue to enhance the experience," Ellsworth and Johnson note.

Hanke, meanwhile, actually dismisses the idea of extending current video games into the AR space. "In terms of taking an existing game mechanic and extending it with some wearable tech, perhaps but that's not so interesting to me," he says.

What does he want to see? "I'm thinking about a range of tech enhancement ranging from small pulses on your wrist letting you know that something just happened all the way to full-blown augmented reality that transforms your world into the one you've always wanted to live in."

These devices will be expected to perform very capably by players used to rich game experiences, Narayanan says. "Consumer expectations around mobile games are rising. For example, consumers now are used to enjoying rich 60 FPS 3D game experiences on the smartphone."

"In a similar fashion we anticipate that more and more apps will take advantage of the increasingly sophisticated sensor capabilities on these devices to meet emerging customer expectations about richer experiences."

He also sees it as essential to use the data that devices can know about players and the world to create the next generation of wearable game experiences:

"The real insight here is that these new wearable games will be micro-transactional in nature. Gamification of all this data that is unique to wearable technology is essential. It’s horizontal, not vertical. We can see this already with health applications. People don’t want to see a chart or graph of their heart rate. They’d rather play a game, test their stamina, clock their mile run. Not only is this beneficial to the consumer but for companies as well, as this type of interaction helps build more meaningful costumer relationships."

If that doesn't interest you, you can think about it this way: "You can walk around the house and start a game, and you'll see zombies coming out of the walls," says Kitchales. "The ideas are limitless -- and there are so many cool ideas and so many ways to use this new technology. It just depends which kind of person you are."

Related Jobs

Digital Extremes
Digital Extremes — London, Ontario, Canada

Sound Designer
Disruptor Beam, Inc.
Disruptor Beam, Inc. — Framingham, Massachusetts, United States

Lead 3D Artist
Red 5 Studios
Red 5 Studios — Orange County, California, United States

Graphics Programmer
Red 5 Studios
Red 5 Studios — Orange County, California, United States

Gameplay Programmer


TC Weidner
profile image
There won't be such a thing as a desktop computer in a few years.

You wanna bet?

Ruud van Gaal
profile image
It's funny indeed. My 7" tablet is almost never being used anymore. I'm using the 10" one a lot, but mostly only for read-only stuff. For real browsing, ordering, typing longer things and general productivity, nothing beats the desktop PC.

Garret Cashman
profile image
Now that's an attention grabbing quote if ever I heard one!
If the word come from deep within Google = must be true :/

Amir Barak
profile image
People are so hung up on inane nomenclature...

Terry Matthes
profile image
Just playing Devil's advocate here, but I think the average person (not developers), don't need a desktop PC. They're overpowered and just too cumbersome. For day to day activities such as email, surfing the web, and listening to music/watching movies I think a larger tablet, or at most a laptop would suffice.

I've noticed friends and family (especially my parents) don't even bother with their desktop PC unless they absolutely need to. First they got a small mac book (circa 2009) and they loved that it could go with them everywhere. As soon as they got a tablet though their laptop became just as unused as their PC. Especially after they figured out how to hook the tablet up to their TV.

People get all up in arms about "desktops dying", but I think it's more that their role is changing and they aren't as useful or convenient for the average person. They will always have a niche in development.

More to that though, I have seen a lot of studios locally being built with a network of laptops rather than desktops. They also have an extra display connected for the most part. It won't be long before Tablets get more powerful and you'll just carry your tablet back and forth to work and dock it in a dual monitor setup. For some this is already a reality. Some people say that storage is an issue, but no studio I have ever worked in had me saving files locally. You're always going to be saving to some sort of work server anyways.

TC Weidner
profile image

noone is disputing that desktop overall market use may fluctuate and will and has gone down. As you are correct, many average users and families are just as well served by tablets and laptops and even smart phones. That however does not rule out and make desktops a dinosaurs. The fact remains desktops still are the most powerful computing tool you can have. While the whole world of computer hardware seems to be shrinking, the desktop tower is actually in many cases getting larger. Its just the physics of power consumption and cooling issues as well as component size.

Fact remains, if you want the best and most powerful computing, its still desktops and will remain that way until someone can tackle all the physics limitations of smaller hardware.

Kevin Nally
profile image
As someone who works in the AR industry this is a very enjoyable article. There have been many new efforts for AR games recently and I am glad to see people making the effort.
I would warn new developers however against over-ambition, especially when it comes to new technical equipment. With each new technology comes a huge amount of potential but that potential also requires a certain degree of mastery. From my point of view the most valuable step forward for AR gaming is for developers to focus their energy on one mechanic/platform(such as image recognition, 3d recognition or hand gestures(leap)) and perfect the uses of that mechanic in a game scenario.

By getting away from the vague ideas of TRUE IMMERSIVE virtual reality we can start to explore some really interesting new variables for creativity. Its like coming up to Miyamoto in the 80's and saying I want a 3d high-octane Nathan Drake and being disappointed when he only offers you a 16 pixel guy in a stupid red hat. Turns out 16 pixels can actually do a lot.. This is why I worry when Hanke mentions "a range of tech enhancement ranging from small pulses on your wrist letting you know that something just happened all the way to full-blown augmented reality that transforms your world into the one you've always wanted to live in." I understand the technical enthusiasm but exploring so many new technical specs isn't going to add value to your game and over-extending your ideas weakens the end product. This is something I see alot in AR discussions.
My practical thoughts are:
Make physical interaction the fundamental focus of your game. A new viewing angle of a 3d football game isn't worth the energy of standing up and walking around. If someone is using a lot more energy to experience your game make sure they are getting a new experience for that energy. I recommend looking at this recent demo from Metaio which focuses on using the physical position of your mobile device to interact with digital objects.

Im glad to see this topic on Gamasutra and hope more people can join in on AR.

Please... whatever you do don't use puns in the title of your AR games. There are already too many AR related puns in the industry

christoph weiss
profile image
Metacraft is *not* a "Minecraft mod made by Meta.
It's a *server* made by Virtual Reality enthusiasts and it's used for playing Minecrift, which is an Oculus Rift mod of Minecraft.