Our Properties: Gamasutra GameCareerGuide IndieGames Indie Royale GDC IGF Game Developer Magazine GAO
My Message close
Latest News
spacer View All spacer
 
February 10, 2012
 
What drives the developers of Unity?
 
Analyst questions validity of unusual January NPD results [14]
 
Skyrim wins big at 15th Annual Interactive Achievement Awards
spacer
Latest Features
spacer View All spacer
 
February 10, 2012
 
arrow Virtual Goods - An Excerpt from Social Game Design: Monetization Methods and Mechanics
 
arrow Principles of an Indie Game Bottom Feeder [21]
 
arrow Postmortem: CyberConnect 2's Solatorobo: Red the Hunter [1]
spacer
Latest Jobs
spacer View All     Post a Job     RSS spacer
 
February 10, 2012
 
Rockstar San Diego
Gameplay Programmer
 
EEDAR
Business Analyst
 
Rockstar San Diego
Tools Programmer
 
Irrational Games
Systems Designer
 
CCP - North America
Sr. Tech Artist
 
CCP - North America
Lead Character Artist
spacer
Blogs

  What Use Is A Baby? Part 1: Post-Natal
by Noah Falstein on 06/05/09 03:47:00 pm   Expert Blogs   Featured Blogs
10 comments Share on Twitter Share on Facebook RSS
 
 
  Posted 06/05/09 03:47:00 pm
 

I'm a little surprised by the degree of negative reaction to Microsoft's new announcement about their motion-sensing, voice recognizing Project Natal.  Sure, this is the company that brought us Microsoft Bob and Vista, but this is one of their good ideas.  Full disclosure - I haven't actually tried a Natal demo myself, and didn't even go to E3.  

But I did spend time last year working with a game studio that is developing games using the same kind of 3D infrared cameras that are at the heart of the Natal motion recognition system.  The company is Omek Interactive  and although they initially used a different 3D camera system (that Microsoft bought out, in an apparent bid to become a monopoly - what a surprise!) the basic technology is very similar.  

Omek is doing some fun exergames, and although they have yet to announce the details publically, they look great.  So I'm speculating on Natal based on that, but with good confidence that the similarities are sound.  The voice recognition aspect of Natal presents other opportunities, but I'll save that for another post.

When I first saw Omek's early demos I was very skeptical.  The demo was set up off a laptop in a coffee shop, and when I saw them set up the camera pointing towards the line of people waiting to order their lattes and step in front of it, I was sure it would never be able to pick the player out of the background clutter.  

I have made a bit of a study of exergaming titles and have lectured about them, and I knew how finicky the Sony Eyetoy had been in their Eyetoy Kinetic title, require precise lighting and focus and even then losing track of my image repeatedly.  But the Omek early prototype picked the player out of the background flawlessly.

These cameras aren't perfect.  There is a bit of a lag problem - no worse than with other motion controllers like the Wiimote, and I expect it will get better quickly with revisions.  They can also be confused by certain clothing or jewelry that reflect infrared better or worse than average, but these are fairly minor points.  

Playing the game, particularly when I came to Omek's offices and saw the more advanced versions, I was instantly reminded of the movie Minority Report, where Tom Cruise's character controls a screen by waving his hands in the air (Microsoft's Natal demo reel shows very similar functionality).

 In the movie Cruise wears a data glove, and in fact I expect that something similar will be popular, perhaps with special IR-reflective beads - but no wires, no power necessary, and it will only be really critical for some fine-motion sensing.

So what does this mean for game designers?  First, a lot more active games.  Exergaming got its first big boost with DDR, then the Wii Sports title, and now Wii Fit is showing it wasn't a passing fad.  But this sort of motion-sensing camera can take it to a new level.  That will be yet more good news for putting an end to those complaints about kids playing video games instead of getting physically active (I'm thinking of you, President Obama!)

I've already heard concerns from people that they don't want to have to get up and jump around to play games.  That's valid.  Some of the demos I've actually tried involving things like virtual steering wheels are fun novelties, but your arms get tired fast held out in front of you.  And although I'm a proponent of exergames, they're just a sub-genre.  

This tech won't replace hand-held controllers.  And yet, being able to walk up to a screen and just interact without donning special gear or even picking up a controller is quite magical.  I expect that this technology might come into its own not as exergaming, but as couch-potato extreme - none of that strenuous searching for a remote control, just sit there and wave your hands to change channels, select movies, control your home from your living room.  Eventually maybe twitching an eyebrow will be enough.  So you exercise-phobes can find something to rejoice in too!

But the bottom line is, this technology and the games for it are in their infancy.  I've seen a lot of new technology and controller schemes come and go, and I've been fooled before, but this is the real deal.   From a design viewpoint, it's particularly exciting because it allows us to design games that respond to players' body language, and to finally free ourselves from requiring physical controllers.  

The dance game possibilities alone are exciting - and consider the body language involved in really good Air Guitar performances and how that would translate into competitive online Guitar Hero/Rock Band titles.  I fully expect that the best applications using this technology have yet to come - but will seem so natural and important we'll wonder how we got by without them.

 
 
Comments

Reid Kimball
profile image
I hadn't thought about the tech being used for normal TV functions, like changing channels or volume. That's very cool. I'm always missing important parts of movies as I dig through my couch for the remote.

Bob McIntyre
profile image
Changing channels seems pretty useless. If it's voice recognition and I can say "go to NBC" without remembering what number NBC is, cool. If I can say "Show me the newest Lost," that's cool too. But gesture recognition? No. The remote control is way faster, less error-prone, and is very easy to use. Not losing the remote is also easy: You just put it anywhere except where you sit. Table, chair, floor, shelf, just not on the couch and it never gets lost.

Jason Pineo
profile image
All valid points, Bob, though don't forget that different people have different input preferences. I like a mouse-centric GUI, while certain friends of mine eschew them for command line interfaces. To each their own.

Now for my own thoughts... does anyone know if something like this will have the fidelity to handle full gestural languages, like American Sign Language?

ddnguyen 278
profile image
From the videos i've seen Natal 3D scanning can recognize major joints like wrists, shoulder, hip, neck, knees etc.. but it doesn't seem to have the fidelity to capture precise hand positions. However you can use similar image recognition technology they use for facial recognition on the hands and that should be able to read hand signs well enough.

-ddn

Tom Newman
profile image
Great points! Personally, I hate motion control for gaming, but was very impressed with the Natal demo. While I could care less about it's functionality with games, my head is swimming with ideas of how this technology will change computing. As said in other posts, Bill Gates has talked about your computer recognizing you, and you being able to verbally converse with it with no analog interface - way before Microsoft ever got into the console business. I can't wait to wake up and have my computer recognize me and remind me of my tasks and tell me what route to take to work based on traffic, or if my fly is unzipped, without ever touching a keyboard or mouse. This technology is just a seed that will change the way we interact with our machines.

Alexander Jhin
profile image
Almost everyone knows how to wave their arms and/or speak. That's the big advantage of Natal.
Most people know how to wave a wand (Wii.)
And relatively few people can tell you where to find the left shoulder button (Xbox, PS3, DS, etc.)

Chris Pasley
profile image
The technology will seem silly to some people until an awesome use of it comes out, then they'll be all over it. I think Natal just faces a consumer public who have been over-hyped too many times. I for one am extremely excited about the possibilities.

Kimberly Unger
profile image
I think Chris has a very valid point. Natal is being broached to a market that gets dissapointed by the promises of the "new" on a yearly basis, so a solid portion of the scepticism Microsoft is facing is probably based on this. Until the thing hits the store shelves at an affordable price-point it's just going to remain a cool idea in an industry that promos new cool ideas every couple years.

That said, however, the non-gamer market (particularly those who have their 401k's invested in MSFT) is probably going to be very excited by the announcement.

Noah Falstein
profile image
I should clarify, I wouldn't be shocked if Natal is to our future in controlling computer/TV interfaces what the Apple Newton was to current iPhones/Smart phones. They may not have got it quite right, and we may need another generation or two of refinement, but I think that at some point it will be the new standard to beat. Perhaps not until the next gen of consoles that might have higher-resolution camera (picking up finger movements or at least more accurate for pointing even at small screens) and that next gen game console may be the long-awaited "does it all' set-top box. We're getting very close to that now.

Ernest Adams
profile image
I'm with Chris Pasley and Noah. I hate hype, because it demands that I bow down before product X and worship, then so often fails to deliver the prayed-for rain on time (ahem, 3DO, ahem). Leaving the hype aside, though, this is the way of the future for SOME applications. I don't want nuke plants run by waving your hands; they need unmistakable positive-response input devices. (Remember IBM's clicky keyboards? Secretaries were used to keys that you had to PRESS -- same phenomenon.) But PowerPoint? and many video games? Hell, yes.


none
 
Comment:
 




 
UBM Techweb
Game Network
Game Developers Conference | GDC Europe | GDC Online | GDC China | Gamasutra | Game Developer Magazine | Game Advertising Online
Game Career Guide | Independent Games Festival | Indie Royale | IndieGames

Other UBM TechWeb Networks
Business Technology | Business Technology Events | Telecommunications & Communications Providers

Privacy Policy | Terms of Service | Contact Us | Copyright © UBM TechWeb, All Rights Reserved.