|
A reprint from the January 2013 issue of Gamasutra sister publication Game Developer magazine, this feature explores touchscreen control methods. You can subscribe to the print or digital edition at GDMag's subscription page, download the Game Developer iOS app to subscribe or buy individual issues from your iOS device, or purchase individual digital issues from our store.
I have a lot of fond memories of pressing buttons. As a six-year-old, it felt like magic to turn a television on with a wireless remote control for the first time.
If I am not mistaken, you are not six years old, so it's fine if you object to the following claim:
Buttons are doomed; touchscreens are the new game controllers.
I've been working on making mobile games as the founder of an independent studio called Action Button Entertainment. In order to make the best mobile games, I've been dissecting and researching every interesting game-control mechanic I can find, from Pong to Angry Birds. Here is what I've found.
Pushing Buttons
I've always been a proponent of the mechanical particulars of a game's feel over any sort of gimmick related to its product construction. The triumph of Super Mario Bros. was one of Game Design by the Milliseconds -- of the developers pre-understanding the game as more than a series of short-, medium-, and long-term goals. Super Mario Bros. is about the immediate-term goals, and the way that the player's microscopic actions feel in increments of five or six milliseconds.
Super Mario Bros. felt like magic. The fine degree to which the minute variations of button-press length could affect Mario's jump heights and lengths checked every box in my child-brain's "best thing ever" wish list. More than 20 years after the Nintendo Entertainment System, we had the Nintendo Wii: Shake a little television-remote-like thing any which way to make a cartoon person hit a tennis ball. Nintendo was shifting the emphasis, aiming for the part of the brain that makes a six-year-old find a television remote control more magical than Asteroids.
Games With Buttons are not superior by default; they are superior because a parade of geniuses like Shigeru Miyamoto laid the groundwork. Players needn't wage a culture war of casual versus hardcore, social versus everything else, mouse and keyboard versus controller; in a perfect world, action gamers would only speak scientifically of the milliseconds of a game. If a game's milliseconds unite its action and its player, then the game is real and true.
In order to understand the touchscreen-versus-button dichotomy, let's revisit the old mouse-and-keyboard-versus-controller debate: You can't click on a recent blog post about or review of Halo 4 without accidentally scrolling down to the comments and seeing someone groaning about how they'll never play a first person shooter on a console because "mouse and keyboard is the only way to play an FPS." This opinion has raged since the moment Halo was announced as an Xbox exclusive.
I am convinced that we could get a room full of theoretical physicists to prove that Halo does a pretty darn good job with a controller, and that Call of Duty's by-the-millisecond design concessions for controller players (such as the smart snap-to auto-aiming) add up to a game that would be just as competitive with a controller as it would be with a mouse and keyboard -- that is, if all the best first-person-shooter players weren't born and raised with a mouse and keyboard in their hands. As the mouse disseth the controller, so does the controller disseth the touchscreen. (And we all diss motion controls, but that's a topic for another day.)
And maybe most touchscreen games deserve the disses.
I see a lot of games with virtual buttons on the screen. This is always a mistake. That's a sign of a subliminal conspiracy between game developers -- everyone on the team silently agreeing to commit to an inferiority complex: "[Sigh.] It sure would be cool if we were making a game with buttons."

Know this: A friend was telling me just the other day that his four-year-old son just doesn't want to touch a game controller. This friend has a glorious collection of old and new game consoles in his many-televisioned house, and all his son wants to do is play Where's My Perry? on the iPad. "Controllers just aren't real games to him," he told me.
I know "hardcore gamers" that will spend an hour of their lives trying to make a Skyrim avatar that looks exactly like themselves, and then they'll say mobile games aren't "real" games because their fingers get in the way of seeing the screen. This is interesting. Personally, I prefer IMAX to 3D movies, because I like feeling like I'm inside the movie, rather than feeling like the movie is popping out at me.
Now, imagine the way a four-year-old child feels playing with a touchscreen: The child touches her fingers to the screen, and the simulated world reacts. The child can literally touch her favorite cartoon character, and watch that character move. How is that not superior to pressing a button over here and watching the character move inside that screen over there?
Modern touchscreen technology has closed the distance from which children will consider electronics magical. For a four-year-old -- one who, in 10 years, will be a 14-year-old buying the games you're hopefully still making -- your remote control simply won't cut it.
Patient Zero: Pong
Designing essential game mechanics for touchscreens requires an understanding that hardcore action has never, ever been "about" the control method. It's about the way the action interacts with the player's brain. The control method is only ever an instrument for fabricating that brain-screen coordination.
Let's consider Pong. It's a hyper-competitive, finely nuanced contest between two players. The control implements are nothing like modern video game controllers. Players twist a tiny, mosquito-bite-sensitive knob. Twist a tiny bit clockwise, and your paddle zips to the bottom of the screen. Twist a tiny bit counter-clockwise, and the paddle zips to the top of the screen.
Furthermore, the paddle is made up of eight segments that appear to be seamless: The part of the angle of the return depends on where the ball contacts the paddle. Throughout a Pong contest, the player must balance the urge to trick their opponent against the urge to fire a return which is not so tricky as to result in any tactical backfires if returned. I like to think that the essence of all hardcore action games is purely available in Pong.
What I most take away from Pong is the relationship between the paddle and the control knob: The delicate sensitivity creates a brain impression that the game is more than just something happening on the screen. It's an object with a physical presence on planet Earth.
That brings us back to the image of a child, holding a screen, touching her favorite cartoon character, and watching that character react, like magic.
|
Ah! I've been developing a game like this for several months now, called Super Bunny Land (relevant link: www.slidedb.com/games/super-bunny-land). With a little difference that the left side is for deaccelerating, not accelerating. I think it works better that way.
Touch screen controls arent without there good point however, selection menus, games requiring touch selection such as trivia games are greatly enhanced by touch screens, but overall button and touch are no where near equivalent IMHO.
Controllers don't work well with games because Shigaru Myamoto figured out how to use them for games.
They work well with games because they were designed, from the ground up, for that purpose.
The current stage of mobile games is like early PC gaming. The touchscreen, like the keyboard, is not ideal for gaming, because it was not DESIGNED for gaming. People are using it for gaming because it happens to already be there, and because standardizing on anything else is "impossible".
It's a compromise, because we're using a multipurpose piece of hardware instead of gaming hardware.
If history is any indication, something better will soon come along. I'm not sure what, but something far more ideal for a wider variety of gaming.
I agree that the controller is much better designed, but I concede the point that these kids are growing up with touch controls, so they're going to be used to these in 10 years when they're buying games for themselves.
"Now, imagine the way a four-year-old child feels playing with a touchscreen: The child touches her fingers to the screen, and the simulated world reacts. The child can literally touch her favorite cartoon character, and watch that character move. How is that not superior to pressing a button over here and watching the character move inside that screen over there?"
That's my daughter (in my Avatar) exactly. She is 4 and she plays "Where's my Perry" and all sorts of games on the iPad and for HER touch is everything. She sees it, she pushes it, it reacts. It's all that simple and that RIGHT for her. Folks need to realize that controllers aren't going away but neither is touch. As much as I hate touch screens they're here and our kids are going to be expecting them in the future.
Honestly I'm curious as to where it'll all be in 10 years when she's 14 and my son is 10. :)
I am definitely curious myself. I wonder, though, if we won't have to wait a bit longer, though. Much as the scene changed when the Atari/Nintendo generation became the ones with buying power, we will see what happens once your daughter and son are the ones buying things.
* The API of smartphones is in general not an invitation to creativity. Besides some pretty basic gesture recognition, as a developer you're left to code your own stuff bottom up.
* There exists an unspoken consensus on touch controls among players which takes time to expand. App consumers will not take in new touch controls overnight.
* As new touch controls will face initial resistance from users you can expect new stuff to come from indie developers and the boldest game studios only.
By the way... Our ios game PENTAPUZZLE has a unique navigation style inspired by the movie "Minority Report". Check it out to have a peek at the future ;)
Imagine being able to use several fingers to drag the things around vs. having to tediously click and drag each one with the mouse. Obviously, in this case, touch controls are superior - but this is because this game was specifically designed that way.
Anything that involves directly manipulating objects is what touch controls are good at. Anything that is turn-based, such as RPGs, are also easily portable to touch controls.
Anything that involves twitch reflexes, precision on multiple "button" surfaces, and switching between them, will never work well on touch. FPS, jump'n'run, even arcade games like Pacman are near unplayable on touch screens. Sure, there are examples where the games use workarounds in order to compensate for the lack of precision, but that isn't giving the player control. That's compensating for the player's LACK of control, and that is the exact opposite of what a "great" controller is.
Sadly, I ONLY got the idea... but I do not have neither a programmer nor a Mac-something (or a touch device to be perfectly honest).
And now I'm wondering if I got this idea since I like to read your articles a lot...
A touchscreen can't emulate the feel of pressing a button. This is why you have to smear your fingers on the screen you're looking at, otherwise you couldn't be able to tell if you're pressing the right button or anything at all. And if you don't want to have virtual buttons then you end up with a binary game like Jetpack Joyride or Canabalt. Touch controls will never replace a real controller. It's nice that you're satisfied from playing games with 2 button input, but there's a whole world of games out there that can't function with such basic controls. Even the most basic platformers like Super Mario Bros. would not work well with touch screens and you're going to preach about how buttons are outdated. Come on.
It's cute that your 4 year old enjoys touch controls and all, but she's a kid. A typical mobile game is perfect fit for her. The touch and response thing you talk about is the basis of just about every toy for a kid her age. Why even bring that up. This article could easily be reduced to 10 sentences of concise thought.
this is the first time in my life that someone has mistaken me for having a child.
don't get me wrong; i'd rather find a cockroach in my kitchen than a toddler.
i swear your mis-impression is the editor's fault, not mine.
having said all that, i don't see why children being young diminishes the value of their experiences any. i enjoyed super mario bros. when i was six and it was brand new, and i still enjoy it. i think, "hey, i was right about one thing when i was a stupid kid". maybe i was right about some other things? i'm sure i overheard my parents, back then, at least once, saying that i only liked those videogames because i was Just A Kid.
Button's can't emulate the proprioceptive information gained from a gesture (for instance).
As much as controllers were designed for games, the type of games we expect to play were designed around controllers. There are plenty of opportunities for great games on touch devices, just in many cases these will be different types of games.
I did an entire talk on how to properly think about touch control design at GDC last year.
They opened it up for free on the vault.
If this is something you're interested in it might be worth looking at:
http://www.gdcvault.com/play/1015663/Controls-You-Can-Feel-Putting
Thanks for taking the time to check it ou!
Yeah most of the stuff in the appstore is pretty disappointing control-wise :(
There are certain genres that really benefit from touch-screens and those are generally the best games available for touch-devices. However I am starting to wonder what the limits are for touch-screen only games (or at least action-focused games). By having such a limited input, players rarely have as many options available to them at any time during gameplay. As a result, most good touch-screen games become sort of stale and played-out within an hour or 2 of gameplay (for me at least).
But hey maybe that's just because most of these games are small $.99 games made for phones and that's all you should really be asking for from them. But I yearn for a day when a game as complex, thrilling, and long-lasting as say Spelunky or Hotline: Miami can come out on a touch-only device and be just as fun and interesting. Run-forever games like Jetpack James control well but they offer almost no real choice for the player, and instead focus mostly on twitch-based reflexes and finesse (in fact most feel like a rhythm game to me). And to me personally, that is only part of the equation for a great action game (the other parts would be more decision-based like strategy and improvisation).
Basically what I'm saying is that I am starting to doubt that touch-screen devices will ever allow for as complex games as consoles and PCs can allow and still control really well. Maybe as tablets become more popular developers in the future will want to focus more on creating bigger more complex games for the devices and we will see what sort of genres can shine on touch-screens and be more complex and long-lasting that the sort of games we're seeing on touch-screens right now. I can't really think of how that can happen on touch-screens (as they are now), but hopefully I'm wrong.
I think there are indeed a lot of important genres that simply cannot provide the same complexity of input on touchscreens, most prominently anything that involves directly controlling a player character, especially in 3D. Virtual buttons seem to be the only way around that; Minecraft's Pocket version uses mobile buttons, for example, and I can't see how you would get that kind of freedom of movement using pure touch controls (though I would love to be proven wrong).
The Drowning claims to do this, but really it just paths for you; there is no straffing, jumping or backwards motion, as far as I know, and you aren't free to just move constantly in arbitrary directions.
I know this wasn't really the point of the article, just saying.
So like Andy Lundell sayd, it's because they were not meant for that in the beginning. As game designer/developper, we've to find a good balance between ergonomy, screen visibility, and responsivity.
Anyway, you should try "League of Evil" for the 2d controls, i really liked it as a 2d plateformer/pixel art.
Thanks for sharing!
I recently worked on a game called Finger Ninjas Zombie Stirke-force which uses a very intelligent and intuitive attack pathing system (rather than a thumb-stick) but to this day the game's largest complaint is that the controls are 'terrible' or 'frustrating' -and people want a more traditional control mechanism (perhaps just the more vocal ones). In fact it seems to be one of the biggest polarizing factors when people comment on the game.
I think that when a game introduces any kind of 'new' or different control scheme devs will always be faced with overcoming the traditionalist barrier -regardless of how appropriate or innovative the controls may be.
Check out 1-bit Ninja, I released it on iOS back in 2011, it's a platformer that uses exactly the control scheme you described. I went with this control scheme after brainstorming ways of creating a precision platformer without traditional onscreen controls (which I'm generally not a fan of).
Here's some thoughts I wrote about it at the time: http://kode80.com/2011/05/04/introducing-1-bit-ninja/
You give a child a toy/game, and if they like the goals and what's on screen, they will learn and adapt to whatever control interface you give 'em -- just like we did as kids. Then later, the child begins to understand what controls work best for specific game types.
By 8 or 9 years old I already had a clear impression of why arcade sticks worked well for certain games, versus using d-pad controllers for other games.
I'm sure plenty of kids are growing up today with 1-2 consoles in the house -and- a tablet to game on. They likely recognize when one type of control interface works best with a specific game type -- whether it's motion-based, controller-based, or touch.
I don't think one interface inherently trivializes the other. We've always had a ton of input device options to play video games with, typically designed to exploit a specific design form.
I.e., arcade sticks for fighters, wheels for racers, mouse & keyboard for FPS, etc.
Devices absolutely optimized and fine-tunable for an experience.
That's the beauty of gaming: Input options.
I <3 tablets, but to be honest, the constant touch on the glass causes my fingers to hurt! I suppose it's the next stage of carpel tunnel... Carpel Finger Pad? Glass Tunnel?
Or maybe I'm just pushing too hard!
So many talks this days about [placeholder] is dying, [another_placeholder] is the future.
Not even remotely funny.
Do you people have nothing to do besides pushing out your preeeeecious home-grown ideas?
Write something useful next time please.
Edit: had to edit doue to text in <> disappeared (treated like keywords probably).
And touchscreens have their limitations. I don't think they are going to be able to do some games as well as a game controller or m/k. On the other hand it does some things better. And certain games will be more fun on a touchscreen.
I haven't seen any touch screen game implement a great way to navigate through 3d space and shoot things etc.
In my opinion, to evolve touch control interface, you should study behavior-expectation coordination that means, if a person takes some actions (for touch devices, it must be gestures), you should know what he or she must expect from games. I was thinking about emulating thumb pad on touch devices with this theory.
Virtual thumb pads these days never know what exactly players expect from their inputs. So I'm thinking what it will be like if it can read from my inputs. For example, try to imagine when you move your character with your physical controllers. Except when you try to move slowly, you will find yourself moving thumb sticks very fast all the way to the edge of the thumb stick rims. Then try to imagine that you move your thumb stick fast from proper position, usually that must mean you're trying to follow the edge of the thumb stick rim around and from there, you can get your imaginary pad rim size, and then again, you may get possible position of thumb pad.
I'm not that good at English, so example above might not be that clear to understand. Anyway if you want to make better controls for touch devices, you may want to implement controllers smart enough to figure out what exactly players want from gesture inputs and it will be better if they can learn from players' inputs.