Contents
Practical Game Playtesting: A Wii-Based Case Study
 
 
Printer-Friendly VersionPrinter-Friendly Version
 
Latest News
spacer View All spacer
 
November 22, 2009
 
Video Game Watchdog National Institute On Media And The Family Shutting Down [12]
 
Modern Warfare 2 Infinity Ward's 'Most Successful PC Version' Yet [15]
 
New Tech, Design Details Of Project Natal To Emerge At Gamefest In February
spacer
Latest Jobs
spacer View All     Post a Job     RSS spacer
 
November 22, 2009
 
Trion Redwood City
Sr. Environment Artist
 
Trion Redwood City
Sr. Evnironment Modeler
 
Sucker Punch Productions
Network Programmer
 
Sucker Punch Productions
Texture Artist
 
Sucker Punch Productions
Character Artist
 
Sucker Punch Productions
3D Environment Artist
 
Crystal Dynamics
Sr. Level Designer
 
Sony Online Entertainment
Brand Manager
spacer
Latest Features
spacer View All spacer
 
November 22, 2009
 
arrow Upping The Craft: Susan O'Connor On Games Writing [7]
 
arrow Small Developers: Minimizing Risks in Large Productions - Part II [7]
 
arrow iPhone Piracy: The Inside Story [51]
 
arrow And Yet It Grows: Analyzing the Size and Growth of the European Game Market [5]
 
arrow NPD: Behind the Numbers, October 2009 [13]
 
arrow Reflecting On Uncharted 2: How They Did It [5]
 
arrow Sponsored Feature: Rasterization on Larrabee -- Adaptive Rasterization Helps Boost Efficiency
 
arrow Postmortem: Wadjet Eye's The Blackwell Convergence [2]
spacer
Latest Blogs
spacer View All     Post     RSS spacer
 
November 22, 2009
 
Managing Creativity
 
Time Fcuk - A Postmortem [3]
 
Accepting the Inherent Value of Games [1]
spacer
About
spacer News Director:
Leigh Alexander
Features Director:
Christian Nutt
Editor At Large:
Chris Remo
Advertising:
John 'Malik' Watson
Recruitment/Education:
Gina Gross
 
Features
  Practical Game Playtesting: A Wii-Based Case Study
by Gareth Griffiths
7 comments
Share RSS
 
 
January 15, 2009 Article Start Previous Page 4 of 4
 

UI Issues

Ah, the dreaded UI. I'm sure every developer has had issues with their UI and this was no exception. The UI relayed information as and when it was needed. For example, it told the user if their health was low, or that boost was available.

Advertisement

Additionally, the color of the flame coming from the car would change in relation to its health. Therefore when the color was a deep red, the car was pretty much on its last legs and an explosion was imminent.

What we had decided, however, was that this would be available for early races -- but to increase the challenge, it would be removed for later stages. It was hoped that the player would become more adept at using the UI and be aware of their car situation. This was not the case.

The first time we implemented this, players kept blowing up and, from their perspective, they had no idea why. The problem here was that players were becoming accustomed to the game informing them about their status, and when it no longer did this, instead of learning how to play the game without it, they just blew up.

The first thing we did to try and solve this was to simply remove it altogether -- to force the player into learning how the UI worked. Unfortunately this approach completely backfired, with players simply blowing up all over the place. This was not a good turn of events.

So, the only thing left was to put everything back in and make sure it flashed up whenever the player's health was low or when boost was available. This is actually an interesting situation, because it shows how much players rely on the game informing them about important states.

How far behind or in front of me are you?

One significant thing about the tracks in Speed Racer is that they are pretty long. The problem with this was that players sometimes found that they had no real idea where they were in relation to the other cars, and actually found themselves wanting more in-race information.

This was intriguing because no other racing game required this kind of feature. As long as players saw what position they were, they were usually happy. However, it seemed that when a race was quite long, then more information was needed as a result.

The solution to this was to include position information to the left of the screen. This showed the person in first place, the person immediately before the player, the player, and the person immediately behind the player. This was all in relation to the player's position, so the times were all relative, and as a result of this, we were able to give players the information they required.

They were able to immediately ascertain how far ahead the next player was and also how far ahead the first position was. Not only did this aid the players, but we found it actually increased the challenge level of the game, too -- a win-win scenario. This is shown in Figure 4.


Figure 4. Racing UI

Discussion

The solutions we found for the above issues were also adapted and used in one way or another for many of the others found within the game, and by spending time playtesting, which did not tax the development process, as sessions can be run concurrently with development itself, we removed a huge number of issues that would otherwise have potentially remained within the game after it had shipped.

You need to ask what would have happened if that had been the case. It is certain that not only would the reviews have been a lot lower, but the word of mouth between the players themselves would have been extremely negative too.

The final part of playtesting is to verify that the changes you have made actually work. This is a relatively easy matter and can be carried out when running other sessions. Observing if issues come up or not will quickly determine whether the problems have been solved.

However, it is entirely feasible that problems still occur -- but chances are that there will still have been a drastic improvement. Simply keeping an eye on problems during the sessions should reveal that any required changes will probably only be a few simple tweaks here and there.

For us, the whole game simply evolved over the months, as we were able to fine-tune everything within the game (time permitting) so that whenever a person picked it up -- be it a child or adult -- they would be able to instantly drive the car and perform every action possible.

Conclusion

It can be daunting to go back to the developers with a load of bad news, because these guys work their butts off. To have someone come up to them with a list of negatives is surely not going to be viewed favorably.

However, this is where a willingness to be open and a commitment to free communication is essential.

The developers need to understand that they are not being criticized; instead, they must understand that the information is simply there to enhance the already great work they do. I'm lucky at Sidhe, because people are always willing to listen and to take on ideas and to use the reports constructively.

Regular playtesting with external players is not merely important when developing games. It is vital. Only by getting first-hand player feedback can we know where the problems truly lie within the game.

Those of who play the game every day learn to compensate for many of the problems with our own shortcuts, and can never look upon the game with fresh eyes. Real-world gamers will never play like this.

 
Article Start Previous Page 4 of 4
 
Comments

Robert Allen
profile image
Thank you for an article with such a high signal to noise ratio, jam packed with useful information!

Razien Bordello
profile image
Thank you!

Great article, and great game! I wished the movie had a better success, and that the game got more sales. It is really shameful that such work is ignored by the public while shovelware gets million sales.

Jerome Strach
profile image
From a QA perspective, it is incredibly important that developers check their egos at the door and learn to embrace the feedback from focus group testing. You cannot get this information early enough by the way; how else will you have an opportunity to embed solutions within the code.

An excellent article that reinforces key strategies to help ensure a broad acceptane of an entertainment product. No you shouldn't design to "please everyone", but quite often it's the simple tweaks that make the world of difference.

Dave Mitchell
profile image
Really great article, thanks :)

Roberto Alfonso
profile image
Great article!

"Shunt issue" reminds me of an issue with Wii Fit, with the soccer minigame where the players need to balance left or right to hit the ball with their head. The problem was that the developers coded it so that the character would move the way the players pressed the board, however they missed the fact that, when in equilibrium, the player would slightly press with their opposite foot to quickly move to the other (so if you are standing and want to balance left, you would first press with your right foot to swing left, instead of gradually letting your weight on the left side). Therefore first players almost always have problems with that game, since the board reads both and the character just stays in the middle.

What you assume as a programmer is never what the end user wants, no matter the industry. For example, who the heck likes the Visual Studio 2005 immediate window after having used the Visual Studio 6 one for years?

Shawn Yates
profile image
Great article, made for a very interesting read. Game testing is a huge part of making appealing games and I think that some designers let their ego get in the way of fully appreciating the full value of playtesting. Great charts btw!

Bob McIntyre
profile image
Great, specific detail in here. Very useful information. Thanks for writing this article!


none
 
Comment:
 


Submit Comment