Now let's look at the Game Specific Test Plan approach used by Functional, which is quite different to the FTCs and uses a common template, comprised of multiple sections. These include Team Setup, Test Direction, Generic Checks, Age Rating Checks and Achievement Checks. The Team Setup is used to map a broad cross section of system and game settings to the size of the assigned test team.

The point of the Test Direction is to establish the overall test goals and strategy for testing the game, and to break those down into test objectives and instructions for each tester. The Generic Checks are a set of general checks tested against every game, by game mode, game type, mission, level, etc., and ensure they very broadly test the really critical features and functionality in all areas of the game.

Age Rating Checks are used to test that the correct age ratings have been signed into the game for each regional rating board (such as PEGI in Europe), and Achievement Checks ensure that each Achievement can be obtained by the user according to its description or criteria for unlocking.

This combined approach of using the FTCs and a Game Specific Test Plan, enables Functional to achieve a massive amount of testing coverage on every game submitted. Not only can they test deep into a game's core story or campaign mode, but also hit a very wide array of options, settings, difficulties and paths in every game mode.

Another very important area of work for Functional is their reporting. Reporting is handled via an internally developed bug tracking database, which allows them to log, track, and share issues amongst any of their internal team members and partners very efficiently. The same database is also used by Compliance, meaning that a consistent look and feel is maintained throughout the reporting process for their partners, regardless of the area issuing the reports.

It also means that reports can very easily be issued to their external partners virtually at the touch of a button, as long as those partners have access to the aforementioned team's website. XNA Game Quality send out reports at the end of testing every day to update their partners with the status of their games.

Whilst games are undergoing testing they receive a daily Functional Interim Report, and then at the end of test they receive a Final Functional report in the case of a Final-Cert, or a Test Complete report in the case of an Optional Final-Cert.

Bugs are reported as a Priority 1, 2 or 3 depending on the seriousness of an issue, which takes into account the nature of a bug, its frequency and likelihood of being seen. In addition, bugs are classified by type, of which the key ones are CFR, ION and SRI. CFRs (Conditions for Resubmission) are the most seriously viewed issues, and these must be fixed before a game is resubmitted.

IONs (Issues of Note) are issues XNA Game Quality doesn't require be fixed, but views seriously enough to highlight to the publisher in case they feel differently about them. SRIs (Standard Reporting Issues) are all other issues they like to make their partners aware of.

Common issues that Functional consider to be very serious include:

• Unable to complete game or game objective: any issue that prevents the user from finishing key objectives/missions or gaining Achievements
• Unable to save/load game data: problems with saving and/or loading user game save data
• Game deletes game data without confirmation: any issue which causes the user to lose game save data without warning
• Unable to play against an updated version of the same game over System Link or Xbox LIVE: Title updates should not introduce incompatibility problems without notifying the user

Functional, along with the rest of XNA Game Quality, are always reviewing and continually striving to improve their processes and the services they offer to their publishing and development partners. It's because of this that they're keen to stress the importance of XNA Game Quality's email support service, which can be used to submit queries and feedback about any aspect of certification.

Whether it's an enquiry about a TCR, Test Case, or FTC, a question about how seriously XNA Game Quality view a particular issue, or feedback on a recent training visit, they are always happy to hear the voice of their partners and customers. The team always does their best to ensure their partners receive a timely response to their email, and if a member of the team cannot personally help, they will put them in touch with somebody who can help. So keep sending those questions in!

Final Words

Well now, if you've managed to get this far, then we hope you've found this article an informative and interesting read, whilst being an insightful glimpse into the world of XNA Game Quality. The team firmly believes the work they do to help ensure that games that operate on Microsoft's platforms and services comply with certain minimum quality standards, benefits everyone involved from their partners to the end user.

Without the great games and amazing support from their publishing and development partners and customers, the team realizes that the Xbox and Games for Windows platforms wouldn't be what they are today, and as such would like to pass on their sincerest thanks to all of these people.

If you were in any doubt before reading this article about what certification is, and what XNA Game Quality does, then we very much hope that you now have a much better appreciation of these concepts, and the great work the team does.

For more information about Games for Windows Branding and Games for Windows - LIVE platform certification, please stay tuned for future articles on both of these over the coming months.