Gamasutra is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Gamasutra: The Art & Business of Making Gamesspacer
Tracking Player Feedback To Improve Game Design
arrowPress Releases
June 28, 2022
Games Press
View All     RSS
If you enjoy reading this site, you might also want to check out these UBM Tech sites:


Tracking Player Feedback To Improve Game Design

August 7, 2007 Article Start Page 1 of 3 Next

This article is about creating a window into player activities by using passive tracking systems to measure and improve the player experience.

We’ll start by looking at simple example from the television show to illustrate how using target audiences (potential customers) along with an iterative process of experimentation and observation can help improve product quality. We will then go over the people, tools and techniques that went into building this capability at BioWare.

Sesame Street

When I originally read this story in the “Tipping Point” by Malcolm Gladwell I thought it was a good simple real-world example to illustrate using target audiences to test product during the development process without getting into complex implementation details which I cover in the second part of this article. I’ve kept this part brief and would recommend reading the book.

“In the late 1960s a television producer named Joan Cooney set out to start an epidemic. Her target was three-, four-, and five-year-olds. Her agent of infection was television and the ‘virus’ she wanted to spread was literacy.” 1 Sesame Street was the show.

There were a couple of must have’s in this equation - a good idea and a team of passionate and talented people to make it a reality. The team did a lot of research and wanted to bring in an expert to help measure and improve the show’s quality. They hired Ed Palmer, a psychologist and pioneer in the research of television as an educational tool. He developed a simple test process to measure the show’s “stickiness” (engagement) that is its ability to hold the audience’s attention and aptly named it “The Distracter”.

In one example, the test audience was setup with an episode of Sesame Street which was setup next to a slide show intended to steal away their attention. The audience was observed and time-stamped notes were taken whenever a portion of the test audience lost interest. The information was then passed back to the development team for review and resulted in many improvements.

The process was simple – hire an expert, define a test process, test the product with the target audience, objectively observe and recording findings, review, improve and repeat as needed. The show’s longevity is a testament to its success after some 37 seasons and 4134 shows.

Now applying this to interactive entertainment software is a little more complex – since each experience is different (non-linear) we need to look at a large number of individual samples and track a considerable amount of data (events and status information), aggregate the information, analyze it and generate valuable information out of it since the experiences can vary widely.

1 Malcolm Gladwell, The Tipping Point: How Little Things Can Make A Big Difference ( Little, Brown and Company ), p.89

Article Start Page 1 of 3 Next

Related Jobs

Treyarch — Playa Vista, California, United States

Associate Systems Designer (Zombies) - Treyarch
Immutable — APAC, Remote, Remote

Game Economy Designer
innogames — Hamburg, Germany

Java Software Developer - Rise of Cultures
innogames — Hamburg, Germany

Game Designer - Forge of Empires

Loading Comments

loader image