660 likes | 769 Vues
Learn how optimization techniques such as A/B testing and player tracking impact game engagement, retention, and revenue. Discover the significance of metrics like levels completed, time played, and return rate. Explore the role of aesthetics and secondary objectives in games like Foldit and Hello Worlds. Analyze the impact of animations and secondary objectives on player engagement, with practical examples from popular games. Uncover insights on how specific game elements like coins and design choices affect player behavior and game performance.
E N D
Game Optimization through Large-Scale ExperimentationErik AndersenPh.D. studentCenter for Game ScienceUniversity of Washington Computer Science Dept.
Music Art Sound effects Gameplay
? engagement retention revenue
A/B Testing A B
Metrics • Levels completed • Time played • Return rate
Aesthetics Secondary Objectives Tutorials
Foldit Refraction Hello Worlds
Rating: 3.8 / 5 400,000 plays
Rating: 4.2 / 5 1,385,000 plays
Player Tracking • Flash cache / login name • New players only
Statistical significance 95% confidence level (p<0.05)
Music Experiment #1: Audio Sound Effects
Result: Music and sound effects did not matter
Result: Animations improved engagement
Refraction No Animations
Refraction No Animations
Refraction No Animations
Hello Worlds No Animations
Hello Worlds No Animations
Experiment #3: Secondary Objectives (Super Mario Bros., Nintendo 1985)
100 % of players 0 Levels
Hypothesis 100 With Coins % of players 0 Levels
Reality 100 With Coins % of players 0 Levels
What about time played? 100 % of players 0 Time
Hypothesis 100 With Coins % of players 0 Time
Hypothesis 100 With Coins % of players 0 Time
Reality: Many Players Quit Sooner 100 With Coins % of players 0 Time
100 % of players 0 Time
Result: secondary objectives harmed engagement
Maybe easier is better? (Super Mario Bros., Nintendo 1985)
100 Off-path Coins % of players 0 Time
100 On-path Coins % of players 0 Time