Can we create a measure of fluid intelligence using Puzzle Creator within Portal 2?

Researchers have suggested that video games can be used to measure cognitive abilities (e.g., Boot, 2015). To that end, we wanted to test the feasibility of developing a measure of fluid intelligence within a commercially-available video game. We created a 15 chamber (i.e., problems to be solved) test called the “Portal 2 Test Battery” using the Puzzle Creator within the popular problem-solving video game Portal 2. In study 1, 35 video game players (VGPs) who had experience playing Portal 2 completed this test and Ravens Advanced Progressive Matrices (RAPM), a validated measure of fluid intelligence, revealing a strong relationship (r=.65) between the two. In study 2, 100 participants, both VGPs and non-video game players (nVGPs) completed the Portal 2 Test Battery, RAPM, and the Bochumer Matrices Test (BOMAT), another validated measure of fluid intelligence. Structure equation modeling revealed a strong relationship between the latent variables fluid intelligence and portal ability (r=.78). Additionally, the reliability of our test was acceptable in both studies (α=.80 and α=.76). These results provide the first evidence that it may be feasible to create a measure of fluid intelligence using the Puzzle Creator within Portal 2. •Researchers have suggested that video games can be used as measurement tools.•We created the Portal 2 Test Battery using Puzzle Creator within Portal 2.•Our data show that it may be feasible to measure fluid intelligence with this test.•Researchers should consider designing measures of cognition within video games.