Photo-Illustration: Sam Whitney; Getty Images
Tech conglomerate Tencent caused a stir last year with the announcement that it would comply with Chinaâs directive to incorporate facial recognition technology into its games in the country. The move was in line with Chinaâs strict gaming regulation policies, which impose limits on how much time minors can spend playing video gamesâan effort to curb addictive behavior, since gaming is labeled by the state as âspiritual opium.â
The stateâs use of biometric data to police its population is, of course, invasive, and especially undermines the privacy of underage usersâbut Tencent is not the only video game company to track its players, nor is this recent case an altogether new phenomenon. All over the world, video games, one of the most widely adopted digital media forms, are installing networks of surveillance and control.
In basic terms, video games are systems that translate physical inputsâsuch as hand movement or gestureâinto various electric or electronic machine-readable outputs. The user, by acting in ways that comply with the rules of the game and the specifications of the hardware, is parsed as data by the video game. Writing almost a decade ago, the sociologists Jennifer R. Whitson and Bart Simon argued that games are increasingly understood as systems that easily allow the reduction of human action into knowable and predictable formats.
To view this video please enable JavaScript, and consider upgrading to a web browser that supports HTML5 video WATCH Military Historian Breaks Down Medieval Weapons in Video Games Share Tweet Email More... EMBED URL<script async src="//player-backend.cnevids.com/script/video/5fe3577dcc196a56c78e6326.js?iu=/3379/conde.wired/partner"></script> VIDEO URLhttps://www.wired.com/video/watch/military-historian-breaks-down-medieval-weapons-in-video-games Our bad! It looks like we're experiencing playback issues. The live event has ended. Please check back again soon for the recorded video. LIVEVIDEO TO BEGIN AFTER ADLoaded: 0%Progress: 0% UnmuteVolume 0% Back Caption Options Close Settings Language ⢠English Font Size ⢠Small ⢠Medium ⢠Large Position ⢠Auto ⢠Bottom ⢠Top Sample Caption TextCurrent Time 0:00Duration 0:00Remaining Time -0:00
Video games, then, are a natural medium for tracking, and researchers have long argued that large data sets about playersâ in-game activities are a rich resource in understanding player psychology and cognition. In one study from 2012, Nick Yee, Nicolas Ducheneaut, and Les Nelson scraped player activity data logged on the World of Warcraft Armory websiteâessentially a database that records all the things a playerâs character has done in the game (how many of a certain monster Iâve killed, how many times Iâve died, how many fish Iâve caught, and so on).
The researchers used this data to infer personality characteristics (in combination with data yielded through a survey). The paper suggests, for example, that there is a correlation between the survey respondents classified as more conscientious in their game-playing approach and the tendency to spend more time doing repetitive and dull in-game tasks, such as fishing. Conversely, those whose characters more often fell to death from high places were less conscientious, according to their survey responses.
Correlation between personality and quantitative gameplay data is certainly not unproblematic. The relationship between personality and identity and video game activity is complex and idiosyncratic; for instance, research suggests that gamer identity intersects with gender, racial, and sexual identity. Additionally, there has been general pushback against claims of Big Dataâs production of new knowledge rooted in correlation. Despite this, games companies increasingly realize the value of big data sets to gain insight into what a player likes, how they play, what they play, what theyâll likely spend money on (in freemium games), how and when to offer the right content, and how to solicit the right kinds of player feelings.
While there are no numbers on how many video game companies are surveilling their players in-game (although, as a recent article suggests, large publishers and developers like Epic, EA, and Activision explicitly state they capture user data in their license agreements), a new industry of firms selling middleware âdata analyticsâ tools, often used by game developers, has sprung up. These data analytics tools promise to make users more amenable to continued consumption through the use of data analysis at scale. Such analytics, once available only to the largest video game studiosâwhich could hire data scientists to capture, clean, and analyze the data, and software engineers to develop in-house analytics toolsâare now commonplace across the entire industry, pitched as âaccessibleâ tools that provide a competitive edge in a crowded marketplace by companies like Unity, GameAnalytics, or Amazon Web Services. (Although, as a recent study shows, the extent to which these tools are truly âaccessibleâ is questionable, requiring technical expertise and time to implement.) As demand for data-driven insight has grown, so have the range of different servicesâdozens of tools in the past several years alone, providing game developers with different forms of insight. One toolâessentially Uber for playtestingâallows companies to outsource quality assurance testing, and provides data-driven insight into the results. Another supposedly uses AI to understand player value and maximize retention (and spending, with a focus on high-spenders).
Developers might use data from these middleware companies to further refine their game (players might be getting overly frustrated and dying at a particular point, indicating the game might be too difficult) or their monetization strategies (prompting in-app purchasesâsuch as extra livesâat such a point of difficulty). But our data is not just valuable to video game companies in fine-tuning design. Increasingly, video game companies exploit this data to capitalize user attention through targeted advertisements. As a 2019 eMarketer report suggests, the value of video games as a medium for advertising is not just in access to large-scale audience data (such as the Unity ad networkâs claim to billions of users), but through ad formats such as playable and rewarded advertisementsâthat is, access to audiences more likely to pay attention to an ad.
These advertisements serve numerous ends, such as facilitating user acquisition (ads for other games or apps), and increasingly, brand advertising. Similar to the approach of digital advertising giants Google and Facebook, where the data generated by platform users (clicks, swipes, likes, dislikes, purchases, movements, behaviors, interests, and so on) supposedly facilitates the placement of advertisements in front of the ârightâ audiences (as Unityâs executives note in a transcript of a recent quarterly earnings call), video game companies are attempting to harness the billions of interactions that take place within their games to create new revenue streams. These companies sell the eyeballs (and perhaps fingers, with playable ads) of their users to advertisers and mobilize data to best match users with advertisers based on the specifications of the advertiser or the software working on the advertiserâs behalf.
The data-richness of video games has also had an impact beyond the video game industryâs attempts to shape player attention. The logic of games is used to gamify functions and derive information that might not have been otherwise volunteered. Indeed, Yee and colleaguesâ study of World of Warcraft player motivation frames the value of correlating sentiment or personality with user activity around the growth of gamification in society. To better understand how and why people play games in certain ways is, as the authors suggest, to better understand how to make gamelike interfaces beyond the context of gaming more compelling.
For instance, the Go365 health insurance app solicited information from usersâsuch as blood glucose levels, sleep cycle, diet, whether they drink or smoke, or wider family medical historiesâ using gamification logics of points and rewards to develop (more profitable) personalized insurance profiles. These identified categories of risk that preclude some from certain kinds of insurance or drive up their premiums.
A 2017 article in The New York Times revealed that Uberâs driver interface used gamification techniques like rewards and points to create a âperfectly efficient systemâ where driver supply can meet rider demand. Crucially, the article revealed that Uberâthrough employing both social and data scientistsâoptimized these systems for compelling continued labor sustaining the platform.
Beyond gamification techniques optimized using data, we are beginning to see the use of gamification techniques to generate data about worker performance. Amazonâs warehouses are reportedly beginning to gamify labor to further make workers keep to âAmazon paceâ (somewhere between walking and jogging)âa move that quite literally resembles the plot of an episode of the dystopian television show Black Mirror. As The Washington Post has reported, high performance in these (currently optional) gamesâwith titles like MissionRacer, PicksInSpace, Dragon Duel, and CastleCrafterâcan be exchanged for âSwag Bucks, a proprietary currency that can be used to buy Amazon logo stickers, apparel or other goods.â Under the guise of gamification, it is not a stretch to imagine how workers may be further disciplined through more invasive data-veillance in order to intensify their productivity at the expense of their welfare.
Because video games are systems that translate human inputs into machine-readable data, they have been afforded important status in driving so-called Silicon Valley innovation. One area has been the application of games in the development of AI. In a kind of one-upmanship of chess-playing algorithms, Alphabetâs AlphaStar AI and OpenAIâs OpenAI Five were trained to play the strategy games Starcraft 2 and Dota 2, respectivelyâfamously, besting some of the worldâs top players. To do so, these AI were trained using techniques like reinforcement learning, where essentially the AI played matches against itselfâchurning through thousands of yearsâ worth of gameplay (and learning from this data) within months.
For these companies, learning to play video games at a high level isnât the end goal. For a company like OpenAI, training on Dota 2 has applications to physical robotics. Darpaâthe Department of Defenseâs research and development armâhas sponsored efforts to use games to develop AI for military application. Gamebreakerâa project that engages both academia and industry (including defense and arms contractors like Lockheed Martin and Northrop Grumman)â aims to use video-game-playing âAI to exploit engagement models ⌠to enable intelligent systems that could in turn enhance military strategy.â
Training AI on complex gamesâgames that take humans thousands of hours to masterâalso serves to drum up support for AI, selling it to investors, policymakers, and publics as something credible amid growing criticism about exaggerated (or outright fraudulent) claims of its efficacy and veracity. If we are told that AI can master Starcraft, then it might make us feel a bit better about the prospect of AI driving a car, assessing debt, and so on.
More speculatively, video games are aligning with the development of new forms of embodied computing interfaces, a training ground for technologies such as brain-computer interfaces (BCI)âaugmenting brain capabilities with computation. Valve Corporation founder Gabe Newell, whose company an early adopter of BCI in the video game industry, suggests that BCI enabled games, built into things like future VR headsets, could well track data points telling us whether people are happy, sad, surprised, or bored. Recently, The Financial Times reported on a series of patents granted to Meta that suggest that future augmented and virtual reality headsets (where the company sees gaming as one major application) may use biometric data (such as gaze, in one patent) leveraged for purposes such as advertising. In this sense, not only can games be used to make inferences about us from our choices, the value proposition of forms of embodied computing interfaces from VR to AR to BCIs is to provide access to the physiological processes underpinning those choices.
Consternation about digital technologies harvesting our data is increasingly common. Video games are by no means free of critique (see, for instance, concerns around inciting violent behavior, or exposure of children to gambling-like practices), but they have been less afflicted by these critiques regarding data and privacy. While critique of the CCPâs use of games to collect biometric data represents an awareness of how video games might enact surveillance, it is only one such example. We need to think critically and lucidly about video games as mechanisms for extraction and accumulation.
This is not to say that we should resign ourselves to the fact that many games vacuum up our data. Platform alternatives to game development such as Twine or Bitsty show that itâs possible to resist the data capture imperative of engines like Unity. As the video game researcher Aleena Chia and her colleagues have noted, where Unityâs large user-base serves to power the companyâs ad network, software like Twine use its network of users to create a collaborative community developing games that âdirectly contraven[e] accepted videogame conventions.â As these platform alternatives show, what we need is to renegotiate the terms on which we play.
- đŠ The latest on tech, science, and more: Get our newsletters!
- How Bloghouse's neon reign united the internet
- The US inches toward building EV batteries at home
- This 22-year-old builds chips in his parents' garage
- The best starting words to win at Wordle
- North Korean hackers stole $400M in crypto last year
- đď¸ Explore AI like never before with our new database
- đđ˝ââď¸ Want the best tools to get healthy? Check out our Gear teamâs picks for the best fitness trackers, running gear (including shoes and socks), and best headphones