Police officers consistently use less respectful language with Black community members than with white community members, the first systematic analysis of body camera footage shows.
Although subtle, widespread racial disparities in officersā language use may erode police-community relations, researchers warn, saying: āThe many small differences in how they spoke with community members added up to pervasive racial disparities.ā
āOur findings highlight that, on the whole, police interactions with Black community members are more fraught than their interactions with white community members,ā says Jennifer Eberhardt, professor of psychology at Stanford University and coauthor of the study in theĀ Proceedings of the National Academy of Sciences.
The findings about racial disparities in respectful speech held true even after researchers controlled for the race of the officer, the severity of the infraction and the location and outcome of the stop.
To analyze the body camera footage, researchers first developed an artificial intelligence technique for measuring levels of respect in officersā language that they then applied to the transcripts from 981 traffic stops the Oakland (California) Police Department made in a single month.
The data shows that white residents were 57 percent more likely than Black residents to hear a police officer say the most respectful utterances, such as apologies and expressions of gratitude like āthank you.ā
Black community members were 61 percent more likely than white residents to hear an officer say the least respectful utterances, such as informal titles like ādudeā and ābroā and commands like āhands on the wheel.ā
āTo be clear: There was no swearing,ā says coauthor Dan Jurafsky, professor of linguistics and of computer science. āThese were well-behaved officers. But the many small differences in how they spoke with community members added up to pervasive racial disparities.ā
āThe fact that we now have the technology and methods to show these patterns is a huge advance for behavioral science, computer science and the policing industry,ā says Rob Voigt, a linguistics doctoral student and the studyās lead author. āPolice departments can use these tools not only to diagnose problems in police-community relations, but also to develop solutions.ā
The Oakland Police Department, like many police departments nationwide, has been using body-worn cameras to monitor police-community interactions. But drawing accurate conclusions from hundreds of hours of footage can be challenging, Eberhardt says. Just ācherry-pickingā negative or positive episodes, for example, can lead to inaccurate impressions of police-community relations overall.
āThe police are already wary of footage being used against them. At the same time, many departments want their actions to be transparent to the public.ā
183 hours of footage
To satisfy demands for both privacy and transparency, the researchers needed a way to approach the footage as data showing general patterns, rather than as evidence revealing wrongdoing in any single stop.
Yet āresearchers canāt just sit and watch every single stop,ā Eberhardt says. āIt would take too long. Besides, their own biases could affect their judgments of the interactions.ā
So, researchers examined transcripts from 183 hours of body camera footage from 981 stops, which 245 different OPD officers conducted in April 2014.
In the first phase of the study, human participants examined a subsample of the transcribed conversations between officers and community members ā without knowing the race or gender of either ā and rated how respectful, polite, friendly, formal and impartial the officersā language was.
In the second phase, the researchers used these ratings to develop a computational linguistic model of how speakers show respect, including apologizing, softening commands and expressing concern for listenersā well-being. They then created software that automatically identified these words, phrases and linguistic patterns in the transcripts of the officersā language.
In the third phase, researchers used this software to analyze the remaining transcripts ā a total of 36,000 officer utterances with 483,966 words. Because the team had so much data, they could statistically account for the race of the officer, the severity of the offense and other factors that could affect officersā language.
āUnderstanding and improving the interactions between the police and the communities they serve is incredibly important, but the interactions can be difficult to study,ā Jurafsky says. āComputational linguistics offers a way to aggregate across many speakers and many interactions to detect the way that everyday language can reflect our attitudes, thoughts and emotions ā which are sometimes outside of our own awareness.ā
āOur findings are not proof of bias or wrongdoing on the part of individual officers,ā Eberhardt cautions. āMany factors could drive racial disparities in respectful speech.ā
Tone of voice
The research team is currently extending their work to analyze the language used by community members during the traffic stops and to study other linguistic features captured by the body cameras, including tone of voice. They also plan to explore the interplay of officersā and community membersā speech as it unfolds over time.
āThere is so much you can do with this footage,ā Eberhardt says. āWe are very excited about the possibilities.ā
Eberhardt praised the City of Oakland and OPD for being open to having their data examined and said she hopes that other departments across the country will invite similar collaborations.
āIām hopeful that, with the development of computational tools like ours, more law enforcement agencies will approach their body camera footage as data for understanding, rather than as evidence for blaming or exonerating. Together, researchers and police departments can use these tools to improve police-community relations.ā