Researchers Assume White Americans Are More Representative Of Humankind Than Other Groups, According To Analysis Of Psychology Paper Titles

By Matthew Warren

It’s well-known that psychology has a problem with generalisability. Studies overwhelmingly involve “WEIRD” participants: those who are western and educated, from industrialised, rich and democratic societies. And while there is increasing recognition that other populations need better representation in research, many psychologists still often draw sweeping conclusions about humanity based on results from a narrow portion of the world’s population.

A new study published in Social Psychological and Personality Science suggests that this problem may have had another, more insidious effect. The authors argue that because of psychology’s traditionally narrow focus, we’ve ended up implicitly assuming that results of studies on WEIRD groups — particularly white Americans — are somehow more universally generalisable than those from other populations.

The study, led by Bobby Cheon at Nanyang Technological University in Singapore, looked at the way in which participant samples were described in the titles of psychology papers. Their logic was simple: article titles are written to get across the most important bits of information about a study, which includes highlighting key features of the sample that might constrain how applicable the results are. For instance, if a study is conducted on children, this will probably be mentioned in the title, so that the reader immediately knows that the results may not apply to adults.

Similarly, some study titles include information about participants’ ethnicity or country of origin. Again, the implication is that the results might not apply to people outside of that group. So if I’m a US-based researcher looking at how access to parks influences our mental health, I might call my study either “The role of green space in the mental wellbeing of adults”, or “The role of green space in the mental wellbeing of American adults”. The latter suggests that the results might not apply in, say, the United Kingdom or India.

The team looked at the titles of 2,088 articles published in 49 prominent psychology journals between 2004 and 2017, all of which were picked out because the title specifically mentioned the ethnicity, nationality, culture or race of participants. Just 14.7% of these titles mentioned that participants were of American origin, and 34.8% mentioned a sample from a WEIRD region outside of the US (e.g. “Exercise improves healthy diet: Evidence from an Australian sample”). These figures were both significantly lower than the 50.5% that mentioned a sample from a non-WEIRD region (e.g. “Bidirectional engagement among Indian students and teachers”).

The fact that research on non-WEIRD groups so often mentions participants’ origins in the title implies a belief that these studies might not generalise but rather only apply to that specific culture. By comparison, the fewer instances of titles mentioning participants’ origin for research conducted on WEIRD groups, and on Americans in particular, suggests these groups are considered more representative of humanity as a whole.

It’s important to note that the vast majority of psychology research is conducted on WEIRD participants and North American samples in particular; according to some analyses, participants from Asia, Africa and Latin America are included in just a small percentage of papers in leading psychology journals. So it’s not the case that the small number of titles specifying American samples is due to there being fewer papers on Americans in general.

Of course, there may often be the best of intentions behind calling out under-represented groups in the title of papers, particularly when we are used to psychologists studying white, Western participants by default. But as the authors point out, “the bias in the tendency to qualify sample characteristics in titles may reflect and/or reinforce a subtle form of infrahumanization … in which the nature, experiences, and behaviors of some populations are assumed to be a better reflection of humanity than others.” And, unfortunately, the team found that this bias has actually got worse in recent years.

In a second analysis, the researchers looked at the titles of a further 945 articles from around the world which specified that the research had been conducted on a minority group from that country. The vast majority of these (85.4%) were from the United States (e.g. “Developmental trajectories of African American youths”). In contrast, the team only found 32 titles which specified that a sample consisted of white Americans. This suggests that within the United States, results from white Americans are considered more generalisable than those from minority groups.

So what’s the solution? The researchers say there should be standardised practices for reporting the population being studied. Editors also have a responsibility, they add:  journals should avoid framing research conducted outside of the United States as “cultural”.

I’d add that outlets reporting on psychology research — including Research Digest! — also need to be more aware of the way they frame research.  It’s important to acknowledge the limitations of research, and that often involves explaining who the participants in a study were. But it becomes a problem if you consistently highlight the limitations of generalising from studies on participants from China or Brazil, for instance, while describing American or UK-based research in generic terms.

How USA-Centric Is Psychology? An Archival Study of Implicit Assumptions of Generalizability of Findings to Human Nature Based on Origins of Study Samples

Matthew Warren (@MattBWarren) is Editor of BPS Research Digest

3 thoughts on “Researchers Assume White Americans Are More Representative Of Humankind Than Other Groups, According To Analysis Of Psychology Paper Titles”

  1. You conclude that “…it becomes a problem if you consistently highlight the limitations of generalising from studies on participants from China or Brazil, for instance, while describing American or UK-based research in generic terms.” I wonder if this might suggest the value of one or more studies on whether earlier studies that did or did not mention the makeup of their participants do in fact generalize or not. I am not suggesting that it is in any way fine that studies show this clear bias in the selection of groups to study. I am thinking that it might be valuable to know if and when studies on limited populations do or do not generalize. Would such studies provide a basis for how to reframe study reports of participant makeup and make it less necessary to “highlight the limitations” because it turns out they are not a problem?

    Like

  2. Professor Emeritus Ferrel Christensen (PhD in Philosophy of Science; lower degrees in physical sciences, also, informal but years of study in sex and gender, where biology and anthropology can give it worth. says:

    Well, Duh.That this conclusion seems un-obvious enough to be considered news is astonishing. The vast majority of subjects in studies conducted by WEIRD social scientists have long been, not only themselves WEIRD (because close at hand in time and space), they have been university pupils taking classes from said naive scientists . Only field-working anthropologists have escaped this foolish trap to an appreciable degree. Brain-probes invented in the physical scientists have begun to provide a partial solution. But for the most part, “social science” is still nowhere near being science. E. g., the recent fuss over the “Dark Triad” is about as enlightening as Aristotle’s earth, air, fire and water theory–it is barely a start. (Yes, they often use (and mis-use) sophisticated statistics, but the results are largely “Garbage in, garbage out”.) There is a long way to go.

    Like

  3. I think this article is generalisable to other issues as well. Any research related to society and culture has been predominantly focused on the WEIRD population when a large part of the world doesn’t share the same culture and beliefs. Maybe a starting point is mentioning the culture or ethnicity of the participants in every research paper, because the differences need to be respected. I believe no study is truly generalisable for the entire population unless the participants include people from around the world. As you say, a study done on white Americans is about as generalisable as one done on people in China – that is to say, generalisable only in that particular culture.

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s