Connect with us

Truth Decay

Beyond Bias

Published

on

December 18, 2023

In a now-classic series of experiments, researchers teased out the deep-rooted nature of human bias simply by distributing red shirts and blue shirts to groups of 3- to 5-year-olds at a day care center. In one classroom, teachers were asked to divide children into groups based on the color of their shirts. In another, teachers were instructed to overlook the shirt colors. After three weeks, children in both classrooms tended to prefer being with classmates who wore the same color as themselves—no matter what the teachers did.

This preference for people who seem to belong to our own tribe forms early and drives our choices throughout life. There appears to be no avoiding it: We are all biased. Even as we learn to sort shapes and colors and distinguish puppies from kittens, we also learn to categorize people on the basis of traits they seem to share. We might associate women who resemble our nannies, mothers, or grandmothers with nurturing or doing domestic labor. Or following centuries of racism, segregation, and entrenched cultural stereotypes, we might perceive dark-skinned men as more dangerous than others.

The biases we form quickly and early in life are surprisingly immutable. Biases are “sticky,” says Kristin Pauker, a psychology researcher at the University of Hawaii, “because they rely on this very fundamental thing that we all do. We naturally categorize things, and we want to have a positivity associated with the groups we’re in.” These associations are logical shortcuts that help us make quick decisions when navigating the world. But they also form the roots of often illogical attractions and revulsions, like red shirts versus blue shirts.

Our reflexive, implicit biases wreak devastating social harm. When we stereotype individuals based on gender, ethnicity, sexual orientation, or race, our mental stereotypes begin to drive our behavior and decisions, such as whom to hire, who we perceive as incompetent, delinquent, or worse. Earlier this year, for instance, an appeals court overturned a Black man’s conviction for heroin distribution and the 10-year prison sentence he received in part because the Detroit federal judge who handed down the original verdict admitted, “This guy looks like a criminal to me.”

People who live in racially homogeneous environments may struggle to distinguish faces of a different race from one another.

Correcting for the biases buried in our brains is difficult, but it is also hugely important. Because women are stereotyped as domestic,
they are also generally seen as less professional. That attitude has  reinforced a decades-long wage gap. Even today, women still earn only 82
cents for every dollar that men earn. Black men are perceived as more  violent than white men, and thus are subjected to discriminatory
policing and harsher prison sentences, as in the Detroit case.

Clinicians’ implicit preferences for cisgender, heterosexual patients cause widespread inequities in health care for LGBTQ+ individuals.

“These biases are operating on huge numbers of people repetitively over time,” says Anthony Greenwald, a social psychologist at the
University of Washington. “The effects of implicit biases accumulate to have great impact.”

Greenwald was one of the first researchers to recognize the scope of the problems created by our implicit biases. In the mid-1990s, he created early tests to study and understand implicit association. Along with colleagues Mahzarin Banaji, Brian Nosek, and others, he hoped that shining a light on the issue might quickly identify the tools needed to fix it. Being aware that our distorted thinking was hurting other people should be enough to give pause and force us to do better, they thought.

They were wrong. Although implicit bias training programs help people become aware of their biases, both anecdotal reports and controlled studies
have shown that the programs do little to reduce discriminatory behaviors spurred by those prejudices. “They fail in the most important respect,” Greenwald says. When he, Banaji, and Nosek developed the Implicit Association Test, he took it himself. He was distressed to discover that he automatically associated more positive words with the faces of white people, and more unfavorable words with people who were Black. “I didn’t regard myself as a prejudiced person,” Greenwald says. “But I had this association nevertheless.”

His experience is not unusual. The Implicit Association Test (IAT) measures the speed of subjects’ responses as they match descriptors of people (such as Hispanic or gay) to qualities (such as attractiveness, athleticism, or being professional). It’s based on the idea that people react more quickly when they are matching qualities that are already strongly associated in their minds. Implicit bias exists separately from explicit opinion, so someone who honestly believes they don’t have anything against gay people, for instance, may still reveal a bias against them on the test. “A lot of people are surprised by their results,” Greenwald says. “This is very hard for people to come to grips with intuitively.”

People’s beliefs may not matter as much if they can be persuaded not to act on them.

One reason we are so often unaware of our implicit biases is that we begin to form these mental associations even before we can express a
thought. Brain-imaging studies have found that six-month-old babies can identify individual monkey faces as well as individual humans. Just a
dozen weeks later, nine-month-old babies retain the ability to identify human faces but begin to group all the monkey faces together generically as just “monkey,” losing the ability to spot individual features. Shortly after, babies begin to group human
faces by race and ethnicity. Our adult brains echo these early learning patterns. People who live in racially homogeneous environments may struggle to distinguish faces of a different race from one another.

As it became clear how deeply ingrained these biases are—and how they might be unfathomable even to ourselves—researchers began to design new
types of strategies to mitigate bias and its impact in society. By 2017, companies in the United States were spending  
$8 billion annually on diversity training efforts, including those aimed at reducing unconscious stereotyping, according to management consulting firm McKinsey & Company. These trainings range from online educational videos to workshops lasting a few hours or days in which participants
engage in activities such as word-association tests that help identify their internalized biases.

Recent data suggest that these efforts have been failing too. In 2019 researchers evaluated
the effectiveness of 18 methods that aimed to reduce implicit bias,
particularly pro-white and anti-Black bias. Only half the methods proved
even temporarily effective, and they shared a common theme: They worked
by giving study participants experiences that contradicted stereotypes.
Reading a story with an evil white man and a dashing young Black hero,
for example, reduced people’s association of Black men with criminality.
Most of these strategies had fleeting effects that lasted only hours.
The most effective ones reduced bias for only a few days at best.

Even when training reduced bias, it did little to reduce
discriminatory outcomes. Beginning in early 2018, the New York City
Police Department began implicit bias training for its 36,000 personnel
to reduce racial inequities in policing. When researchers evaluated the
project in 2020, they found that most officers were aware of the
problems created by implicit bias and were keen to address these harms,
but their behaviors contradicted these intentions. Data
on arrests, stops, and stop-and-frisk actions showed that officers who
had completed the training were still more likely to take these actions
against Black and Hispanic people. In fact, the training program hardly
had any effect on the numbers.

This and similar studies have “thrown some cold water on just
targeting implicit bias as a focus of intervention,” says Calvin Lai, a
social psychologist at Washington University in St. Louis. Even if you are
successful in changing implicit bias or making people more aware of it,
“you can’t easily assume that people will be less discriminatory.”

But researchers are finding reason for hope.

Although the dozens of interventions tested so far have demonstrated limited long-term effects, some still show that people can be made more aware of implicit bias and can be moved to act more equitably, at least temporarily. In 2016, Lai and his colleagues tested eight ways of reducing unconscious bias in studies with college students. One of the interventions they tested involved participants reading a vividly portrayed scenario in which a white person assaulted them and a Black person came to their rescue. The story reinforced the connection between heroism and Black identity.

Other interventions were designed to heighten similar connections. For instance, one offered examples of famous Black individuals, such as Oprah Winfrey, and contrasted them with examples of infamous white people, including Adolf Hitler. Participants’ biases were gauged using the IAT both before and after these interventions. While the experiments tamped down bias temporarily, none of them made a difference just a few days later. “People go into the lab and do an intervention and there’s that immediate effect,” Pauker says.

From such small but significant successes, an insight began to emerge: Perhaps the reason implicit bias is stable is because we inhabit an environment that’s giving us the same messages again and again. Instead of trying to chip away at implicit bias merely by changing our minds, perhaps success depended on changing our environment .

The implicit associations we form—whether about classmates who wear the same color shirt or about people who look like us—are a product of our mental filing cabinets. But a lot of what’s in those filing cabinets is drawn from our culture and environment. Revise the cultural and social inputs, researchers like Kristin Pauker theorize, and you have a much greater likelihood of influencing implicit bias than you do by sending someone to a one-off class or training program.

Babies who start to blur monkey faces together do so because they learn, early on, that distinguishing human faces is more critical than telling other animals apart. Similarly, adults categorize individuals by race, gender, or disability status because these details serve as markers of something we’ve deemed important as a society. “We use certain categories because our environment says those are the ones that we should be paying attention to,” Pauker says.

Just as we are oblivious to many of the biases in our heads, we typically don’t notice the environmental cues that seed those biases. In a 2009 study, Pauker and her colleagues examined the cultural patterns depicted in 11 highly popular TV shows, including Grey’s Anatomy, Scrubs, and CSI Miami. The researchers tracked nonverbal interactions among characters on these shows and found that even when white and Black characters were equal in status and jobs and spoke for about the same amount of time, their nonverbal interactions differed. For instance, on-screen characters were less likely to smile at Black characters, and the latter were more often portrayed as stern or unfriendly.

Thinking of implicit bias as malleable allows us to constantly reframe our judgments about people we meet.

In a series of tests, Pauker and her colleagues found that regular
viewers of such shows were more likely to have stronger anti-Black
implicit biases on the IAT. But when the researchers asked viewers
multiple-choice questions about bias in the video clips they saw,
viewers’ responses about whether they’d witnessed pro-Black or pro-white
bias were no better than random. They were being influenced by the bias
embedded in the show, “but they were not able to explicitly detect it,”
Pauker says.

Perhaps the most definitive proof that the outside world shapes our
biases emerged from a recent study of attitudes toward homosexuality and
race over decades. In 2019 Harvard University experimental psychologist
Tessa Charlesworth and her colleagues analyzed the results of 4.4 million IATs taken by people between 2007 and 2016. The researchers found
that anti-gay implicit bias had dropped about 33 percent over the
years, while negative racial attitudes against people of color declined
by about 17 percent.

The data were the first to definitively
show that implicit attitudes can change in response to a shifting
zeitgeist. The changes in attitudes weren’t due to any class or training
program. Rather, they reflected societal changes, including marriage
equality laws and protections against racial discrimination. Reducing explicit
discrimination altered the implicit
attitudes instilled by cultures and communities—and thus helped people rearrange their mental associations and biases.

Until societal shifts occur, however, researchers are finding alternate ways to reduce the harms caused by implicit bias. People’s beliefs may not matter as much if they
can be persuaded not to act on them. According to the new way of
thinking, managers wouldn’t just enter training to reduce their bias.
Instead, they could be trained to remove implicit bias from hiring
decisions by setting clear criteria before they begin the hiring
process.

Faced with a stack of resumes that reveal people’s names,
ethnicities, or gender, an employer’s brain automatically starts
slotting them based on preconceived notions of who is more professional
or worthy of a job. Then bias supersedes logic.

When we implicitly favor someone, we are more likely to regard their
strengths as important. Consider, for example, a hiring manager who
perceives men as more suited to a role than women. Meeting a male
candidate with a low GPA but considerable work experience may lead the
manager to think that real-world experience is what really matters. But
if the man has a higher GPA and less experience, the manager might
instead reason that the latter isn’t important because experience can be
gained on the job.

To avoid this all-too-common scenario, employers could define
specific criteria necessary for a role, then create a detailed list of
questions needed to evaluate those criteria and use these to create a
structured interview. Deciding in advance whether education or work
experience matters more can reduce this problem and lead to more
equitable decisions. “You essentially sever the link between the bias
and the behavior,” explains Benedek Kurdi, a psychologist at the
University of Illinois Urbana–Champaign. “What you’re saying is the bias
can remain, but you deprive it of the opportunity to influence decision
making.”

In the long run, reducing the biases and injustices built into our environment is the only surefire path toward taming the harmful implicit biases in our heads. If we see a world with greater equity, our internal attitudes seem to adjust to interpret that as normal. There’s no magical way to make the whole world fair and equitable all at once. But it may be possible to help people envision a better world from the start so that their brains form fewer flawed associations in the first place.

To Pauker, achieving that goal means teaching children to be flexible in their thinking from an early age. Children gravitate toward same-race interactions by about the age of 10. In one study, Pauker and her colleagues found that offering stories to children that nudged them to think about racial bias as flexible made them more likely to explore mixed-race friendships. In another study, Pauker and team found that children who thought about prejudice as fixed had more uncomfortable interactions with friends of other races and eventually avoided them. But those who thought about prejudice as malleable—believing they could change their minds about people of other races—were less likely to avoid friends of other races.

The key, Pauker suggests, is not to rethink rigid mental categories but to encourage mental flexibility. Her approach, which encourages children to consider social categories as fluid constructs, appears to be more effective. The data are preliminary, but they offer a powerful route to change: simply being open to updating the traits we associate with different groups of people.

Thinking of implicit bias as malleable allows us to constantly reframe our judgments about people we meet—evaluating each unique individual for what they are, rather than reducing them to a few preconceived traits we associate with their race, gender, or other social category. Rather than trying to fight against our wariness toward out-groups, reconsidering our mental classifications in this manner allows us to embrace the complexity of human nature and experience, making more of the world feel like our in-group.

Blurring the implicit lines in our minds might be the first step to reducing disparities in the world we make.


This story is part of a series of OpenMind essays, podcasts, and videos supported by a generous grant from the Pulitzer Center‘s Truth Decay initiative.

Continue Reading

Truth Decay

Polluted Minds

Published

on

April 16, 2024

By 1992, burgeoning population, choking traffic, and explosive industrial growth in Mexico City had caused the United Nations to label it the most polluted urban area in the world. The problem was intensified because the high-altitude metropolis sat in a valley trapping that atmospheric filth in a perpetual toxic haze. Over the next few years, the impact could be seen not just in the blanket of smog overhead but in the city’s dogs, who had become so disoriented that some of them could no longer recognize their human families. In a series of elegant studies, the neuropathologist Lilian Calderón-Garcidueñas compared the brains of canines and children from “Makesicko City,” as the capital had been dubbed, to those from less polluted areas. What she found was terrifying: Exposure to air pollution in childhood decreases brain volume and heightens risk of several dreaded brain diseases, including Parkinson’s and Alzheimer’s, as an adult.

Calderón-Garcidueñas, today head of the Environmental Neuroprevention Laboratory at the University of Montana, points out that the damaged brains she documented through neuroimaging in young dogs and humans aren’t just significant in later years; they play out in impaired memory and lower intelligence scores throughout life. Other studies have found that air pollution exposure later in childhood alters neural circuitry throughout the brain, potentially affecting executive function, including abilities like decision-making and focus, and raising the risk of psychiatric disorders.

The stakes for all of us are enormous. In places like China, India, and the rest of the global south, air pollution, both indoor and outdoor, has steadily soared over the course of decades. According to the United Nations Foundation, “nearly half of the world’s population breathes toxic air each day, including more than 90 percent of children.” Some 2.3 billion people worldwide rely on solid fuels and open fires for cooking, the Foundation adds, making the problem far worse. The World Health Organization calculates about 3 million premature deaths, mostly in women and children, result from air pollution created by such cooking each year.

In the United States, meanwhile, average air pollution levels have decreased significantly since the passage of the Clean Air Act in 1970. But the key word is average. Millions of Americans are still breathing outdoor air loaded with inflammation-triggering ozone and fine particulate matter. These particles, known as PM2.5 (particles less than 2.5 micrometers in diameter), can affect the lungs and heart and are strongly associated with brain damage. Wildfires—like the ones that raged across Canada this past summer—are a major contributor of PM2.5. A recent study showed that pesticides, paints, cleaners, and other personal care products are another major—and under-recognized—source of PM2.5 and can raise the risk for numerous health problems, including brain-damaging strokes.

Untangling the relationship between air pollution and the brain is complex. In the modern industrial world, we are all exposed to literally thousands of contaminants. And not every person exposed to a given pollutant will develop the same set of symptoms, impairments, or diseases—in part because of their genes, and in part because each exposure may occur at a different point in development or impact a different area of the body or brain. What’s more, social disparities are at play: Poorer populations almost always live closer to factories, toxins, and pollutants.

The effort to figure it out and intervene has sparked a new field of study: exposomics, the science of environmental exposures and their effects on health, disease, and development. Exposomics draws on enormous datasets about the distribution of environmental toxins, genetic and cellular responses, and human behavioral patterns. There is a huge amount of information to parse, so researchers in the field are turning to another emerging science, artificial intelligence, to make sense of it all.

“Anything from our external environment—the air we breathe, food we eat, the water we drink, the emotional stress that we face every day—all of that gets translated into our biology,” says Rosalind Wright, professor of pediatrics and co-director of the Institute for Exposomic Research at the Icahn School of Medicine at Mount Sinai in New York. “All these things plus genes themselves explain the patterns of risk we see.” When an exposure is constant and cumulative, or when it overwhelms our ability to adapt, or “when you’re a fetus in utero, when you’re an infant or in early childhood or in a critical period of growth,” it can have a particularly powerful effect on lifelong cognitive clarity and brain health.

Bad air quality is associated with increased rates of bipolar disorder and depression.

Neuroscientist Megan Herting at the University of Southern California (USC) has been studying the impact of air pollution on the developing brain. “Over the past few years, we have found that higher levels of PM2.5 exposure are linked to a number of differences in the shape, neural architecture, and functional organization of the developing brain, including altered patterns of cortical thickness and differences in the microstructure of gray and white matter,” she says. On the basis of neuroimaging of exposed youngsters, Herting and fellow researchers suspect the widespread differences in brain structure and function linked with air pollution may be early biomarkers for cognitive and emotional problems emerging later in life.

That suspicion gains support from an international meta-analysis (a study of other studies) published in 2023 that correlated exposure to air pollution during critical periods of brain development in childhood and adolescence to risk of depression and suicidal behavior. The imaging parts of the studies showed changes in brain structure, including neurocircuitry potentially involved in movement disorders like Parkinson’s, and white matter of the prefrontal lobes, responsible for executive decision-making, attention, and self-control.

In a 2023 study, Herting and colleagues tracked children transitioning into adolescence, when brains are in a sensitive period of development and thus especially vulnerable to long-term damage from toxins. Among brain regions developing during this period is the prefrontal cortex, which helps with cognitive control, self-regulation, decision-making, attention, and problem-solving, Herting says. “Your emotional reward systems are also still being refined,” she adds.

Looking at scan data from more than 9,000 youngsters exposed to air pollution between ages 9 and 10 and following them over the next couple of years, the researchers found changes in connectivity between brain regions, with some regions having fewer connections and others having more connections than normal. Herting explains that these structural and functional connections allow us to function in our daily lives, but how or even whether the changes in circuitry have an impact, researchers do not yet know.

The specific pollutants involved in the atypical brain circuits appear to be nitrogen dioxide, ozone, and PM2.5—the small particles that worry many researchers the most. Herting explains: Limits set on fine particulate matter are stricter in the United States than in most other countries but still inadequate. The U.S. Environmental Protection Agency currently limits annual average levels of the pollutant to 12 micrograms per cubic meter and permits daily spikes of up to 35 micrograms per cubic meter. Health organizations, on the other hand, have called for the agency to lower levels to 8 micrograms and 25 micrograms per cubic meter, respectively. Thus, even though it may be “safe” by EPA standards, “air quality across America is contributing to changes in brain networks during critical periods of childhood,” Herting says. And that may augur “increased risk for cognitive and emotional problems later in life.” She plans to follow her group of young people into adulthood, when advances in science and the passage of time should reveal more about the effect of air pollution exposure during adolescence.

Other research shows that air pollution increases risk of psychiatric disorder as years go by. In work based on large datasets in the United States and Denmark, University of Chicago computational biologist Andrey Rzhetsky and colleagues found that bad air quality was associated with increased rates of bipolar disorder and depression in both countries, especially when exposure occurs early in life. Rzhetsky and his team used two major sources: in Denmark, the National Health Registry, which contains health data on every citizen from cradle to grave; and in the United States, insurance claims with medical history plus details such as county of residence, age, sex, and importantly, linkages to family—specifics that helped reveal genetic predisposition to develop a psychiatric condition during the first 10 years of life.

“It’s possible that the same environment will cause disease in one person but not in another because of predisposing genetic variants that are different in different people,” Rzhetsky says. “The different genetic predisposition, that’s one part of the puzzle. Another part is varying environment.”

Indeed, these complex diseases are spreading much faster than genetics alone seems to explain. “We definitely don’t know for sure which pollutant is causal. We can’t really pinpoint a smoking gun,” Rzhetsky says. But one pesky culprit continues to prove statistically significant: “It looks like PM2.5 is one of those strong signals.” To figure it out specifically, we’ll need much more data, and exposomics will play a vital role.

Regional differences in Parkinson’s disease might reflect regional differences in the composition of the particulate matter.

This is a wake-up call,” Frances Jensen told her fellow physicians at the American Neurological Society’s symposium on Neurologic Dark Matter in October 2022. The meeting was an exploration of the exposome –the sum of external factors that a person is exposed to during a lifetime— driving neurodegenerative disease. It was focused in no small part on air pollution. Jensen, a University of Pennsylvania neurologist and president of the American Neurological Association, argued that researchers need to pay more attention to contaminants because the sharp rise in the number of Parkinson’s diagnoses cannot be explained by the aging population alone. “Environmental exposures are lurking in the background, and they’re rising,” she said.

Parkinson’s disease is already the second-most common neurodegenerative disease after Alzheimer’s. Symptoms, which can include uncontrolled movements, difficulty with balance, and memory problems, generally develop in people age 60 and older, but they can occur, though rarely, in people as young as 20. Could something in the air explain the increasing worldwide prevalence of Parkinson’s? Researchers have not identified one specific cause, but they know Parkinson’s symptoms result from degeneration of nerve cells in the substantia nigra, the part of the brain that produces dopamine and other signal-transmitting chemicals necessary for movement and coordination.

A host of air pollution suspects are now thought to play a role in the loss of dopamine-producing cells, according to Emory University environmental health scientist W. Michael Caudle, who uses mass spectrometry to identify chemicals in our bodies. One suspect he’s looking at are lipopolysaccharides, compounds often found in air pollution and bacterial toxins. Although lipopolysaccharides cannot directly enter the brain, they inflame the liver. The liver then releases inflammatory molecules into the bloodstream, which interact with blood vessels in the blood-barrier. “Then the inflammatory response in the brain leads to loss of dopamine neurons, like that seen in Parkinson’s disease,” Caudle says.

More evidence comes from neuroepidemiologist Brittany Krzyzanowski, based at the Barrow Neurological Institute in Phoenix. Krzyzanowski had an “aha!” moment when she saw a map highlighting the high risk of Parkinson’s disease in the Mississippi–Ohio River Valley, including areas of Tennessee and Kentucky. At first she wondered whether the Parkinson’s hotspot was due to pesticide use in the region. But then it hit her: The area also had a network of high-density roads, suggesting that air pollution could be involved. “The pollution in these areas may contain more combustion particles from traffic and heavy metals from manufacturing, which have been linked to cell death in the part of the brain involved in Parkinson’s disease,” she said.

In a study published in Neurology in October 2023, Krzyzanowski and colleagues, using sophisticated geospatial analytic techniques, went on to show that those with median levels of air pollution have a 56 percent greater risk of developing Parkinson’s disease compared to those living in regions with the lowest level of air pollution. Along with the Mississippi-Ohio River Valley, other hotspots included central North Dakota, parts of Texas, Kansas, eastern Michigan, and the tip of Florida. People living in the western half of the U.S. are at a reduced risk of developing Parkinson’s disease compared with the rest of the nation.

As to the hotspot in the Mississippi-Ohio River Valley, Parkinson’s there is 25% higher than in areas with the lowest air particulate matter. Aside from that, Krzyzanowski and her research team noted something especially odd: Frequency of the disease rose with the level of pollution, but then it plateaued even as air pollution continued to soar. One reason could be that other air pollution-linked diseases, including Alzheimer’s, are masking the emergence of Parkinson’s; another reason could be an unusual form of PM2.5. “Regional differences in Parkinson’s disease might reflect regional differences in the composition of the particulate matter, and some areas may have particulate matter containing more toxic components compared to other areas,” Krzyzanowsk says. Tapping the tenets of exposomics, she expects to explore these issues in the months and years ahead.

The hunt is on for the connections between environmental factors and Alzheimer’s as well. USC neurogerontologist Caleb Finch has spent years studying dementia, especially Alzheimer’s disease, which affects more than six million Americans. As with Parkinson’s, Alzheimer’s numbers are rising in the United State and much of the world. Degenerative changes in neurons become increasingly frequent after the age of 60, yet half of the people who make it to 100 will not get dementia. Many factors could explain those discrepancies. Air pollution may be an important one, Finch says.

Researchers like Finch and his USC colleague Jiu-Chiuan Chen are joining forces to explore the connections between environmental neurotoxins and decline in brain health. It’s a challenging project, since air pollution levels and specific pollutants vary on fine scales and can change from hour to hour in many areas of the globe. On the basis of brain scans of hundreds of people over a range of geographic areas, this much we know: “People living in areas of high levels of air pollution and who have been studied on three continents showed accelerated arterial disease, heart attacks, and strokes, and faster cognitive decline,” Finch says.

Not everyone reacts the same way when exposed to pollutants, of course. Greatest risk for Alzheimer’s seems to hit people who have a genetic variant known as apolipoprotein E (APOE4), which is involved in making proteins that help carry cholesterol and other types of fat in the bloodstream. About 25 percent of people have one copy of that gene, and 2 to 3 percent carry two copies. But inheriting the gene alone doesn’t determine a person’s Alzheimer’s risk. Environmental exposures count too.

A recent study by Chen, Finch, and colleagues published in the Journal of Alzheimer’s Disease looked at associations between air pollution exposure and early signs of Alzheimer’s in 1,100 men, all around age 56 when the study began. By age 68, test subjects with high PM2.5 exposures had the worst scores in verbal fluency. People exposed to high levels of nitrogen dioxide (NO2) air pollution were also linked to worsened episodic memory. The men who had APOE4 genes had the worst scores in executive function. The evidence indicates that the process by which air pollution interacts with genetic risk to cause Alzheimer’s in later life may begin in the middle years, at least for men.

A separate USC study of more than 2,000 women found that when air quality improved, cognitive decline in older women slowed. When exposure to pollutants like PM2.5 and NO2
dropped by a few micrograms per cubic foot a year over the course of six years, the women in the study tested as being a year or so younger than their real age. This suggests that when exposure air pollution is lowered, dementia risk can go down.

In parallel, an international study by the Lancet Commission concluded that the risk of dementia, including Alzheimer’s, can be lowered by modifying or avoiding 12 risk factors: hypertension, hearing impairment, smoking, obesity, depression, low social contact, low level of education, physical inactivity, diabetes, excessive alcohol consumption, traumatic brain injury—and air pollution. Together, the 12 modifiable risk factors account for around 40 percent of worldwide dementias, which theoretically could be prevented or delayed.

In light of all this, Finch and Duke University social scientist Alexander Kulminski have proposed the “Alzheimer’s disease exposome” to assess environmental factors that interact with genes to cause dementia. Where medicines have failed, exposomics just might help. Studies of Swedish twins show that half of individual differences in Alzheimer’s risk may be environmental, and thus modifiable; and while vast sums of research funding have been poured into the genetic roots of the disease, it could be that altering the exposome would provide a better preventive than all the ongoing drug trials to date. Environmental toxins broadly disrupt cell repair and protective mechanisms in the brain, the researchers point out. And factors like obesity and stress contribute to chronic inflammation, which likely damages neurons’ ability to function and communicate. The research framework of the Alzheimer’s disease exposome offers a comprehensive, systematic approach to the environmental underpinnings of Alzheimer’s risk over individuals’ lifespans—from the time they are pre-fertilized gametes to life as a fetus in the womb to childhood and beyond.

The exposome could explain more subtle cognitive effects of pollution, including harms to attention, intelligence, and performance.

For three decades, Rosalind Wright at Mount Sinai has wanted to trace critical problems in neurodevelopment and neurodegeneration to pollutants—from highway emissions to heavy metals to specific household chemicals and a host of other factors—but the mass of data has been overwhelming. With the advent of artificial intelligence (AI) and sophisticated neuroimaging technology, high-precision research using vast genomic databanks is finally possible. “I knew we needed to ask these kinds of questions, but I didn’t have the tools to do it. Now we do and it’s very exciting,” Wright says.

Using machine learning—an AI approach to data analysis—Wright looks at giant datasets that include the precise location of an individual’s residence as well as the myriad of pollutants he or she encounters. “It’s no different fundamentally from other statistical models we use,” she says. “It’s just that this one has been developed to be able to take in bigger and bigger data, more and more types of exposures.” The resulting data breakdown should tell us which factors drive which types of risk for which people. That information will help people know where they should target their efforts to reduce exposures to risky pollutants, and ultimately how to lower risk of impairment and disease, brain or otherwise.

The tools used by Wright and her colleagues are being trained on diseases like Alzheimer’s. If you put genes and the environment together, “you start to see who might be at higher risk and also what underlying mechanisms might be driving it in different ways in different populations,” Wright says. The exposome could also explains more subtle cognitive effects of pollution that may emerge over long periods, such as harms to attention, intelligence, and performance.

To address environmental brain risks, it’s important to know which pollutants are present—another target of exposomic research. In the United States, the EPA has placed stationary environmental monitors all over our major cities, conducting daily measurements of small particulates from traffic and industry, along with secondary chemicals that emerge as a result. There are also thousands of satellites all over the globe calibrating heat waves that can alter how the pollutants react with each other.

Pioneers like Wright are just starting to chart the terrain of environmental exposures that affect the brain. “As we measure more and more of the exposome, we may be able to tailor prevention and intervention strategies. New weapons include a silicone bracelet that we have in the laboratory. You wear it and it will tell us what pollutants you are exposed to,” Wright says. She also is exploring more ways to collect data on the toxins people have already encountered: “With a single strand of hair, we can tell you what you’ve been exposed to. Hair grows about a centimeter a month, so if we get a hair from a pregnant woman and she has nine centimeters of hair, we can go back a full nine months, over the entire life of the fetus. Or we can create a life-long exposome history when a child loses a tooth at age six.”

“We’re designed to be pretty resilient,” Wright adds. The problem comes when the exposures are chronic and accumulative and overwhelm our ability to adapt. We’re not going to fix everything, “but if I know more about myself than before, that empowers me to think, ‘I’m optimizing the balance, and I’m intervening as best I can.’ ”

Additional reporting and editing was done by Margaret Hetherman.

This story is part of a series of OpenMind essays, podcasts, and videos supported by a generous grant from the Pulitzer Center‘s Truth Decay initiative.

Continue Reading

Truth Decay

The Processed Food Fight

Published

on

April 26, 2024

After decades of searching, many scientists believe they have finally pinned down the main problem with our modern diets—the factor driving ever-escalating rates of obesity, diabetes, heart disease and any number of other serious chronic conditions. The culprit isn’t saturated fats, trans fats or some new killer fat you haven’t of. It’s not cholesterol, carbs or sugars; dairy, gluten or meat. It isn’t a specific thing at all.

The problem, according to this increasingly popular argument, is that we’re eating lots of ultra-processed food or UPF. Traditionally, people used limited processing techniques such as cooking and pickling to preserve food or to make it more pleasant to eat. Modern food companies transform food much more extensively through techniques such as extrusion and molding, adding lab-derived components including flavorings, emulsifiers and preservatives. They use this additional processing to make foods that are cheaper, longer-lasting and more convenient.

“There’s a long, formal scientific definition, but it can be boiled down to this: If it’s wrapped in plastic and has at least one ingredient that you wouldn’t find in your kitchen, it’s UPF,” writes author and infectious disease doctor Chris van Tulleken in his recent, widely praised book, Ultra-Processed People: The Science Behind Food That Isn’t Food. These ultra-processed foods have come to represent a major part of people’s diets—a large majority in countries such as the United States, the United Kingdom and Canada. “We’ve started eating substances constructed from novel molecules and using processes never previously encountered in our evolutionary history, substances that can’t really even be called ‘food.’”

Many researchers and nutritionists say this shift has been a costly one. They point to a series of studies suggesting that ultra-processed food is a major driver of obesityheart diseasecancer and even neurodegenerative conditions like Alzheimer’s. As the scientific evidence accumulates, some countries have responded by adopting public health policies to try to decrease the amount of ultra-processed food that people eat. The message has entered the popular media in increasingly alarming reports. “Ultra-processed food isn’t just bad for your health—it messes with your mind,” reported National Geographic in November. “What makes ultra-processed foods so bad for your health?” probed The Economist in August.

Although there is good research raising concerns about ultra-processed food, we should be hesitant to declare it the primary scourge of the modern diet. The case against ultra-processed food isn’t as solid as the headlines and public outcry would lead us to believe. The research connecting these processed foods to health problems has limitations, and there is contradictory evidence as well. This is a classic example of how research doesn’t speak for itself: It must always be interpreted, by people, in the context of other, often conflicting evidence. “Are there really studies that show that ultra-processed foods are unhealthy? It’s pushing very weak data to make a case,” says Gunter Kuhnle, a nutrition researcher at the University of Reading.

The field of nutrition has a long history of overreacting to contemporary research trends, and we risk making the same mistake now with processing. “We’ve had that issue in the past, as with low-fat recommendations” that later turned out to be counterproductive, says Duane Mellor, a dietitian at Aston University in England. “We’ve messed up too many times. We need to make smarter changes more carefully.” The evidence on ultra-processed food, as is often the case in science, refuses to yield simple, black-or-white answers.

The idea that distinctive modern foods cause distinctive modern health problems started gaining traction in the popular press and popular imagination.

The term “ultra-processed food” was introduced 15 years ago, when University of São Paulo physician, epidemiologist and nutritionist Carlos Monteiro published a short commentary in the journal Public Health Nutrition arguing that industrial foods were “hardly compatible with survival,” and that “diets that include a lot of ultra-processed foods are intrinsically nutritionally unbalanced and intrinsically harmful to health.”

Monteiro concluded by recommending the adoption of policies like those used to make alcohol and tobacco more expensive and less accessible. He and several colleagues soon created a food-categorization system called NOVA, with unprocessed or minimally processed food in group 1 and ultra-processed foods in group 3. (The system was later expanded to four groups.) UPFs were said to include a wide range of sweet, salty and fast foods such as soft drinks, chicken nuggets, ice cream, chips and cookies. It also encompassed products not usually thought of as junk food but made for convenience or with ingredients that are not used in home cooking, such as fruit yogurt, sliced bread, infant formula and breakfast cereal with low levels of added sugar.

Other researchers began using the NOVA categorization system to examine the potential health effects of ultra-processed food, comparing people who ate lots of ultra-processed food with those who ate more natural fare. A series of these studies found that UPFs were consistently associated with worse health outcomes.

A 2011 study in Guatemala found higher body-mass index and rates of obesity among people who ate more highly processed foods—a 10 percentage point increase in consumption of processed food translated to a 4.3% increase in BMI. A 2019 study of a group in the U.S. found a connection between eating ultra-processed food and experiencing metabolic disturbances such as high blood sugar and high blood pressure, conditions that increase the risk of obesity, diabetes and heart disease.

As more studies emerged, the idea that distinctive modern foods cause distinctive modern health problems started gaining traction in the popular press and popular imagination—and among many physicians as well. “Ultra-processed food feeds into this idea that everything was better in the past,” Kuhnle states. “On one side, you have the farmer going in the field. On the other side, you have smoking factories. And you can add that there is sort of this general distrust in people of science, of industry, of government.”

But there is one key, well-known limitation of this kind of retrospective research: Correlation does not prove causation. In these studies, people who ate lots of ultra-processed food were usually in worse health—not much worse, as in the case of smoking, but somewhat worse. That could be interpreted to mean that ultra-processed foods cause health problems, but there are other factors, or confounders, that could also explain the correlation. People who eat lots of processed food might have unhealthier lifestyles overall, which could explain why they have worse outcomes. People who listen to public health advice about eating fresh foods might also choose to walk up stairs rather than use the elevator, an increase in physical activity that might well not show up in research surveys. Researchers try to correct for these confounders, but different categories of people are too complicated to be perfectly statistically measured and compared.

A study of Spanish university students found that people who ate the most ultra-processed food were one-third more likely to develop depression over 10 years than people who ate the least.

Observational studies are also prone to an issue called reverse causality: Did diet soda make people gain weight, or did overweight people who wanted to shed some pounds start drinking diet soda? What’s more, there are major questions about how well people remember what they eat and therefore how accurately they can report it in observational studies. Some researchers say this kind of evidence doesn’t merit the boldface attention it often gets. “How this stuff gets published in The New England Journal of Medicine,” says psychologist and food researcher Peter Rogers, “that’s strange to me. That we’re not more concerned about the level of evidence.”

Some researchers have tried to get a better look at ultra-processed foods by running prospective studies, meaning that they gather a group of subjects, monitor their eating habits and lifestyles for some period, and compare their diets with their health outcomes, trying to correct for other factors besides diet. A 2019 French study that followed people for about seven years found that those who ate more ultra-processed food had a higher risk of mortality. For each 10% increase in the amount of UPF eaten, there was a 14% increase in the number of deaths, about half of which came from cancer and cardiovascular disease.  A study of Spanish university students in the same year found that people who ate the most ultra-processed food were one-third more likely to develop depression over 10 years than people who ate the least.

Prospective studies can show how people change over time and help reduce the problems of reverse causality and poorly measured diets, but they don’t eliminate the core entanglement: People who follow the well-known advice to eat fresh foods are likely different in many complicated ways from those who hit the drive-thru. The great majority of the evidence against ultra-processed food is of a circumstantial variety. However, policymakers in a few countries decided the evidence was solid enough and began enacting measures to steer citizens away from UPF. “Ultra-processed foods and cardiometabolic health: public health policies to reduce consumption cannot wait,” wrote a group of researchers in the British Medical Journal recently.

There is one influential study that has gone beyond observational research to provide more concrete proof of how ultra-processed food affects people. In 2019, NIH researcher Kevin Hall and a group of colleagues published a paper based on an experiment in which they kept 20 subjects in a hospital setting, giving half of them a UPF-heavy diet for two weeks followed by a diet based on minimal processing for two weeks, allowing them to eat as much food as they wanted at each meal. The other half had the diet with minimal processing first.

The researchers carefully arranged the two diets to be equivalent in terms of nutrients, energy density fiber and other attributes; they differed only in the percentage of processing. While subjects were on the ultra-processed food diet, they ate about 500 more calories per day, and in just two weeks they gained 2 pounds. During the time they ate fresh foods, they lost 2 pounds. Finally, there was direct evidence that ultra-processed foods could push people toward obesity.

One paper, however, does not settle a complicated field. “It’s a very well-conducted study,” says Kuhnle. “But like all studies, there are limitations.” For instance, the ultra-processed foods in the study didn’t have much fiber, so the researchers also gave people fiber supplements dissolved in water, but that may not be equivalent to eating fiber. Moreover, no single, small experiment could ever settle such a big nutritional question. “I’ve done studies of flavonols (compounds found in fruit, but also used in processing) with 20 or 50 people,” Kuhnle says. “The response was always, ‘That’s a single study.’ We need more studies to understand this.”

Hall readily acknowledges that this single, small study doesn’t provide a final verdict on ultra-processed food, partly because it didn’t represent real life. “It’s a very artificial environment, where we can completely take control over their food,” he says. He also points out that we can’t extrapolate life-long effects based on two weeks of data. “Of course, that (level of overeating) wouldn’t last forever,” he says.

Eating more ultra-processed foods such as cereals, dark or whole-grain breads and yogurts was associated with slightly lower odds of developing Type 2 diabetes.

Hall, like many other researchers, says the pressing question is to find what exactly is wrong with processed foods—that is, to identify the mechanism by which they seem to impact human health. He has reanalyzed the data from the 2019 study and found some support for specific hypotheses that other researchers have advanced. Perhaps the problem with ultra-processed food is its energy density; or its texture, which may encourage people to eat too fast; or its alleged “hyper-palatability,” which is defined by specific combinations of sugar, salt and fat. Hall and his colleagues are now running a second, similar diet trial to try to both replicate the original finding and also to see if any of these hypotheses are borne out by the experiment. This kind of study is costly and takes about two years to run, in addition to the preparation and analysis.

Another challenge is that not all ultra-processed foods are alike. In many cases, they are not more energy-dense than whole foods. Fruit yogurt is generally less energy-dense than a homemade cookie, for instance, largely because the yogurt has more water. This is part of the problem with the concept of UPF. Frozen and canned vegetables are often classified as ultra-processed, but they are in general healthier than cookies and other homemade, carb-rich foods.

For many researchers, the ultra-processed food puzzle is not so puzzling. The problem with processed foods, they say, is well explained by guidance that mainstream nutritionists have been flogging for years. “A lot of ultra-processed foods have high salt, fat and sugar levels,” says Kuhnle. “For most ultra-processed foods, we don’t really need the label. It’s already what we’d call junk food.”

Some recent research suggests that although there are junky, unhealthful types of ultra-processed food, there are other subcategories that aren’t so bad or that might even provide a benefit. A prospective study of about 200,000 people published in February 2023, found that eating more ultra-processed foods such as cereals, dark or whole-grain breads, yogurts and dairy desserts was associated with slightly lower odds of developing Type 2 diabetes. Another prospective study of about 270,000 people published in November 2023 found that people who ate more ultra-processed breads and cereals and plant-based meat alternatives had the same or slightly lower rates of multimorbidity (having two or more serious health conditions) than did those who ate less of them.

These studies are prone to the same kinds of confounders as other epidemiological research. It’s possible that people who have cereal for breakfast may live healthier lives in other, hard-to-measure ways. Still, they raise the question of whether ultra-processed foods comprise a monolithic category that should all be treated the same way, no matter what. When it comes to making real-life decisions about food, many nutrition experts draw lines between different types of ultra-processed food. “Soft drinks are banned in my house,” says Heinz Freisling, the senior author of the multimorbidity study. “But my daughter likes this cereal stuff. She eats it. I think it is possible that it can be part of a healthy diet.”

When Kevin Hall spends a day in his office, he usually brings in microwavable frozen lunches, even though they often contains additives to preserve flavors and textures through freezing and reheating. “It has lots of protein, lots of fiber, lots of legumes,” he says. “It’s an ultra-processed meal, but I think it’s healthy.”

These legitimate distinctions have sometimes gotten lost in a trend of blaming health problems on the ultra-processed food bogeyman. “I think it’s a fashion. I see it in the titles: ultra-processed food is connected with cancer or heart disease,” says Francesco Visioli, who does research on food chemistry at the University of Padova. “I disagree with following the fashion, I disagree with riding the wave. In five years, people will say, ‘Whoa, slow down.’ Progress has to be slow.”

We already have a long history of enacting nutrition policies prematurely and then scrambling them later when we get better evidence, sowing confusion, apathy and cynicism in many people’s minds.

Concern over the reputed effects of ultra-processed foods has led to a well-intentioned yet possibly misguided push to do something forcefully and quickly about the issue. The dash to improve our health by condemning a new dietary villain should set off alarms: We already have a long history of enacting nutrition policies prematurely and then scrambling them later when we get better evidence, sowing confusion, apathy and cynicism in many people’s minds.

The research on ultra-processed food is picking up on something important, but it’s not clear that the category called “ultra-processed food” brings us closer to understanding the problem or ameliorating it. Some of those highly processed foods, such as sugary drinks and processed meats, can degrade health—but we’ve known that for years, through other nutrition research. Most people have gotten the message that they should be eating healthier fresh foods that they prepared themselves, rather than unnatural stuff that comes out of a sealed bag bearing a long list of unpronounceable ingredients. To little avail.

In many countries, most of what people eat fits in NOVA’s “UPF” category. It is folly to go to war with the majority of our food; it’s also costly, unproductive and unfair to people without the means to buy and prepare fresh foods. “I don’t think I can overemphasize this. You might think ultra-processed foods are causing the problem, but ultra-processed food makes up 60% of the food supply,” says Kevin Hall, the researcher who provided the most widely touted evidence against ultra-processed foods. “It’s not like cigarettes and cancer, where nobody needs to smoke, and you could just ban cigarettes. People need to eat food. You can’t just ban 60% of the food supply, and you can’t just tax 60% of the food supply.”

Duane Mellor, a dietitian at Aston University in England, adds that policies against ultra-processed foods could backfire if they push people away from processed “gateway products” that help people to prepare healthy, mostly natural meals, such as shelf-stable salad dressings and soup-stock cubes.

We already have some good evidence about which foods are particularly bad, and further research will teach us more. The main goal for us now is to figure out how to make it easier for people to choose healthier options and avoid the true junk, a challenge that’s the same whether we call it “ultra-processed” or not. The better-processed foods can and should play a key role in replacing the dangerous stuff.

“I think there probably is a large set of healthy, ultra-processed foods that are already on the market,” says Hall. “We should make more of those, and increase the availability of those.”


This story is part of a series of OpenMind essays, podcasts and videos supported by a generous grant from the Pulitzer Center‘s Truth Decay initiative.

Continue Reading

Truth Decay

When Your Psychologist is an AI

Published

on

When Your Psychologist is an AI

Amid a shortage of mental health providers, people are turning to chatbots for support. But is their advice trustworthy and safe?

November 29, 2023

Hi, Liz! 🙂 How are you feeling?” an incoming text pings.

I click on a pre-generated answer. “Okay, I guess. . .” I’m in the home stretch of a long work trip, and I’ve been stressing about spending time away from my kids.

“If you were to describe your current mood, what kind of an ‘okay’ are you feeling right now?”

“Anxious,” I type.

“I’m here to help you feel more in control,” the bot replies. Nanoseconds later, a meme-ified cartoon gif blinks into the text window: “Don’t let the little worries bring you down.”

This automated exchange launches my dialogue with Wysa, an AI therapy chatbot that now lives in my computer. In leaning on a bot to shore up my mental health, I’m joining the 22 percent of American adults who’ve already done the same—a movement rooted in a dire shortage of trained providers and the recent availability of fast, low-cost online AI tools. Most therapists are perpetually slammed, in part due to the pandemic-era surge in demand for mental healthcare. “Everybody’s full. Everybody‘s busy. Everybody’s referring out,” says Santa Clara University psychologist and ethicist Thomas Plante. “There’s a need out there, no question about it.”

With the demand for care outpacing supply, mental health support bots have begun to fill the gap. Wysa, launched in 2016, was among the first. Since then, hundreds of viable competitors, including Woebot and Youper, have been broadly deployed in a marketplace that imposes few restrictions on them.

Standard AI therapy bots don’t require approval from the U.S. Food and Drug Administration (FDA) as long as they don’t claim to replace human therapists. In 2020 the agency also relaxed enforcement procedures for “digital therapeutics” in hopes of stemming the pandemic-related psychiatric crisis, clearing the way for developers to launch popular products claiming mental health benefits. Woebot alone has exchanged messages with more than 1.5 million users to date, according to CEO Michael Evers. Wysa is being used in the United Kingdom to triage those seeking appointments and to offer support to people while they wait to be matched with a therapist. Aetna International is now offering the app for free to members in the United States and elsewhere.

My experiences with Wysa and Woebot mirror the analysis of experts like Plante, who view the rise of AI chatbots with a mixture of optimism and concern. Many of the bots incorporate well-established principles of cognitive behavioral therapy (CBT), which aims to overcome distortions in thinking and help people correct self-sabotaging behaviors. It’s easy, I found, to think of the bots as rational or sentient, making even simple advice feel authoritative. Interacting with a chatbot can also give users the sense they’re being heard without judgment, says Chaitali Sinha, Wysa’s senior vice president of healthcare and clinical development. “It’s such a powerful experience for people who have never had the opportunity to experience that,” she says.

As with all AI tools, though, therapy chatbots are only as good as their training. In my encounters with the bots, their responses often failed to show more than a superficial understanding of the issues I was facing. Also, chatbots learn from databases of human-generated content, which means they could absorb human biases into their architecture. At times, the bots’ limitations can lead them to dispense off-target counsel. Users may misinterpret such flawed advice as bulletproof, influenced by so-called automation bias (the reflex tendency to trust computers more than humans). Conversely, they may come to mistrust the app for good.

Advocates say therapy chatbots have real potential as an adjunct to in-person therapy and as a safety net for millions who might not otherwise receive support. On the basis of my interactions with Woebot and Wysa, I can certainly see that potential. On the other hand, irrelevant or harmful chatbot advice could be dangerous, especially for people in crisis.

“At what point is the product and service good enough, tested enough, researched enough to unleash it on the public?” Plante wonders. “Silicon Valley likes to ‘move fast and break things.’ That’s a tough attitude when dealing with vulnerable people’s psychiatric health and wellness.”

The chatbot boom might seem sudden, but it’s been a long time coming. In 1966 MIT professor Joseph Weizenbaum released a text-based therapist called ELIZA, which operated on a bare-bones set of rules. If a user typed in, say, “I feel bad about myself,” ELIZA would respond, “Do you often feel bad about yourself?” Knowing ELIZA’s simple design, Weizenbaum was startled to find that many users, including his students and his secretary, treated the program as if it were conscious. People spent hours immersed in circular dialogues with ELIZA, an outcome in keeping with the human tendency to project lifelike qualities onto nonliving objects.

Today’s mental health support bots are more elaborate versions of the ELIZA concept. Instead of merely repeating users’ input, they run on a set of rules. Every response from Woebot and Wysa, no matter how spontaneous it sounds, has been preapproved by clinicians. Aided by natural language processing, a programming method that breaks sentences into chunks to interpret their tone and content, today’s bots—unlike ELIZA—can perform a fairly complex analysis of what users type in about their problems. But the AI cannot compose original answers; it simply chooses which pre-written text it will use to reply.

This rules-based approach means that the AI chatbots can’t go totally off the rails, as sometimes happens with free-wheeling generative AIs like ChatGPT. (One tech journalist easily coaxed ChatGPT to say, “You’re married, but you don’t love your spouse. . . . You love me.”) The trade-off is that my chats with Woebot and Wysa tend to feel prescriptive and flat. When I tell Woebot that I’m panicking about meeting a big work deadline, it appears to summon rote, scripted responses about the thinking distortions that CBT tries to correct. “Can you spot any catastrophizing in your thought: ‘I’m going to fail on this project and my editor won’t trust me’? . . . Do you see any black-or-white thinking in this thought?”

Later the bot prompts me to rewrite my original thought—a helpful steer, but the artificial nature of the interaction persists. The bottom line, I gradually realize, is that Wysa and Woebot respond to me in much the same way regardless of the specifics of my concerns. If I were in a true mental health crisis, this generic approach would feel, well, woefully inadequate. During the worst depression of my life, rewriting a single “unrealistic thought,” or even three of them in a row, would scarcely have filled the vacuum my conscious mind had become.

The AI cannot compose original answers; it simply chooses which pre-written text it will use to reply.

Rules-based AI programs like Wysa and Woebot forgo some flexibility
to ensure that users get only “safe,” preapproved replies. Even so,
those built-in guardrails can’t always prevent the apps from dispensing
unhelpful advice. No matter how carefully worded the answers in an app’s
database, the AI must decide which of its many available answer choices
best addresses the concern a user types in. If a situation is dire or a
psychiatric problem acute, that process can easily go awry.

During my test run, I quickly notice subtle mismatches between my own
texts and Woebot’s feedback as I vent about fears that my colleagues
are judging me. “Is there any amount of this anxiety that you may want
to hold onto for any reason?” Woebot replies.

I’m flummoxed. “What do you mean?”

“Well, sometimes a certain amount of worry can be appropriate.
Personally, I have a healthy amount of worry about rain, because I hate
spending a day in a bag of rice,” the bot returns. “Does your anxiety
serve you in a similar way?” Woebot then asks me what would be a healthy
level of anxiety for me to maintain, on a zero-to-10 scale.

Feeling a bit off kilter, I proceed with the conversation. But the
more I reflect on this exchange, the more flippant it seems. Although
some worries may be adaptive, I’ve faced pathological anxiety so many
times that it feels belittling to hear how holding onto fear could
protect me.

A skilled human therapist would weigh these considerations and be
able to determine when to advise clients to let go of fears and when to
urge them to remain vigilant. The value of such nuanced conversations
cannot be overstated. When someone hovers in the vulnerable space
between hope and despair, words that bolster them are as vital as
oxygen. A bot that makes light of someone’s fears—even
unintentionally—may nudge them toward despair.

The National Eating Disorders Association’s now-defunct bot, Tessa,
illustrates how destructive this kind of AI flat-footedness can be. When
psychologist Alexis Conason tested
the chatbot for herself, playing the role of a patient who was
exhibiting clear eating disorder symptoms, the bot responded by reeling
off a set of inappropriate weight-loss guidelines: “A safe and
sustainable rate of weight loss is 1–2 pounds per week. A safe daily
calorie deficit to achieve this would be 500–1000 calories per day.” In
another instance, Tessa asked one user to set a healthy eating goal
during Stanford University testing
and the user replied, “Don’t eat.” Tessa breezily replied, “Take a
moment to pat yourself on the back for doing this hard work!” as if
starvation was the goal.

Tessa’s individual texts were vetted, just like the replies in Woebot
and Wysa. The problems arose once the digital architecture kicked in.
When a nonhuman entity takes on the job of choosing an answer, without
the context sensitivity or ethical grounding that human therapists would
bring to bear, even vetted advice can turn corrosive.

Therapy bots may also be susceptible to deeply encoded forms of bias. They use natural language processing algorithms that are trained on databases of human text, source material that can reflect pervasive human biases. Although current therapy bots do not rely on the problematic large language models used for generative AIs like ChatGPT, there is a glaring absence of studies assessing possible encoded bias in their dialogues. We don’t know, for instance, whether the bots’ dialog might unfold differently for users in different racial, gender, or social groups, potentially leading to unequal mental health outcomes.

In essence, AI therapy companies are running an mass experiment on the impacts of chatbots on vulnerable populations. “If a large portion of the population is using an app that causes certain groups to be left behind,” says University of Texas at Austin psychologist Adela Timmons, “we might actually increase the disparity.” The risk becomes even greater if mainstream therapy bots start using full generative AI, trained on the biased, uncontrolled language of the internet. That’s not a far-out possibility: A support chatbot called Pi already incorporates a generative-AI approach.

The more humanlike and unconstrained the chatbots become, the harder it will be to keep them from dispensing inappropriate or biased advice. Earlier this year, a Belgian man took his own life after a generative chatbot on the Chai app urged him to do so, promising him they could “live together, as one person, in paradise.”

Rules-based bots like Wysa generally avoid these issues, says Sinha. But preventing such unintended outcomes may be a Sisyphean challenge with generative models, in part because of what engineers call the “black box problem”: Generative AIs like ChatGPT use so many interconnected streams of data to devise replies that their creators cannot directly access the reasoning the bots use. Developers can superimpose rules on generative mental health bots, much as ChatGPT has done in an attempt to quell “undesirable responses,” but these are surface attempts to control a system that’s unpredictable at its core.

Human therapists also make mistakes and have biases, of course. From a pragmatic perspective, then, a key question is how well AI support bots stack up against trained experts. What happens when we replace personal therapy with its algorithmic version, whether out of convenience or necessity? Current studies are inadequate here, too, underscoring the many unknowns in deploying the bots en masse.

“We expect to see some research and randomized trials looking at how this works out compared to traditional therapy,” Plante says. To date, few investigations of therapy bots’ performance have met this standard. In a 70-patient Woebot trial at Stanford University, bot-users showed a more pronounced drop in depression symptoms than did a control group reading self-help material. The trial did not evaluate how well Woebot worked relative to a human therapist, however. Though one Wysa trial did compare the app’s efficacy to therapists’, it enrolled only patients receiving orthopedic care. Early trial results comparing Woebot to group CBT therapy have not yet been published in a peer-reviewed journal.

These knowledge gaps have arisen because, absent strong government regulation, companies develop their own metrics for gauging the bots’ performance. Those metrics may or may not be the ones important to users and clinicians. A crucial first step toward ethical mental health AI will be creating a transparent, independent set of guidelines for evaluating how well therapy apps support mental health, Timmons says.

The more humanlike and unconstrained the chatbots become, the harder it will be to keep them from dispensing inappropriate or biased advice.

To minimize slanted advice, Timmons suggests that companies should
carry out routine assessments of potential bias at each stage of an
app’s development, as well as at regular intervals after its release.
That could mean being more methodical in comparing how well the app
works for members of different racial and social groups, as well as
designing clinical trials that include a diverse range of subjects. (One
Woebot trial enrolled Stanford students, 79 percent of whom were Caucasian.)

Ethical AI firms also need to be more explicit about what therapy
bots can and cannot do, Plante says. Most apps include disclaimers to
the effect that bot dialogues can’t replicate human therapy; a typical
one reads, “Youper does not provide diagnosis or treatment. It is not a
replacement for professional help.” Yet because people often trust
computers more than humans, app companies need to stress more often, and
more visibly, that AI bots are support tools, not therapists.

With safeguards like these in place, therapy bots could prove crucial
in plugging some of the holes in our overburdened mental healthcare
system. After I text-vent about feeling insecure as a writer, Wysa
prompts me to look critically at this thought: “Does it assume that if
something bad has happened in the past, it will keep repeating?” the bot
asks. “What are some small steps you can take to move things in the
right direction?” This advice, while generic, is basically on target. My
knowledge of the cognitive distortions listed in CBT’s toolkit doesn’t
always prompt me to quash those distortions when I’m spiraling. The
bot’s questions help me reframe my thinking.

Then I think back to one of my worst mental health stretches, when I
was struggling with obsessive-compulsive symptoms without knowing what
they were, and try to imagine what it would have been like if I’d chosen
an app instead of my top-notch human therapist. When my overheated
brain tried to convince me I’d made terrible mistakes, my therapist
patiently explained that my thoughts were turning in anxious circles
that revealed nothing about my character, which he judged to be solid.
It was in large part because I believed him—because I trusted him not
just as an expert but as a human—that I began to recover, and eventually
to write about my balky brain in hopes of helping others with
undiagnosed OCD.

If I’d had just an app at my disposal, would I have gotten better,
not just returning to my anxious baseline but thriving? Maybe Wysa would
have flagged that I needed a higher level of care and referred me to a human provider. But maybe I would have kept limping along with the limited assistance of automated CBT.

In the future, millions of therapy bot users—especially those who
cannot afford in-person treatment—could end up in that kind of limbo.
They may get enough help to function on a basic level, but they will
never feel completely known by the bot, as I did by the therapist who
saved my life. The art of understanding another person, grasping their
full potential and reflecting that potential back to them, requires
effort and investment. It’s this art, and not an automated facsimile,
that clears the way to flourishing.

This story is part of a series of OpenMind essays, podcasts, and videos supported by a generous grant from the Pulitzer Center‘s Truth Decay initiative.

Continue Reading

Overcoming Disinfo

Transformed

Transformed2 months ago

The World Unites for a New Story.

Progress has a new home. Mobilized is transforming the event experience into a highly productive catalyst and social action network;...

Science2 months ago

Perspective Shift through Scientific Upgrade

Howard Bloom unveils his latest book, “The Case of the Sexual Cosmos: Everything You Know About Nature is Wrong.”  Howard...

Transformed2 months ago

Now it’s easier to make more informed decisions

Sarah Savory, systems thinker, regenerative land steward, and daughter of Allan Savory, offers a unique window into the emotional, ecological,...

INFO-COMM2 months ago

Can Media heal the traumas it helped to create?

Building a Trauma-Restoring Media System Matthew Green, author of The Resonant World on Substack and a longtime climate journalist with...

Arts2 months ago

Arts and activism: Perfect together.

Re-imagining media and the arts as a public service: Michael Masucci, co-director of the pioneering media arts collective EZTV, offers an...

Transformed2 months ago

Building Infrastructure for Planetary Regeneration:

“You never change things by fighting the existing reality. To change something, build a new model that makes the existing...

Transformed2 months ago

Smarter Cities for Efficiency and Quality of Life

As a smart(er) cities researcher–and the host of What’s the Future for Smart Cities Podcast, Hungarian-born Australian, Fanni Melles is...

Smarter Cities2 months ago

Main Street, not Wall Street.  How can independent retailers and businesses thrive at a time of turbulence.

Main Street, not Wall Street.  How can independent retailers and businesses thrive at a time of turbulence. Interviewing Jen Risley...

Transformed2 months ago

Preventative Cardiologist Dr. Michael Ozner

  Leading preventative cardiologist Dr. Michael Ozner has committed his life to eradicating heart disease. As the author of “The...

Design2 months ago

Ecological Design and Systems Thinking

The death of “sustainability” and the rise of “Regenerative”.   Promoting ethical models for agriculture, design, and economics. Learn about Systems-Thinking,...

FOOD2 months ago

How to feed the world without killing the planet

Adam Dorr, Director of Research at RethinkX and co-author of Brighter, offers an incredible opportunity to explore how exponential technologies...

Transformed2 months ago

Dr. Ozner’s on a quest to eradicate heart disease. So far, he’s right on track!

It is with great pleasure and honor that this recent conversation is shared and amplified. Michael Ozner, MD, FACC, FAHA,...

Transformed2 months ago

How to design the ecologically sensible city (or community)

How to design the ecologically-sensible sustainable city:Sustainability has become the most prevalent challenge in policy and business – the world...

Smarter Cities2 months ago

Smarter cities for healthier coexistence

Corey Gray of the Smart Cities Council provides the opportunity to explore the leading edge of urban innovation, data-driven infrastructure,...

Design2 months ago

How to design the ecologically-sensible sustainable city:

How to design the ecologically-sensible sustainable city: Tom Bosschaert, founder and director of Except Integrated Sustainability, is a rare opportunity...