DiscussionNurse staffing and patient outcomes: Strengths and limitations of the evidence to inform policy and practice. A review and discussion paper based on evidence reviewed for the National Institute for Health and Care Excellence Safe Staffing guideline development
Introduction
Ensuring safe and effective levels of nurse staffing in hospitals is a major concern in many countries. A large and widely cited international body of evidence has linked low nurse staffing levels to higher hospital mortality rates. One of the seminal studies in the field, Aiken's study of 10,184 staff nurses and 232,342 surgical patients in 168 general hospitals in Pennsylvania, USA (Aiken et al., 2002), is among the most highly cited pieces of research about nursing, with 2022 citations on the Scopus research database (August 12, 2015). A systematic review of research confirming the relationship between low nurse staffing levels and adverse patient outcomes found 101 studies published up to 2006, mainly from the USA (Kane et al., 2007). Major studies have continued to be undertaken in countries around the world including Australia (Twigg et al., 2011), China (You et al., 2013), England (Rafferty et al., 2007), Thailand (Sasichay-Akkadechanunt et al., 2003) and across 12 European countries (Aiken et al., 2012, Aiken et al., 2014).
In England, the Francis Inquiry and the Keogh review into care provided by hospital trusts with high death rates identified inadequate nurse staffing as a significant factor associated with poor patient outcomes (Keogh, 2013, The Mid Staffordshire NHS Foundation Trust Inquiry chaired by Robert Francis QC, 2010). As a result of these inquiries, the Department of Health commissioned the National Institute for Health and Social Care Excellence (NICE), an independent body responsible for producing evidence based recommendations to the National Health Service in England, to develop guidance on safe staffing.
NICE applies the principles of evidence based practice to its guideline development process, considering evidence for both the effects and cost effectiveness of its recommendations (National Institute for Health and Care Excellence, 2014a). At the start of the guideline development process NICE commissioned a series of evidence reviews on safe staffing from independent researchers. In this paper we consider the evidence that we reviewed for NICE to support its guidance on safe nurse staffing on adult inpatient wards, in order to understand how NICE could have concluded that:
…while others describe the extensive evidence concerning the association between nurse staffing levels and patient outcomes as “…compelling” (Royal College of Nursing, 2010, p. 39) and “…overwhelming…” (Joint Commission, 2005, p. 105).“There is a lack of high-quality studies exploring and quantifying the relationship between registered nurse and healthcare assistant staffing levels and skill mix and any outcomes” (National Institute for Health and Care Excellence (NICE), 2014b, p. 27),
In this paper we consider this evidence in order to understand its strengths and limitations and how these apparently contradictory assessments could be made. We begin by summarising the NICE evidence review and related studies before discussing challenges that arise in interpreting and using the evidence in practice and, in particular, applying it to quantify the benefits and costs of changes in nurse staffing. For brevity we do not cite every included study. Rather we describe overall patterns in the evidence and cite specific examples. We conclude by identifying strategies to increase the usefulness of future research studies for those charged with developing policies and guidance on safe nurse staffing levels.
Section snippets
Review methods and data sources
The NICE evidence review is described in full elsewhere (Griffiths et al., 2014a, Simon et al., 2014). This paper focuses on evidence used to answer two questions specified in the brief by NICE:
- 1.
What patient safety outcomes are associated with nurse and healthcare assistant staffing levels and skill mix?
- 2.
What approaches for identifying required nurse staffing levels and skill mix are effective, and how frequently should they be used?
The term ‘effective’ highlights NICE's concern to review
Review results
In addition to the existing systematic reviews, we found 35 primary studies addressing our first question about nurse staffing and patient outcomes that met our inclusion criteria, together with an additional four economic studies. A single study addressed the question about effective approaches for identifying required nurse staffing levels and skill mix (Twigg et al., 2011). All the studies we identified were observational. Sample sizes ranged from studies undertaken in hundreds of hospitals
Discussion
The evidence base for associations between nurse staffing and patient outcomes is exclusively comprised of observational studies. This evidence is broadly consistent with a protective effect for increased nurse staffing in relation to a range of patient safety outcomes, care processes and nurse outcomes. A skill mix that is richer in RNs (as opposed to licensed practical nurses or care assistants) is associated with improved outcomes. Higher levels of care assistant staffing are not associated
Acknowledgements
The work reported here draws on a review initially conducted under a contract for the National Institute for Health and Care Excellence. We are grateful to Karen Welch, Information Scientist, who conducted the literature searches. This paper presents independent analysis funded by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) Wessex, and the NIHR Health Services & Delivery Research programme (grant number 13/114/17).
References (86)
- et al.
Nurse staffing and education and hospital mortality in nine European countries: a retrospective observational study
Lancet
(2014) - et al.
On making causal claims: a review and recommendations
Leadersh. Q.
(2010) - et al.
The association of patient safety climate and nurse-related organizational factors with selected patient outcomes: a cross-sectional survey
Int. J. Nurs. Stud.
(2013) - et al.
Nursing staff numbers and their relationship to conflict and containment rates on psychiatric wards—a cross sectional time series Poisson regression study
Int. J. Nurs. Stud.
(2012) - et al.
The effect of a hospital nurse staffing mandate on patient health outcomes: evidence from California's minimum staffing regulation
J. Health Econ.
(2012) - et al.
Nursing staffing, nursing workload, the work environment and patient outcomes
Appl. Nurs. Res.
(2011) - et al.
Economic evaluation of nurse staffing and nurse substitution in health care: a scoping review
Int. J. Nurs. Stud.
(2011) - et al.
Is failure to rescue derived from administrative data in England a nurse sensitive patient safety indicator for surgical care? Observational study
Int. J. Nurs. Stud.
(2013) - et al.
Organisational quality, nurse staffing and the quality of chronic disease management in primary care: observational study using routinely collected data
Int. J. Nurs. Stud.
(2011) - et al.
Good research practices for comparative effectiveness research: analytic methods to improve causal inference from nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report—Part III
Value Health
(2009)
Unfinished nursing care, missed care, and implicitly rationed care: state of the science review
Int. J. Nurs. Stud.
Mortality of emergency general surgical patients and associations with hospital structures and processes
Br. J. Anaesth.
Outcomes of variation in hospital nurse staffing in English hospitals: cross-sectional analysis of survey data and discharge records
Int. J. Nurs. Stud.
The relationship between nurse staffing and quality of care in nursing homes: a systematic review
Int. J. Nurs. Stud.
The impact of the nursing hours per patient day (NHPPD) staffing method on patient outcomes: a retrospective analysis of patient and staffing data
Int. J. Nurs. Stud.
Hospital nursing, care quality, and patient satisfaction: cross-sectional surveys of nurses and patients in hospitals in China and Europe
Int. J. Nurs. Stud.
Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction
J. Am. Med. Assoc.
Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States
BMJ
Implications of the California nurse staffing mandate for other states
Health Serv. Res.
Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models
BMJ
‘Care left undone’ during nursing shifts: associations with workload and perceived quality of care
BMJ Qual. Saf.
Nurse Staffing effects on patient outcomes: safety-net and non-safety net hospitals
Med. Care
A multisite study of nurse staffing and patient occurrences
Nurs. Econ.
Nurse staffing levels: impact of organizational characteristics and registered nurse supply
Health Serv. Res.
Health care professional staffing, hospital characteristics, and hospital mortality rates
Pharmacotherapy
Strengths and weaknesses of hospital standardised mortality ratios
BMJ
Organization of hospital nursing, provision of nursing care, and patient experiences with care in Europe
Med. Care Res. Rev.
From the editors: common method variance in international business research
J. Int. Bus. Stud.
The effects of nurse staffing on adverse events, morbidity, mortality, and medical costs
Nurs. Res.
Failure to rescue: lessons from missed opportunities in care
Nurs. Inq.
Methods for the estimation of the National Institute for Health and Care Excellence cost-effectiveness threshold
Health Technol. Assess.
The economic value of professional nursing
Med. Care
Impact of California's licensed nurse-patient ratios on unit-level nurse staffing and patient outcomes
Policy Polit. Nurs. Pract.
Impact of California mandated acute care hospital nurse staffing ratios: a literature synthesis
Policy Polit. Nurs. Pract.
Nursing workload measurement systems
Annu. Rev. Nurs. Res.
The impact of hospital nursing characteristics on 30-day mortality
Nurs. Res.
Results of an integrative review of patient classification systems
Annu. Rev. Nurs. Res.
Hospital nurse practice environments and outcomes for surgical oncology patients
Health Serv. Res.
Effects of nurse staffing on hospital-acquired conditions and length of stay in community hospitals
Qual. Manag. Health Care
Nurse staffing is an important strategy to prevent medication error in community hospitals
Nurs. Econ.
The Association Between Patient Safety Outcomes and Nurse/Healthcare Assistant Skill Mix and Staffing Levels and Factors That May Influence Staffing Requirements (NICE Evidence Review)
Nurses’ shift length and overtime working in 12 European countries: the association with perceived quality of care and patient safety
Med. Care
Hospital admissions for asthma, diabetes and COPD: is there an association with practice nurse staffing?. A cross sectional study using routinely collected data
BMC Health Serv. Res.
Cited by (178)
Differential effects of electronic patient record systems for wound care on hospital-acquired pressure injuries: Findings from a secondary analysis of German hospital data
2024, International Journal of Medical InformaticsThe association between nurse staffing and quality of care in emergency departments: A systematic review
2024, International Journal of Nursing StudiesSafety culture, quality of care, missed care, nurse staffing and their impact on pressure injuries: A cross-sectional multi-source study
2023, International Journal of Nursing Studies AdvancesCosts and cost-effectiveness of improved nurse staffing levels and skill mix in acute hospitals: A systematic review
2023, International Journal of Nursing StudiesPostoperative Critical Care Admission Was Not Associated with Improved Postoperative Outcomes in Elective Colorectal Surgery: Secondary Analysis Of POWER Trial
2023, Journal of Gastrointestinal Surgery