Over the last decade, average intensive care unit (ICU) occupancy at larger tertiary and quaternary centres has steadily increased with many sites routinely operating near or over capacity.1,2 As a result, there is growing interest and acknowledgment that capacity strain in the ICU may significantly impact patient processing, decision-making, and clinical outcomes.3,4,5,6,7

In the ICU, capacity strain has been defined as the discrepancy between available resources (beds, staff, equipment, etc.) and the current demand to admit patients in need of intensive care.3,7 Two commonly utilized metrics of capacity strain in the ICU are occupancy and afterhours discharge.3 Afterhours discharge is an important metric of strain as these discharges are ideally avoided because they are associated with increased mortality and ICU readmission.4,5,8,9,10,11 Since they are avoided, afterhours discharges are also considered an outcome of strain.3 Occupancy is a broader, system-level indicator of strain and reflects the current environment in the ICU on a given day. Yet, while many analyses have focused on the impact of high occupancy at the time of admission,7,12,13,14,15 few have assessed the impact of occupancy at ICU discharge.6

Theoretically, occupancy strain at discharge may lead to patients being discharged prematurely and/or sub-optimally, resulting in clinical consequences such as readmission and mortality. Afterhours discharge may act as a mediator between discharge occupancy and clinical outcomes (Fig. 1). As occupancy strain increases, clinicians may be pushed to discharge patients at non-opportune times resulting in communications errors and a mismatch between the care available and the needs of the patient.3,8,9 Nevertheless, it is unknown whether discharge occupancy is associated with afterhours discharge. Additionally, there is a paucity of contemporary, patient-level data evaluating the association between high occupancy at ICU discharge and clinical outcomes such as readmission and subsequent mortality. Many tertiary and quaternary centres have developed new strategies to deal with increasing admission demand, and previous studies that used aggregate data from mostly small centres with fixed ICU capacities and open models of care are unlikely to be applicable.6

Fig. 1
figure 1

Schematic of the theoretical relationship between discharge occupancy, afterhours discharge, and clinical outcomes in the ICU. *Afterhours discharge is also considered an outcome of ICU strain; ICU = intensive care unit.

The objective of this single-centre historical cohort study was to explore the association between ICU occupancy on the day of discharge and afterhours discharges, subsequent 72-hr readmission, and 30-day mortality.

Methods

Study design and setting

We conducted a historical cohort study of all patients discharged from the ICU at Vancouver General Hospital between 5 April 2010 and 13 September 2017. Results are reported in accordance with the STrengthening the Reporting of Observational Epidemiology (STROBE) statement and the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) extension for routinely collected data.16,17 The ICU is a closed, 32-bed mixed medical surgical unit affiliated with the University of British Columbia. It operates on an approximately 1:1.2 nurse to patient ratio. When all ICU beds are filled, additional patients admitted to the ICU are attended to by the ICU care team in off-service beds (e.g., post-anesthetic care unit and emergency department). During the study period in April 2014, the size of the ICU increased from 27 to 31 physical beds and then from 31 to 32 beds in April 2016. There is also a 12-bed high acuity unit (HAU) for patients needing a higher level of care but not requiring advanced life-sustaining therapies. The HAU opened in September 2015 and admits patients who require vasoactive medications or non-invasive ventilation. Additionally, the HAU can function as a step-down unit for the ICU. Patients admitted solely to the HAU were excluded from this analysis. Patients in the ICU and HAU are cared for by one of three physician teams, each consisting of an attending intensive care physician, resident physicians (variety of subspecialty residents, including critical care medicine fellows) and other clinical staff (nurses, respiratory therapists, pharmacists, dieticians, and physical and occupational therapists). Discharge readiness is assessed by the attending physician.

Data

Data were obtained from the British Columbia Critical Care Database, which records patient-specific data for all patients admitted to the ICU. Patient-specific data included baseline demographics (age, sex), primary diagnosis, and illness acuity. Illness acuity was characterized by the sequential organ function assessment (SOFA), which is a commonly utilized mortality prediction score based on the level of dysfunction present in six organ systems.18 Scores can range from 0 to 24 and greater scores are associated with greater risk of mortality and readmission to the ICU.9,10,11 The SOFA score was determined at the time of ICU admission. This database also included daily operational factors such as the number of patients discharged, hours of patient care performed, and number of available beds. There were 152 discharges (1.7%) missing an admission SOFA score. Of these 152, 120 (79%) had SOFA scores calculated at some point during their ICU stay but not at admission. Discharges missing admission SOFA scores were not included in the logistic regression models. There were no other missing data. Study investigators had full access to the data set.

Exposure

By linking each ICU discharge to daily ICU characteristics, we were able to identify several indicators of capacity strain for each individual ICU discharge. Our principal exposure included ICU occupancy at discharge. Occupancy was defined as the number of hours of ICU patient care delivered in a day divided by the total amount of hours of care available for that day (number of funded beds x 24 hr). This method is considered to be a better representation of ICU capacity strain compared with other methods of determining occupancy, such as a simple patient census.19,20 The occupancy on the day of ICU discharge was calculated for each discharge. Additional exposures of ICU capacity strain included the total number of admissions in the 24 hr preceding that specific discharge. For example, if a patient was discharged at 15:00, all ICU admissions from that instance to 15:00 the day prior were totalled. Delayed discharge was defined as a delay of six or more hours between the time a patient was labelled appropriate for discharge and when that patient physically left the ICU. This definition of delayed discharge has been utilized in a previous analysis21 while other studies have used either four or eight hours.22 Temporal factors were also included such as weekend discharge (Saturday to Sunday) and season of discharge (winter [December to February], spring [March to May], summer [June to August], fall [September to November]). The number of funded beds by era were also included as a categorical variable (n = 27 [April 2010 to March 2014], n = 31 [April 2014 to March 2016], n = 32 [April 2016 to August 2017]) along with a binary variable of pre- and post-HAU creation (September 2015).

Outcomes

Outcomes of interest included afterhours discharge, 72-hr readmission, and 30-day mortality. Afterhours discharge was defined as any discharge from the ICU between 22:00 and 06:59. This definition is a commonly used standard in Canadian and United Kingdom practice and has been used in more contemporary analyses of larger tertiary and quaternary centres.4,23 Seventy-two-hour readmission was defined as any patient who was discharged and admitted back to the ICU within 72 hr. We chose 72 hr as our readmission time frame as it is commonly used metric to indicate readmissions that are thought to be avoidable, and it represents the median time to ICU readmission from previous large epidemiological studies.24,25 Thirty-day mortality was defined as any death (regardless of location) that occurred within 30 days of being discharged from the ICU. A period of 30 days was chosen as it represents a reasonable timeframe to assume that mortality may be related to ICU discharge. Deaths occurring 30 days post discharge are very unlikely to be related to any strain factor that occurred at discharge.

Statistical methods

The base unit of analysis was ICU discharge and data were treated as longitudinal, controlling for repeatedly discharged patients. Sample size was one of convenience, acknowledging that over a seven-year period we would have an adequate number of events to build a robust multivariable model. Descriptive statistics were presented for the overall cohort and for each ascending quintile of discharge occupancy. All continuous variables were presented as mean (standard deviation) and categorical variables were presented as total number (%) unless otherwise stated.

We constructed three logistic regression models to evaluate the association between ICU discharge occupancy (per 10% increase) and afterhours discharge, 72-hr readmission, and 30-day mortality. Since patients could have more than one ICU discharge, we accounted for within-patient correlation using a mixed-effects logistic regression model with the random-effect specified at the patient level (STATA command xtlogit). Standard errors were determined from the observed information matrix based on the asymptotic maximum-likelihood theory. In each model, we controlled for important baseline covariates such as age (per one-year increase), sex (male vs female), admission SOFA score (per one-unit increase), primary diagnosis category (e.g., shock), season of discharge (e.g., winter), discharge location (e.g., medical ward), HAU epoch (pre vs post), and number of funded beds epoch (e.g., April 2010 to March 2014). Other possible metrics of capacity strain such as the total number of ICU admissions in the 24 hr prior to discharge, delayed discharges (yes/no), and weekend discharge (Sat/Sun) were included. For the 72-hr readmission model, we included afterhours discharge as a predictor variable. Additionally, for the 30-day mortality model, we included both afterhours discharge and 72-hr readmission as predictor variables. Results of the logistic regression models were displayed as odd ratios (OR) with 95% confidence intervals (CI). Conceptually, we considered afterhours discharge to be a potential mediator between discharge occupancy and clinical outcomes (Fig. 1). Nevertheless, based on null associations with 72-hr readmission and 30-day mortality in our model, a mediation analysis was not justified.26,27

To adjust for non-linear relationships, we incorporated restricted cubic spline transformations within our logistic regression models (STATA commands mkspline & xbrcspline) to visually characterize the relationship between discharge occupancy and the odds of afterhours discharges, 72-hr readmission, and 30-day mortality. These models consisted of four knots and adjusted for important baseline covariates (same as logistic regression models). Discharge occupancy was rounded to the nearest 5% and corresponding adjusted odds ratios (aOR) with 95% CI were determined for afterhours discharges, 72-hr readmission, and 30-day mortality. A reference value of 70% was chosen as it corresponded with the lowest occupancy value.

Several sensitivity analyses were conducted to ensure the robustness of our results. We assessed whether altering the definition of afterhours discharge from 22:00–6:59 to 19:00–6:59 would alter any study results. This more liberal definition has sometimes been used in previous literature.3 We conducted an analysis of ICU discharges with a SOFA score at the time of discharge available. This applied only to patients with an ICU length of stay less than seven days as SOFA is only calculated daily for the first week. We also wanted to evaluate whether weekend discharge modified any associations between discharge occupancy, afterhours discharge, and clinical outcomes. We also evaluated whether afterhours discharge modified the effect of discharge occupancy on 72-hr readmission and 30-day mortality. Lastly, multicollinearity between the number of admissions in the 24 hr prior to discharge and discharge occupancy was evaluated. All analyses were performed using STATA (StataCorp. 2017. Stata Statistical Software: Release 15. College Station, StataCorp LLC, TX, USA).

Results

Descriptive statistics

A total of 8,862 discharges, representing 7,288 individual patients from the ICU, occurred between 5 April 2010 and 13 September 2017. All discharges during this period were included in this analysis. A total of 1,180 (13.3%) afterhours discharges, 408 (4.6%) 72-hr readmissions, and 574 (6.5%) 30-day post-discharge deaths occurred. Complete descriptive statistics for the overall cohort and by discharge occupancy quintile are presented in Table 1. The range of discharge occupancy values associated with each quintile are 68–90% (quintile 1), 91–94% (quintile 2), 95–99% (quintile 3), 100–106% (quintile 4), and 106–137% (quintile 5).

Table 1 Demographics

Afterhours discharges

In the crude analysis, each 10% increase in discharge occupancy was associated with an 19% increase in the odds of afterhours discharge (OR, 1.19; 95% CI, 1.11 to 1.27; P < 0.001, per 10% increase). After adjusting for covariates, increasing discharge occupancy remained significantly associated with afterhours discharge (Table 2). An adjusted restricted cubic spline model for the association between discharge occupancy and afterhours discharge is presented in both Figs 2 and 3. Each additional admission to the ICU in the 24 hr prior to discharge resulted in a 12% increase in the odds of afterhours discharge (aOR, 1.12; 95% CI, 1.08 to 1.16; P < 0.001) (Table 2). The remaining results of the adjusted logistic regression model for afterhours discharge are presented in Table 2.

Table 2 Adjusted logistic regression models for afterhours discharge, 72-hr readmission, and 30-day mortality
Fig. 2
figure 2

Adjusted a restricted cubic splines for ICU occupancy at discharge vs odds of afterhours discharge and 72-hr readmission. a Regression models are adjusted for age, female sex, SOFA score at admission, afterhours discharges, weekend discharges, delayed discharge, number of ICU admissions in 24 hr prior to discharge, primary diagnosis, source of discharge, season, number of funded ICU beds, and post-HAU creation. HAU = high acuity unit; ICU = intensive care unit; SOFA = sequential organ function assessment.

Fig. 3
figure 3

Adjusted a restricted cubic splines for ICU occupancy at discharge vs odds of afterhours discharge and seven-day mortality. a Regression models are adjusted age, female sex, SOFA score at admission, afterhours discharges, weekend discharges, delayed discharge, number of ICU admissions in 24 hr prior to discharge, primary diagnosis, source of discharge, season, number of funded ICU beds, and post-HAU creation. HAU = high acuity unit; ICU = intensive care unit; SOFA = sequential organ function assessment.

Seventy-two hour readmission

In the crude analysis, there was no association between discharge occupancy and 72-hr readmission to the ICU (OR, 1.00; 95% CI, 0.89 to 1.11; P = 0.97, per 10% increase). After adjustment, the lack of association between increasing discharge occupancy and the odds of 72-hr readmission persisted (Table 2). An adjusted restricted cubic spline model for the association between discharge occupancy and 72-hr readmission is presented in Fig. 2. In the adjusted model, afterhours discharges from the ICU were not associated with any statistically significant difference in the odds of 72-hr readmission (aOR, 1.15; 95% CI, 0.86 to 1.54; P = 0.34) (Table 2). The remaining results of the adjusted logistic regression model for 72-hr readmission are presented in Table 2.

Thirty-day mortality

In the crude analysis, discharge occupancy was not associated with 30-day mortality (OR, 1.04; 95% CI, 0.96 to 1.14; P = 0.32, per 10% increase). In the adjusted model, the lack of association between discharge occupancy and 30-day mortality persisted (Table 2). An adjusted restricted cubic spline model for the association between discharge occupancy and 30-day mortality is presented in Fig. 3. In the adjusted model, afterhours discharge was not associated with any statistically significant difference in the odds of 30-day mortality (aOR, 1.05; 95% CI, 0.82 to 1.36; P = 0.69) (Table 2). Seventy-two-hour readmission to the ICU was associated with a statistically significant increase in the odds of 30-day mortality (aOR, 1.51; 95% CI, 1.07 to 2.14; P = 0.02) (Table 2). The remaining results of the adjusted logistic regression model for 30-day mortality are presented in Table 2.

Sensitivity analyses

Altering the definition of afterhours discharge to any discharge between 19:00 and 6:59 (vs 22:00–6:59) did not alter the study findings (eTable 1, available as Electronic Supplementary Material [ESM]). Furthermore, there were no significant differences in model results when readmission timeframe was extended to seven days and 30 days and all (< 30 day and > 30 day) post-discharge deaths were included (eTables 2 and 3, available as ESM). Sensitivity analyses of ICU length of stay and discharge year are also provided (eTables 4 and 5, available as ESM). A subgroup analysis of 6,347 discharges (5,526 unique patients) with discharge SOFA scores available (ICU length of stay less than seven days) did not result in any deviations from study findings (eTable 6, available as ESM). Weekend discharge was not found to modify the effect between discharge occupancy, afterhours discharge, and clinical outcomes (72-hr readmission and 30-day mortality) (eTable 7, available as ESM). Additionally, afterhours discharge itself did not modify the effect of discharge occupancy on 72-hr readmission and 30-day mortality (eTable 8, available as ESM). There was no indication of significant collinearity between discharge occupancy and number of admissions in the prior 24 hr (eTable 9, available as ESM).

Discussion

In our single-centre historical study of 8,862 ICU discharges over a seven-year period, ICU occupancy on the day of discharge was associated with increased odds of afterhours discharge. Yet, neither discharge occupancy nor afterhours discharge were associated with clinical outcomes such as 72-hr readmission and 30-day post-discharge mortality.

This study presents a novel analysis of the association between ICU discharge occupancy and the odds of afterhours discharge. Previous studies have focused solely on either afterhours discharge4,5,6,9,10,11,23,28 or discharge occupancy6,29 separately when assessing their independent effects on patient outcomes. We specifically wanted to evaluate if greater strain, such as higher occupancy on the day of discharge, would modify the discharge process by pushing clinicians to discharge patients from the ICU at night. It is known that afterhours or night-time discharges are strongly avoided because of the strong association with increased readmission and mortality risk in previous studies.4,5,8,9,10,11 Our results show that higher discharge occupancy is associated with increased odds of afterhours discharge, but not in a linear fashion. Instead, there appears to be a steady climb in the odds of afterhours discharge as occupancy approaches near capacity (100%), which then plateaus once occupancy is over capacity (> 100%). This mirrors results from a large Scottish analysis that found a notable increase in early discharges from the ICU when ICU occupancy was > 80%, which plateaued once overcapacity was reached.30 Furthermore, we included the number of ICU admissions in the 24 hr prior to discharge as an additional measure of capacity strain. We observed that for each additional admission to the ICU in the preceding 24 hr there was a statistically significant increase in the odds of afterhours discharge. These are important findings as it shows that capacity strain, as indicated by both high discharge occupancy and the number of admissions in the 24 hr prior to discharge, can impact the timing, and more broadly, the process of discharge.

Our next objective was to assess whether high occupancy at discharge was associated with clinical outcomes such as 72-hr readmission and 30-day mortality. Few studies have evaluated the effects of high occupancy at discharge on subsequent clinical outcomes. One study using aggregate data from 155 ICUs in the US between 2001 and 2008 determined that a higher census on the day of discharge was associated with ICU readmissions but not subsequent mortality.6 Although a signal for increased readmissions was present, the authors stressed that the lack of mortality signal may indicate that clinicians are safely discharging ICU patients even during periods of increased strain. One drawback of this analysis is that occupancy was the census on the day of discharge standardized to the average annual census from the respective centre. Although grossly indicative of capacity strain, total daily census is a less desirable measure of occupancy as it is summation of total patients rather than the quantity of patient care hours provided.19,20 For instance, if five patients are discharged from the ICU in the morning, all five of those patients are included in the daily census despite them not being present in the ICU. A more precise and accurate method of calculating occupancy, and the method used in this analysis, is to calculate the fraction total hours of patient care delivered in a day by the total funded hours available.20 A single-centre analysis of 8,693 discharges between 1989 and 1996 showed that lack of ICU bed vacancy at the time of discharge was associated with a statistically significant 56% increase in the odds of early death and readmission.29 Nevertheless, lack of bed vacancy is a cruder, binary metric of occupancy that may be more reflective of the normality rather than increased strain in modern, large ICUs. As well, ICUs may “hold” patients that are ready for discharge when there are no incoming patients. In this circumstance, lack of an available bed may not necessarily reflect increased capacity strain. In our adjusted analysis, controlling for baseline covariates showed that discharge occupancy was not associated with 72-hr readmission or 30-day mortality. It was originally hypothesized that higher occupancy at discharge may lead to increased pressure on the ICU team to prematurely discharge patients, resulting in increased rates of 72-hr readmission and 30-day mortality. Nevertheless, our findings do not suggest this. Although high occupancy may impact discharge decisions, such as discharging during afterhours, it did not impact clinical outcomes at our centre.

Our final objective was to determine if afterhours discharge at our centre was associated with 72-hr readmission and 30-day mortality. Afterhours discharge has been previously shown to increase the risk of readmission and subsequent mortality.4,5,8,9,10,11 A recent meta-analysis pooling data from 1,191,178 patients across 18 cohort studies showed that afterhours discharges were associated with a statistically significant 42% increase in the odds of mortality (OR, 1.42; 95% CI, 1.32 to 1.53; P < 0.0001).4 Additionally, afterhours discharge was associated with a greater rate of readmission (6.3% vs 5.1%; P < 0.0001). Interestingly, in our adjusted models, we did not observe any effect of afterhours discharge itself on 72-hr readmission or 30-day mortality. This aligns with our findings that occupancy at discharge was not associated with subsequent clinical outcomes.

A variety of centre-specific variables may explain why increased capacity strain did not result in clinical consequences. Similar to many larger ICUs in Canada, our ICU operates routinely near capacity and often, over capacity. Our total beds available are not fixed and patients can be admitted to the ICU service despite not physically being present in an ICU bed, leading to occupancy values above 100%. In response to this increasing burden, our centre introduced a Critical Care Outreach Team in 2008 that re-assesses all patients discharged from the ICU within 12 hr. Moreover, our centre possesses a 12-bed HAU that can admit patients from the ICU, functioning as a step-down unit for patients who may not be ready for the hospital wards. A recent analysis showed that implementation of a rapid response team, similar to our Critical Care Outreach Team, had marked benefits with respect to ICU workflow by reducing ICU admissions and occupancy.31 Perhaps the combination of our flexible ICU capacity, Critical Care Outreach Team, and HAU services provides the structural support needed to mitigate the clinical consequences of capacity strain. It is well known and understandable that ICU physicians and staff experience increased stress during periods of increased capacity strain.32,33,34 Our study does validate that capacity strain, such as high occupancy, modifies the discharge process by increasing the number of afterhours discharges. Yet, we show that despite increased capacity strain, clinicians at our centre appear to be efficiently and safely discharging patients from the ICU.

Limitations of our analysis should be noted. Our study is a single-centre analysis of a large quaternary ICU centre and our results may not be generalizable to other centres. Although we incorporated a more accurate and precise metric of determining occupancy on the day of discharge, this value is still ultimately aggregated over a calendar day and does not represent the instantaneous burden of occupancy at the exact time of discharge. An additional limitation of our analysis is the inability to determine whether a patient was discharged from the ICU with a “do not readmit” status. This may occur if a patient is palliative and the level of care has been modified. In times of increased strain, these patients may be discharged from the ICU but are ineligible to be readmitted to the ICU. Theoretically, this would bias our results towards the null (type 2 error) for readmission and towards significance (type 1 error) for post-discharge mortality. Nevertheless, patients who are ineligible to return to the ICU likely represent a very small fraction of our overall population. Lastly, our study is historical and observational in nature and although we have attempted to adjust for important baseline covariates there is certainly unmeasured and residual confounding that could provide an alternate explanation for our findings.

Conclusion

In summary, we showed that greater ICU occupancy on the day of discharge was associated with a significant increase in afterhours discharges. Nevertheless, neither discharge occupancy nor afterhours discharge were associated with an increase in 72-hr readmission or 30-day mortality at our large quaternary centre.