- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Research Data /
- Validation of a risk-prediction model for pediatric...
Open Collections
UBC Research Data
Validation of a risk-prediction model for pediatric post-discharge mortality at two hospitals in Rwanda Hooft, Anneka; Kornblith, Aaron E; Umhoza, Christian; Trawin, Jessica; Mfuranziza, Cynthia Grace; Uwiragiye, Emmanuel; Zhang, Cherri; Nguyen, Vuong; Lewis, Peter; Wiens, Matthew O
Description
<br/><strong>Background:</strong>Mortality following hospital discharge remains a significant threat to child health, particularly in resource-limited settings. In Uganda, the Smart Discharges risk-prediction models have demonstrated success in their ability to predict those at highest risk of death after discharge and use this to guide a risk-based approach to post-discharge care in children admitted with suspected sepsis. Respective prediction models for post-discharge mortality in ages 0-6 months and ages 6-60 months were developed in this cohort but have not yet been validated outside of Uganda. This study aimed to externally validate existing risk prediction models for pediatric post-discharge mortality within the Rwandan context.<br /> <br /><strong>Methods:</strong> Prospective cohort of children 0d-60 mos admitted with suspected sepsis at two hospitals in Rwanda: Ruhengeri Referral Hospital in Musanze (rural) and University Hospital of Kigali in Kigali (urban) from May 2022 to February 2023. Vital status follow up was conducted at 2-, 4- and 6-months post-discharge.<br /> <br />Five existing models from Smart Discharges Uganda were validated in this cohort: two models for children 0-6 months, and three for children 6-60 months. Models were applied to each participant in the Rwanda cohort to obtain a risk score which was then used to calculate predicted probability of post-discharge death. Model performance was evaluated by comparing to observed outcomes and to determine sensitivity, specificity, and AUROC. Threshold was set at 80% sensitivity. .<br /> <br /><strong>Findings:</strong>In a cohort of 1218 children, 1123 children (96.7%) completed follow up. The overall rate of post-discharge mortality was 4.8% (n=58). The highest performing models had an AUROC of 0.75 (0-6 mos) and 0.74 (6-60mos), respectively. All five prediction models tested achieved an AUROC greater than 0.7 (range 0.706 - 0.738). Model degradation (determined by the percent reduction in AUC between the original model and the derived model) was relatively low, ranging from from 1.1% to 7.7%. Calibration plots showed good calibration for all models at predicted probabilities below 10%. There were too few outcomes to assess calibration among those at higher levels of predicted risk. <br /> <br /><strong>Data Processing Methods:</strong> <br /> <br /><strong>Ethics Declaration:</strong> Ethical approval was obtained from the University of Rwanda College of Medicine and Health Sciences (No 411/CMHS IRB/2021); University Teaching Hospital of Kigali (EC/CHUK/005/2022), University of California San Francisco (381688) and the University of British Columbia (H21-02795).<br />; <br /><strong>NOTE for restricted files:</strong> If you are not yet a CoLab member, please complete our <a href = "https://rc.bcchr.ca/redcap/surveys/?s=EDCYL7AC79">membership application survey</a> to gain access to restricted files within 2 business days. <br />Some files may remain restricted to CoLab members. These files are deemed more sensitive by the file owner and are meant to be shared on a case-by-case basis. Please contact the CoLab coordinator at <a href = mailto:sepsiscolab@bccchr.ca>sepsiscolab@bcchr.ca</a> or visit our <a href = "https://wfpiccs.org/pediatric-sepsis-colab/">website</a>.
Item Metadata
Title |
Validation of a risk-prediction model for pediatric post-discharge mortality at two hospitals in Rwanda
|
Creator | |
Contributor | |
Date Issued |
2024-04-11
|
Description |
<br/><strong>Background:</strong>Mortality following hospital discharge remains a significant threat to child health, particularly in resource-limited settings. In Uganda, the Smart Discharges risk-prediction models have demonstrated success in their ability to predict those at highest risk of death after discharge and use this to guide a risk-based approach to post-discharge care in children admitted with suspected sepsis. Respective prediction models for post-discharge mortality in ages 0-6 months and ages 6-60 months were developed in this cohort but have not yet been validated outside of Uganda. This study aimed to externally validate existing risk prediction models for pediatric post-discharge mortality within the Rwandan context.<br />
<br /><strong>Methods:</strong> Prospective cohort of children 0d-60 mos admitted with suspected sepsis at two hospitals in Rwanda: Ruhengeri Referral Hospital in Musanze (rural) and University Hospital of Kigali in Kigali (urban) from May 2022 to February 2023. Vital status follow up was conducted at 2-, 4- and 6-months post-discharge.<br />
<br />Five existing models from Smart Discharges Uganda were validated in this cohort: two models for children 0-6 months, and three for children 6-60 months. Models were applied to each participant in the Rwanda cohort to obtain a risk score which was then used to calculate predicted probability of post-discharge death. Model performance was evaluated by comparing to observed outcomes and to determine sensitivity, specificity, and AUROC. Threshold was set at 80% sensitivity.
.<br />
<br /><strong>Findings:</strong>In a cohort of 1218 children, 1123 children (96.7%) completed follow up. The overall rate of post-discharge mortality was 4.8% (n=58). The highest performing models had an AUROC of 0.75 (0-6 mos) and 0.74 (6-60mos), respectively. All five prediction models tested achieved an AUROC greater than 0.7 (range 0.706 - 0.738). Model degradation (determined by the percent reduction in AUC between the original model and the derived model) was relatively low, ranging from from 1.1% to 7.7%. Calibration plots showed good calibration for all models at predicted probabilities below 10%. There were too few outcomes to assess calibration among those at higher levels of predicted risk.
<br />
<br /><strong>Data Processing Methods:</strong> <br />
<br /><strong>Ethics Declaration:</strong> Ethical approval was obtained from the University of Rwanda College of Medicine and Health Sciences (No 411/CMHS IRB/2021); University Teaching Hospital of Kigali (EC/CHUK/005/2022), University of California San Francisco (381688) and the University of British Columbia (H21-02795).<br />; <br /><strong>NOTE for restricted files:</strong> If you are not yet a CoLab member, please complete our <a href = "https://rc.bcchr.ca/redcap/surveys/?s=EDCYL7AC79">membership application survey</a> to gain access to restricted files within 2 business days.
<br />Some files may remain restricted to CoLab members. These files are deemed more sensitive by the file owner and are meant to be shared on a case-by-case basis. Please contact the CoLab coordinator at <a href = mailto:sepsiscolab@bccchr.ca>sepsiscolab@bcchr.ca</a> or visit our <a href = "https://wfpiccs.org/pediatric-sepsis-colab/">website</a>.
|
Subject | |
Type | |
Language |
English
|
Date Available |
2024-04-11
|
Provider |
University of British Columbia Library
|
License |
CC BY-NC-SA 4.0
|
DOI |
10.14288/1.0441295
|
URI | |
Publisher DOI | |
Grant Funding Agency |
Thrasher Research Fund; University of California, San Francisco
|
Rights URI | |
Aggregated Source Repository |
Dataverse
|
Item Media
Item Citations and Data
Licence
CC BY-NC-SA 4.0