U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Cover of Evidence review for preoperative risk stratification tools

Evidence review for preoperative risk stratification tools

Perioperative care in adults

Evidence review C

NICE Guideline, No. 180

.

London: National Institute for Health and Care Excellence (NICE); .
ISBN-13: 978-1-4731-3827-8

1. Preoperative risk stratification tools

1.1. Review question: Which validated preoperative risk stratification tools best identify increased risk of mortality and morbidity in adults who will be undergoing surgery?

1.2. Introduction

The conundrum facing all perioperative clinicians when evaluating patients for surgery remains how best to evaluate and quantify the risk of undergoing the anticipated procedure. There are a number of reasons why this is a key element of evaluation during the preoperative clinical encounter. Firstly, establishing objective understanding of the anticipated mortality and morbidity risk allows and directs discussions with other involved clinicians about the appropriateness of the planned surgery and whether it should proceed as planned, should be abbreviated, or whether alternative non-surgical options should be considered. Secondly, being able to quantify morbidity risk allows planning for post-operative destination, discussions about quality of life and recovery or convalescence and to give insight to the patient about the anticipated clinical course. Understanding these elements allows frank discussions about what the patients actually wish to achieve from the surgical encounter. Furthermore this opens the discussions amongst all parties for shared decision making about the best outcome decision that will meet the goals of the involved parties.

Thus it becomes incumbent on perioperative clinicians to find robust, reliable and accurate tools that will allows us to determine bespoke perioperative risk for each individual patient allowing these discussions and decisions to proceed smoothly. Current practice appears to be that many perioperative clinicians use risk stratification tools but not in a uniform or unified fashion. Different tools are used with different sensitivities and specificities and are not uniformly applied to all surgical populations. There does not exist a national recommendation or standard on which tools to use, how they should be applied, nor even that a risk stratification tool should be consistently used in the perioperative setting at all.

The committee agreed this was a fundamental aspect that required investigation of existing evidence around such tools with the intention to set a recommendation standard in this area of perioperative care.

1.3. PICO table

For full details see the review protocol in Appendix A:.

Table 1. PICO characteristics of review question.

Table 1

PICO characteristics of review question.

1.4. Clinical evidence

1.4.1. Included studies

Sixty studies were included in the review;11, 14, 17, 18, 20, 22, 24, 25, 27, 32, 33, 37, 39, 43, 45, 47, 48, 51, 54, 56, 57, 59, 6163, 65, 69, 70, 74, 78, 84, 88, 93, 94, 101, 105, 110, 116, 118, 120, 136, 138, 142, 149, 151, 155, 157, 161, 162, 165, 166, 170, 171, 177, 179, 182, 183, 186, 187, 189 these are summarised in Table 2 below. Evidence from these studies is summarised in the clinical evidence summary below (Table 3).

See also the study selection flow chart in Appendix C: and study evidence tables in Appendix D:.

1.4.2. Excluded studies

See the excluded studies list in appendix J.

1.4.3. Summary of clinical studies included in the evidence review

Table 2. Summary of studies included in the evidence review.

Table 2

Summary of studies included in the evidence review.

See Appendix D:for full evidence tables.

1.4.4. Quality assessment of clinical studies included in the evidence review

1.1. Discrimination

Table 3. Clinical evidence profile.

Table 3

Clinical evidence profile.

1.2. Calibration

Risk toolNo of studiesnRisk of biasInconsistencyIndirectnessImprecisionObserved/Expected ratio (median, range)Quality
Mortality
POSSUM105252Serious risk of biasSerious inconsistencyNo serious indirectnessnot estimable

0.86

(0–1.73)

Very low
P-POSSUM108029Serious risk of biasSerious inconsistencyNo serious indirectnessnot estimable

1.03

(0.56–15.87)

Very low
NSQIP42634Serious risk of biasSerious inconsistencyNo serious indirectnessnot estimable

1.23

(0.64–1.28)

Very low
E-PASS1100Serious risk of biasNo serious inconsistencyNo serious indirectnessnot estimable1Low
ASA11186Serious risk of biasNo serious inconsistencyNo serious indirectnessnot estimable1.08Low
SRS1949Serious risk of biasNo serious inconsistencyNo serious indirectnessnot estimable0.81Low
Morbidity (composite outcome)
POSSUM93356Serious risk of biasSerious inconsistencyNo serious indirectnessnot estimable

1

(0.8–1.44)

Very low
NSQIP53510Serious risk of biasSerious inconsistencyNo serious indirectnessnot estimable

1.06

(0.76–1.84)

Very low
a)

Risk of bias was assessed using the PROBAST checklist. Downgraded by 1 increment if the majority of the evidence was at high risk of bias, and downgraded by 2 increments if the majority of the evidence was at very high risk of bias

b)

Inconsistency was assessed by visual inspection of a plotted summary where reported.

c)

The judgement of precision was not possible in the absence of the confidence region of the O/E ratio, summary ratios were downgraded due to this limitation.

1.3. Economic evidence

1.3.1. Included studies

No health economic studies were included.

1.3.2. Excluded studies

No relevant health economic studies were excluded due to assessment of limited applicability or methodological limitations.

See also the health economic study selection flow chart in Appendix H:.

1.4. Evidence statements

1.4.1. Clinical evidence statements

Risk tools mortality concordance

Thirteen studies reported an accuracy of 47–95% with POSSUM predicting mortality, with a median c-statistic of 82% (n=10811, Very low quality evidence)

Eighteen studies reported an accuracy of 56–94% with P-POSSUM predicting mortality, with a median c-statistic of 81% (n=15579, Very low quality evidence)

Eight studies reported an accuracy of 62–97% with NSQIP predicting mortality, with a median c-statistic of 83% (n=241905, Low quality evidence)

Two studies reported an accuracy of 82–84% with E-PASS for predicting mortality, with a median c-statistic of 83% (n=5372, Low quality evidence)

Seven studies reported an accuracy of 59–93% with ASA for predicting mortality, with a median c-statistic of 77% (n=58056, Very low quality evidence)

Four studies reported an accuracy of 58–86% with Charlson Comorbidity Index for predicting mortality, with a median c-statistic of 77% (n=136995, Very low quality evidence)

One study reported an accuracy of 80% with SORT for predicting mortality (n=78, Very low quality evidence)

Five studies reported an accuracy of 66–93% with SRS for predicting mortality of, with a median c-statistic of 85% (n=8160, Very low quality evidence)

Risk tools morbidity concordance

Nine studies reported an accuracy of 56–84% with POSSUM for predicting morbidity, with a median c-statistic of 75% (n=2673, Very low quality evidence)

One study reported an accuracy of 61% with P-POSSUM for predicting morbidity (n=113, Low quality evidence)

Eight studies reported an accuracy of 55–88% with NSQIP for predicting morbidity, with a median c-statistic of 62.5% (n=4819, Very low quality evidence)

Three studies reported an accuracy of 59–68% with E-PASS for predicting morbidity, with a median c-statistic of 67% (n=1093, Very low quality evidence)

Ten studies reported an accuracy of 52–93% with ASA for predicting morbidity, with a median c-statistic of 69% (n=66792, Very low quality evidence)

Four studies reported an accuracy of 56–69% with Charlson Comorbidity Index for predicting morbidity, with a median c-statistic of 64% (n=103357, Very low quality evidence)

Risk tools mortality calibration

Ten studies reported a predictive accuracy of POSSUM for mortality with median O/E ratio of 0.86 (n=5252, Very low quality evidence)

Ten studies reported a predictive accuracy of P-POSSUM for mortality with median O/E ratio of 1.03 (n=8029, Very low quality evidence)

Four studies reported a predictive accuracy of NSQIP for mortality with median O/E ratio of 1.23 (n=2634, Very low quality evidence)

One study reported a predictive accuracy of E-PASS for mortality with median O/E ratio of 1 (n=100, Low quality evidence)

One study reported a predictive accuracy of ASA for mortality with median O/E ratio of 1.08 (n=1186, Low quality evidence)

One study reported a predictive accuracy of SRS for mortality with median O/E ratio of 0.81 (n=949, Low quality evidence)

Risk tools morbidity calibration

Nine studies reported a predictive accuracy of POSSUM for morbidity with median O/E ratio of 1 (n=3356, Very low quality evidence)

Five studies reported a predictive accuracy of NSQIP for morbidity with median O/E ratio of 1.06 (n=3510, Very low quality evidence)

1.4.2. Health economic evidence statements

  • No relevant economic evaluations were identified.

1.5. The committee’s discussion of the evidence

Please see recommendations 1.3.1 – 1.3.2 in the guideline.

1.5.1. Interpreting the evidence

1.5.1.1. The outcomes that matter most

The committee highlighted that a key goal of preoperative risk assessment is to identify and stratify those at increased risk of mortality and morbidity. As such, the main outcomes included in this evidence review was the predictive accuracy of risk tools, as measured by sensitivity, specificity, predictive values, c-statistic data, and predicted risk versus observed risk (calibration data). The risk prediction tools do not predict or report specific morbidities, rather morbidity rate as a composite outcome.

1.5.1.2. The quality of the evidence

The quality of evidence varied from low to very low. Studies were downgraded for risk of bias inconsistency and imprecision. Risk of bias was generally serious or very serious due to unclear methodology in terms of blinding of risk tool and outcome data. A large proportion of the available concordance data had no reported variance data (such as 95% CI). As such, many of the outcomes were downgraded for a subsequent risk of inconsistency and possible imprecision. Due to the method of reporting and analysis of the calibration data with observed/expected ratios, it was also not possible to ascertain variance data. These outcomes were subsequently downgraded due to the uncertainty around outcome precision.

1.5.1.3. Benefits and harms

The committee agreed that an accurate risk prediction tool can have benefits in directing discussions between clinicians about the appropriateness of the planned surgery and whether it should proceed as planned, should be abbreviated, or whether alternative non-surgical options should be considered. Additionally, the committee suggested that being able to quantify morbidity risk allows planning for post-operative destination, discussions about recovery or convalescence and the anticipated clinical course. Effective risk tools can subsequently have a benefit on patient experience and postoperative quality of life. One possible disadvantage (harm) of using risk tools is underestimating mortality or morbidity risk, which may lead to insufficient attention to preventable risks, insufficient monitoring or surgery being performed when alternative options may be more appropriate. Another potential harm is over-estimating operative risk, which can lead to unnecessary over-vigilance and possibly reluctance on the part of the patient (and maybe clinician) to commence surgery. Thus using accurate risk prediction was seen by the GC as vital to maximise benefits and minimise harms.

The committee discussed the results and utility of the risk tools reviewed and agreed that a concordance (c-statistic) of >80% represents a good level of predictive accuracy, with results of >90% demonstrating an excellent test. The committee added that a test yielding <70% accuracy would be considered poor. The committee also noted that calibration data showing a test observed/expected ratio of 0.9–1.1 would be considered a fair level of accuracy, adding that it would be better to overestimate the event rate than to underestimate morbidity or mortality.

The committee agreed that tools such as POSSUM, P-POSSUM, NSQIP, E-PASS and SRS showed a fair level of accuracy for mortality with median c-statistic of ~85%. The committee highlighted that there was notable inconsistency in the accuracy of tools in the prediction of mortality and morbidity, with most tools ranging from ~60% to ~90% accuracy for predicting mortality.

The committee noted that all tools were less accurate in predicting morbidity showing a predictive accuracy of ~60–70%, but agreed that this was expectedly lower than the accuracy in predicting mortality and could still be informative for a healthcare professional and patient scheduled to undergo surgery.

The committee agreed that the evidence on risk tool calibration showed significant inconsistency between studies, limiting the utility of these results. As such, the committee weighted the majority of their discussions on the benefits and harms of risk tools on risk tool concordance evidence.

The committee considered that the noted variation in results could be due to the heterogeneity in study populations, with included studies providing risk prediction for a range of varied types of surgery. This was a notable concern to the committee, and while they felt confident that risk tools can have a benefit in the preoperative setting in predicting morbidity and mortality, they were not able to determine which risk tool should be used.

1.5.2. Cost effectiveness and resource use

No economic evaluations were identified for this question.

All of the different risk tools are freely available, and therefore do not have a cost associated with using them. Although they require some time to complete, the committee stated it would usually take less than 5 minutes during a preoperative assessment. The different types of risk tools do require different information, for example, some require information on the adult’s haemoglobin levels, however, all of these tests are already carried out as part of preoperative assessment.

The committee highlighted that if a risk tool is not accurate at estimating mortality and morbidity, then the wrong people may be given targeted interventions before surgery (incorrectly identified as high risk), or the wrong people may not be receiving interventions they should have (incorrectly identified as low risk). These targeted interventions vary, but could require being referred to a Consultant Anaesthetist, Cardiologist or Care of the Elderly specialist, or being admitted to a specialist area after surgery. Therefore, the committee highlighted the importance of accurately identifying who is at risk, as these downstream interventions can have a high cost associated with them, or quality of life could be lost from people not receiving interventions they require.

A recommendation was made to use a validated risk tool as part of a preoperative assessment. The committee agreed that the most commonly used tools such as P-POSSUM, NSQIP, E-PASS and SORT showed similar level of accuracy in predicting mortality and therefore will not lead to differences in the downstream interventions that are implemented in relation to patient risk. As current practice already involves using a validated risk tool as part of a preoperative assessment, the recommendation will not have a substantial resource impact.

1.5.3. Other factors the committee took into account

The committee recognised that it may be more appropriate to use a surgery specific risk tool rather than a generic tool. In addition, the committee agreed that the tool could simply be recording the American Society of Anaesthesiologists status of the patient for lower risk, less complex surgery.

The committee noted that a validated risk stratification tool can also help to frame discussions about risk with the person having surgery. Planned surgery is recognised as a ‘teachable moment’ when patients are more receptive and motivated to undertake healthy lifestyle changes such as smoking cessation or increasing the exercise they undertake. Healthcare professionals involved in the perioperative pathway can be trained to use motivational behavioural change techniques to help support these interactions with patients.

The committee noted that a validated risk stratification tool can also help to frame discussions about risk with the person having surgery as well as the wider perioperative team on the impact of surgical management on overall outcome. They agreed that the risk of postoperative morbidity is an important concern for people when they are making decisions about surgery. The committee noted that the recommendation was applicable to people undergoing dental surgery.

The committee considered that the findings of risk tools could have an influence over allocation of resources, although this would not be solely based on the risk tool findings, but alongside clinical assessment and judgement.

References

1.
Ahle SL, Healy JM, Pei KY. Prediction of postoperative surgical risk: a needs assessment for a medical student curriculum. Journal of Surgical Education. 2019; 76(1):89–92 [PubMed: 30100325]
2.
Al-Homoud S, Purkayastha S, Aziz O, Smith JJ, Thompson MD, Darzi AW et al. Evaluating operative risk in colorectal cancer surgery: ASA and POSSUM-based predictive models. Surgical Oncology. 2004; 13(2–3):83–92 [PubMed: 15572090]
3.
Ali R, Schwalb JM, Nerenz DR, Antoine HJ, Rubinfeld I. Use of the modified frailty index to predict 30-day morbidity and mortality from spine surgery. Journal of Neurosurgery Spine. 2016; 25(4):537–541 [PubMed: 27153143]
4.
Amrock LG, Neuman MD, Lin HM, Deiner S. Can routine preoperative data predict adverse outcomes in the elderly? Development and validation of a simple risk model incorporating a chart-derived frailty score. Journal of the American College of Surgeons. 2014; 219(4):684–694 [PMC free article: PMC4171218] [PubMed: 25154667]
5.
Anderson JE, Lassiter R, Bickler SW, Talamini MA, Chang DC. Brief tool to measure risk-adjusted surgical outcomes in resource-limited hospitals. Archives of Surgery. 2012; 147(9):798–803 [PMC free article: PMC4282492] [PubMed: 22987164]
6.
Anonymous. Correction: Preoperative risk score for the prediction of mortality after repair of ruptured abdominal aortic aneurysms (Journal of Vascular Surgery (2018) 68(4) (991–997), (S0741521418302751)(10.1016/j.jvs.2017.12.075)). Journal of Vascular Surgery. 2018; 68(5):1623
7.
Anonymous. Development of machine learning algorithms for prediction of discharge disposition after elective inpatient surgery for lumbar degenerative disc disorders. Neurosurgical Focus. 2018; 45(5):E6 [PubMed: 30453463]
8.
Arakkal D, Prabhu P, Evans M, Hoddnett D, Tailor A, Butler-Manuel S et al. Co-relation between the ACS and p Possum Calculator to improve patient understanding of the risk of postoperative morbidity and mortality. BJOG: An International Journal of Obstetrics and Gynaecology. 2018; 125:(Suppl 1):157
9.
Armstrong BN, Renson A, Zhao LC, Bjurlin MA. Development of novel prognostic models for predicting complications of urethroplasty. World Journal of Urology. 2019; 37(3):553–559 [PubMed: 30039388]
10.
Arshad W, Longbotham D, Kaur G. Is P POSSUM better than anaesthetic/surgical assessment in risk stratification of the major surgical patient? Colorectal Disease. 2014; 2):123
11.
Baker S, Waldrop MG, Swords J, Wang T, Heslin M, Contreras C et al. Timed stair-climbing as a surrogate marker for sarcopenia measurements in predicting surgical outcomes. Journal of Gastrointestinal Surgery. 2018; Epublication [PubMed: 30511131]
12.
Bartlett EK, Roses RE, Kelz RR, Drebin JA, Fraker DL, Karakousis GC. Morbidity and mortality after total gastrectomy for gastric malignancy using the American College of Surgeons National Surgical Quality Improvement Program database. Surgery. 2014; 156(2):298–304 [PubMed: 24947651]
13.
Bekelis K, Desai A, Bakhoum SF, Missios S. A predictive model of complications after spine surgery: the National Surgical Quality Improvement Program (NSQIP) 2005–2010. Spine Journal. 2014; 14(7):1247–55 [PubMed: 24211097]
14.
Bennett-Guerrero E, Hyam JA, Shaefi S, Prytherch DR, Sutton GL, Weaver PC et al. Comparison of P-POSSUM risk-adjusted mortality rates after surgery between patients in the USA and the UK. British Journal of Surgery. 2003; 90(12):1593–8 [PubMed: 14648741]
15.
Bihorac A, Ozrazgat-Baslanti T, Ebadi A, Motaei A, Madkour M, Pardalos PM et al. MySurgeryRisk: Development and validation of a machine-learning risk algorithm for major complications and death after surgery. Annals of Surgery. 2019; 269(4):652–662 [PMC free article: PMC6110979] [PubMed: 29489489]
16.
Blair B, Lehman E, Jafri S, Raman J. Actual versus estimated clinical outcomes using the ACS surgical risk calculator in patients undergoing partial nephrectomy for renal cell carcinoma. Journal of Urology. 2016; 195:(4 Suppl):e943
17.
Blair BM, Lehman EB, Jafri SM, Kaag MG, Raman JD. Predicted versus observed 30-day perioperative outcomes using the ACS NSQIP surgical risk calculator in patients undergoing partial nephrectomy for renal cell carcinoma. International Urology and Nephrology. 2018; 50(7):1249–1256 [PubMed: 29868938]
18.
Bodea R, Hajjar NA, Bartos A, Zaharie F, Graur F, Iancu C. Evaluation of P-POSSUM risk scoring system in prediction of morbidity and mortality after pancreaticoduodenectomy. Chirurgia. 2018; 113(3):399–404 [PubMed: 29981671]
19.
Bollschweiler E, Lubke T, Monig SP, Holscher AH. Evaluation of POSSUM scoring system in patients with gastric cancer undergoing D2-gastrectomy. BMC Surgery. 2005; 5:8 [PMC free article: PMC1112603] [PubMed: 15831104]
20.
Bonaventura A, Leale I, Carbone F, Liberale L, Dallegri F, Montecucco F et al. Pre-surgery age-adjusted Charlson Comorbidity Index is associated with worse outcomes in acute cholecystitis. Digestive and Liver Disease. 2019; 51(6):858–863 [PubMed: 30529046]
21.
Borja-Cacho D, Parsons HM, Habermann EB, Rothenberger DA, Henderson WG, Al-Refaie WB. Assessment of ACS NSQIP’s predictive ability for adverse events after major cancer surgery. Annals of Surgical Oncology. 2010; 17(9):2274–2282 [PubMed: 20585875]
22.
Boyd SS, O’Sullivan DM, Lasala C. Evaluating Postoperative Morbidity in Patients Undergoing Pelvic Reconstructive Surgery Using the American College of Surgeons national surgical quality improvement program surgical risk calculator. Female Pelvic Medicine & Reconstructive Surgery. 2019; Epublication [PubMed: 30896455]
23.
Brennan M, Puri S, Ozrazgat-Baslanti T, Feng Z, Ruppert M, Hashemighouchani H et al. Comparing clinical judgment with the MySurgeryRisk algorithm for preoperative risk assessment: A pilot usability study. Surgery. 2019; 165(5):1035–1045 [PMC free article: PMC6502657] [PubMed: 30792011]
24.
Bronheim RS, Oermann EK, Bronheim DS, Caridi JM. Revised Cardiac Risk Index versus ASA Status as a predictor for noncardiac events after posterior lumbar decompression. World Neurosurgery. 2018; 120:e1175–e1184 [PubMed: 30218801]
25.
Brooks MJ, Sutton R, Sarin S. Comparison of Surgical Risk Score, POSSUM and p-POSSUM in higher-risk surgical patients. British Journal of Surgery. 2005; 92(10):1288–92 [PubMed: 15981213]
26.
Bryce GJ, Payne CJ, Gibson SC, Kingsmore DB, Byrne DS, Delles C. Risk stratification scores in elective open abdominal aortic aneurysm repair: are they suitable for preoperative decision making? European Journal of Vascular and Endovascular Surgery. 2012; 44(1):55–61 [PubMed: 22521840]
27.
Bulow E, Cnudde P, Rogmark C, Rolfson O, Nemes S. Low predictive power of comorbidity indices identified for mortality after acute arthroplasty surgery undertaken for femoral neck fracture. Bone & Joint Journal. 2019; 101-B(1):104–112 [PubMed: 30601054]
28.
Burg ML, Clifford TG, Bazargani ST, Lin-Brande M, Miranda G, Cai J et al. Frailty as a predictor of complications after radical cystectomy: A prospective study of various preoperative assessments. Urologic Oncology. 2019; 37(1):40–47 [PubMed: 30448327]
29.
Burgess JR, Smith B, Britt R, Weireter L, Polk T. Predicting postoperative complications for acute care surgery patients using the ACS NSQIP surgical risk calculator. American Surgeon. 2017; 83(7):733–738 [PubMed: 28738944]
30.
Butterfield R, Stedman W, Herod R, Aneman A. Does adding ICU data to the POSSUM score improve the prediction of outcomes following surgery for upper gastrointestinal malignancies? Anaesthesia and Intensive Care. 2015; 43(4):490–6 [PubMed: 26099762]
31.
Cao A, Khayat S, Cash E, Nickel C, Gettelfinger J, Tennant P et al. ACS NSQIP risk calculator reliability in head and neck oncology: The effect of prior chemoradiation on NSQIP risk estimates following laryngectomy. American Journal of Otolaryngology. 2018; 39(2):192–196 [PubMed: 29174070]
32.
Cengiz F, Kamer E, Zengel B, Uyar B, Tavusbay C, Unalp HR. Comparison of different scoring systems in patients undergoing colorectal cancer surgery for predicting mortality and morbidity. Indian Journal of Cancer. 2014; 51(4):543–8 [PubMed: 26842190]
33.
Chun DH, Kim DY, Choi SK, Shin DA, Ha Y, Kim KN et al. Feasibility of a modified E-PASS and POSSUM system for postoperative risk assessment in patients with spinal disease. World Neurosurgery. 2018; 112:e95–e102 [PubMed: 29277590]
34.
Chung PJ, Lee JS, Tam S, Schwartzman A, Bernstein MO, Dresner L et al. Predicting 30-day postoperative mortality for emergent anterior abdominal wall hernia repairs using the American College of Surgeons National Surgical Quality Improvement Program database. Hernia. 2017; 21(3):323–333 [PubMed: 27637187]
35.
Cohen ME, Bilimoria KY, Ko CY, Hall BL. Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. Journal of the American College of Surgeons. 2009; 208(6):1009–1016 [PubMed: 19476884]
36.
Collard MK, Moszkowicz D, Clause-Verdreau AC, Beauchet A, Cudennec T, Vychnevskaia K et al. Postoperative morbidity and mortality for malignant colon obstruction: the American College of Surgeon calculator reliability. Journal of Surgical Research. 2018; 226:112–121 [PubMed: 29661276]
37.
Cologne KG, Keller DS, Liwanag L, Devaraj B, Senagore AJ. Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy: how good is it and how can we improve it? Journal of the American College of Surgeons. 2015; 220(3):281–286 [PubMed: 25617914]
38.
Cote DJ, Dasenbrock HH, Gormley WB, Smith TR, Dunn IF. Adverse events after microvascular decompression: A national surgical quality improvement program analysis. World Neurosurgery. 2019; 128:e884–894 [PMC free article: PMC6825526] [PubMed: 31082546]
39.
Dahlke AR, Merkow RP, Chung JW, Kinnier CV, Cohen ME, Sohn MW et al. Comparison of postoperative complication risk prediction approaches based on factors known preoperatively to surgeons versus patients. Surgery. 2014; 156(1):39–45 [PubMed: 24890570]
40.
de Castro SM, Houwert JT, Lagarde SM, Reitsma JB, Busch OR, van Gulik TM et al. Evaluation of POSSUM for patients undergoing pancreatoduodenectomy. World Journal of Surgery. 2009; 33(7):1481–7 [PMC free article: PMC2691933] [PubMed: 19384458]
41.
Debinska I, Smolinska K, Osiniak J, Paluszkiewicz P. The possum scoring system and complete blood count in the prediction of complications after pancreato-duodenal area resections. Polski Przeglad Chirurgiczny. 2011; 83(1):10–8 [PubMed: 22166237]
42.
DeLuzio MR, Keshava HB, Wang Z, Boffa DJ, Detterbeck FC, Kim AW. A model for predicting prolonged length of stay in patients undergoing anatomical lung resection: a National Surgical Quality Improvement Program (NSQIP) database study. Interactive Cardiovascular and Thoracic Surgery. 2016; 23(2):208–15 [PubMed: 27073262]
43.
Donati A, Ruzzi M, Adrario E, Pelaia P, Coluzzi F, Gabbanelli V et al. A new and feasible model for predicting operative risk. British Journal of Anaesthesia. 2004; 93(3):393–9 [PubMed: 15220171]
44.
Dunn CP, Emeasoba EU, Holtzman AJ, Hung M, Kaminetsky J, Alani O et al. Comparing the predictive power of preoperative risk assessment tools to best predict major adverse cardiac events in kidney transplant patients. Surgery Research & Practice Print. 2019; 2019:9080856 [PMC free article: PMC6446090] [PubMed: 31016227]
45.
Dutta S, Al-Mrabt NM, Fullarton GM, Horgan PG, McMillan DC. A comparison of POSSUM and GPS models in the prediction of post-operative outcome in patients undergoing oesophago-gastric cancer resection. Annals of Surgical Oncology. 2011; 18(10):2808–17 [PubMed: 21431986]
46.
Easterlin MC, Chang DC, Wilson SE. A practical index to predict 30-day mortality after major amputation. Annals of Vascular Surgery. 2013; 27(7):909–17 [PubMed: 23790769]
47.
Egberts F, Hartje C, Schafmayer C, Kaehler KC, von Schonfels W, Hauschild A et al. Risk evaluation in cutaneous melanoma patients undergoing lymph node dissection: impact of POSSUM. Annals of the Royal College of Surgeons of England. 2011; 93(7):514–22 [PMC free article: PMC3604920] [PubMed: 22004633]
48.
Egberts JH, Stroeh A, Alkatout I, Goumas FA, Brand PA, Schafmayer C et al. Preoperative risk evaluation of postoperative morbidity in IBD patients--impact of the POSSUM score. International Journal of Colorectal Disease. 2011; 26(6):783–92 [PubMed: 21526374]
49.
Engin A, Engin AB, Kurukahvecioglu O, Sepici-Dincel A. Perioperative mortality prediction using possum in patients with gastrointestinal tumors: Do immunological variables affect individual predictive mortality risk? Pteridines. 2018; 29(1):114–123
50.
Farhat JS, Falvo AJ, Horst HM, Swartz A, Velanovich V, Patton JH et al. Are the frail destined to fail?: Frailty index as a predictor of surgical morbidity and mortality in the elderly. Journal of Trauma and Acute Care Surgery. 2012; 72(6):1526–1531 [PubMed: 22695416]
51.
Filip B, Hutanu I, Radu I, Anitei MG, Scripcariu V. Assessment of different prognostic scores for early postoperative outcomes after esophagectomy. Chirurgia. 2014; 109(4):480–5 [PubMed: 25149610]
52.
Ford J, Coughlin KR, Van Dorp D, Berri RN. Validation of the American College of Surgeons (ACS) National Surgical Quality Improvement Program (NSQIP) risk calculator to estimate serious complications in patients undergoing major gastrointestinal oncologic resection. Journal of the American College of Surgeons. 2015; 221(4):e135–e136
53.
Fryer S, McCann J. ICNARC score versus P-POSSUM score for predicting mortality in emergency laparotomies. Journal of the Intensive Care Society. 2018; 19 (2 Suppl 1):129–130
54.
Fu MC, Ondeck NT, Nwachukwu BU, Garcia GH, Gulotta LV, Verma NN et al. What associations exist between comorbidity indices and postoperative adverse events after total shoulder arthroplasty? Clinical Orthopaedics and Related Research. 2019; 477(4):881–890 [PMC free article: PMC6437372] [PubMed: 30614913]
55.
Gentry RD, Dineen HA, Hahn JC. An overview of risk stratification in the elderly orthopaedic population. Current Geriatrics Reports. 2018; 7(2):92–102
56.
Goffi L, Saba V, Ghiselli R, Necozione S, Mattei A, Carle F. Preoperative APACHE II and ASA scores in patients having major general surgical operations: prognostic value and potential clinical applications. European Journal of Surgery. 1999; 165(8):730–5 [PubMed: 10494636]
57.
Golan S, Adamsky MA, Johnson SC, Barashi NS, Smith ZL, Rodriguez MV et al. National Surgical Quality Improvement Program surgical risk calculator poorly predicts complications in patients undergoing radical cystectomy with urinary diversion. Urologic Oncology. 2018; 36(2):77.e1–77.e7 [PubMed: 29033195]
58.
Hacohen Solovitz A, Ivry S, Ronen O. Man against the machine - Differences in surgical risk evaluation. A cohort prospective study. International Journal of Surgery. 2018; 60:252–256 [PubMed: 30471366]
59.
Haga Y, Ikejiri K, Wada Y, Takahashi T, Ikenaga M, Akiyama N et al. A multicenter prospective study of surgical audit systems. Annals of Surgery. 2011; 253(1):194–201 [PubMed: 21233616]
60.
Harris AHS, Kuo AC, Weng Y, Trickey AW, Bowe T, Giori NJ. Can machine learning methods produce accurate and easy-to-use prediction models of 30-day complications and mortality after knee or hip arthroplasty? Clinical Orthopaedics and Related Research. 2019; 477(2):452–460 [PMC free article: PMC6370104] [PubMed: 30624314]
61.
Hightower CE, Riedel BJ, Feig BW, Morris GS, Ensor JE, Jr., Woodruff VD et al. A pilot study evaluating predictors of postoperative outcomes after major abdominal surgery: Physiological capacity compared with the ASA physical status classification system. British Journal of Anaesthesia. 2010; 104(4):465–71 [PMC free article: PMC2837548] [PubMed: 20190255]
62.
Hirose J, Taniwaki T, Fujimoto T, Okada T, Nakamura T, Okamoto N et al. Predictive value of E-PASS and POSSUM systems for postoperative risk assessment of spinal surgery. Journal of Neurosurgery Spine. 2014; 20(1):75–82 [PubMed: 24206035]
63.
Hirose J, Taniwaki T, Fujimoto T, Okada T, Nakamura T, Usuku K et al. Validity of e-pass system for postoperative morbidity of spinal surgery. Journal of Spinal Disorders & Techniques. 2015; 28(10):E595–E600 [PubMed: 24270578]
64.
Hirpara DH, Kidane B, Rogalla P, Cypel M, de Perrot M, Keshavjee S et al. Frailty assessment prior to thoracic surgery for lung or esophageal cancer: a feasibility study. Supportive Care in Cancer. 2019; 27(4):1535–1540 [PubMed: 30426204]
65.
Hobson SA, Sutton CD, Garcea G, Thomas WM. Prospective comparison of POSSUM and P-POSSUM with clinical assessment of mortality following emergency surgery. Acta Anaesthesiologica Scandinavica. 2007; 51(1):94–100 [PubMed: 17073858]
66.
Hoeks SE, Scholte op Reimer WJ, van Gestel YR, Smolderen KG, Verhagen H, van Domburg RT et al. Preoperative cardiac risk index predicts long-term mortality and health status. American Journal of Medicine. 2009; 122(6):559–65 [PubMed: 19376487]
67.
Hoftman N, Prunean A, Dhillon A, Danovitch GM, Lee MS, Gritsch HA. Revised Cardiac Risk Index (RCRI) is a useful tool for evaluation of perioperative cardiac morbidity in kidney transplant recipients. Transplantation. 2013; 96(7):639–43 [PubMed: 23860084]
68.
Huang J, Yuan Y, Wang Y, Chen Y, Kong W, Xue W et al. Preoperative prognostic nutritional index is a significant predictor of survival in patients with localized upper tract urothelial carcinoma after radical nephroureterectomy. Urologic Oncology. 2017; 35(12):671.e1–671.e9 [PubMed: 28826702]
69.
Huisman MG, van Leeuwen BL, Ugolini G, Montroni I, Spiliotis J, Stabilini C et al. “Timed Up & Go”: a screening tool for predicting 30-day morbidity in onco-geriatric surgical patients? A multicenter cohort study. PloS One. 2014; 9(1):e86863 [PMC free article: PMC3901725] [PubMed: 24475186]
70.
Igari K, Ochiai T, Yamazaki S. POSSUM and P-POSSUM for risk assessment in general surgery in the elderly. Hepato-Gastroenterology. 2013; 60(126):1320–7 [PubMed: 23933925]
71.
Inoue K, Ueno T, Akishige N, Soeta T, Tsuchiya T, Nakayama S et al. Short-term outcomes of laparoscopic colorectal cancer surgery in elderly patients. -Is it really safe in elderly patients with severe comorbidities? International Journal of Surgery Open. 2019; 17:27–32
72.
Jean RA, DeLuzio MR, Kraev AI, Wang G, Boffa DJ, Detterbeck FC et al. Analyzing risk factors for morbidity and mortality after lung resection for lung cancer using the NSQIP database. Journal of the American College of Surgeons. 2016; 222(6):992–1000 [PubMed: 27118714]
73.
Jensen AM, Crandall ML, Tepas JJ, 3rd, Ra JH. ACS NSQIP Surgical Risk Calculator: Pilot analysis on feasibility in an academic safety net hospital. Journal of Surgical Research. 2019; 236:124–128 [PubMed: 30694746]
74.
Jones DR, Copeland GP, de Cossart L. Comparison of POSSUM with APACHE II for prediction of outcome from a surgical high-dependency unit. British Journal of Surgery. 1992; 79(12):1293–6 [PubMed: 1486421]
75.
Kalender M, Adademir T, Tasar M, Ecevit AN, Karaca OG, Salihi S et al. Validation of EuroSCORE II risk model for coronary artery bypass surgery in high-risk patients. Kardiochirurgia I Torakochirurgia Polska. 2014; 11(3):252–6 [PMC free article: PMC4283878] [PubMed: 26336431]
76.
Kapma M, Kahmann O, van Stijn I, Zeebregts CJ, Vahl A. Evaluation of risk prediction models, V-POSSUM and GAS, in patients with acute abdominal aortic rupture treated with EVAR or an open procedure. Journal of Cardiovascular Surgery. 2017; 58(3):439–445 [PubMed: 24429803]
77.
Karabulut H, Toraman F, Alhan C, Camur G, Evrenkaya S, Dagdelen S et al. EuroSCORE overestimates the cardiac operative risk. Cardiovascular Surgery. 2003; 11(4):295–8 [PubMed: 12802265]
78.
Katlic MR, Coleman J, Khan K, Wozniak SE, Abraham JH. Sinai abbreviated geriatric evaluation: Development and validation of a practical test. Annals of Surgery. 2019; 269(1):177–183 [PubMed: 29189383]
79.
Kavanagh JW, Blyth C. An audit of 30-day fractured neck of femur mortality compared to predictions from possum, p-possum and the Nottingham Hip Fracture Score (NHFS) at a district general hospital in the UK-are pre-operative risk scores relevant to the individual? Journal of the American Geriatrics Society. 2016; 64(S1):S83
80.
Kelly KJ, Greenblatt DY, Wan Y, Rettammel RJ, Winslow E, Cho CS et al. Risk stratification for distal pancreatectomy utilizing ACS-NSQIP: preoperative factors predict morbidity and mortality. Journal of Gastrointestinal Surgery. 2011; 15(2):250–259 [PubMed: 21161427]
81.
Kertai MD, Steyerberg EW, Boersma E, Bax JJ, Vergouwe Y, van Urk H et al. Validation of two risk models for perioperative mortality in patients undergoing elective abdominal aortic aneurysm surgery. Vascular and Endovascular Surgery. 2003; 37(1):13–21 [PubMed: 12577134]
82.
Khalfallah M, Jerraya H, Sbai A, Dougaz W, Changuel A, Nouira R et al. Prognostic Nutritional Index score is useful to predict post-operative mortality and morbidity in gastric cancer. Tunisie Medicale. 2016; 94(7):401–405 [PubMed: 28051230]
83.
Khene ZE, Peyronnet B, Freton L, Graffeille V, Pradere B, Robert C et al. What is better for predicting morbidity of robotic partial nephrectomy-a score or your clinical judgement? European Urology Focus. 2018; Epublication [PubMed: 30442584]
84.
Kim CY, Sivasundaram L, LaBelle MW, Trivedi NN, Liu RW, Gillespie RJ. Predicting adverse events, length of stay, and discharge disposition following shoulder arthroplasty: a comparison of the Elixhauser Comorbidity Measure and Charlson Comorbidity Index. Journal of Shoulder and Elbow Surgery. 2018; 27(10):1748–1755 [PubMed: 29798824]
85.
Klausing A, Martini M, Wimmer MD, Gravius S, Wirtz DC, Randau TM. Postoperative medical complications and intermediate care unit/intensive care unit admission in joint replacement surgery: A prospective risk model. Journal of Arthroplasty. 2019; 34(4):717–722 [PubMed: 30718172]
86.
Klinceva M, Widimsky P, Dohnalova A. Prospective use of EuroSCORE for the short-term risk evaluation of consecutive cardiac surgery candidates: are there any differences in prediction of perioperative risk versus risk of nonsurgical treatments? Vnitrni Lekarstvi. 2006; 52(12):1156–61 [PubMed: 17299908]
87.
Knight B, Sherlock D, Manu M, D OR. Outcome predictors after major pancreatic surgery; The role of possum, p-POSSUM and the Glasgow prognostic score. Pancreatology. 2009; 9(4):476
88.
Kong CH, Guest GD, Stupart DA, Faragher IG, Chan ST, Watters DA. Recalibration and validation of a preoperative risk prediction model for mortality in major colorectal surgery. Diseases of the Colon and Rectum. 2013; 56(7):844–9 [PubMed: 23739190]
89.
Kong CH, Guest GD, Stupart DA, Faragher IG, Chan ST, Watters DA. Colorectal preOperative Surgical Score (CrOSS) for mortality in major colorectal surgery. ANZ Journal of Surgery. 2015; 85(6):403–7 [PubMed: 25823601]
90.
Kongkaewpaisan N, Lee JM, Eid AI, Kongwibulwut M, Han K, King D et al. Can the emergency surgery score (ESS) be used as a triage tool predicting the postoperative need for an ICU admission? American Journal of Surgery. 2019; 217(1):24–28 [PubMed: 30172358]
91.
Kongwibulwut M, Chiang K, Lee JM, Eid AI, Kongkaewpaisan N, Han K et al. Life after 90: Predictors of mortality and performance of the ACS-NSQIP risk calculator in 4,724 nonagenarian patients undergoing emergency general surgery. Journal of Trauma and Acute Care Surgery. 2019; 86(5):853–857 [PubMed: 30741887]
92.
Kurki TS, Kataja MJ, Reich DL. Validation of a preoperative risk index as a predictor of perioperative morbidity and hospital costs in coronary artery bypass graft surgery. Journal of Cardiothoracic and Vascular Anesthesia. 2002; 16(4):401–4 [PubMed: 12154415]
93.
Kwok AC, Lipsitz SR, Bader AM, Gawande AA. Are targeted preoperative risk prediction tools more powerful? A test of models for emergency colon surgery in the very elderly. Journal of the American College of Surgeons. 2011; 213(2):220–225 [PubMed: 21622012]
94.
Lakomkin N, Zuckerman SL, Stannard B, Montejo J, Sussman ES, Virojanapa J et al. Preoperative risk stratification in spine tumor surgery - a comparison of the modified Charlson Index, Frailty Index, and ASA score. Spine. 2018; 44(13):E782–787 [PubMed: 31205174]
95.
Lam CM, Fan ST, Yuen AW, Law WL, Poon K. Validation of POSSUM scoring systems for audit of major hepatectomy. British Journal of Surgery. 2004; 91(4):450–4 [PubMed: 15048745]
96.
Laurent M, Fournet M, Feit B, Oger E, Donal E, Thebault C et al. Simple bedside clinical evaluation versus established scores in the estimation of operative risk in valve replacement for severe aortic stenosis. Archives of Cardiovascular Diseases. 2013; 106(12):651–60 [PubMed: 24231053]
97.
Lazarides MK, Arvanitis DP, Drista H, Staramos DN, Dayantas JN. POSSUM and APACHE II scores do not predict the outcome of ruptured infrarenal aortic aneurysms. Annals of Vascular Surgery. 1997; 11(2):155–8 [PubMed: 9181770]
98.
Le Manach Y, Collins G, Rodseth R, Le Bihan-Benjamin C, Biccard B, Riou B et al. Preoperative score to predict postoperative mortality (pospom): Derivation and validation. Anesthesiology. 2016; 124(3):570–9 [PubMed: 26655494]
99.
Lee SG, Russ A. Predicting and preventing postoperative outcomes. Clinics in Colon and Rectal Surgery. 2019; 32(3):149–156 [PMC free article: PMC6494615] [PubMed: 31061643]
100.
Lee TH, Marcantonio ER, Mangione CM, Thomas EJ, Polanczyk CA, Cook EF et al. Derivation and prospective validation of a simple index for prediction of cardiac risk of major noncardiac surgery. Circulation. 1999; 100(10):1043–9 [PubMed: 10477528]
101.
Lima MJM, Cristelo DFM, Mourao JB. Physiological and operative severity score for the enumeration of mortality and morbidity, frailty, and perioperative quality of life in the elderly. Saudi Journal of Anaesthesia. 2019; 13(1):3–8 [PMC free article: PMC6329238] [PubMed: 30692881]
102.
Lindroth H, Bratzke L, Twadell S, Rowley P, Kildow J, Danner M et al. Predicting postoperative delirium severity in older adults: The role of surgical risk and executive function. International Journal of Geriatric Psychiatry. 2019; 34(7):1018–1028 [PMC free article: PMC6579704] [PubMed: 30907449]
103.
Malik AT, Quatman CE, Phieffer LS, Jain N, Khan SN, Ly TV. 30-day adverse events, length of stay and re-admissions following surgical management of pelvic/acetabular fractures. Journal of Clinical Orthopaedics and Trauma. 2019; Epublication [PMC free article: PMC6739240] [PubMed: 31528063]
104.
Marconi L, de Bruijn R, van Werkhoven E, Beisland C, Fife K, Heidenreich A et al. External validation of a predictive model of survival after cytoreductive nephrectomy for metastatic renal cell carcinoma. World Journal of Urology. 2018; 01:01 [PubMed: 30069581]
105.
Markovic D, Jevtovic-Stoimenov T, Stojanovic M, Vukovic A, Dinic V, Markovic-Zivkovic B et al. Addition of clinical risk scores improves prediction performance of American Society of Anesthesiologists (ASA) physical status classification for postoperative mortality in older patients: a pilot study. European Geriatric Medicine. 2018; 9(1):51–59 [PubMed: 34654274]
106.
Marufu TC, Mannings A, Moppett IK. Risk scoring models for predicting peri-operative morbidity and mortality in people with fragility hip fractures: Qualitative systematic review. Injury. 2015; 46(12):2325–34 [PubMed: 26553425]
107.
Mayhew D, Mendonca V, Murthy BVS. A review of ASA physical status - historical perspectives and modern developments. Anaesthesia. 2019; 74(3):373–379 [PubMed: 30648259]
108.
Meguid RA, Bronsert MR, Juarez-Colunga E, Hammermeister KE, Henderson WG. Surgical risk preoperative assessment system (SURPAS): II. Parsimonious risk models for postoperative adverse outcomes addressing need for laboratory variables and surgeon specialty-specific models. Annals of Surgery. 2016; 264(1):10–22 [PubMed: 26945154]
109.
Meguid RA, Bronsert MR, Juarez-Colunga E, Hammermeister KE, Henderson WG. Surgical risk preoperative assessment system (SURPAS): III. accurate preoperative prediction of 8 adverse outcomes using 8 predictor variables. Annals of Surgery. 2016; 264(1):23–31 [PubMed: 26928465]
110.
Moonesinghe SR, Mythen MG, Das P, Rowan KM, Grocott MP. Risk stratification tools for predicting morbidity and mortality in adult patients undergoing major surgery: qualitative systematic review. Anesthesiology. 2013; 119(4):959–81 [PubMed: 24195875]
111.
Nag DS. Assessing the risk: Scoring systems for outcome prediction in emergency laparotomies. Biomedicine. 2015; 5(4):20 [PMC free article: PMC4662940] [PubMed: 26615537]
112.
Nagashima I, Takada T, Okinaga K, Nagawa H. A scoring system for the assessment of the risk of mortality after partial hepatectomy in patients with chronic liver dysfunction. Journal of Hepato-Biliary-Pancreatic Surgery. 2005; 12(1):44–8 [PubMed: 15754099]
113.
Nashef SA, Roques F, Hammill BG, Peterson ED, Michel P, Grover FL et al. Validation of European system for cardiac operative risk evaluation (EuroSCORE) in North American cardiac surgery. European Journal of Cardio-Thoracic Surgery. 2002; 22(1):101–5 [PubMed: 12103381]
114.
Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). European Journal of Cardio-Thoracic Surgery. 1999; 16(1):9–13 [PubMed: 10456395]
115.
National Institute for Health and Care Excellence. Developing NICE guidelines: the manual, updated 2018. London. National Institute for Health and Care Excellence, 2014. Available from: https://www​.nice.org​.uk/process/pmg20/chapter​/introduction-and-overview [PubMed: 26677490]
116.
Neary WD, Prytherch D, Foy C, Heather BP, Earnshaw JJ. Comparison of different methods of risk stratification in urgent and emergency surgery. British Journal of Surgery. 2007; 94(10):1300–5 [PubMed: 17541986]
117.
Nesi F, Leo E, Biancari F, Bartolucci R, Rainio P, Satta J et al. Preoperative risk stratification in patients undergoing elective infrarenal aortic aneurysm surgery: evaluation of five risk scoring methods. European Journal of Vascular and Endovascular Surgery. 2004; 28(1):52–8 [PubMed: 15177232]
118.
Ngulube A, Muguti GI, Muguti EG. Validation of POSSUM, P-POSSUM and the surgical risk scale in major general surgical operations in Harare: A prospective observational study. Annals of Medicine & Surgery. 2019; 41:33–39 [PMC free article: PMC6475666] [PubMed: 31016016]
119.
O’Brien SM, Shahian DM, Filardo G, Ferraris VA, Haan CK, Rich JB et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2--isolated valve surgery. Annals of Thoracic Surgery. 2009; 88:(1 Suppl):S23–42 [PubMed: 19559823]
120.
Organ N, Morgan T, Venkatesh B, Purdie D. Evaluation of the P-POSSUM mortality prediction algorithm in Australian surgical intensive care unit patients. ANZ Journal of Surgery. 2002; 72(10):735–8 [PubMed: 12534386]
121.
Parmar CD, Torella F. Prediction of major adverse cardiac events in vascular surgery: are cardiac risk scores of any practical value? Vascular and Endovascular Surgery. 2010; 44(1):14–9 [PubMed: 19828579]
122.
Patila T, Kukkonen S, Vento A, Pettila V, Suojaranta-Ylinen R. Relation of the Sequential Organ Failure Assessment score to morbidity and mortality after cardiac surgery. Annals of Thoracic Surgery. 2006; 82(6):2072–8 [PubMed: 17126112]
123.
Patterson BO, Holt PJ, Hinchliffe R, Loftus IM, Thompson MM. Predicting risk in elective abdominal aortic aneurysm repair: a systematic review of current evidence. European Journal of Vascular and Endovascular Surgery. 2008; 36(6):637–45 [PubMed: 18922709]
124.
Paul M, Raz A, Leibovici L, Madar H, Holinger R, Rubinovitch B. Sternal wound infection after coronary artery bypass graft surgery: validation of existing risk scores. Journal of Thoracic and Cardiovascular Surgery. 2007; 133(2):397–403 [PubMed: 17258572]
125.
Pavone C, Candela L, Fontana D, Simonato A. Postoperative complications and 90-day mortality in radical cystectomy in high-risk patients: A monocentric retrospective observational study. Urologia (Treviso). 2018; 85(3):111–117 [PubMed: 30117387]
126.
Perkins J. The MELD score as a predictor of nontransplant surgical mortality in patients with cirrhosis. Liver Transplantation. 2006; 12(1):159 [PubMed: 16382470]
127.
Perkins L, Jeffries M, Patel T. Utility of preoperative scores for predicting morbidity after cholecystectomy in patients with cirrhosis. Clinical Gastroenterology and Hepatology. 2004; 2(12):1123–8 [PubMed: 15625658]
128.
Pillai BS, Baloria KA, Selot N. Validation of the European System for Cardiac Operative Risk Evaluation-II model in an urban Indian population and comparison with three other risk scoring systems. Annals of Cardiac Anaesthesia. 2015; 18(3):335–42 [PMC free article: PMC4881706] [PubMed: 26139738]
129.
Pinna-Pintor P, Bobbio M, Colangelo S, Veglia F, Giammaria M, Cuni D et al. Inaccuracy of four coronary surgery risk-adjusted models to predict mortality in individual patients. European Journal of Cardio-Thoracic Surgery. 2002; 21(2):199–204 [PubMed: 11825724]
130.
Pliam MB, Shaw RE, Zapolanski A. Comparative analysis of coronary surgery risk stratification models. Journal of Invasive Cardiology. 1997; 9(3):203–222 [PubMed: 10762902]
131.
Prabakaran V, Thangaraju T, Mathew AC, Govindan V, Kannan V, Poulose TR. CR-Possum-Can it be used to predict morbidity? A single-centre retrospective study. Indian Journal of Surgical Oncology. 2019; 10(1):174–179 [PMC free article: PMC6414562] [PubMed: 30948895]
132.
Ranucci M, Castelvecchio S, Menicanti L, Frigiola A, Pelissero G. Accuracy, calibration and clinical performance of the EuroSCORE: can we reduce the number of variables? European Journal of Cardio-Thoracic Surgery. 2010; 37(3):724–9 [PubMed: 19819158]
133.
Ranucci M, Di Dedda U, Castelvecchio S, La Rovere MT, Menicanti L, Surgical Clinical Outcome Research Group. In search of the ideal risk-scoring system for very high-risk cardiac surgical patients: a two-stage approach. Journal of Cardiothoracic Surgery. 2016; Epublication [PMC free article: PMC4717657] [PubMed: 26782077]
134.
Ranucci M, Pistuddi V, Scolletta S, de Vincentiis C, Menicanti L. The ACEF II Risk Score for cardiac surgery: updated but still parsimonious. European Heart Journal. 2018; 39(23):2183–2189 [PubMed: 28498904]
135.
Rasmussen M, Platell C, Jones M. Monitoring excess unplanned return to theatre following colorectal cancer surgery. ANZ Journal of Surgery. 2018; 88(11):1168–1173 [PubMed: 30306716]
136.
Raymond BL, Wanderer JP, Hawkins AT, Geiger TM, Ehrenfeld JM, Stokes JW et al. Use of the American College of Surgeons national surgical quality improvement program surgical risk calculator during preoperative risk discussion: The patient perspective. Anesthesia and Analgesia. 2019; 128(4):643–650 [PubMed: 30169413]
137.
Reis P, Lopes AI, Leite D, Moreira J, Mendes L, Ferraz S et al. Predicting mortality in patients admitted to the intensive care unit after open vascular surgery. Surgery Today. 2019; 49(10):836–842 [PubMed: 30968224]
138.
Rivard C, Nahum R, Slagle E, Duininck M, Isaksson Vogel R, Teoh D. Evaluation of the performance of the ACS NSQIP surgical risk calculator in gynecologic oncology patients undergoing laparotomy. Gynecologic Oncology. 2016; 141(2):281–286 [PMC free article: PMC5179222] [PubMed: 26899020]
139.
Rix TE, Bates T. Pre-operative risk scores for the prediction of outcome in elderly people who require emergency surgery. World Journal of Emergency Surgery. 2007; 2:16 [PMC free article: PMC1894959] [PubMed: 17550623]
140.
Roxas MFT, Castro EJT. Validating the American College of Surgeons (ACS)-NSQIP surgical risk calculator in a Philippine ACS-NSQIP hospital collaboration. Journal of the American College of Surgeons. 2017; 225 (4 Suppl 2):e23–e24
141.
Ryan SP, Politzer C, Green C, Wellman S, Bolognesi M, Seyler T. Albumin versus American Society of Anesthesiologists score: Which is more predictive of complications following total joint arthroplasty? Orthopedics. 2018; 41(6):354–362 [PubMed: 30321441]
142.
Saafan T, El Ansari W, Al-Yahri O, Eleter A, Eljohary H, Alfkey R et al. Assessment of PULP score in predicting 30-day perforated duodenal ulcer morbidity, and comparison of its performance with Boey and ASA, a retrospective study. Annals of Medicine and Surgery. 2019; 42:23–28 [PMC free article: PMC6527942] [PubMed: 31193430]
143.
Sankar A, Beattie WS, Tait G, Wijeysundera DN. Evaluation of validity of the STOP-BANG questionnaire in major elective noncardiac surgery. British Journal of Anaesthesia. 2019; 122(2):255–262 [PubMed: 30686311]
144.
Saunders ND, Kearney JF, Lyon EH, Bloomston M, Squires MH, Kooby DA et al. The ACS-NSQIP surgical risk calculator lacks enough sensitivity to risk stratify patients with gastric cancer at academic medical centers. Annals of Surgical Oncology. 2015; 22(1):S136
145.
Schneider AL, Deig CR, Prasad KG, Nelson BG, Mantravadi AV, Brigance JS et al. Ability of the National Surgical Quality Improvement Program Risk Calculator to predict complications following total laryngectomy. JAMA Otolaryngology Head & Neck Surgery. 2016; 142(10):972–979 [PubMed: 27467967]
146.
Sfoungaristos S, Gofrit ON, Yutkin V, Landau EH, Pode D, Duvdevani M. External validation of CROES nephrolithometry as a preoperative predictive system for percutaneous nephrolithotomy outcomes. Journal of Urology. 2016; 195(2):372–6 [PubMed: 26316372]
147.
Sfoungaristos S, Lorber A, Gofrit ON, Yutkin V, Landau EH, Pode D et al. External validation and predictive accuracy assessment of guy’s stone score as a preoperative tool for estimating percutaneous nephrolithotomy outcomes. Journal of Endourology. 2015; 29(10):1131–1135 [PubMed: 25936386]
148.
Shah R, Velanovich V, Syed Z, Swartz A, Rubinfeld I. Limitations of patient-associated co-morbidity model in predicting postoperative morbidity and mortality in pancreatic operations. Journal of Gastrointestinal Surgery. 2012; 16(5):986–92 [PubMed: 22415858]
149.
Shaker S, Rivard C, Nahum R, Vogel RI, Teoh D. The American College of Surgeon’s surgical risk calculator’s ability to predict disposition in older gynecologic oncology patients undergoing laparotomy. Journal of Geriatric Oncology. 2019; 10(4):618–622 [PMC free article: PMC6589371] [PubMed: 30803821]
150.
Sharma A, Tanenbaum JE, Hogue O, Mehdi S, Vallabh S, Hu E et al. Predicting clinical outcomes following surgical correction of adult spinal deformity. Neurosurgery. 2019; 84(3):733–740 [PubMed: 29873763]
151.
Sharrock AE, McLachlan J, Chambers R, Bailey IS, Kirkby-Bott J. Emergency abdominal surgery in the elderly: Can we predict mortality? World Journal of Surgery. 2017; 41(2):402–409 [PMC free article: PMC5258798] [PubMed: 27783141]
152.
Shiba H, Misawa T, Fujiwara Y, Futagawa Y, Furukawa K, Haruki K et al. Glasgow prognostic score predicts therapeutic outcome after pancreaticoduodenectomy for carcinoma of the ampulla of vater. Anticancer Research. 2013; 33(6):2715–21 [PubMed: 23749931]
153.
Silaschi M, Conradi L, Seiffert M, Schnabel R, Schon G, Blankenberg S et al. Predicting risk in transcatheter aortic valve implantation: Comparative analysis of EuroSCORE II and established risk stratification tools. Thoracic and Cardiovascular Surgeon. 2015; 63(6):472–8 [PubMed: 25191764]
154.
Silva Junior JM, Malbouisson LM, Nuevo HL, Barbosa LG, Marubayashi LY, Teixeira IC et al. Applicability of the simplified acute physiology score (SAPS 3) in Brazilian hospitals. Revista Brasileira de Anestesiologia. 2010; 60(1):20–31 [PubMed: 20169260]
155.
Simpson G, Parker A, Hopley P, Wilson J, Magee C. Pre-operative psoas major measurement compared to P-POSSUM as a prognostic indicator in over-80s undergoing emergency laparotomy. European Journal of Trauma and Emergency Surgery. 2018; Epublication [PubMed: 30317377]
156.
Singh N, Gimpel D, Parkinson G, Conaglen P, Meikle F, Lin Z et al. Assessment of the EuroSCORE II in a New Zealand tertiary centre. Heart, Lung & Circulation. 2018; Epublication
157.
Slim K, Panis Y, Alves A, Kwiatkowski F, Mathieu P, Mantion G et al. Predicting postoperative mortality in patients undergoing colorectal surgery. World Journal of Surgery. 2006; 30(1):100–6 [PubMed: 16369701]
158.
Sobotka LA, Husain SG, Krishna SG, Hinton A, Pavurula R, Conwell DL et al. A risk score model of 30-day readmission in ulcerative colitis after colectomy or proctectomy. Clinical and Translational Gastroenterology. 2018; 9(8):175 [PMC free article: PMC6092348] [PubMed: 30108206]
159.
Srilata M, Padhy N, Padmaja D, Gopinath R. Does Parsonnet scoring model predict mortality following adult cardiac surgery in India? Annals of Cardiac Anaesthesia. 2015; 18(2):161–9 [PMC free article: PMC4881632] [PubMed: 25849683]
160.
Strilchuk L, Besh D. Estimation of cardiosurgical intervention risk according to EuroSCORE in patients with acute coronary syndrome and different gallbladder conditions before coronary artery bypass grafting. Kardiochirurgia I Torakochirurgia Polska. 2018; 15(4):238–240 [PMC free article: PMC6329887] [PubMed: 30647747]
161.
Suresh V, Levites H, Peskoe S, Hein R, Avashia Y, Erdmann D. Validation of the American College of Surgeons national surgical quality improvement program risk model for patients undergoing panniculectomy. Annals of Plastic Surgery. 2019; 83(1):94–98 [PubMed: 30633014]
162.
Sutton R, Bann S, Brooks M, Sarin S. The Surgical Risk Scale as an improved tool for risk-adjusted analysis in comparative surgical audit. British Journal of Surgery. 2002; 89(6):763–8 [PubMed: 12027988]
163.
Suzuki Y, Okabayashi K, Hasegawa H, Tsuruta M, Shigeta K, Kondo T et al. Comparison of preoperative inflammation-based prognostic scores in patients with colorectal cancer. Annals of Surgery. 2018; 267(3):527–531 [PubMed: 27984214]
164.
Tambyraja AL, Murie JA, Chalmers RT. Prediction of outcome after abdominal aortic aneurysm rupture. Journal of Vascular Surgery. 2008; 47(1):222–30 [PubMed: 17928187]
165.
Teeuwen PH, Bremers AJ, Groenewoud JM, van Laarhoven CJ, Bleichrodt RP. Predictive value of POSSUM and ACPGBI scoring in mortality and morbidity of colorectal resection: a case-control study. Journal of Gastrointestinal Surgery. 2011; 15(2):294–303 [PMC free article: PMC3035786] [PubMed: 20936370]
166.
Teoh D, Halloway RN, Heim J, Vogel RI, Rivard C. Evaluation of the American College of Surgeons National Surgical Quality Improvement Program surgical risk calculator in gynecologic oncology patients undergoing minimally invasive surgery. Journal of Minimally Invasive Gynecology. 2017; 24(1):48–54 [PMC free article: PMC6614862] [PubMed: 27789387]
167.
ter Horst R, Markou AL, Noyez L. Prognostic value of preoperative quality of life on mortality after isolated elective myocardial revascularization. Interactive Cardiovascular and Thoracic Surgery. 2012; 15(4):651–4 [PMC free article: PMC3445344] [PubMed: 22733593]
168.
Thiels CA, Yu D, Abdelrahman AM, Habermann EB, Hallbeck S, Pasupathy KS et al. The use of patient factors to improve the prediction of operative duration using laparoscopic cholecystectomy. Surgical Endoscopy. 2017; 31(1):333–340 [PubMed: 27384547]
169.
Tian R, Xu H, Lv S. The use of a modified EuroSCORE to evaluate mortality risk in percutaneous coronary intervention. Annals of Thoracic and Cardiovascular Surgery. 2014; 20(1):32–7 [PubMed: 23411848]
170.
Tominaga T, Takeshita H, Takagi K, Kunizaki M, To K, Abo T et al. E-PASS score as a useful predictor of postoperative complications and mortality after colorectal surgery in elderly patients. International Journal of Colorectal Disease. 2016; 31(2):217–25 [PubMed: 26607908]
171.
Tran Ba Loc P, du Montcel ST, Duron JJ, Levard H, Suc B, Descottes B et al. Elderly POSSUM, a dedicated score for prediction of mortality and morbidity after major colorectal surgery in older patients. British Journal of Surgery. 2010; 97(3):396–403 [PubMed: 20112252]
172.
Traven SA, Reeves RA, Sekar MG, Slone HS, Walton ZJ. New 5-factor modified frailty index predicts morbidity and mortality in primary hip and knee arthroplasty. Journal of Arthroplasty. 2019; 34(1):140–144 [PubMed: 30337252]
173.
Tsaousi GG, Pitsis AA, Ioannidis GD, Pourzitaki CK, Yannacou-Peftoulidou MN, Vasilakos DG. Implementation of EuroSCORE II as an adjunct to APACHE II model and SOFA score, for refining the prognostic accuracy in cardiac surgical patients. Journal of Cardiovascular Surgery. 2015; 56(6):919–27 [PubMed: 24525523]
174.
Tyritzis SI, Papadoukakis S, Katafigiotis I, Adamakis I, Anastasiou I, Stravodimos KG et al. Implementation and external validation of Preoperative Aspects and Dimensions Used for an Anatomical (PADUA) score for predicting complications in 74 consecutive partial nephrectomies. BJU International. 2012; 109(12):1813–8 [PubMed: 21981696]
175.
Vaid S, Bell T, Grim R, Ahuja V. Predicting risk of death in general surgery patients on the basis of preoperative variables using American College of Surgeons National Surgical Quality Improvement Program data. Permanente Journal. 2012; 16(4):10–7 [PMC free article: PMC3523928] [PubMed: 23251111]
176.
Varela Barca L, Lopez-Menendez J, Navas Elorza E, Moya Mur JL, Centella Hernendez T, Redondo Palacios A et al. Long-term prognosis after surgery for infective endocarditis: Distinction between predictors of early and late survival. Enfermedades Infecciosas y Microbiología Clínica. 2019; 37(7):435–440 [PubMed: 30470460]
177.
Vather R, Zargar-Shoshtari K, Adegbola S, Hill AG. Comparison of the possum, P-POSSUM and Cr-POSSUM scoring systems as predictors of postoperative mortality in patients undergoing major colorectal surgery. ANZ Journal of Surgery. 2006; 76(9):812–6 [PubMed: 16922904]
178.
Veeravagu A, Li A, Swinney C, Tian L, Moraff A, Azad TD et al. Predicting complication risk in spine surgery: a prospective analysis of a novel risk assessment tool. Journal of Neurosurgery Spine. 2017; 27(1):81–91 [PubMed: 28430052]
179.
Wang H, Wang H, Chen T, Liang X, Song Y, Wang J. Evaluation of the POSSUM, P-POSSUM and E-PASS scores in the surgical treatment of hilar cholangiocarcinoma. World Journal of Surgical Oncology. 2014; 12:191 [PMC free article: PMC4079624] [PubMed: 24961847]
180.
Wang TK, Choi DH, Stewart R, Gamble G, Haydock D, Ruygrok P. Comparison of four contemporary risk models at predicting mortality after aortic valve replacement. Journal of Thoracic and Cardiovascular Surgery. 2015; 149(2):443–8 [PubMed: 24836990]
181.
Wang TK, Oh T, Voss J, Gamble G, Kang N, Pemberton J. Comparison of contemporary risk scores for predicting outcomes after surgery for active infective endocarditis. Heart and Vessels. 2015; 30(2):227–34 [PubMed: 24463846]
182.
Wang X, Hu Y, Zhao B, Su Y. Predictive validity of the ACS-NSQIP surgical risk calculator in geriatric patients undergoing lumbar surgery. Medicine. 2017; 96(43):e8416 [PMC free article: PMC5671873] [PubMed: 29069040]
183.
Wani NA, Parray FQ, Safdar G. “POSSUM”: a good indicator of morbidity and mortality in calcular disease of biliary tract. JK Practitioner. 2005; 12(1):6–10
184.
Wendt D, Thielmann M, Kahlert P, Kastner S, Price V, Al-Rashid F et al. Comparison between different risk scoring algorithms on isolated conventional or transcatheter aortic valve replacement. Annals of Thoracic Surgery. 2014; 97(3):796–802 [PubMed: 24594746]
185.
Wingert NC, Gotoff J, Parrilla E, Gotoff R, Hou L, Ghanem E. The ACS NSQIP risk calculator is a fair predictor of acute periprosthetic joint infection. Clinical Orthopaedics and Related Research. 2016; 474(7):1643–8 [PMC free article: PMC4887356] [PubMed: 26911971]
186.
Wolters U, Mannheim S, Wassmer G, Brunkwall J. What is the value of available risk-scores in predicting postoperative complications after aorto-iliac surgery? A prospective non randomized study. Journal of Cardiovascular Surgery. 2006; 47(2):177–85 [PubMed: 16572092]
187.
Yap MKC, Ang KF, Gonzales-Porciuncula LA, Esposo E. Validation of the American College of Surgeons risk calculator for preoperative risk stratification. Heart Asia. 2018; 10(2):e010993 [PMC free article: PMC5976106] [PubMed: 29868129]
188.
Ye IB, Girdler SJ, Cheung ZB, White SJ, Ranson WA, Cho SK. Risk factors associated with 30-day mortality after open reduction and internal fixation of vertebral fractures. World Neurosurgery. 2019; 125:e1069–e1073 [PubMed: 30790742]
189.
Zattoni D, Montroni I, Saur NM, Garutti A, Bacchi Reggiani ML, Galetti C et al. A simple screening tool to predict outcomes in older adults undergoing emergency general surgery. Journal of the American Geriatrics Society. 2019; 67(2):309–316 [PubMed: 30298686]
190.
Zhang B, Sun H, Hu S, Xu J, Wang W, Song Y et al. Predictive value of different scoring systems for early postoperative mortality in patients with a second coronary artery bypass grafting. Chinese Medical Journal. 2014; 127(4):614–7 [PubMed: 24534209]
191.
Zheng Z, Fan H, Gao H, Li X, Yuan X, Meng J et al. Mortality risk model for heart valve surgery in China. Journal of Heart Valve Disease. 2013; 22(1):93–101 [PubMed: 23610996]
192.
Zugel NP, Kox M, Lichtwark-Aschoff M, Gippner-Steppert C, Jochum M. Predictive relevance of clinical scores and inflammatory parameters in secondary peritonitis. Bulletin de la Société des Sciences Médicales du Grand-Duché de Luxembourg. 2011; (1):41–71 [PubMed: 21634221]

Appendices

Appendix B. Literature search strategies

The literature searches for this review are detailed below and complied with the methodology outlined in Developing NICE guidelines: the manual 2014, updated 2018.115

For more detailed information, please see the Methodology Review.

B.1. Clinical search literature search strategy

Searches were constructed using a PICO framework where population (P) terms were combined with Intervention (I) and in some cases Comparison (C) terms. Outcomes (O) are rarely used in search strategies for interventions as these concepts may not be well described in title, abstract or indexes and therefore difficult to retrieve. Search filters were applied to the search where appropriate.

Table 6. Database date parameters and filters used

Medline (Ovid) search terms

Embase (Ovid) search terms

Cochrane Library (Wiley) search terms

B.2. Health Economics literature search strategy

Health economic evidence was identified by conducting a broad search relating to the perioperative care population in NHS Economic Evaluation Database (NHS EED – this ceased to be updated after March 2015) and the Health Technology Assessment database (HTA) with no date restrictions. NHS EED and HTA databases are hosted by the Centre for Research and Dissemination (CRD). Additional health economics searches were run on Medline and Embase.

Table 7. Database date parameters and filters used

Medline (Ovid) search terms

Embase (Ovid) search terms

NHS EED and HTA (CRD) search terms

Appendix D. Clinical evidence tables

Download PDF (605K)

Appendix E. PROBAST checklist

Download PDF (437K)

Appendix I. Health economic evidence tables

None.

Appendix J. Excluded studies

J.2. Excluded health economic studies

Published health economic studies that met the inclusion criteria (relevant population, comparators, economic study design, published 2003 or later and not from non-OECD country or USA) but that were excluded following appraisal of applicability and methodological quality are listed below. See the health economic protocol for more details.

Table 9. Studies excluded from the health economic review

Final

Evidence reviews underpinning recommendations 1.3.1 and 1.3.2 in the NICE guideline

This evidence review was developed by the National Guideline Centre

Disclaimer: The recommendations in this guideline represent the view of NICE, arrived at after careful consideration of the evidence available. When exercising their judgement, professionals are expected to take this guideline fully into account, alongside the individual needs, preferences and values of their patients or service users. The recommendations in this guideline are not mandatory and the guideline does not override the responsibility of healthcare professionals to make decisions appropriate to the circumstances of the individual patient, in consultation with the patient and, where appropriate, their carer or guardian.

Local commissioners and providers have a responsibility to enable the guideline to be applied when individual health professionals and their patients or service users wish to use it. They should do so in the context of local and national priorities for funding and developing services, and in light of their duties to have due regard to the need to eliminate unlawful discrimination, to advance equality of opportunity and to reduce health inequalities. Nothing in this guideline should be interpreted in a way that would be inconsistent with compliance with those duties.

NICE guidelines cover health and care in England. Decisions on how they apply in other UK countries are made by ministers in the Welsh Government, Scottish Government, and Northern Ireland Executive. All NICE guidance is subject to regular review and may be updated or withdrawn.

Copyright © NICE 2020.
Bookshelf ID: NBK561975PMID: 32931173

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (1.3M)

Other titles in this collection

Related NICE guidance and evidence

Related information

  • PMC
    PubMed Central citations
  • PubMed
    Links to PubMed

Similar articles in PubMed

See reviews...See all...

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...