Table 6Model performance for AEs

GLMnetGBMHybrid
StudyPhaseThresholdSensitivityPPVSensitivityPPVSensitivityPPV
AAPOriginal0.00110.07810.0710.07
0.0110.16810.13810.118
0.020.9780.21510.27410.194
0.10.9010.3920.9340.4360.9560.385
Update0.00110.03310.02910.029
0.010.990.0650.9710.0560.990.047
0.020.9810.090.8950.110.9810.078
0.10.8670.1720.8480.20.8860.162
LBDOriginal0.00110.06510.07310.057
0.010.9930.1750.9750.1920.9960.166
0.020.9640.210.9710.2290.9780.203
0.10.8850.3380.9030.3650.9180.328
Update0.0010.9460.040.9570.0390.9670.033
0.010.7390.0970.6740.0980.7390.09
0.020.6850.1160.6630.1190.7070.112
0.10.5110.1790.4780.1910.5220.167

GLMnet = Generalized Linear Models with Convex Penalties; GBM = gradient boosting machine; Hybrid = Maximum prediction from either GLMnet or GBM; PPV = Positive predictive value

Note: We calculated bootstrapped standard errors for the GLMnet estimates. In all cases, the standard errors were substantially smaller (<0.005) than the estimates for sensitivity or PPV.

From: Results

Cover of A Pilot Study Using Machine Learning and Domain Knowledge To Facilitate Comparative Effectiveness Review Updating
A Pilot Study Using Machine Learning and Domain Knowledge To Facilitate Comparative Effectiveness Review Updating [Internet].
Dalal SR, Shekelle PG, Hempel S, et al.

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.