Table 2.

Model performance on validation and test data

ModelValidation set
AUC-PRMCCF1 scorePrecisionSpecificitySensitivity
LSTM hemato-oncology 0.88 0.77 0.79 0.80 0.98 0.77 
LSTM cardiothoracic 0.55 0.52 0.53 0.56 0.99 0.50 
LSTM multispecialty 0.78 0.68 0.69 0.73 0.99 0.66 
ModelValidation set
AUC-PRMCCF1 scorePrecisionSpecificitySensitivity
LSTM hemato-oncology 0.88 0.77 0.79 0.80 0.98 0.77 
LSTM cardiothoracic 0.55 0.52 0.53 0.56 0.99 0.50 
LSTM multispecialty 0.78 0.68 0.69 0.73 0.99 0.66 
Test set
LSTM hemato-oncology 0.84 (0.83-0.84) 0.73 (0.72-0.73) 0.74 (0.74-0.75) 0.77 (0.76-0.77) 0.98 (0.98-0.98) 0.72 (0.71-0.73) 
LSTM cardiothoracic 0.41 (0.39-0.43) 0.41 (0.40-0.43) 0.43 (0.42-0.44) 0.44 (0.43-0.45) 0.99 (0.98-0.99) 0.42 (0.4-0.43) 
LSTM multispecialty 0.73 (0.73-0.73) 0.64 (0.64-0.64) 0.65 (0.65-0.65) 0.70 (0.69-0.70) 0.99 (0.99-0.99) 0.61 (0.61-0.62) 
Test set
LSTM hemato-oncology 0.84 (0.83-0.84) 0.73 (0.72-0.73) 0.74 (0.74-0.75) 0.77 (0.76-0.77) 0.98 (0.98-0.98) 0.72 (0.71-0.73) 
LSTM cardiothoracic 0.41 (0.39-0.43) 0.41 (0.40-0.43) 0.43 (0.42-0.44) 0.44 (0.43-0.45) 0.99 (0.98-0.99) 0.42 (0.4-0.43) 
LSTM multispecialty 0.73 (0.73-0.73) 0.64 (0.64-0.64) 0.65 (0.65-0.65) 0.70 (0.69-0.70) 0.99 (0.99-0.99) 0.61 (0.61-0.62) 

The scores in parentheses represent the 0.95 confidence interval.

Close Modal

or Create an Account

Close Modal
Close Modal