Table 1

Performance of machine learning models

ModelAUCRecallAccuracyF1 scorePrecision
Base model
AdaBoost0.830.800.730.650.55
LightGBM0.880.670.820.690.71
XGBoost0.880.930.760.700.56
Gradient Boosting0.850.800.820.730.67
Extra trees0.860.800.760.670.57
Random forest0.900.800.820.730.67
CatBoost0.890.800.800.710.63
Final model
 PFCML-MTTest set0.870.800.820.730.67
Temporal validation set0.840.750.780.710.68
  • AdaBoost, adaptive boosting; AUC, area under the receiver operator characteristic curve; CatBoost, categorical boosting; LightGBM, light gradient boosting machine; XGBoost, eXtreme gradient boosting.