Test set Model Macro-AGM Macro-AGM SOV8 Q8
Residue level
Sequence level (±SD/p-value/d) Sequence level (±SD/p-value/d)
Residue level
TEST2016
ProteinUnetLM
0.829
0.767 ± 0.135 0.786 ± 0.113
0.771
ProteinUnet2
0.729
0.759 ±0.122/p=0.005/d=0.063 0.784 ±0.102/p=0.526/d=0.014
0.766
SPOT-1D
0.809
0.747 ±0.127/p=2e-5/d=0.154 0.784 ±0.103/p=0.385/d=0.019
0.771
TEST2018
ProteinUnetLM
0.728
0.728 ±0.182 0.760 ±0.144
0.756
ProteinUnet2
0.721
0.719 ±0.175/p=0.273/d=0.050 0.763 ±0.129/p=0.643/d=-0.020
0.746
SPOT-1D
0.718
0.707 ±0.176/p=0.008/d=0.114 0.762 ±0.132/p=0.767/d=-0.012
0.754