Reverted back to the best warmup epochs value that was found and increased the warmup momentum to 0.801 to see if performance can be improved. The result achieved was PR AUC 0.108 at mAP@0.5 | F1 max 0.09 at 0.096 confidences and was not able to improve upon the performance. Figure 10 shows the F1-Confidence curve which depicts the score of F1 max 0.09 at 0.096 confidence rate which is very less as compared to the result achieved using SGD optimizer. Figure 11 shows the Precision- Recall curve which depicts the score of PR AUC 0.108 at mAP@0.5 which is very less as compared to the result achieved using SGD optimizer.
Fig 10. F1-Confidence Curve for momentum 0.08 Fig 11. Precision- Recall curve momentum 0.08