5.3 Increase the momentum of SGD Optimiser
Case 2. Changing the value of momentum to 0.92
  1. lr0 -> 0.1
  2. momentum ->0.92
  3. lrf ->0.2
  4. weight_decay: 0.0005
  5. warmup_epochs: 3.0
  6. optimizer : SGD
In this experiment, we increase the momentum slightly to see if performance can be improved. We increase the SGD momentum of our model to 0.92 to verify if increasing the momentum helps in getting better results. It was conducted with 30 epochs on the sub-sampled tiles of xView Dataset. PR AUC 0.104 at mAP@0.5 | F1 max 0.08 at 0.106 confidence was achieved and it was concluded that the model was not able to improve upon the performance. Figure 6 shows the F1-Confidence curve which depicts the score of F1 max 0.08 at 0.106 confidence rate which is very less. Figure 7 shows the Precision- Recall curve which depicts the score of AUC 0.104 at mAP@0.5 which is very less as compared to SGD momentum.