The learning rate decay has been implemented in this model. We can see the model can only classify the data it has seen. And the accuracy on the validation set is not increasing.
Both siamese network and PredictingNet have the problem of overfitting.