You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I guess you used the wrong hyper parameters since the gap is really large.
But I also can not reproduce the result, the paper claimed the STSB has achieved 91.5, but my result is 91.03.
And for Roberta-large, I also can not reproduce the results.
Cola: 68.2(paper) - 67.0(my), gap is 1.2
Stab: 92.6(paper) - 92.2(my), gap is 0.4
Mrpc:90.9(paper) - 90.7(my), gap is 0.2
Does anyone have reproduce the LoRA result of roberta-base? I found the reproduction result of LoRA cannot achieve the result that paper has claimed.
e.g.:
Paper claimed that the RTE has achieved 86.6 accuracy, but my result has only achieved ~60 accuracy.
The text was updated successfully, but these errors were encountered: