Add to that that the models become bigger and bigger and it takes real money to train these models. How would a reviewer test a paper? You can look at formal correctness and whether you agree with the experimental setup, but aside from that there isn't much you can do.