claim
Deep networks exhibit a phenomenon called 'agreement-on-the-line' under distribution shifts, where in-distribution versus out-of-distribution accuracy is strongly linearly correlated across architectures and hyperparameters, and the agreement between predictions of independently trained networks follows the same linear trend.

Authors

Sources

Referenced by nodes (1)