Training code and evaluation benchmarks for the "Self-Supervised Policy Adaptation during Deployment" paper.