Google finds new way to train AI models using smaller ‘teacher’ models
A joint team from Google Research and DeepMind has developed a training method called SALT (Small model aided large model training) that cuts training time by up to 28 percent while improving performa...