Downing Street says the PM remains in contact with officials, but Reform UK says he has "bunked off".