Government sources insisted his departure was unrelated to the ongoing controversy over Downing Street parties or Covid restrictions.