Ok, I'll rephrase.
There are Brexiters who couldn't care less about the possibility of others losing jobs, their livelihoods etc. You cannot be 100% sure that everything will be absolutely fine from the moment we leave, so you are prepared to run the risk of people being worse off etc.