Consent is not the only reason why personal details can be passed over to a 3rd party.
As a simple example, your employer does not need your consent to give your details to the Revenue as they have a legal obligation to do so.
I am not saying that I know they are compliant but if they are legally allowed to sell your mortgage, they probably have the right to pass over the details.