Example: The tax man passes a debt to the sheriff. The debt is paid regularly to the sheriff. The sheriff does not issue receipts on request and the tax man is not issuing statements (asked umpteen times with no joy).
As far as I know the law is silent as regards receipts and obligation to issue them. Can you pay via bank account / draft .. Retain then as proof of payment