Had a similar problem with swallows returning every year to nest in the covered garage (i.e. no walls). Didn't mind the birds themselves but the mess they left on the ground, the car and clothes on the line was awful.
We would never disturb a nest in use but this year have thought ahead and blocked the access to prevent the birds setting up home while not preventing our own regular daily use of the space.
In the early days, the swallows would come and check it out. Generally they can access the smallest space and they fly so fast. Some got through but left again quickly. We guess the parents figured the new access would be tricky fifty times a day and thought that it might prove difficult when the fledglings begin to move.
So far, so good.