We have House Martins nesting next door and there are about half a dozen of them flying around.
We've had them nest at our house once, they chose the apex of the gable to build their nest. We were having an extension built at the time which made it a bit disturbed for them, but they didn't seem to mind.
We have modern soffits which I'm sure deters them somewhat.
Should I be trying to enlarge this colony by providing nest boxes or go for Swifts instead or both?