I find this is a common problem when you do a boolean on something that you have already done a boolean on.

my suggestion is that you use the split polygon tool to break the wall into a series of slices which you then extract, so you have a number of pieces of individual geometry (like planks), cut a hole in each one with the boolean and then merge them back together.