Never use booleans.

Do make a perfect hole:

Make a cylinder with 8 sides and place the bottom on the plane where the hole should be.

Now use the split polygon tool to "draw" a 8 sided circle.

Snap all vertices so that they are exactly the same as the cylinders.

Clean up and delete the plane in the circle.

Remember that the vertices in the circle only should connect to ONE other vertex.