Booleans in Maya can be quite whimsical... Make sure your geometry is well inside one another. I suggest you consider not using booleans. I found them quite unsatisfactory. There is a different approach - combining an merging vertices/edges. It is mentioned later in the tutorial.