Or, like you were doing before, with rigids, you could select all of your rigid bricks, and go to FIELDS > RADIAL.

Then, just key the intensity of the radial field to GREATLY increase at the time of impact, thus, pushing (exploding) all of your brick pieces apart in all directions....

Check it out in the docs