Matter Mixing in Aspherical Core-collapse Supernovae: Three-dimensional Simulations with Single-star and Binary Merger Progenitor Models for SN 1987A