The Hong-Ou-Mandel (HOM) interference, which arises from the interaction of indistinguishable photons at a beam splitter, plays a pivotal role in quantum information processing. Its outcomes have been constrained by the bosonic nature of photons and the unitarity of conventional beam splitters, leading to photon bunching. Recent studies have explored HOM interference modulation using non-unitary systems, yet no work has achieved control via unitary systems.In this work, we propose a method to achieve continuous control of HOM interference for both bosonic and fermionic polarization-entangled states using polarization-decoupled unitary metasurfaces. This approach enables arbitrary modulation—even complete reversal—of HOM interference without introducing losses, thereby significantly enhancing photon utilization efficiency. Furthermore, by incorporating the rotational degree of freedom of the metasurface, a single structure suffices for continuous tuning of the interference. Our work offers a novel paradigm for manipulating HOM interference, promising to enrich the design of quantum computing systems and quantum logic circuits, while unlocking new applications for metasurfaces in quantum optics.