A phononic crystal coupled with the acoustic black hole structure was proposed based on the local resonance theory. The low frequency band gap was widened by utilizing the low frequency, broad band gap, and multi-modal properties of the acoustic black hole structure. The energy band structure, eigenmodes and attenuation characteristics of the phononic crystal were calculated by the finite element method. The generation mechanism of its band gap was analyzed, and the influence of the geometric parameters (i.e., the structural parameters of the acoustic black hole) on the band gap was discussed. The results show that the phononic crystal has multiple band gaps at 1 600 Hz, and the first complete band gap ranges from 12 to 805 Hz. The band gap coverage below 40 Hz is 70%, and the band gap coverage within 1 600 Hz reaches 97.3%. The starting and cut-off frequencies of the first complete band gap are mainly determined by the vibrational modes of the scatterer and the acoustic black hole structure. The starting frequency of the first complete band gap increases with increasing the height of the acoustic black hole structure short side. The width and short side height of the acoustic black hole structure and the height of the short plate have an effect on the cut-off frequency and the width of the first complete band gap.