Infrared photon detection technology usually works in the passive sensing mode and contains the advantages of long acting-distance, good anti-interference, excellent penetration of smoke and haze, and all-day operation, which has been widely used in space remote sensing, military equipment, astronomical detection and other aspects. So far, the second-generation and the third-generation infrared photon detectors have been deployed widely. The high-end third-generation infrared photon detectors have been gradually promoted to practical application. The fourth generation and more forward-looking research including new concept, new technology, and new device has been proposed. This paper focuses on the research status of infrared technology at home and abroad, emphatically introducing the hotspots and development trends of infrared photon detectors. Firstly, the concept of SWaP³ is introduced due to tactical ubiquity and strategic high performance. Secondly, the high-end third-generation infrared photon detectors with ultra-high spatial resolution, ultra-high energy resolution, ultra-high time resolution and ultra-high spectral resolution are reviewed. Technical characteristics and implementation methods of ultimate-performance infrared detectors are analyzed. Then, the fourth-generation infrared photon detector based on the artificial micro-structure is discussed. The realization approaches and technical challenges of multi-dimensional information fusion such as polarization, spectrum and phase are mainly introduced. Lastly, highly innovative trends of future detectors are discussed according to upgradation from on-chip digitization to on-chip intelligence.