In recent years, with the growth of video and multimedia applications, the upgrading of radar and electronic warfare systems, and the expansion of satellite communication and navigation systems, the requirements for the bandwidth, real-time spectrum analysis, acquisition, and reliability of Radio Frequency (RF) signals have been continuously increasing. As a key basic technology, broadband RF signal processing is widely applied in data transmission, electronic countermeasures, cognitive radio, and other fields. Traditional electrical methods process RF signals in the electrical domain, meeting conventional signal processing requirements to a certain extent. However, these methods are restricted by inherent electronic bottlenecks such as bandwidth, electromagnetic interference, power consumption, and reliability. Microwave photonics, benefiting from characteristics such as large bandwidth, electromagnetic interference resistance, low transmission loss, and high frequency bands, provides a new solution for broadband RF signal processing.The current main technical schemes can be divided into optical heterodyne detection, photonic-assisted channelization, and microwave photonic filters. The optical heterodyne detection method converts RF signals into beat frequency signals by mixing signal light and local oscillator light. Based on a sampling frequency of 200 kHz, the theoretical bandwidth of the system is 100 kHz, and the resolution can reach 390 Hz. However, frequency drift or phase fluctuation will lead to instability of the beat frequency signal, affecting the measurement accuracy. The photonic-assisted channelization scheme divides broadband signals into multiple sub-channels with small bandwidths. The photonic-assisted channelization scheme using dispersion delay can process microwave signals with an instantaneous bandwidth of 4.86 GHz and achieve a spectral resolution of 340 MHz, but it has high requirements for the performance of dispersive media. The microwave photonic filter method performs filtering processing on RF signals by designing microwave photonic filters with specific frequency responses, which can realize spectral analysis with a spectral range of 0~20 GHz and a resolution of 650 kHz. However, the filter fabrication process is relatively complex and requires high processing precision. In the current research field, how to achieve an optimal balance between bandwidth and spectral resolution has gradually become a key focus and frontier hot issue in related research directions such as broadband RF signal processing. Many research teams have carried out studies from different perspectives to break through existing technical bottlenecks, achieve collaborative improvement of bandwidth and spectral resolution, and further meet the growing demand for processing capabilities of large-bandwidth signals and high spectral resolution. Among them, the technology of processing RF signals based on the spectral hole burning effect has shown significant advantages.Based on the spectral hole burning effect of Tm³⁺:YAG crystal for broadband radio frequency signal processing, this paper studies the influence of power spectrum writing and reading parameters on spectral resolution. By numerically solving the two-level optical Bloch equation using the Runge-Kutta method, the population distribution changes of each energy level are calculated. Under the condition of inputting a linearly chirped pulse, the crystal absorption spectrum is obtained by using the Beer-Lambert type Fourier domain transfer function method. The signal power spectrum is obtained through differential detection. The influences of crystal homogeneous broadening, writing signal intensity and reading signal chirp rate on spectral resolution are analyzed and discussed. The results show that the spectral resolution increases with the increase of crystal homogeneous broadening, writing signal intensity and reading signal chirp rate. The optimal optical field chirp rate for reading spectral hole burning is 1 MHz/μs. When the crystal temperature is 9 K, the experimentally measured spectral resolution is 300 MHz.