The semi-analytical solution of nonlinear Schrdinger equation (NLSE) is obtained by Volterra series theory, and the semi-analytical expression of coupling crosstalk between the useful pulses and amplified spontaneous emission (ASE) induced by the combined effects of fiber loss, dispersions and nonlinearities is derived in a high-speed long-haul fiber-optic system, which is made up of multi-span with each including a transmission fiber and an erbium doped fiber amplifier (EDFA), and the relational expression between the output signal at the receiver and the input signal at the transmitter of multi-span transmission is also obtained. Besed on the time-domain filtering method of Wiener filtering, a Wiener filter is designed at the receiver to filter the multiplicative crosstalk noise mentioned above. Its applications in pre-, post-lumped and distributed dispersion compensation system, as well as “one-for-three” compensation fiber spans transmission lines with scaled translational symmetry are proved feasible by numerical simulations, which provide a novel solution to improve fiber input power and nonlinear channel capacity.