By means of EDS, SEM, NMR and other test methods, the multi-modal data were deeply fused and analyzed from the perspectives of microstructure, hydration products, element distribution and pore characteristics. The evolution law of cement-emulsified asphalt (CA) mortar microstructure varying with asphalt-cement ratio (A/ C) and age was studied qualitatively and quantitatively. The results show that with the increase of A/ C, the CA mortar changes from a spatial structure with cement hydration products as continuous phase and asphalt as dispersed phase to a loose porous spatial structure with asphalt as continuous phase and cement hydration products as dispersed phase. The cement particles and hydration products are coated by asphalt, which seriously affects the development of pore structure. The total porosity and the most probable pore size gradually increase, the number of gel pores and transition pores decreases, and the number of macropores increases. With the increase of age, the hydration products of cement increases, the original larger pores are separated into smaller pores, the total porosity and the number of macropores and capillary pores decrease, the number of gel pores and transition pores increases, and the pore structure gradually becomes dense.