Functionalized black phosphorus (BP) nanosheets have been considered as promising nanoagents in cancer therapy due to their excellent photothermal conversion efficiency. However, it is still difficult to visually monitor the dynamic localization of BP nanoagents in cancer cells. In this paper, we systematically studied the second-harmonic generation (SHG) signals originating from exfoliated BP nanosheets. Interestingly, under the excitation of a high frequency pulsed laser at 950 nm, the SHG signals of BP nanosheets in vitro are almost undetectable because of their poor stability. However, the intracellular SHG signals from BP nanosheets could be measured by in vivo optical imaging due to the efficient enrichment of living HeLa cells. Moreover, the SHG signal intensity from BP nanosheets increases with the prolonged incubation time. It can be expected that the BP nanosheets could be a promising intracellular SHG nanoprobe employed for visually in vivo biomedical imaging in practical cancer photothermal therapy (PIT).