Recently, several researchers have demonstrated the potential of fiber optic Raman technology for biomedical applications. With improving optical component performance and emerging new technologies, the design of fiber optic Raman probes is constantly evolving, leading to diverse applications and functions. Herein, the latest developments in fiber optic Raman probes, focusing on their structural design and material selection, are reviewed. This includes fiber selection and arrangement, probe size, objective selection, and system construction. Moreover, this article highlights the recent practical applications of fiber optic Raman probes in biomedicine and summarizes the approaches and methodologies for designing and constructing clinically specific probes. Moreover, the ideas and directions for future applications and development of fiber optic Raman technology are clarified.