Glaucoma as an irreversible blinding opioid neuropathy disease, its blindness rate is the second only after cataract in the world. The optic cup-to-disc ratio (CDR) is generally considered to be an important clinical indicator for judging the severity of glaucoma by ophthalmologists from retinal fundus image. In this letter, we propose an automatic CDR measurement method that consists of a novel optic disc localization method and a simultaneous optic disc and cup segmentation network based on the improved U shape deep convolutional neural network. Experimental results demonstrate that the proposed method can achieve superior performance when compared with other existing methods. Thus, our method can be used as a powerful tool for glaucoma-assisted diagnosis.