The detection and localization of bone joint regions in medical X-ray images are essential for contemporary medical diagnostics. Traditional methods rely on subjective interpretation by physicians, leading to variability and potential errors. Automated bone joint detection techniques have become feasible with advancements in general-purpose object detection. However, applying these algorithms to X-ray images faces challenges due to the domain gap. To overcome these challenges, a novel framework called effective and efficient network (EAE-Net) is proposed. It incorporates a context augment module (CAM) to leverage global structural information and a ghost bottleneck module (GBM) to reduce redundant features. The EAE-Net model achieves exceptional detection performance, striking a balance between accuracy and speed. This advancement improves efficiency, enabling clinicians to focus on critical aspects of diagnosis and treatment.