Over the past two decades, computer-aided detection or diagnosis has emerged as a highly promising field of research. Its primary goal is to enhance the diagnostic and treatment procedures for radiologists and clinicians in medical image analysis. With the help of big data and advanced Artificial Intelligence (AI) technologies, i.e., machine learning and deep learning algorithms, assist in making our healthcare system more convenient, active, efficient, and personalized. The primary goal of the literature survey study is to present a thorough overview of the most important developments related to Computer-Aided Diagnosis (CAD) systems in medical imaging. This survey holds considerable importance for researchers and professionals in both medical and computer science. Several reviews regarding specific facets of CAD in medical imaging already exist. Nevertheless, the main emphasis of this paper is on covering the complete range of CAD systems’ capabilities in medical imaging. This review article introduces the background concept used for typical CAD systems in medical imaging by outlining and comparing several methods frequently employed in recent studies. The article also offers a comprehensive and well-structured survey of CAD in medicine, drawing from a meticulous selection of relevant publications. Moreover, it describes the process of handling medical images and introduces state-of-the-art AI-based CAD technologies in medical imaging, along with the future directions of CAD. This study indicates that deep learning algorithms are the most effective way to diagnose or detect diseases.