Artery calcification (AC) is a pathological phenomenon in the process of atherosclerosis, especially the coronary artery calcification (CAC) of the arterial intima. Originally, CAC is a self-protection mechanism to reduce atherosclerotic inflammation. However, it also acts as a significant cause of atherosclerotic plaque rupture, particularly of the microcalcification in the early stage of CAC, which is the leading cause of plaque rupture. From the microcalcification in the early stage to the stable fusion in the late stage, different degrees of CAC have different effects on cardiovascular events. Chinese herbal medicine (CHM) has been used to treat atherosclerotic cardiovascular diseases for centuries. How CHM is effective in the treatment and what mechanism is involved in CAC need further investigation. Here, we review the molecular mechanisms of the development of CAC and the influence of CHM on those pathological processes.