The innate immune system can be boosted in response to subsequent triggers by pre-exposure to microbes or microbial products, known as “trained immunity”. Compared to classical immune memory, innate trained immunity has several different features. Firstly, the molecules involved in trained immunity differ from those involved in classical immune memory. Innate trained immunity mainly involves innate immune cells (e.g., myeloid immune cells, natural killer cells, innate lymphoid cells) and their effector molecules (e.g., pattern recognition receptor (PRR), various cytokines), as well as some kinds of non-immune cells (e.g., microglial cells). Secondly, the increased responsiveness to secondary stimuli during innate trained immunity is not specific to a particular pathogen, but influences epigenetic reprogramming in the cell through signaling pathways, leading to the sustained changes in genes transcriptional process, which ultimately affects cellular physiology without permanent genetic changes (e.g., mutations or recombination). Finally, innate trained immunity relies on an altered functional state of innate immune cells that could persist for weeks to months after initial stimulus removal. An appropriate inducer could induce trained immunity in innate lymphocytes, such as exogenous stimulants (including vaccines) and endogenous stimulants, which was firstly discovered in bone marrow derived immune cells. However, mature bone marrow derived immune cells are short-lived cells, that may not be able to transmit memory phenotypes to their offspring and provide long-term protection. Therefore, trained immunity is more likely to be relied on long-lived cells, such as epithelial stem cells, mesenchymal stromal cells and non-immune cells such as fibroblasts. Epigenetic reprogramming is one of the key molecular mechanisms that induces trained immunity, including DNA modifications, non-coding RNAs, histone modifications and chromatin remodeling. In addition to epigenetic reprogramming, different cellular metabolic pathways are involved in the regulation of innate trained immunity, including aerobic glycolysis, glutamine catabolism, cholesterol metabolism and fatty acid synthesis, through a series of intracellular cascade responses triggered by the recognition of PRR specific ligands. In the view of evolutionary, trained immunity is beneficial in enhancing protection against secondary infections with an induction in the evolutionary protective process against infections. Therefore, innate trained immunity plays an important role in therapy against diseases such as tumors and infections, which has signature therapeutic effects in these diseases. In organ transplantation, trained immunity has been associated with acute rejection, which prolongs the survival of allografts. However, trained immunity is not always protective but pathological in some cases, and dysregulated trained immunity contributes to the development of inflammatory and autoimmune diseases. Trained immunity provides a novel form of immune memory, but when inappropriately activated, may lead to an attack on tissues, causing autoinflammation. In autoimmune diseases such as rheumatoid arthritis and atherosclerosis, trained immunity may lead to enhance inflammation and tissue lesion in diseased regions. In Alzheimer’s disease and Parkinson’s disease, trained immunity may lead to over-activation of microglial cells, triggering neuroinflammation even nerve injury. This paper summarizes the basis and mechanisms of innate trained immunity, including the different cell types involved, the impacts on diseases and the effects as a therapeutic strategy to provide novel ideas for different diseases.