Ovarian aging occurs approximately 10 years prior to the natural age-associated functional decline of other organ systems. With the increase of life expectancy worldwide, ovarian aging has gradually become a key health problem among women. Therefore, understanding the causes and molecular mechanisms of ovarian aging is very essential for the inhibition of age-related diseases and the promotion of health and longevity in women. Recently, studies have revealed an association between adipose tissue (AT) and ovarian aging. Alterations in the function and quantity of AT have profound consequences on ovarian function because AT is central for follicular development, lipid metabolism, and hormonal regulation. Moreover, the interplay between AT and the ovary is bidirectional, with ovary-derived signals directly affecting AT biology. In this review, we summarize the current knowledge of the complex molecular mechanisms controlling the crosstalk between the AT and ovarian aging, and further discuss how therapeutic targeting of the AT can delay ovarian aging.