In the past decade, a growing set of immunotherapies including immune checkpoint blockade, chimeric antigen receptor T cells, and bispecific antibodies propelled the advancement of oncology therapeutics. Accumulating evidence demonstrates that immunotherapy could eliminate tumors better than traditional chemotherapy or radiotherapy with lower risk of adverse events in numerous cancer types. Unfortunately, a substantial proportion of patients eventually acquire resistance to immunotherapy. By analyzing the differences between immunotherapy-sensitive and immunotherapy-resistant populations, it was noticed that the composition of gut microbiota is closely related to treatment effect. Moreover, in xenograft models, interventional regulation of gut microbiota could effectively enhance efficacy and relieve resistance during immunotherapy. Thus, we believe that gut microbiota composition might be helpful to explain the heterogeneity of treatment effect, and manipulating gut microbiota could be a promising adjuvant treatment for cancer immunotherapy. In this mini review, we focus on the latest understanding of the cross-talk between gut microbiota and host immunity. Moreover, we highlight the role of gut microbiota in cancer immunotherapy including immune checkpoint inhibitor and adoptive cell transfer.