Sex determining region Y (SRY)-related high-mobility group (HMG) box (SOX) factors belong to an evolutionarily conserved family of transcription factors that play essential roles in cell fate decisions involving numerous developmental processes. In recent years, the significance of SOX factors in the initiation and progression of cancers has been gradually revealed, and they act as potential therapeutic targets for cancer. However, the research involving SOX factors is still preliminary, given that their effects in some leading-edge fields such as tumor immune microenvironment (TIME) remain obscure. More importantly, as a class of 'undruggable' molecules, targeting SOX factors still face considerable challenges in achieving clinical translation. Here, we mainly focus on the roles and regulatory mechanisms of SOX family members in hepatocellular carcinoma (HCC), one of the fatal human health burdens worldwide. We then detail the role of SOX members in remodeling TIME and analyze the association between SOX members and immune components in HCC for the first time. In addition, we emphasize several alternative strategies involved in the translational advances of SOX members in cancer. Finally, we discuss the alternative strategies of targeting SOX family for cancer and propose the opportunities and challenges they face based on the current accumulated studies and our understanding.