Modern data science spans various parts of computer science, mathematics, and applications. This talk will bring a sharp focus on the complementary roles of statistics and optimization in data science. In particular, we will demonstrate how the combination of mathematical statistics and optimization theory leads to more efficient and reliable algorithms, unravels intricate extremal networks, and strengthens our understanding of AI.