Mathematical practice throughout history has featured a dichotomy that can broadly be characterized as a struggle between syntax and semantics. We survey the history and the roots of this dichotomy and offer some speculation and thinking points.