You would run ``math'' instead of ``mathematica'' if you are logged on to a workstation remotely without the benefit of X Windows -- especially, when you are using a modem! You would also run ``math'' instead of ``mathematica'' if you want to run a batch job in the background (but see mathbg).
More online information about Mathematica; especially, ``basics''.