I get really nervous when I can hear people walking behind me, which is a BIT of a problem as I am a pedestrian living in a city.
Usually, if I turn to look at the person it will ease my fear (not it's not a axe-yielding maniac!) but I also will either speed up or slow down to put some distance between us.