Answer :
It either means to actually travel to a destination that's South of your current one or it means things are going down hill/not looking good.
(If this is used in a different context that's a bit more risque it could mean something else....)
(If this is used in a different context that's a bit more risque it could mean something else....)
