Now that you mention it, it’s odd that some people (like myself) have to think about it. Like I wouldn’t have to hardly think about what you meant if you said “up” or “down.”

Think of it like telling someone the directions like “twelve o’clock” versus “six o’clock” or “three o’clock” - you probably have to take a tic (heh) to picture it.