Down the Street

Why do people say "down the street" instead of "up the street?"
Would you say down the street if you were walking up a hill?
Why do you say up the road?
Over the hill and through the woods?
Down the shore?