Yeah, I say "the PCH".
Probably just a colloquialism... because it should be "down to LA" and "up to San Fran". But yeah, I tend to use "up" and "down" to mean North and South, and "over" to mean East/West.
PROTIP: Lake Tahoe is actually West of Los Angeles! Crazy.